Data & Schema Discussions

how to convert date to string

Hi,I have two columns , one is timestamp and another one is string. I want to join these two columns in spark sql mv.Date_effective column is timestamp with "yyyy-mm-dd hh:mm:ss" format.Period_name column is string with "mm-yy" format. I want write b...

Joins missing post upgradation from 5.2.9 to 6.0.3

Hello Everyone,We recently upgraded to 6.0.3 from 5.2.9 and post upgrade we are getting two weird issues -1)Few joins are missing.2)Compaction issue which is causing data mismatch.Do let us know if any one had already faced similar issue.

subquery

Hi Team,Glad to see you all.I need help to get run time values by passing input. in sql query we can call as subquery.query(EBS_CS.CS_ESTIMATE_DETAILS.AFTER_WARRANTY_COST,EBS_CS.CS_ESTIMATE_DETAILS.SOURCE_CODE = 'DR',EBS_CS.CS_ESTIMATE_DETAILS.LINE_C...

Array to columns ( or rows )

I have a DB table which stores ( as a string ) values in an array. I don't like it, but I don't have any say in the matter nor do I have access to the DB to rework it there.What I'd like to do is query the table ( e.g. select ID, Name, ArrayField f...

Failed to create MV

Ive been trying to create an MV. Im running the query in edit in notebook where it is giving result. But when i try to add it to MV it is failing giving below errorTransformation error [Error can not infer schema from empty dataset ValueError : can n...