I am new to trying to write Pyspark query in incorta to filter a data for last week (Week starts from Monday and Ends on Sunday)
But I am getting Transformation error (error log attached) while trying to save the query <<query attached>>
also, I am observing that left join is not working as expected.
When filtering the data for a specific date (from table B), only those data is getting displayed (from table A) for which data is available even though table B is left joined with table A.
Dataset Type : Materialized View
Language : Spark Python
Solved! Go to Solution.