Data & Schema Discussions

Materialized Views with Scala

I am trying to refactor some tables that were previously using pyspark to use scala. However whenever I try to read in my data I am met with an error that states "table or view not found"My code looks something like this: import org.apache.spark.sql....

Resolved! Materialized views - Query ends with _X

Hi,I'm trying to write a query in MV (Spark SQL) which excludes the items ending with "_X" I understand underscore ("_") is single character wildcard in SQL and should be addressed as '%[_]x' or '%\_x' which will include the Underscore (_). But it s...

"inception to date" measure

HelloI am trying to create an inception-to-data measure. This would be similar to year-to-date but across all years in the data. I need this to show the development of Balance sheet numbers (which are in the data as transactional data, so the sum of ...

Edit Business Schema

Any why to add filter to business schema that created without analyzer ??

Load failures are sometimes not graceful

Hi,Some of our schema loads will occasionally fail due to memory errors. On this I would like to pass on some feedback as well as seek some advice.The feedback is that depending on how it falls over it might end up breaking all practical data access ...