Data & Schema Discussions

INC_03020207 – History MV fails after adding new column to source PySpark MV

We are using a PySpark script inside Incorta to call an API and load data into a Materialized View (full load). Since loading this MV directly into a table is not feasible, we store the data in a history Materialized View (incremental mode) to mainta...

SQL Database Built in Functions

I'm having difficulty finding the documentation on the viable SQL Database Functions. I'm looking to see if it's possible to use any kind of TRIM() function during table definition, and can't seem to find the right page. Please see the attached scree...

check if an expire date is within 18 months from now

Is this expression supposed to work? SO that the count of such "matches" can be aggregated in an insight to report on:case( (addMonths( $currentDate, 18 ) > WPR_test.Lease.Expire_Date), 1, 0)

Data Source name or annotation to as a mnemonic especially multisource table

It would be very convenient to tag each data source with some name to serve as a hint for multi source tables. Otherwise ine is forced to inspect each datasource's method ie sql or code.

How to Disable Timezone Conversion for Date/Datetime Columns in Incorta?

We are running into an issue where date or datetime values are shifting by one day after being loaded into Incorta. Our source system does not include any timezone information in these fields, but Incorta still seems to apply a timezone conversion so...