Data & Schema Discussions

Dense Snapshot Truncation?

I've read and implemented a dense snapshot table. It works exactly as expected. Yay!What I need now is a way to trim the snapshot. The start of the snapshot has a starting date way back when. I want to move that starting date forward so as to limit t...

Resolved! MV using Incorta SQL

Hi,I tried creating an MV using Incorta SQL as Data Source, but I keep getting below error as shown below. Can you help me understand when to use this particular type in creating MV's.INC_04030340: Materializing table failed because 109152Thanks,Srin...

Resolved! Plan for Spark Version 3.2

Hi all,I was wondering if there is a roadmap for the upgrade of Incorta Spark to version 3.2 or 3.3?The reason I ask is because Spark version 3.2 saw the implementation of Pandas API on Spark (https://spark.apache.org/docs/latest/api/python/user_guid...

Python MV

Has anyone been able to use a variable as an input to the read function in a python MV?See example below:var_name = "sample_schema.sample_table"dataframe = read(var_name)save(dataframe)The code above returns an error when I try to validate. However, ...

Data Agent troubleshoot

Data agent is enabled and has been running up until update ( you can see where this is going ).After update ( several jumps to 2022.7.3 ) of cluster and data agent:Agent service is runningAgent status is a green checkmarkExternal data source which u...