This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
OverviewWhat is Chidori?Incorta and Sparkflows IntegrationConfigure the ConnectionsCreate Project and workflow in SparkflowsML Model RegistryCreate an Incorta MV using the PySpark generated by Sparkflows
Overview
Sparkflows provides a no code or low...
Introduction
Incorta MV Notebooks offer an alternative way to edit Spark code used to generate materialized views (MVs). This article provides a couple of tips that allows you to save your work while doing development.
What you need to know before r...
Scenario
You need to access AWS services, such as S3, Kafka, or Kinesis, from an Incorta Materialized View (MV) for extracting data.
Issues
You prefer not to list the credentials in the MV script.
Solution
You can set up AWS to use temporary secur...
The data are extracted into Incorta and used in analytics and machine learning for training. Over periods of time, we would like to archive the old data, for example, beyond three years.
How can we get the support from Incorta by
Archiving those d...
Manually editing the schema XML files may result in a corrupted Incorta metadata and can cause the entire system not workable. Even a small typo with the schema name, which can be sensitive, caused us a lot of time to debug as the symptom is on the ...
We support the migration using
CLI - You can access the command line interface to export and import objectsUI - You can manually export and import objects from the UI
Here is a community article about content migration from DEV to UAT to PROD. https://community.incorta.com/t5/administration-knowledgebase/migrating-content-between-environments/ta-p/1865
The lookup function is for looking up another lookup table using the key.
To get the value, we will need to aggregate across these two rows:
if(distinct(schemaX.tableN.column3)>1, "V", max(schemaX.tableN.column3))
To repeat the same value, we may nee...
Incremental logic will be executed by the source database. If you just add simple where clause like, "LAST_UPDATE_DATE > ?", it may be fine. If the source extraction query involves multiple tables and you use OR to connect multiple filters like
WHE...
.png "Employee"){kind=icon}
