Load Data into Incorta using external sources

Ruchita — Thu, 09 Mar 2023 07:23:22 GMT

Hi everyone !

Is there any chance we can push data into Incorta Schema/Business schema using python / jupyter notebooks ?

I know we can read data from incorta, but just want to know if that's bidirectional.

Thank you !

Re: Load Data into Incorta using external sources

dylanwan — Thu, 09 Mar 2023 18:36:54 GMT

Incorta has the connectors that include files upload and reading files from an external drive such as Google Drive and Sharepoint. Incorta also can read the file from cloud storage, such Google Cloud service, and AWS S3.

Once the schema and table are created, Incorta provides the CLI which internally calls the incorta webservice that can trigger a data load to read the data from the files into a physical schema.

However, there is no API that can directly push data.

Incorta MV, however, can be used in generating data. For example, this post shows how you can generate a calendar Date table using pySpark - https://incortablog.wordpress.com/2020/11/09/how-to-create-fiscal-calendar-in-incortapart-1/

ANother post shows how to convert a python list of tuples as a Spark data frame and thus a MV in Incorta.

https://suziepyspark.blogspot.com/2020/07/my-first-incorta-materialized-view.html

Hope these helps.

topic Load Data into Incorta using external sources in Data & Schema Discussions

Load Data into Incorta using external sources

Re: Load Data into Incorta using external sources