This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Scenario
You need to access AWS services, such as S3, Kafka, or Kinesis, from an Incorta Materialized View (MV) for extracting data.
Issues
You prefer not to list the credentials in the MV script.
Solution
You can set up AWS to use temporary secur...
The data are extracted into Incorta and used in analytics and machine learning for training. Over periods of time, we would like to archive the old data, for example, beyond three years.
How can we get the support from Incorta by
Archiving those d...
Symptoms
You received the error when trying to convert a Pandas DataFrame to Spark DataFrame in a PySpark MV. Here is the error.
- INC_03070101: Transformation error Error 'DataFrame' object has no attribute 'iteritems' AttributeError : 'DataFrame' ...
Currently Incorta allows a user to add a URL and the URL can refer to the values from the row of the insight when the URL link is clicked from.
While it is powerful already, in some cases, the target system expects a URL but passed the input paramete...
Incremental logic will be executed by the source database. If you just add simple where clause like, "LAST_UPDATE_DATE > ?", it may be fine. If the source extraction query involves multiple tables and you use OR to connect multiple filters like
WHE...
Extracting the same data during incremental refresh will add the cost to the process of merging the records. Incorta extract will insert all data fetched to the file system and thus requires disk I/O. The data will be merged during compaction and w...
If you want any table to not fetch any data during scheduled or ad hoc incremental refresh, you can add a dummy incremental logic to the table.
For example, add the filter that returns nothing in the SQL based table.
SELECT COL1
, COL2
FROM SC...
For SQL based source tables, the workaround is to add a column that is based on the current time function from the source database.
For example, if you are using Oracle database, you can do the following:
SELECT COL1
, COL2
, sysdate as DH_...
The business view is currently a collection of columns and formulas and cannot have a filter. The runtime security filter that is defined at the physical schema level will be applied when you query the data from the business views if the table is th...
.png "Employee"){kind=icon}
