Truncating data in Incorta
is there a way to Truncate (or delete) data in Incorta table, as part of workflow loading the data ?
for eg. if i'm getting the complete data feed on a daily basis (for a specific region - but not the deleted records), can i delete or truncate the data (for the specific region) and reload the data for that day ?
Karan Alang First of all thanks for posting to the community and sharing the scenario. Our suggestion (from just reading the message here, happy to have someone jump on a call to understand more) is to have all the data (historical etc.) in the parquet layer. You can then apply a load filter to the Incorta Direct Data Mapping Engine (aka Performance Optimized Tables) to load just in the data set you want from the parquet layer. This will allow you to set the regions you want to load. The other regions not loaded will be available for you to analyze via the SQLi port and can be loaded whenever you change the load filter. If you need more details on load filters, let us know. Thanks.