Truncating data in Incorta

is there a way to Truncate (or delete) data in Incorta table, as part of  workflow loading the data  ?

for eg. if i'm getting the complete data feed on a daily basis (for a specific region - but not the deleted records), can i delete or truncate the data (for the specific region) and reload the data for that day ?    

2replies Oldest first
  • Oldest first
  • Newest first
  • Active threads
  • Popular
  • Karan Alang First of all thanks for posting to the community and sharing the scenario. Our suggestion (from just reading the message here, happy to have someone jump on a call to understand more) is to have all the data (historical etc.) in the parquet layer. You can then apply a load filter to the Incorta Direct Data Mapping Engine (aka Performance Optimized Tables) to load just in the data set you want from the parquet layer. This will allow you to set the regions you want to load. The other regions not loaded will be available for you to analyze via the SQLi port and can be loaded whenever you change the load filter. If you need more details on load filters, let us know. Thanks. 

  • Karan Alang - look at this article which has details on how to handle source deletes - https://community.incorta.com/t/x1rarf/how-does-incorta-handle-source-deletions-of-rows

Like1 Follow
  • 2 yrs agoLast active
  • 2Replies
  • 115Views
  • 3 Following

Product Announcement

A new community experience is coming! If you would like to have beta access to provide feedback, please contact us at community@incorta.com.