Incorta Table load fails for a large Oracle table with 'Snapshot too old' error

While trying to load a Incorta table with nearly 1 billion rows from Oracle the load fails with 'ORA-01555 ERROR MESSAGE “SNAPSHOT TOO OLD”' error.

3replies Oldest first
  • Oldest first
  • Newest first
  • Active threads
  • Popular
  • While querying large tables from Oracle sometimes we see this load error from Oracle database. One possible solution is to enable chunking while extracting data from these huge tables .

    Incorta chunking is a table data source configuration that allows for parallel data extraction. The parallel execution significantly helps extract rows from very large tables.  This is handled at a table level where we can specify the chunk size for a single table extract. Please refer to the screenshot below for an example of how we could solve this extract issue for a 1B row OE_ORDER_LINES_ALL table in Oracle, we specified LINE_ID which is the key column of this table for chunking. Please refer to https://docs.incorta.com/ for more information.

  • Hi Amit Kothari

    I am going to try this for a SELECT sql.

    But curious to know, will the chunking work on query which has 2 or more tables with joins, and selecting a column for chunking from the driving table?

    Thank you.

    • Yogesh Bhave  I think it is better to bring the huge tables separately and then do the joins in a MV.

Like Follow
  • 1 mth agoLast active
  • 3Replies
  • 15Views
  • 2 Following