Incremental Load query

[mohamed_kamal]

Hello Community,

We have a schema that is currently scheduled with a full load, and I would like to switch to incremental load for specific tables.

• These tables have a timestamp column (for example: creation_date) that should be used for incremental load.

• The source database is PostgreSQL.

• I need guidance or documentation on:

How to correctly edit the Query and Update Query for incremental load.

How to choose the right parameters such as Incremental Type and Incremental Extract Using.

What I tried:

• Following the Incorta course I have taken, I added a where condition in the query like:
  WHERE "CREATION_DATE" > ?

        But when I run discovery, I get this error: Failed discovery. Cannot retrieve sample data from [schema_name] due to [No value specified for parameter 1.]

so I tried:
WHERE "CREATION_DATE" >= :last_incremental_value
which also returned an error: Failed discovery. Cannot retrieve sample data from [schema_name] due to [ERROR: syntax at or near ":"]

Could you please share the correct approach, or point me to guides/docs

Thanks in advance for your help!