Allow Schema Edits During Load Plan Execution

[cckya]

Hi all,

While executing a load plan, I noticed that attempting to edit and save a schema results in an error, preventing the changes from being saved.

Wouldn't it be useful if there were a feature or configuration that allowed saving schema changes while the load plan is running? This could help improve flexibility and efficiency during execution.

[Venkat]

Hi cckya,

Please find my thoughts below.

One idea is that data loading is inherently tied to the table's structure. Any changes—such as data type alterations or adding new columns—might necessitate a complete reload of the table. Therefore, allowing modifications to the table structure might not be straightforward.

Alternatively, if we're modifying a specific table and loading another table within the same schema, it might be acceptable to permit changes while saving to that table.

Currently, when we attempt to load any table within a schema, we've noticed that Incorta seems to lock the entire schema. This results in all tables within that schema showing as "loading," status even when only one table is actively being loaded.

Thanks

Venkat