Incorta MetaData is failing with Table 'incortametadata.CATALOG_LINK' doesn't exist

[makkawi]

Symptoms

After an upgrade, there is a possibility that incortaMetaData schema would fail with the following error:

com.incorta.api.exceptions.DataException: INC_03070000: Failed retrieving sample data from [_IncortaMetadata] with properties [[incremental, false], [fetchsize, 5000], [incrementalFieldType, DATE], [incrementalMethod, 0], [incrementalColumn, ], [batchMethod, 0], [batchSize, ], [batchColumn, ], [batchUpperBound, ], [batchLowerBound, ], [timeBatchColumn, ], [chunkPeriod, ], [customNumberOfDays, ], [timeBatchUpperBound, ], [timeBatchLowerBound, ], [useExternalExtractor, false], [sparkParallelizationFactor, 4], [sparkParallelizationColumn, ], [sparkMemory, 1]]
	at com.incorta.loader.etl.ExtractionPhase.handleTableExtractionFailure(ExtractionPhase.java:349)
	at com.incorta.loader.etl.ExtractionPhase.extractTable(ExtractionPhase.java:309)
	at com.incorta.loader.etl.ExtractionPhase$1.doAction(ExtractionPhase.java:152)
	at com.incorta.util.ConcurrentService$4.call(ConcurrentService.java:388)
	at com.incorta.util.ConcurrentService$4.call(ConcurrentService.java:365)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at com.incorta.util.ConcurrentService$5.run(ConcurrentService.java:412)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: com.incorta.connector.errors.DiscoveryException: Error of type MySQLSyntaxErrorException while discovering columns from datasource [_IncortaMetadata]  due to: Table 'incortametadata.CATALOG_LINK' doesn't exist

Diagnosis

The CATALOG_LINK table has been removed from the MetaData database but has not been removed from the IncortaMetaData schema.

Solution

1. Delete the CATALOG_LINK from the IncortaMetaData schema

2. Edit the MV called OBJECT_NAME and delete the following parts from the query:

UNION ALL
select
    NAME as OBJECT_NAME,
    ID as OBJECT_ID,
    17 CONTENTTYPE,
    NULL as SCHEMATYPE_DESC,
    OWNERID as OBJECT_OWNERID
from
    _IncortaMetadata."CATALOG_LINK"

and

UNION ALL
select
    NAME as OBJECT_NAME,
    ID as OBJECT_ID,
    70 CONTENTTYPE,
    NULL as SCHEMATYPE_DESC,
    OWNERID as OBJECT_OWNERID
from
    _IncortaMetadata."CATALOG_LINK"

3. Save the changes and run a full load of the IncortaMetaData schema