cancel
Showing results for 
Search instead for 
Did you mean: 

Failed to get lastCheckpoint file

yasminemaximos
Employee
Employee

Following parquet files migration between environments, deleting the schema.table records from FILES_VERSIONS table in metadata db and performing a successful stage load.

DELETE from FILES_VERSIONS where NAME like 'Schema_Table.%';

Table is failing with be below error during the next incremental or full:

Failed to get lastCheckpoint file for Table: Fusion_Hist.Product_Process_Dependency [com.incorta.datamanagement.staging.TenantDataManagerImpl.getLastCheckpointOfCompactedVersion]
java.io.IOException: failed to read _last_checkpoint [com.incorta.datamanagement.staging.TenantDataManagerImpl.getLastCheckpointOfCompactedVersion]

Resolution:

  1. Delete the last checkpoint parquet file located under schema.table → _delta_log > → _last_checkpoint
  2. Set the compaction to 0 in the Files Version metadata
    UPDATE FILES_VERSIONS SET COMPACTED_VERSION = 0 WHERE NAME LIKE 'Schema.%';
  3. Rerun Stage Load
  4. Resuming the increment or full loads.

 

0 REPLIES 0