Running Only the MVs in a Schema
Is there a way to run a full load of a schema, but only the MVs?
I have run across a few times where I run a series of MVs based on the previously run MVs and when I have to change one of the early ones it's a pain to have to run them one table at a time, and I don't need to extract the tables again so I don't want to wait for that to occur.
What steps are run if you load from staging?
When are the joins updated?
When are the formula fields updated?
There is not a way to run just the MVs (enrichment step) of a schema. If you routinely need to do this, you might consider splitting the MVs out into their own schema; otherwise, running the MVs a la carte is the standard approach. The full load process has these high-level steps:
- Data extraction (persists extracted data to parquet)
- Enrichment (MVs, also persists results to parquet)
- Data Load (all persisted parquet read into physical memory)
- Post-load (Joins calculated and then formulas calculated)
When you run a staging load, it repeats steps 3 and 4 using the already extracted and enriched data. I hope that helps answer your questions. Also, please feel free to suggest desired functionality in the Product Ideas & Feature Requests section of Community.