https://community.incorta.com/t5/data-schema-discussions/spark-sql-execution-plan/m-p/5245#M418 <P>Is there any way to get the Spark execution plan in an MV when selecting Spark SQL? I know I can take the below approach, but I prefer to do this in Spark SQL and not have to rebuild the Spark SQL queries.</P><P>&nbsp;</P><P>%pyspark</P><P>df = read("EBS_PARTY_COMMON.HZ_PARTIES")<BR />df.registerTempTable("TBL")<BR />spark.sql("""<BR />SELECT count(*)<BR />FROM TBL<BR />""").explain(mode="formatted")</P> Tue, 07 Nov 2023 16:05:20 GMT JC_Data_Wizard 2023-11-07T16:05:20Z https://community.incorta.com/t5/data-schema-discussions/spark-sql-execution-plan/m-p/5245#M418 <P>Is there any way to get the Spark execution plan in an MV when selecting Spark SQL? I know I can take the below approach, but I prefer to do this in Spark SQL and not have to rebuild the Spark SQL queries.</P><P>&nbsp;</P><P>%pyspark</P><P>df = read("EBS_PARTY_COMMON.HZ_PARTIES")<BR />df.registerTempTable("TBL")<BR />spark.sql("""<BR />SELECT count(*)<BR />FROM TBL<BR />""").explain(mode="formatted")</P> Tue, 07 Nov 2023 16:05:20 GMT https://community.incorta.com/t5/data-schema-discussions/spark-sql-execution-plan/m-p/5245#M418 JC_Data_Wizard 2023-11-07T16:05:20Z https://community.incorta.com/t5/data-schema-discussions/spark-sql-execution-plan/m-p/5271#M422 <P>&lt;IncortaCluster&gt;/applications will get you to the SPARK screen which is full of drillable links and contains all kinds of information including ( I think ) the explain plan if you drill far enough.&nbsp; &nbsp;&nbsp;</P> Mon, 13 Nov 2023 21:10:35 GMT https://community.incorta.com/t5/data-schema-discussions/spark-sql-execution-plan/m-p/5271#M422 RADSr 2023-11-13T21:10:35Z