topic Re: Why is my Pyspark code output different from the output loaded into the Incorta analyzer? in Data & Schema Discussions https://community.incorta.com/t5/data-schema-discussions/why-is-my-pyspark-code-output-different-from-the-output-loaded/m-p/3893#M310 <P>So this is a bit out of my lane, but if I were starting to look at this I'd check the load history to see if any records from the pyspark output were being rejected when loaded into the Incorta table ( file ).&nbsp; &nbsp;Same for checking row counts - checking to see if any Incorta table columns are designated as keys.</P><P>I'd also swear at it, but I don't know if that technique is an officially approved troubleshooting method!&nbsp; <span class="lia-unicode-emoji" title=":winking_face:">😉</span>&nbsp; &nbsp;&nbsp;</P> Tue, 14 Mar 2023 16:51:51 GMT RADSr 2023-03-14T16:51:51Z Why is my Pyspark code output different from the output loaded into the Incorta analyzer? https://community.incorta.com/t5/data-schema-discussions/why-is-my-pyspark-code-output-different-from-the-output-loaded/m-p/3892#M309 <P>Hey guys,</P><P>Newbee here - I wrote some pyspark code and it ran perfectly with the output i wanted but in the incorta analyzer the data populates differently. Any tips to resolve this issue?</P> Tue, 14 Mar 2023 15:47:38 GMT https://community.incorta.com/t5/data-schema-discussions/why-is-my-pyspark-code-output-different-from-the-output-loaded/m-p/3892#M309 DanIton 2023-03-14T15:47:38Z Re: Why is my Pyspark code output different from the output loaded into the Incorta analyzer? https://community.incorta.com/t5/data-schema-discussions/why-is-my-pyspark-code-output-different-from-the-output-loaded/m-p/3893#M310 <P>So this is a bit out of my lane, but if I were starting to look at this I'd check the load history to see if any records from the pyspark output were being rejected when loaded into the Incorta table ( file ).&nbsp; &nbsp;Same for checking row counts - checking to see if any Incorta table columns are designated as keys.</P><P>I'd also swear at it, but I don't know if that technique is an officially approved troubleshooting method!&nbsp; <span class="lia-unicode-emoji" title=":winking_face:">😉</span>&nbsp; &nbsp;&nbsp;</P> Tue, 14 Mar 2023 16:51:51 GMT https://community.incorta.com/t5/data-schema-discussions/why-is-my-pyspark-code-output-different-from-the-output-loaded/m-p/3893#M310 RADSr 2023-03-14T16:51:51Z