cancel
Showing results for 
Search instead for 
Did you mean: 

Why is my Pyspark code output different from the output loaded into the Incorta analyzer?

DanIton
Rocketeer

Hey guys,

Newbee here - I wrote some pyspark code and it ran perfectly with the output i wanted but in the incorta analyzer the data populates differently. Any tips to resolve this issue?

1 REPLY 1

RADSr
Captain
Captain

So this is a bit out of my lane, but if I were starting to look at this I'd check the load history to see if any records from the pyspark output were being rejected when loaded into the Incorta table ( file ).   Same for checking row counts - checking to see if any Incorta table columns are designated as keys.

I'd also swear at it, but I don't know if that technique is an officially approved troubleshooting method!  😉    

-- IncortaOne@PMsquare.com --