on 04-06-2022 04:35 PM - edited on 04-06-2022 04:35 PM by Tristan
You can enter a DataFrame name, such as df, to get basic information about the Spark DataFrame.
# get basic information about the SparkDataFrame.
df
# show the Spark data frame structure
str(df)
# use display() - Incorta Notebook extension to display data
display(df)
# use display(summary(df)) to print summary table
display(summary(df))
# show all columns from data frame
colnames(df)
# show all columns from data frame method 2
names(df)