Convert Spark DataFrame into R DataFrame

[suxinji]

Overview

In this recipe, you'll learn how to convert Spark DataFrame into R DataFrame. Use collect() to collect the data from Spark DataFrame to R DataFrame. 

Solution

# collect the data from Spark to local
# convert Spark DataFrame into R data frame
local_df_r <- collect(df)
display(local_df_r)