Convert R DataFrame into Spark DataFrame
use as.DataFrame()and createDataFrame()to convert R data frame into Spark DataFrame.
Knowledge Base Articles
Convert Spark DataFrame into R DataFrame
Use collect() to collect the data from Spark DataFrame to R DataFrame.
Interactive Analysis using Incorta Notebook and SparkR
Run SQL queries to do interactive analysis in Incorta Notebook with SparkR.
Use SparkR DataFrame for Selecting, Filtering, and Grouping your Data
Use select(), filter(), arrange(), and group_by() functions to handle Spark DataFrame on R.
Getting Started with R in Incorta Notebook
Overview R is a popular language in Data Science. Incorta supports creating materialized views (MV) with R. Your first Spark Program The minimum requirement for creating an MV includes the following: # Read data from Incorta into Spark df <- read(...
Use SparkSQL with SparkR
Overview In this recipe, you’ll learn how to run SQL queries from SparkR. After using the read() Incorta Notebook extension function to load data in Incorta Notebook, the data is in a SparkR DataFrame. You can use sql() to write SQL queries after cr...
Performance of Materialized Views (MV)
Introduction Incorta Materialized Views are a powerful way to enrich data contained in Incorta tables. Leveraging Spark's processing engine, Materialized Views (MVs) can be defined to introduce enrichments and advanced analytics to reshape your dat...
