apache-spark-dataset tutorials

Spark Dataset unique id performance - row_number vs monotonically_increasing_id

Jun 08, 2022

How to traverse/iterate a Dataset in Spark Java?

Oct 24, 2022

java apache-spark iterator apache-spark-2.0 apache-spark-dataset

Spark Dataset and java.sql.Date

Nov 03, 2022

scala apache-spark apache-spark-dataset apache-spark-encoders

Reading JSON files into Spark Dataset and adding columns from a separate Map

Feb 12, 2022

json scala apache-spark apache-spark-sql apache-spark-dataset

Why dataset.count() is faster than rdd.count()?

Apr 14, 2022

scala performance apache-spark apache-spark-sql apache-spark-dataset

Spark java : Creating a new Dataset with a given schema

Oct 15, 2022

java scala apache-spark apache-spark-dataset

How can I add a column with a value to a new Dataset in Spark Java?

Apr 10, 2022

java apache-spark dataset apache-spark-dataset bigdata

How to unpack multiple keys in a Spark DataSet

Sep 18, 2019

scala apache-spark apache-spark-dataset

How to use approxQuantile by group?

Sep 02, 2021

apache-spark apache-spark-sql apache-spark-dataset

Scala spark: how to use dataset for a case class with the schema has snake_case?

Aug 31, 2022

scala apache-spark apache-spark-dataset

Spark StringIndexer.fit is very slow on large records

Sep 14, 2022

apache-spark apache-spark-ml apache-spark-dataset

Can Spark read data directly into a nested case class?

Oct 22, 2022

scala apache-spark apache-spark-dataset

Should cache and checkpoint be used together on DataSets? If so, how does this work under the hood?

Sep 15, 2022

apache-spark apache-spark-sql apache-spark-dataset

How to drop malformed rows while reading csv with schema Spark?

Oct 19, 2022

scala csv apache-spark apache-spark-dataset

Convert scala list to DataFrame or DataSet

Nov 16, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

When to use Spark DataFrame/Dataset API and when to use plain RDD?

Oct 25, 2022

apache-spark apache-spark-sql spark-dataframe apache-spark-dataset

Spark 2.0 implicit encoder, deal with missing column when type is Option[Seq[String]] (scala)

Nov 14, 2019

scala apache-spark apache-spark-dataset

New posts in apache-spark-dataset