apache-spark-dataset tutorials

What is the difference between Spark DataSet and RDD

Oct 27, 2018

apache-spark rdd apache-spark-dataset

Spark 2 Dataset Null value exception

Sep 05, 2022

scala apache-spark apache-spark-sql apache-spark-dataset

Create Spark Dataset from a CSV file

Oct 20, 2022

apache-spark apache-spark-dataset

How to lower the case of column names of a data frame but not its values?

Aug 19, 2022

apache-spark apache-spark-sql apache-spark-dataset

How to convert the datasets of Spark Row into string?

Sep 19, 2022

java string apache-spark apache-spark-sql apache-spark-dataset

Why do columns change to nullable in Apache Spark SQL?

Oct 22, 2022

apache-spark apache-spark-sql apache-spark-dataset

How to read ".gz" compressed file using spark DF or DS?

Aug 31, 2022

apache-spark apache-spark-sql gzip apache-spark-dataset

Apache Spark 2.0: java.lang.UnsupportedOperationException: No Encoder found for java.time.LocalDate

Mar 14, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

Encode an ADT / sealed trait hierarchy into Spark DataSet column

Apr 18, 2022

scala apache-spark apache-spark-dataset apache-spark-encoders

Why is predicate pushdown not used in typed Dataset API (vs untyped DataFrame API)?

Oct 15, 2022

apache-spark dataframe apache-spark-sql apache-spark-dataset

Mapping Spark DataSet row values into new hash column

Mar 24, 2022

scala apache-spark spark-dataframe apache-spark-dataset

Partition data for efficient joining for Spark dataframe/dataset

Nov 04, 2022

apache-spark apache-spark-sql spark-dataframe partitioning apache-spark-dataset

Spark Dataset select with typedcolumn

Sep 06, 2022

scala apache-spark apache-spark-dataset

Spark simpler value_counts

Sep 21, 2022

apache-spark apache-spark-sql apache-spark-dataset

Spark structured streaming - join static dataset with streaming dataset

Sep 19, 2022

scala apache-spark apache-spark-sql apache-spark-dataset spark-structured-streaming

How to convert DataFrame to Dataset in Apache Spark in Java?

Oct 24, 2017

java apache-spark spark-dataframe apache-spark-dataset

Why is the error "Unable to find encoder for type stored in a Dataset" when encoding JSON using case classes?

Nov 28, 2021

scala apache-spark apache-spark-dataset apache-spark-encoders

S3 SlowDown error in Spark on EMR

Nov 18, 2022

scala apache-spark amazon-s3 amazon-emr apache-spark-dataset

How to create a Spark Dataset from an RDD

Sep 14, 2022

scala apache-spark dataset apache-spark-dataset

New posts in apache-spark-dataset