apache-spark-dataset tutorials

Spark Streamming : Reading data from kafka that has multiple schema

Nov 10, 2022

Spark SQL alternatives to groupby/pivot/agg/collect_list using foldLeft & withColumn so as to improve performance

Nov 09, 2022

apache-spark apache-spark-sql apache-spark-dataset

No Java class corresponding to Product with Serializable with Base found

Oct 20, 2022

java scala apache-spark rdd apache-spark-dataset

Spark-SQL Joining two dataframes/ datasets with same column name

Oct 19, 2022

java apache-spark apache-spark-sql apache-spark-dataset

java.lang.UnsupportedOperationException: Error in spark when writing

Oct 19, 2022

apache-spark apache-spark-dataset

Spark using recursive case class

Oct 18, 2022

scala apache-spark apache-spark-sql apache-spark-dataset

using DataSet.repartition in Spark 2 - several tasks handle more than one partition

Nov 01, 2022

apache-spark spark-streaming apache-spark-dataset

Spark Java - Collect multiple columns into array column

Aug 27, 2022

java apache-spark apache-spark-dataset

Spark Datasets - strong typing

Oct 24, 2022

apache-spark dataset apache-spark-dataset

Using stat.bloomFilter in Spark 2.0.0 to filter another dataframe

Dec 06, 2021

scala apache-spark apache-spark-sql apache-spark-dataset bloom-filter

spark convert dataframe to dataset using case class with option fields

Jul 07, 2022

scala apache-spark apache-spark-sql apache-spark-dataset

How to create a Dataset of Maps?

Nov 19, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

Spark Dataset equivalent for scala's "collect" taking a partial function

Feb 22, 2022

scala apache-spark apache-spark-dataset

How to convert Dataset into JavaPairRDD?

Jun 13, 2022

java apache-spark apache-spark-dataset java-pair-rdd

How to create a Dataset from custom class Person?

Jan 23, 2017

apache-spark apache-spark-sql apache-spark-dataset

Array Intersection in Spark SQL

Mar 22, 2022

apache-spark apache-spark-sql spark-dataframe hiveql apache-spark-dataset

How to join two spark dataset to one with java objects?

Sep 05, 2022

java apache-spark apache-spark-dataset apache-spark-encoders

How to create a custom Encoder in Spark 2.X Datasets?

Oct 22, 2022

scala apache-spark apache-spark-dataset apache-spark-encoders

How to change case of whole column to lowercase?

Oct 03, 2022

java apache-spark apache-spark-sql apache-spark-dataset

New posts in apache-spark-dataset