apache-spark-sql tutorials

spark convert dataframe to dataset using case class with option fields

Jul 07, 2022

How do I flatMap a row of arrays into multiple rows?

Apr 16, 2022

apache-spark apache-spark-sql

UPDATE Cassandra table using spark cassandra connector

Sep 05, 2018

scala apache-spark cassandra-2.0 apache-spark-sql spark-cassandra-connector

Spark DataFrame filtering: retain element belonging to a list

Aug 31, 2022

scala apache-spark dataframe apache-spark-sql apache-zeppelin

When registering a table using the %pyspark interpreter in Zeppelin, I can't access the table in %sql

Aug 12, 2022

apache-spark-sql apache-zeppelin

SparkSQL sql syntax for nth item in array

Aug 28, 2022

python apache-spark pyspark apache-spark-sql

How do I collect a List of Strings from spark DataFrame Column after a GroupBy operation?

Oct 02, 2022

java apache-spark apache-spark-sql

Spark remove duplicate rows from DataFrame [duplicate]

Nov 05, 2022

scala apache-spark dataframe apache-spark-sql

save dataframe as external hive table

Oct 14, 2022

apache-spark hive apache-spark-sql spark-dataframe

Apache Spark - Backend servers

Jun 05, 2022

php apache-spark apache-spark-sql

What is the faster way to count the number of entries in a data frame?

Jun 17, 2022

scala apache-spark apache-spark-sql

Spark Scala Dataframe convert a column of Array of Struct to a column of Map

Nov 11, 2022

scala apache-spark apache-spark-sql

How to create a Dataset of Maps?

Nov 19, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

How does Spark 2.0 handle column nullability?

Jun 13, 2022

apache-spark pyspark apache-spark-sql apache-spark-2.0

Spark: select with key in map

Apr 19, 2022

apache-spark apache-spark-sql

Set spark configuration

Feb 27, 2022

python-3.x apache-spark pyspark apache-spark-sql

select latest record from spark dataframe

Jun 18, 2022

apache-spark-sql

PySpark explode stringified array of dictionaries into rows

Sep 25, 2022

python apache-spark dataframe pyspark apache-spark-sql

Convert UTC timestamp to local time based on time zone in PySpark

Oct 25, 2022

apache-spark pyspark apache-spark-sql

Stream-Static Join: How to refresh (unpersist/persist) static Dataframe periodically

Sep 25, 2021

scala apache-spark apache-spark-sql spark-streaming spark-structured-streaming

New posts in apache-spark-sql