apache-spark-sql tutorials

save dataframe as external hive table

Oct 14, 2022

Apache Spark - Backend servers

Jun 05, 2022

php apache-spark apache-spark-sql

What is the faster way to count the number of entries in a data frame?

Jun 17, 2022

scala apache-spark apache-spark-sql

Spark Scala Dataframe convert a column of Array of Struct to a column of Map

Nov 11, 2022

scala apache-spark apache-spark-sql

How to create a Dataset of Maps?

Nov 19, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

How does Spark 2.0 handle column nullability?

Jun 13, 2022

apache-spark pyspark apache-spark-sql apache-spark-2.0

Spark: select with key in map

Apr 19, 2022

apache-spark apache-spark-sql

Set spark configuration

Feb 27, 2022

python-3.x apache-spark pyspark apache-spark-sql

select latest record from spark dataframe

Jun 18, 2022

apache-spark-sql

PySpark explode stringified array of dictionaries into rows

Sep 25, 2022

python apache-spark dataframe pyspark apache-spark-sql

Convert UTC timestamp to local time based on time zone in PySpark

Oct 25, 2022

apache-spark pyspark apache-spark-sql

Stream-Static Join: How to refresh (unpersist/persist) static Dataframe periodically

Sep 25, 2021

scala apache-spark apache-spark-sql spark-streaming spark-structured-streaming

Spark DataFrame created from JavaRDD<Row> copies all columns data into first column

Sep 13, 2022

apache-spark apache-spark-sql

How is it possible to add new column to existing Dataframe in Spark SQL

May 11, 2022

java-8 dataframe apache-spark-sql spark-dataframe

Broadcast not happening while joining dataframes in Spark 1.6

Oct 20, 2022

scala apache-spark join apache-spark-sql query-optimization

How to drop rows with too many NULL values?

Mar 04, 2022

scala apache-spark dataframe apache-spark-sql

Pyspark : Custom window function

Jun 23, 2022

apache-spark pyspark apache-spark-sql window-functions

How to add new columns to DataFrame given their names when they are missing?

Jan 02, 2022

scala apache-spark dataframe apache-spark-sql

How to write rows asynchronously in Spark Streaming application to speed up batch execution?

Jun 27, 2022

performance apache-spark apache-spark-sql spark-streaming

spark-sql Table or view not found error

Jun 12, 2018

apache-spark apache-spark-sql spark-dataframe

New posts in apache-spark-sql