apache-spark-sql tutorials

How to construct Dataframe from a Excel (xls,xlsx) file in Scala Spark?

Oct 20, 2022

In Apache Spark, how to convert a slow RDD/dataset into a stream?

Sep 19, 2022

scala apache-spark apache-spark-sql spark-streaming

What is happening when Spark is calling ShuffleBlockFetcherIterator?

Sep 14, 2022

apache-spark apache-spark-sql

Spark: Most efficient way to sort and partition data to be written as parquet

Nov 17, 2022

apache-spark pyspark apache-spark-sql pyspark-sql

Read an unsupported mix of union types from an Avro file in Apache Spark

Apr 01, 2019

scala apache-spark apache-spark-sql spark-avro

PySpark: StructField(..., ..., False) always returns `nullable=true` instead of `nullable=false`

Jul 29, 2021

python apache-spark pyspark apache-spark-sql

Spark structured streaming - join static dataset with streaming dataset

Sep 19, 2022

scala apache-spark apache-spark-sql apache-spark-dataset spark-structured-streaming

Spark SQL: Why two jobs for one query?

Jul 06, 2017

apache-spark apache-spark-sql unsafe parquet

Spark Task not serializable with lag Window function

Jan 07, 2020

scala apache-spark serialization apache-spark-sql window-functions

argmax in Spark DataFrames: how to retrieve the row with the maximum value

Aug 22, 2022

apache-spark apache-spark-sql

How to get all columns after groupby on Dataset<Row> in spark sql 2.1.0

Sep 18, 2022

apache-spark apache-spark-sql

How to create a copy of a dataframe in pyspark?

Mar 20, 2022

python apache-spark pyspark apache-spark-sql

How to connect HBase and Spark using Python?

Oct 16, 2022

python apache-spark hbase pyspark apache-spark-sql

How to filter one spark dataframe against another dataframe

Sep 18, 2022

scala apache-spark apache-spark-sql spark-dataframe

How do I collect a single column in Spark?

Oct 17, 2019

apache-spark dataframe pyspark apache-spark-sql

Spark SQL filter multiple fields

Nov 07, 2022

scala apache-spark apache-spark-sql

Building a StructType from a dataframe in pyspark

Sep 23, 2022

python apache-spark dataframe pyspark apache-spark-sql

How to select last row and also how to access PySpark dataframe by index?

Oct 25, 2022

python apache-spark pyspark apache-spark-sql pyspark-sql

How to connect to remote hive server from spark [duplicate]

Aug 23, 2022

apache-spark hive apache-spark-sql spark-thriftserver

dynamically bind variable/parameter in Spark SQL?

Sep 18, 2022

scala apache-spark apache-spark-sql apache-spark-2.0

New posts in apache-spark-sql