apache-spark-sql tutorials

Spark create UDF that doesn't take in input

Dec 22, 2019

Spark from_json - StructType and ArrayType

Nov 06, 2022

json scala apache-spark apache-spark-sql

How to create a Schema file in Spark

Aug 29, 2022

scala apache-spark-sql schema orc

Generating monthly timestamps between two dates in pyspark dataframe

Sep 16, 2022

apache-spark pyspark apache-spark-sql date-range

PySpark: filtering with isin returns empty dataframe

Sep 26, 2022

python apache-spark pyspark apache-spark-sql pyspark-sql

Assign a variable a dynamic value in SQL in Databricks / Spark

Nov 04, 2022

apache-spark apache-spark-sql pyspark-sql databricks

Spark SQL - Generate array of arrays from the sql function

Feb 03, 2022

scala apache-spark apache-spark-sql

PySpark - Add a new column with a Rank by User

Nov 07, 2019

python apache-spark pyspark apache-spark-sql pyspark-sql

Spark Scala: retrieve the schema and store it

Mar 18, 2022

scala apache-spark apache-spark-sql spark-dataframe

How to write a DataFrame schema to file in Scala

Oct 21, 2022

scala apache-spark dataframe apache-spark-sql

How to Create a Database in Spark SQL

May 30, 2022

apache-spark apache-spark-sql

Understanding Representation of Vector Column in Spark SQL

Nov 05, 2022

apache-spark apache-spark-sql apache-spark-mllib apache-spark-ml

How to Read Data from DB in Spark in parallel

Jun 02, 2022

apache-spark jdbc apache-spark-sql

spark jdbc df limit... what is it doing?

Sep 30, 2021

apache-spark apache-spark-sql

How to get max length of string column from dataframe using scala?

Sep 06, 2022

scala apache-spark apache-spark-sql max

Check if arraytype column contains null

May 20, 2022

scala apache-spark dataframe null apache-spark-sql

How to get date from different year, month and day columns in spark (scala)

Nov 13, 2022

dataframe scala apache-spark date apache-spark-sql

Build Spark SQL query dynamically

Oct 14, 2022

scala apache-spark apache-spark-sql

Coalesce columns in spark dataframe

Feb 20, 2020

scala apache-spark null apache-spark-sql user-defined-functions

Error using spark 'save' does not support bucketing right now

Apr 26, 2022

apache-spark apache-spark-sql partitioning parquet

New posts in apache-spark-sql