apache-spark-sql tutorials

How to save a partitioned parquet file in Spark 2.1?

Nov 08, 2022

Is there a way to filter a field not containing something in a spark dataframe using scala?

Mar 09, 2022

scala apache-spark apache-spark-sql

Spark SQL change format of the number

Nov 18, 2022

scala apache-spark apache-spark-sql

Error while using Hive context in spark : object hive is not a member of package org.apache.spark.sql

Mar 27, 2022

apache-spark apache-spark-sql

Selecting only numeric/string columns names from a Spark DF in pyspark

Dec 21, 2017

python apache-spark pyspark apache-spark-sql

PySpark - Adding a Column from a list of values using a UDF

Oct 03, 2019

python list apache-spark pyspark apache-spark-sql

spark partition data writing by timestamp

Oct 25, 2022

scala apache-spark apache-spark-sql

spark error RDD type not found when creating RDD

Jun 12, 2019

scala apache-spark apache-spark-sql

What is the best way to define custom methods on a DataFrame?

May 28, 2021

scala apache-spark apache-spark-sql

Apply same function to all fields of spark dataframe row

Aug 25, 2022

apache-spark apache-spark-sql

Pyspark: Replacing value in a column by searching a dictionary

Nov 03, 2022

python apache-spark dataframe pyspark apache-spark-sql

Making histogram with Spark DataFrame column

Aug 11, 2022

python pandas apache-spark pyspark apache-spark-sql

how to cast all columns of dataframe to string

Nov 10, 2022

apache-spark pyspark apache-spark-sql

Spark streaming multiple sources, reload dataframe

Nov 17, 2021

postgresql apache-spark spark-streaming apache-spark-sql

Spark java Issue creating row with java.util.Map type

Jul 17, 2020

java apache-spark apache-spark-sql

Efficient text preprocessing using PySpark (clean, tokenize, stopwords, stemming, filter)

Apr 18, 2020

python apache-spark pyspark apache-spark-sql text-processing

Is Spark SQL UDAF (user defined aggregate function) available in the Python API?

Feb 13, 2017

apache-spark apache-spark-sql spark-dataframe

Caching ordered Spark DataFrame creates unwanted job

Nov 17, 2022

python apache-spark pyspark apache-spark-sql pyspark-sql

How to change the attributes order in Apache SparkSQL `Project` operator?

Oct 02, 2021

scala apache-spark apache-spark-sql

Hive partitioned table reads all the partitions despite having a Spark filter

Apr 11, 2022

scala apache-spark hive apache-spark-sql

New posts in apache-spark-sql