apache-spark-sql tutorials

Count number of words in a spark dataframe

Oct 23, 2022

Spark 2: how does it work when SparkSession enableHiveSupport() is invoked

Nov 18, 2022

apache-spark hive apache-spark-sql hiveql

How to Join Multiple Columns in Spark SQL using Java for filtering in DataFrame

Aug 27, 2022

java apache-spark dataframe apache-spark-sql

PySpark: Absolute value of a column. TypeError: a float is required

Mar 01, 2022

python apache-spark pyspark apache-spark-sql

Spark SQL performing carthesian join instead of inner join

Mar 09, 2022

scala apache-spark pyspark apache-spark-sql

Why agg() in PySpark is only able to summarize one column at a time? [duplicate]

Aug 04, 2020

python apache-spark pyspark apache-spark-sql pyspark-sql

How to convert rows into a list of dictionaries in pyspark?

Nov 07, 2022

apache-spark pyspark apache-spark-sql

Replacing whitespace in all column names in spark Dataframe

Apr 19, 2022

scala apache-spark apache-spark-sql spark-dataframe

Dropping multiple columns from Spark dataframe by Iterating through the columns from a Scala List of Column names

Nov 20, 2022

scala apache-spark apache-spark-sql

pyspark approxQuantile function

Oct 29, 2022

apache-spark pyspark apache-spark-sql pyspark-sql

ON DUPLICATE KEY UPDATE while inserting from pyspark dataframe to an external database table via JDBC

Mar 16, 2022

apache-spark apache-spark-sql pyspark spark-dataframe pyspark-sql

Is proper event-time sessionization possible with Spark Structured Streaming?

Mar 21, 2022

apache-spark apache-spark-sql spark-structured-streaming

Structured streaming - Metrics in Grafana

Oct 14, 2022

apache-spark apache-spark-sql graphite spark-structured-streaming

Using SparkR JVM to call methods from a Scala jar file

Jan 22, 2021

r scala apache-spark apache-spark-sql sparkr

How to protect password and username in Spark (such as for JDBC connections/accessing RDBMS databases)?

Nov 15, 2022

apache-spark apache-spark-sql

Apache Spark 2.0: java.lang.UnsupportedOperationException: No Encoder found for java.time.LocalDate

Mar 14, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

Dollar sign in function call in Java using Spark SQL

Apr 12, 2022

java scala apache-spark apache-spark-sql

DataFrame fail to find the column name after join condition

Nov 11, 2022

java apache-spark apache-spark-sql

How to extract a value from a Vector in a column of a Spark Dataframe [duplicate]

Sep 22, 2022

scala apache-spark dataframe apache-spark-sql apache-spark-mllib

How to handle small file problem in spark structured streaming?

Sep 19, 2022

apache-spark apache-spark-sql spark-streaming parquet

New posts in apache-spark-sql