apache-spark-sql tutorials

How to read whole file in one string

Aug 23, 2022

json apache-spark apache-spark-sql

How can I sum multiple columns in a spark dataframe in pyspark?

Oct 24, 2022

python apache-spark pyspark apache-spark-sql

What is the Scala type mapping for all Spark SQL DataType

Nov 14, 2022

sql scala apache-spark apache-spark-sql sqldatatypes

Create array of literals and columns from List of Strings in Spark SQL

Feb 06, 2021

arrays scala apache-spark apache-spark-sql

How can I create a Spark DataFrame from a nested array of struct element?

Oct 30, 2022

scala apache-spark dataframe apache-spark-sql

How to lower the case of column names of a data frame but not its values?

Aug 19, 2022

apache-spark apache-spark-sql apache-spark-dataset

How to convert the datasets of Spark Row into string?

Sep 19, 2022

java string apache-spark apache-spark-sql apache-spark-dataset

Converting JavaRDD to DataFrame in Spark java

Nov 19, 2022

java apache-spark hadoop apache-spark-sql

java.lang.ClassNotFoundException: org.apache.spark.sql.Dataset

Apr 21, 2022

scala apache-spark apache-spark-sql

Scala & Spark: Recycling SQL statements

Jan 16, 2022

scala apache-spark apache-spark-sql

Spark colocated join between two partitioned dataframes

Apr 06, 2019

scala join apache-spark apache-spark-sql spark-dataframe

Working Around Performance & Memory Issues with spark-sql GROUP BY

Apr 03, 2022

apache-spark apache-spark-sql

Does Spark lock the File while writing to HDFS or S3

Nov 14, 2022

apache-spark apache-spark-sql

Merge Schema with int and double cannot be resolved when reading parquet file

Nov 11, 2022

scala apache-spark apache-spark-sql

Spark: Find pairs having at least n common attributes?

Feb 17, 2022

algorithm apache-spark apache-spark-sql spark-streaming spark-dataframe

How to profile pyspark jobs

Nov 12, 2022

apache-spark pyspark apache-spark-sql profiler spark-dataframe

Spark + Parquet + Snappy: Overall compression ratio loses after spark shuffles data

Mar 22, 2022

apache-spark apache-spark-sql spark-dataframe parquet snappy

Spark query running very slow

Feb 12, 2022

apache-spark apache-spark-sql pyspark

How to get the progress bar (with stages and tasks) with yarn-cluster master?

Aug 11, 2020

apache-spark jar progress-bar apache-spark-sql hadoop-yarn

How to join big dataframes in Spark SQL? (best practices, stability, performance)

Nov 13, 2022

performance join apache-spark apache-spark-sql spark-dataframe

New posts in apache-spark-sql