apache-spark tutorials and guides

How to sort an RDD of tuples with 5 elements in Spark Scala?

Aug 29, 2022

Spark ExecutorLostFailure

Oct 14, 2022

apache-spark

Stack Overflow while processing several columns with a UDF

Oct 20, 2022

python apache-spark pyspark apache-spark-sql user-defined-functions

first_value windowing function in pyspark

Sep 05, 2022

apache-spark pyspark apache-spark-sql window-functions

Advantage of setting name to RDD

Apr 29, 2022

scala apache-spark

Copy schema from one dataframe to another dataframe

Mar 10, 2022

scala apache-spark dataframe apache-spark-sql

In Apache Spark 2.0.0, is it possible to fetch a query from an external database (rather than grab the whole table)?

Oct 14, 2022

mysql jdbc apache-spark pyspark

check if a row value is null in spark dataframe

Jan 12, 2022

apache-spark pyspark user-defined-functions spark-dataframe isnull

Replace all ":" with "_" in Spark dataframe [duplicate]

May 11, 2022

scala apache-spark user-defined-functions spark-dataframe

Querying json object in dataframe using Pyspark

May 02, 2021

python mysql json apache-spark pyspark

Scala & Spark: Cast multiple columns at once

Oct 28, 2022

scala apache-spark

How to parse CSV file with UTF-8 encoding?

May 23, 2022

csv apache-spark unicode

Spark on YARN + Secured hbase

Mar 21, 2022

apache-spark hbase kerberos hadoop2 spark-structured-streaming

How to use --num-executors option with spark-submit?

Sep 07, 2022

apache-spark hadoop-yarn

How to Generate Parquet File Using Pure Java (Including Date & Decimal Types) And Upload to S3 [Windows] (No HDFS)

Oct 18, 2022

java apache-spark amazon-s3 avro parquet

Pyspark 'NoneType' object has no attribute '_jvm' error

Oct 19, 2022

python apache-spark pyspark apache-spark-sql

DataFrame object has no attribute 'col'

Oct 17, 2022

apache-spark

Pandas scalar UDF failing, IllegalArgumentException

Apr 16, 2021

python apache-spark pyspark user-defined-functions

Storing a Graph in Spark Graphx with HDFS

Jan 04, 2022

apache-spark spark-graphx

Apache Spark Exception in thread "main" java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class

May 25, 2017

scala maven apache-spark apache-spark-sql

New posts in apache-spark