apache-spark tutorials and guides

Dividing complex rows of dataframe to simple rows in Pyspark

Aug 28, 2022

What is the right way to edit spark-env.sh before running spark-shell?

Sep 12, 2022

windows scala apache-spark config

Spark Scala: Task Not serializable error

Nov 01, 2022

scala apache-spark pyspark

pyspark py4j.Py4JException: Method and([class java.lang.Integer]) does not exist

Mar 26, 2022

apache-spark pyspark apache-spark-sql

Spark job is failed due to java.io.NotSerializableException: org.apache.spark.SparkContext

Oct 24, 2022

java scala hadoop apache-spark

Unable to submit jobs to spark cluster (cluster-mode)

Sep 22, 2022

apache-spark spark-streaming

Why does partition parameter of SparkContext.textFile not take effect?

Nov 13, 2022

scala apache-spark rdd

SBT cannot import Kafka encoder/decoder classes

Jul 15, 2019

apache-spark sbt apache-kafka spark-streaming kafka-consumer-api

How to limit decimal values to 2 digits before applying agg function?

Oct 31, 2022

scala apache-spark apache-spark-sql apache-spark-1.5

Find column index by searching column header of a Dataset in Apache Spark Java

Sep 13, 2022

java apache-spark apache-spark-sql apache-spark-dataset

convert RDD to Dataset in Java Spark

Apr 03, 2022

java apache-spark

Spark Failure : Caused by: org.apache.spark.shuffle.FetchFailedException: Too large frame: 5454002341

Sep 26, 2022

apache-spark apache-spark-sql hadoop-yarn

Spark java.lang.ClassCastException: scala.collection.mutable.WrappedArray$ofRef cannot be cast to java.util.ArrayList

May 22, 2022

scala apache-spark apache-spark-sql

How to fix 'Unsupported class file major version 55' while executing 'org.apache.spark.sql.DataSet.collectAsList()'

Apr 16, 2022

java spring-boot apache-spark

How to filter a Spark dataframe by a boolean column?

Nov 20, 2022

python apache-spark filter apache-spark-sql

Can I read a CSV represented as a string into Apache Spark using spark-csv

May 25, 2022

apache-spark apache-spark-sql spark-csv

Error: not found: value lit/when - spark scala

Nov 29, 2020

scala maven intellij-idea apache-spark

Spark : Average of values instead of sum in reduceByKey using Scala

Apr 23, 2022

scala apache-spark

PySpark Will not start - ‘python’: No such file or directory

May 04, 2022

python apache-spark pyspark

Writing to HBase via Spark: Task not serializable

Nov 03, 2020

scala apache-spark hbase

New posts in apache-spark