spark-streaming tutorials

Spark streaming + json4s-jackson dependency problems

Feb 28, 2021

How to config checkpoint to redeploy spark streaming application?

Jul 11, 2022

apache-spark bigdata spark-streaming

Spark + Kafka integration - mapping of Kafka partitions to RDD partitions

Oct 22, 2022

scala apache-spark apache-kafka spark-streaming apache-spark-1.4

Can a model be created on Spark batch and use it in Spark streaming?

Nov 12, 2022

apache-spark machine-learning spark-streaming

Spark Streaming from Kafka Consumer

Oct 19, 2022

apache-spark apache-kafka pyspark spark-streaming kafka-consumer-api

Kafka with Spark 2.1 Structured Streaming - cannot deserialize

Oct 24, 2022

apache-spark pyspark deserialization apache-spark-sql spark-streaming

NoClassDefFoundError: Could not initialize XXX class after deploying on spark standalone cluster

Oct 20, 2022

scala apache-spark deployment spark-streaming spark-submit

How to parse JSON data in Scala?

Oct 29, 2022

scala spark-streaming

Spark Streaming on a S3 Directory

Nov 18, 2022

scala amazon-web-services amazon-s3 apache-spark spark-streaming

Is it possible to get the first n elements of every RDD in Spark Streaming?

Nov 12, 2022

spark-streaming

Direct Kafka Stream with PySpark (Apache Spark 1.6)

Sep 23, 2022

apache-spark apache-kafka pyspark spark-streaming

Kafka topic partition and Spark executor mapping

Nov 13, 2022

java apache-spark apache-kafka spark-streaming kafka-consumer-api

get topic from kafka message in spark

Sep 01, 2022

apache-spark apache-kafka spark-streaming

In Spark Streaming, is there a way to detect when a batch has finished?

Mar 22, 2022

scala apache-spark spark-streaming cloudera

Streaming data store in hive using spark

Nov 09, 2022

scala hadoop apache-spark hive spark-streaming

java.lang.IllegalArgumentException: Invalid lambda deserialization

Dec 05, 2019

java apache-spark apache-kafka spark-streaming

How to achieve dynamic load-balancing of tasks in Apache Spark

Jul 10, 2022

apache-spark spark-streaming load-balancing job-scheduling

java.lang.UnsupportedOperationException: 'Writing to a non-empty Cassandra Table is not allowed

Jun 15, 2022

apache-spark cassandra apache-spark-sql spark-streaming datastax-enterprise

Read json from Kafka and write json to other Kafka topic

Nov 05, 2022

scala apache-spark apache-kafka spark-streaming

Increase Kafka Streams Consumer Throughput

Aug 29, 2022

spark-streaming kafka-consumer-api apache-kafka-streams spark-streaming-kafka

New posts in spark-streaming