Srinivas

Srinivas has asked 0 questions and find answers to 10 problems.

Stats

About

Big Data Engineer using Spark, Kafka, Hive on a Hadoop distribution to build streaming & batch applications. My preferred language is Scala.

If you find my answers helpful, I'd appreciate a cup of coffee

Contact me if you need paid support 15$/hour Email : [email protected]

Srinivas questions

Srinivas answers

Spark.read() multiple paths at once instead of one-by-one in a for loop
How to calculate size of dataframe in spark scala
What is the optimal way to read from multiple Kafka topics and write to different sinks using Spark Structured Streaming?
How to handle small file problem in spark structured streaming?
Maven build ERROR (Scala + Spark):object apache is not a member of package org
What is the differences between spark.table("TABLE A") and spark.read.("TABLE A")
How to use split function with variable delimiter for each row?