T. Gawęda

T. Gawęda has asked 3 questions and find answers to 77 problems.

Stats

About

Senior Developer at Codedose, mostly Java, Scala, Spring, interested in Spark & other big-data frameworks

T. Gawęda questions

Why IntelliJ needs Lombok plugin?
Spark' Dataset unpersist behaviour

T. Gawęda answers

Spark request max count
Caching DataFrame in Spark Thrift Server
Reuse a cached Spark RDD
Spark structured streaming with kafka leads to only one batch (Pyspark)
Exploded Struct in Spark
Manipulating a dataframe within a Spark UDF
Parallelism in reading Oracle data from using Spark 1.6.2 JDBC
How to create Dataset (not DataFrame) without using case class but using StructType?
object ml is not a member of package org.apache.spark
Spark: How can DataFrame be Dataset[Row] if DataFrame's have a schema