pasha701

pasha701 has asked 0 questions and find answers to 18 problems.

Stats

About

Spark/Scala developer, with Hadoop stack: Java/MapReduce, Oozie, Hive, etc. Before this, I worked as Java developer on various projects. More than 20 years in development overall.

pasha701 questions

pasha701 answers

Exceeding `spark.driver.maxResultSize` without bringing any data to the driver
How to check if key exists in spark sql map type
How to create a copy of a dataframe in pyspark?
Scala/ Spark- Multiply an Integer with each value in a Dataframe Column
How to get child nodes with ELEMENT_NODE type only
Join two maps by key
Updating column value in loop in spark
Filter Spark Dataframe with a variable
What is the Mapper of Reducer setup() used for?
How to skip lines while reading a CSV file as a dataFrame using PySpark?