Avishek Bhattacharya

Avishek Bhattacharya has asked 2 questions and find answers to 48 problems.

Stats

About

Software Engineer

Avishek Bhattacharya questions

Spark parquet partitioning : Large number of files

Avishek Bhattacharya answers

Adding line numbers when parsing many CSV files with Spark
spark reading missing columns in parquet
Spark Error reading csv file with spaces in the path/file name
What is the benefit of using nested data types in Parquet?
What does Spark recover the data from a failed node?
How to pass multiple column in partitionby method in Spark
What is the difference between Log4j, SLF4J and Logback?
filter pushdown using spark-sql on map type column in parquet
Graph as adjacency matrix time complexity
spark - scala - save dataframe to a table with overwrite mode