Daniel questions

Daniel answers

• What are Shuffled Partitions?
• the difference between "one Executor per Core vs one Executor with multiple Core"
• how to select columns in pySpark dataframe from a variable in Python
• list the files of a directory and subdirectory recursively in Databricks(DBFS)