Som questions

Som answers

• Fetch week start date and week end date from Date
• Finding table size (in MB/GB) in Spark SQL
• Pyspark - How to get basic stats (mean, min, max) along with quantiles (25%, 50%) for numerical cols in a single dataframe
• How to do feature selection/feature importance using PySpark?
• Why does Spark not push down a filter to before a groupBy with collect_list?
• Spark ML - MulticlassClassificationEvaluator - can we get precision/recall by each class label?
• How to Read a parquet file , change datatype and write to another Parquet file in Hadoop using pyspark
• Spark SQL Java Unable to convert fromTuple to Row and Dataframe
• PySpark - getting number of elements of array with same value