Tzach Zohar questions

Tzach Zohar answers

• Catch Exceptions that are thrown on map function in Spark
• Spark & Scala - Cannot Filter null Values from RDD
• In Scala, only add items to Map if Optional values are present
• function to each row of Spark Dataframe
• SparkSQL function require type Decimal
• Scala type inference and multiple arguments list
• Scala type parameters in various places
• What specific Spark libraries are 'Provided'?
• Scala read and parse JSON
• how to extract the column name and data type from nested struct type in spark