apache-spark-sql tutorials

How to load CSVs with timestamps in custom format?

Oct 15, 2022

Number of Partitions of Spark Dataframe

Oct 15, 2022

apache-spark dataframe apache-spark-sql

How to use a subquery for dbtable option in jdbc data source?

Sep 05, 2022

mysql apache-spark jdbc apache-spark-sql pyspark-sql

Pass variables from Scala to Python in Databricks

Apr 20, 2022

python apache-spark pyspark apache-spark-sql databricks

How to convert pyspark.rdd.PipelinedRDD to Data frame with out using collect() method in Pyspark?

Nov 17, 2022

python-3.x apache-spark pyspark apache-spark-sql rdd

How to use spark-avro package to read avro file from spark-shell?

Nov 11, 2022

apache-spark apache-spark-sql avro spark-avro

What row is used in dropDuplicates operator?

Oct 18, 2022

apache-spark pyspark apache-spark-sql

How to CREATE TABLE USING delta with Spark 2.4.4?

May 02, 2022

apache-spark apache-spark-sql delta-lake

Find minimum for a timestamp through Spark groupBy dataframe

Apr 22, 2022

sql scala apache-spark apache-spark-sql

Config file to define JSON Schema Structure in PySpark

Nov 09, 2022

python apache-spark pyspark apache-spark-sql

How many SparkSessions can a single application have?

Nov 07, 2022

apache-spark apache-spark-sql hadoop-yarn

How to get a string representation of DataFrame (as does Dataset.show)?

Apr 29, 2022

apache-spark apache-spark-sql

How to use Spark SQL DataFrame with flatMap?

Jan 29, 2019

scala apache-spark apache-spark-sql

Fill Pyspark dataframe column null values with average value from same column

Sep 07, 2022

python apache-spark pyspark apache-spark-sql pyspark-sql

Creating Pyspark DataFrame column that coalesces two other Columns, why am I getting error of 'unicode' object has no attribute isNull?

Jan 28, 2022

python apache-spark dataframe pyspark apache-spark-sql

spark windowing function VS group by performance issue

Sep 27, 2022

apache-spark apache-spark-sql

Random sampling in pyspark with replacement

Oct 23, 2022

random pyspark apache-spark-sql

Calculate quantile on grouped data in spark Dataframe

Oct 29, 2022

apache-spark dataframe pyspark apache-spark-sql

Whole-Stage Code Generation in Spark 2.0

Aug 25, 2022

apache-spark apache-spark-sql

Spark Dataframe select based on column index

Jun 16, 2022

scala apache-spark dataframe apache-spark-sql

New posts in apache-spark-sql