Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

New posts in apache-spark

Partitions not being pruned in simple SparkSQL queries

amazon-s3 apache-spark apache-spark-sql pyspark parquet

Multiple windows of different durations in Spark Streaming application

apache-spark real-time analytics apache-kafka spark-streaming

Failed to load class for data source: com.databricks.spark.csv

apache-spark

Spark JoinWithCassandraTable on TimeStamp partition key STUCK

mysql scala cassandra apache-spark datastax-enterprise

Using TestHiveContext/HiveContext in unit tests

apache-spark hive apache-spark-sql hivecontext

Locally change the log level for the zookeeper C client

logging apache-spark apache-zookeeper mesos

Spark mapWithState shuffles all data to one node

scala apache-spark spark-streaming

How to give predicted and label columns in BinaryClassificationMetrics evaluation for Naive Bayes model

scala apache-spark machine-learning apache-spark-mllib apache-spark-ml

Not able to fetch result from hive transaction enabled table through spark-sql

hadoop apache-spark hive apache-spark-sql

How to write dataframe (obtained from hive table) into hadoop SequenceFile and RCFile?

apache-spark apache-spark-sql spark-dataframe

How to convert RDD to DataFrame in Spark Streaming, not just Spark

scala apache-spark spark-streaming rdd

Apache Toree and Spark Scala Not Working in Jupyter

scala apache-spark jupyter-notebook apache-toree

Spark never finishes jobs and stages, JobProgressListener crash

apache-spark

The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx--------- (on Linux)

apache-spark hive apache-spark-sql spark-dataframe hiveql

How to implement a ScalaTest FunSuite to avoid boilerplate Spark code and import implicits

scala apache-spark scalatest

Accessing Spark Mllib Bisecting K-means tree data

apache-spark apache-spark-mllib

Am I fully utilizing my EMR cluster?

amazon-web-services apache-spark pyspark elastic-map-reduce

How to log malformed rows from Scala Spark DataFrameReader csv

scala csv logging apache-spark

How to transform Dataset<Tuple2<String,DeviceData>> to Iterator<DeviceData>

java apache-spark apache-spark-2.0 apache-spark-dataset

Naive install of PySpark to also support S3 access

python amazon-web-services apache-spark amazon-s3 pyspark
« Newer Entries Older Entries »