apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
spark strange java.lang.NullPointerException
user_96308940
•
2
0
168
apache-spark
Spark Build Fails Because Of Avro Mapred Dependency
user_31029680
•
3
1
381
apache-spark scala
Difference in the agg() function after a groupByKey() on a Dataset between Spark 2.3 and Spark 2.4
user_47033590
•
2
0
105
apache-spark-dataset apache-spark scala
How to create a koalas dataframe with index from another dataframe?
user_80896950
•
2
1
195
spark-koalas pyspark apache-spark-sql apache-spark
Performance of pyspark + hive when a table has many partition columns
user_15008870
•
2
1
307
hive-partitions pyspark apache-spark hive
How to see a particular metric in Spark Structured Streaming with Python
user_143671200
•
2
2
278
spark-structured-streaming pyspark apache-spark python
Reading single parquet-partition with single file results in DataFrame with more partitions
user_37576720
•
2
1
923
parquet pyspark apache-spark python
Increasing CPU and memory usage in a Spark Structured Streaming application
user_171597860
•
2
0
122
amazon-emr spark-structured-streaming apache-kafka apache-spark memory-leaks
How to Save Great_Expectations suite locally on Databricks (Community Edition)
user_155206150
•
3
1
296
databricks-community-edition great-expectations databricks apache-spark
Why is adding org.apache.spark.avro dependency is mandatory to read/write avro files in Spark2.4 while I'm using com.databricks.spark.avro?
user_47033590
•
3
1
340
spark-avro google-cloud-dataproc apache-spark scala
Hot Questions