apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Getting error from spark : Number of dynamic partitions created is 1041, which is more than 1000
user_137481810
•
2
1
770
apache-spark-sql apache-spark scala
Apache Spark integration with Kafka
user_67070100
•
4
1
547
spark-kafka-integration spark-structured-streaming apache-kafka apache-spark
Is there a way to load .RData or .model files in sparkR (using databricks)?
user_65563880
•
3
1
511
rdata sparkr databricks apache-spark r
Spark Streaming receiver is processing only one record
user_21453680
•
2
1
122
spark-streaming hadoop-yarn google-cloud-dataproc apache-spark
Spark: task not serializable strange error
user_106818280
•
2
0
82
apache-spark serialization
Submitting pyspark job with multiple python files and one configuration file
user_82360290
•
5
1
5589
spark-submit pyspark apache-spark python
Spark: writing data to place that is being read from without loosing data
user_106629270
•
2
1
135
amazon-emr apache-spark
Using regexp to join two dataframes in spark
user_106431620
•
5
3
416
apache-spark scala regex
Spark Session With Multiple s3 Roles
user_133242600
•
3
1
563
assume-role pyspark apache-spark amazon-s3
read multiple parquet file at once in pyspark
user_131267940
•
2
2
3457
pyspark apache-spark-sql apache-spark
Hot Questions