apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark writing data back to HDFS
user_33577350
•
1
1
144
apache-spark-sql apache-spark
Getting SparkUpgrade exception while trying to convert string to unix_timestamp datatype in pyspark dataframe
user_157353330
•
1
1
96
pyspark apache-spark casting
attributeerror: 'AioClientCreator' object has no attribute '_register_lazy_block_unknown_fips_pseudo_regions'
user_114072270
•
13
2
10331
apache-spark amazon-web-services python-3.x amazon-s3 python
spark scala: extracting xml from one column
user_36291510
•
1
1
56
apache-spark scala
Duplicate column in json file throw error when creating PySpark dataframe Databricks after upgrading runtime 7.3LTS(Spark3.0.1) to 9.1LTS(Spark3.1.2)
user_174254580
•
2
3
1071
delta-lake pyspark databricks apache-spark json
Spark s3 write (s3 vs s3a connectors)
user_73378310
•
2
1
897
amazon-emr parquet apache-spark amazon-web-services amazon-s3
Reuse Spark Session Across Modules/Packages
user_32565980
•
2
0
101
pyspark apache-spark python
Is Star Schema (data modelling) still relevant with the Lake House pattern using Databricks?
user_76798320
•
5
3
1065
apache-spark-3.0 bigdata azure-databricks databricks apache-spark
Spark workers 'KILLED exitStatus 143' when given huge resources to do simple computation
user_79545040
•
2
1
446
apache-spark kubernetes java
Two separate images to run spark in client-mode using Kubernetes, Python with Apache-Spark 3.2.0?
user_81337690
•
1
1
76
apache-spark kubernetes docker python
Hot Questions