apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark Dataframe: Representing Schema of MapType with non homogeneous data types in StructType values
user_59866610
•
2
1
641
apache-spark scala
How to spark-submit a jar in a Spark docker-compose network?
user_135165180
•
1
1
650
apache-spark docker sbt scala java
Adding new column using other existing columns Spark/Scala
user_64856350
•
3
1
103
apache-spark-sql apache-spark dataframe scala
Delta lake and ADLS Gen2 transactions
user_32664120
•
3
1
313
azure-data-lake-gen2 azure-data-lake databricks apache-spark azure
Does partition filter order has significant performance impact on spark read
user_52462710
•
2
1
63
apache-spark
Overwriting(Updating) Data on S3 via PySpark
user_143171740
•
1
1
372
pyspark apache-spark amazon-s3
Hadoop 3.3.0: RPC response has invalid length
user_54763990
•
1
1
447
pyspark apache-spark homebrew hadoop macos
Spark REST API is not running on port 4040
user_77963750
•
1
0
145
apache-spark
What is a common use case for Apache arrow in a data pipeline built in Spark
user_4546710
•
3
1
2565
apache-arrow parquet pyarrow apache-spark
How to get spark logs from history server by submission id
user_83864550
•
1
0
79
apache-spark
Hot Questions