apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Add batch number to DataFrame based on moving sum in spark
user_114437320
•
3
2
509
pyspark apache-spark dataframe python
Is there a way to "set *" on a Spark/Databricks merge query when all columns are not in the source?
user_26705710
•
2
1
333
delta-lake databricks apache-spark
Spark : Can't set table properties start with "spark.sql" to hive external table while creating
user_53966120
•
2
0
618
pyspark apache-spark hive
How to configure beam python sdk with spark in a kubernetes environment
user_134545480
•
4
1
751
apache-beam apache-spark kubernetes sdk java
Performance comparison between groupBy + join vs window func Spark
user_89329100
•
2
2
565
apache-spark static-typing window-functions group-by sql
Spark Adaptive Query Execution not working as expected
user_153350790
•
4
0
484
spark3 pyspark apache-spark amazon-web-services amazon-s3
Flatten nested array in Spark DataFrame
user_6471510
•
3
3
1449
pyspark apache-spark python
Installing Mesos on ubuntu 20.04 causing makefile issue
user_119824170
•
4
4
897
mesos apache-spark docker makefile
Spark dataframe value to Scala List
user_25385590
•
2
1
164
apache-spark dataframe scala-collections list scala
get schema for Parquet file in StructType format
user_78043640
•
2
1
1476
pyspark pyarrow azure-databricks databricks apache-spark
Hot Questions