apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
how to estimate the memory needed for each task?
user_20215160
•
1
0
24
apache-spark task memory
PySpark DataFrame showing different results when using .select()
user_93729960
•
2
2
91
pyspark apache-spark python
Spark Iceberg - Merge Into Issue - Caused by: org.apache.spark.sql.AnalysisException: unresolved operator 'ReplaceIcebergData RelationV2
user_139287520
•
3
0
180
iceberg apache-spark-sql apache-spark
How do I filter the column in pyspark?
user_72109180
•
4
4
61
pyspark apache-spark-sql apache-spark python
How do I populate a Mutable map using a loop in scala?
user_112657010
•
1
2
51
pyspark apache-spark-sql apache-spark hashmap scala
Rearranging Columns in Descending Order using Pyspark
user_176820240
•
1
3
102
pyspark apache-spark-sql apache-spark python
In Java spark, how to select columns based on index
user_105163080
•
1
1
29
apache-spark-dataset apache-spark java
Can I write multiple DataFrames in parallel in Spark?
user_100940030
•
2
3
79
spark-avro apache-spark-sql apache-spark dataframe scala
Getting error when I try to create an iceberg table using dataFrame.write() in spark and store it in a cloud Filesystem source
user_197922690
•
1
1
39
azure-databricks apache-spark scala
Hold Spark dataframe in dictionary
user_37358710
•
1
0
44
pyspark apache-spark dataframe dictionary python
Hot Questions