apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Task Not Serializable - Serialization behavior Change between Spark 2.4 and Spark 3.x
user_38922800
•
4
0
291
kryo apache-spark serialization scala java
spark structured streaming operation duration
user_79462230
•
2
0
377
pyspark apache-spark-sql apache-spark
Difficult JSON To Convert To A Spark Dataframe
user_42358400
•
2
1
50
pyspark apache-spark-sql apache-spark json
How to submit Spark job through containerized Livy
user_152092680
•
2
0
206
livy bigdata apache-spark java
Spark does't run in Windows anymore
user_143812820
•
8
3
9781
jupyter-notebook pyspark apache-spark windows
Apache Spark Connector for SQL Server and Azure SQL
user_62672650
•
4
1
959
azure-databricks apache-spark azure
Pyspark: function joining changeable number of columns
user_154682700
•
2
1
51
pyspark apache-spark concatenation python
dask read parquet and specify schema
user_60460190
•
5
1
737
dask parquet pyarrow pandas apache-spark
Time filtering a struct column in Pyspark dataframe
user_17319700
•
2
1
321
pyspark apache-spark filter user-defined-functions python
Preventing Spark from storing state in stream/stream joins
user_39139520
•
2
3
624
spark-streaming spark-structured-streaming pyspark apache-spark
Hot Questions