apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
scala spark rdd error : java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda
user_157366800
•
4
1
1555
rdd apache-spark scala
Spark Create new column containing min and max of corresponding values in certain other column
user_118400020
•
2
2
126
apache-spark-sql apache-spark scala
How to make unit test mock code effect on every spark worker node(process)
user_157297290
•
3
2
362
pyspark apache-spark mocking unit-testing python
Parallel REST API request using Spark(Databricks)
user_39307270
•
5
1
2683
pyspark azure-databricks databricks apache-spark rest
cannot import s3fs in pyspark
user_116185860
•
4
1
3261
python-s3fs pyspark apache-spark filesystems amazon-s3
UnsupportedOperationException while streaming data through pyspark
user_151891450
•
4
1
928
py4j pyspark databricks apache-spark java
What is the role of Catalyst optimizer and Project Tungsten
user_141655130
•
4
1
1770
catalyst-optimizer apache-spark-sql apache-spark
Use Parquet UUID LogicalType in pyspark
user_4714780
•
2
0
187
parquet pyspark apache-spark
Working with pyspark in Azure Synapse Analytics how do I create a session that multiple notebooks can use
user_26403380
•
3
1
1982
azure-synapse apache-spark session
Delta Lake independent of Apache Spark?
user_21195220
•
4
2
430
delta-lake apache-spark
Hot Questions