apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark UDAF with ArrayType as bufferSchema performance issues
user_30229000
•
5
1
3405
apache-spark-sql apache-spark user-defined-functions scala performance
How to set a custom loss function in Spark MLlib
Admin1
•
8
1
1272
apache-spark-mllib apache-spark regression machine-learning scala
AWS Glue ETL Job fails with AnalysisException: u'Unable to infer schema for Parquet. It must be specified manually.;'
user_11181380
•
3
2
2965
parquet aws-glue apache-spark amazon-web-services
Difference between spark.config & spark.conf.set
user_42658230
•
4
0
465
apache-spark configuration
Streaming from CSV files with Spark
user_31464760
•
3
0
760
spark-csv apache-spark
Spark job getting stuck at 99% and doesn't continue
user_76158790
•
3
1
3865
apache-spark-sql apache-spark
Capturing Kafka offsets when writing with Spark Structured Streaming
user_89334040
•
3
2
1198
spark-streaming apache-kafka apache-spark
Spark. Split RDD into batches
user_55261000
•
5
2
2533
batching rdd apache-spark
AssertionError: all exprs should be Column
user_73168070
•
9
1
18156
pyspark apache-spark python
Spark DataFrame from pandas Series
user_69252080
•
3
2
5533
pyspark pandas apache-spark series python
Hot Questions