apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Is there a better way to load a huge tar file in Spark while avoiding OutOfMemoryError?
user_21750520
•
2
0
206
apache-spark tar
How to preserve event order per key in Structured Streaming Repartitioning By Key?
user_105156400
•
7
0
863
spark-structured-streaming apache-spark
Apache Spark - Implementing a distributed QuadTree
user_65879180
•
2
1
607
pyspark apache-spark data-structures distributed scala
Unable to pull jar file from JFrog Artifactory repo when running Spark job on K8's
user_106255580
•
2
1
1086
apache-spark kubernetes artifactory jar
Why doesn't dataset's foreach method require an encoder, but map does?
user_26028160
•
2
1
273
apache-spark-encoders apache-spark-dataset apache-spark scala
How to make realtime predictions in Spark Streaming with a pretrained h5py model from Keras?
user_101394040
•
2
0
68
google-cloud-ml keras apache-spark deep-learning
What would be the best way to read data parquet for data range using spark(scala/java) data frame?
user_106234670
•
2
0
76
apache-spark scala java
Spark-Submit Error: Cannot load main class from JAR file
user_99990350
•
3
1
9070
spark-submit apache-spark scala
How to set maxDF to pyspark.ml.feature.CountVectorizer even though there was no maxDF parameter?
user_70779410
•
2
1
338
apache-spark-mllib pyspark apache-spark python-3.x python
How do I improve loading thousands of tiny JSON files into a Spark dataframe?
user_21750520
•
2
2
1936
apache-spark json
Hot Questions