apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Apply sklearn trained model on a dataframe with PySpark
user_57065480
•
8
3
5503
scikit-learn pyspark apache-spark python
Why does collecting dataset fail with org.apache.spark.shuffle.FetchFailedException?
user_80917890
•
3
2
4131
spark-cassandra-connector apache-spark-sql apache-spark cassandra scala
How to convert bytes from Kafka to their original object?
user_80496520
•
6
1
7374
spark-avro spark-streaming apache-kafka apache-spark
Spark LuceneRDD - how does it work
user_27615090
•
3
1
1009
apache-spark-2.0 apache-spark lucene scala java
How to find longest sequence of consecutive dates?
user_47522770
•
4
3
3164
apache-spark-sql apache-spark
How to Convert DataSet<Row> to DataSet of JSON messages to write to Kafka?
user_18704000
•
2
1
1963
spark-structured-streaming apache-kafka apache-spark-sql apache-spark java
fastest way to write spark dataframe to phoenix table
user_17262750
•
2
0
620
spark-dataframe phoenix apache-spark
Issue in extracting 54K entries into dataset and writing it into csv file in apache spark
user_77138110
•
4
0
97
apache-spark-dataset apache-spark-sql apache-spark java
How to read only n rows of large CSV file on HDFS using spark-csv package?
user_36705320
•
20
7
32790
spark-csv hdfs pyspark apache-spark-sql apache-spark
In spark, how to estimate the number of elements in a dataframe quickly
user_35793090
•
6
2
9829
apache-spark approximation
Hot Questions