apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Explode multiple columns in Spark SQL table
user_56998240
•
6
3
6798
apache-spark explode user-defined-functions scala
pySpark/Python iterate through dataframe columns, check for a condition and populate another colum
user_83839300
•
4
2
7760
pyspark-sql pyspark apache-spark python
Java Spark MLlib: There is an error "ERROR OWLQN: Failure! Resetting history: breeze.optimize.NaNHistory:" for Logistic Regression in ml library
user_83784850
•
7
1
789
apache-spark-ml logistic-regression apache-spark hadoop java
Date and Interval Addition in SparkSQL
user_52991550
•
10
2
19931
apache-spark-sql apache-spark sql
How to define schema of streaming dataset dynamically to write to csv?
user_31176980
•
3
1
1008
spark-csv spark-structured-streaming apache-kafka apache-spark scala
Spark does not find Scala specific methods
user_40549190
•
3
1
274
apache-spark-mllib apache-spark sbt scala java
Spark 1.6.Token can be issued only with kerberos or web authentication
user_16970030
•
3
1
1248
keytab gssapi apache-spark kerberos hadoop
How to write JDBC Sink for Spark Structured Streaming [SparkException: Task not serializable]?
user_83702950
•
13
3
8563
spark-structured-streaming apache-spark scala
JVM options not taken into consideration, spark-submit of java program
user_8583450
•
3
0
1644
spark-submit apache-spark jvm-arguments java
Unresolved reference while trying to import col from pyspark.sql.functions in python 3.5
user_53041180
•
8
4
8545
pyspark-sql spark-structured-streaming pyspark apache-spark python
Hot Questions