apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Is there a hook for Executor Startup in Spark?
user_10185620
•
3
2
1618
apache-spark executor callback scala
Kafka offset commit not working?
user_13750430
•
3
0
305
spark-streaming apache-kafka apache-spark
How to group by multiple columns and collect in list in PySpark?
user_87124180
•
3
3
12625
pyspark-sql pyspark apache-spark-sql apache-spark
Spark structured streaming - join static dataset with streaming dataset
user_13154450
•
15
2
9000
apache-spark-dataset spark-structured-streaming apache-spark-sql apache-spark scala
Spark join array
user_6386490
•
3
2
1571
apache-spark scala
How to force inferSchema for CSV to consider integers as dates (with "dateFormat" option)?
user_13748040
•
8
2
7177
spark-csv apache-spark-sql apache-spark dataframe
Dummy Encoding using Pyspark
user_67965470
•
5
1
9380
pyspark apache-spark dummy-variable encoding
PySpark: How to check if a column contains a number using isnan
user_76104080
•
4
1
15504
pyspark apache-spark
Is there a difference between OUTER & FULL_OUTER in Spark SQL?
user_2016570
•
11
2
5213
apache-spark-sql apache-spark
Spark sql throws UTF8 String Casting Error
user_32407900
•
5
1
3877
apache-spark-sql apache-spark
Hot Questions