apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
apply groupby over window in a continuous manner pyspark
user_76417660
•
2
1
362
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Including null inside PySpark isin
user_27535010
•
2
3
1156
isin pyspark apache-spark-sql apache-spark python
scala spark UDF ClassCastException : WrappedArray$ofRef cannot be cast to [Lscala.Tuple2
user_20811520
•
3
1
469
apache-spark user-defined-functions scala
PySpark how to sort by a value, if the values are equal sort by the key?
user_61696880
•
2
1
638
rdd pyspark apache-spark
Empty list representation in PySpark
user_126425880
•
2
3
1083
pyspark apache-spark python
Pandas udf loop over PySpark dataframe rows
user_98939070
•
3
2
1481
pyspark pandas apache-spark dataframe user-defined-functions
Get second last word from string using PySpark
user_4396210
•
2
2
746
pyspark apache-spark-sql apache-spark split
how to create new column 'count' in Spark DataFrame under some condition
user_151815990
•
2
2
837
pyspark-dataframes pyspark apache-spark-sql apache-spark dataframe
Track of consumed messages in Spark structured streaming
user_148822930
•
2
1
350
spark-structured-streaming apache-kafka apache-spark java
Spark - Stategy for persisting derived dataframes when parent DF is already persisted
user_14858640
•
2
1
299
apache-spark-sql apache-spark dataframe scala
Hot Questions