apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pickle error while creating new pyspark dataframe by processing old dataframe using foreach method
user_37551660
•
2
1
986
pyspark-dataframes pyspark apache-spark dataframe python
Fill NaN with group-by other column in spark
user_153819470
•
1
2
460
pyspark apache-spark-sql apache-spark python
Scala Spark Job in Dataproc cluster returns java.util.NoSuchElementException: None.get
user_107914640
•
2
1
435
google-cloud-dataproc apache-spark scala
pyspark - join with OR condition
user_74654620
•
2
1
4346
pyspark apache-spark dataframe join python
How to count unique values in aggregation in koalas
user_154218080
•
2
2
415
spark-koalas pyspark apache-spark
Apache Spark: Calling setCallSite(description) when a stage really starts, not during the analysis phase
user_28271810
•
3
0
225
apache-spark java
Pyspark TypeError when using reduceByKey function to sum text length
user_113063950
•
1
1
163
rdd pyspark apache-spark
convert timestamp format to iso time format in pyspark
user_148469810
•
1
1
2452
pyspark apache-spark-sql apache-spark timestamp python
spark version 3.1.1 job stuck
user_19962960
•
2
0
83
apache-spark
How to run stored procedure on SQL server from Spark (Databricks) JDBC python?
user_92808200
•
3
1
5888
databricks apache-spark jdbc scala python
Hot Questions