apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
When reading a CSV is there an option to start on row 2 or below?
user_52126140
•
2
2
525
pyspark databricks apache-spark azure
Zeppelin 0.8.2 - localRepoPath should have a value
user_13373520
•
3
1
207
apache-zeppelin apache-spark
org.apache.spark.SparkException: Task not serializable Caused by: java.io.NotSerializableException
user_7866760
•
2
1
1021
apache-spark scala
How do I use updateStateByKey in pyspark to concatenate a list?
user_111441720
•
3
0
112
anaconda pyspark apache-spark python-3.x python
spark dataframe is loading all nulls from csv file
user_76952820
•
3
1
1331
apache-spark dataframe csv scala
dropDuplicates() not working with pyspark but works with spark java
user_85084630
•
4
0
707
pyspark apache-spark-sql apache-spark
Why does pyspark fail with “Error while instantiating 'org.apache.spark.sql.internal.SessionStateBuilder'”?
user_80211050
•
3
1
1730
pyspark databricks apache-spark pycharm java
Why does Spark run 5 jobs for a simple aggregation?
user_56063180
•
4
1
109
apache-spark-sql apache-spark
Read Avro in Azure HDI4.0
user_65180290
•
3
1
158
spark-avro avro apache-spark azure
Modify all elements in ArrayType
user_19459810
•
2
2
733
pyspark apache-spark-sql apache-spark
Hot Questions