apache-spark

apache-spark

436 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to aggregate data which come from MongoDB on Spark executor not in driver?
Ersin Gulbahar0
•
0
0
21
executor apache-spark scala mongodb
Populating an empty pyspark dataframe with auto-generated dates
Jamie Arodi0
•
0
2
41
pyspark apache-spark
Pivot fixed amount of rows to fixed amount of columns in PySpark
Robert Kossendey0
•
1
1
29
pivot-table databricks pyspark apache-spark apache-spark-sql
Spark Streaming - Dataframe Collect Performance Issue
Sinan Guney0
•
0
1
22
collect rdd performance apache-spark
AttributeError: 'DataFrame' object has no attribute 'pivot'
KlimShaman0
•
1
1
26
pivot attributeerror dataframe pyspark apache-spark
dataset transformations and actions can only be invoked by the driver
Carol0
•
0
0
21
apache-spark scala
pyspark.sql 3.1.2 collect_set gives all null values
baka yaro0
•
0
0
16
pyspark apache-spark
pyspark write csv - double double quotes in output csv file
Sambit0
•
0
0
30
csvwriter csv pyspark apache-spark python
In spark UI, how to view the actual visual query plan of the computation which is cached?
userrZ9m10
•
1
0
32
caching apache-spark
pyspark first setup on windows - error launching
rvndc0
•
0
0
15
pyspark apache-spark python
Hot Questions