apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Graphframes: py4j.protocol.Py4JJavaError: An error occurred while calling o100.createGraph
user_54746400
•
6
0
903
graphframes amazon-emr pyspark apache-spark
Spark.read() multiple paths at once instead of one-by-one in a for loop
user_106234440
•
3
1
4611
azure-data-lake pyspark databricks apache-spark python
how to read/write sparkR and sparklyr dataframe from/to casandara and S3?
user_96917200
•
2
0
120
sparkr spark-cassandra-connector apache-spark r cassandra
Clean way to identify runs on a PySpark DF ArrayType column
user_63829010
•
4
3
197
windowing pyspark pandas apache-spark
AnalysisException: u'Cannot resolve column name
user_129669510
•
3
1
1194
pyspark apache-spark-sql apache-spark
What's the best way to write a big file to S3?
user_111172550
•
2
2
2471
apache-zeppelin parquet pyspark apache-spark scala
Caching data frames to disk between executions in an automated/smart way
user_19137810
•
3
0
42
pyspark apache-spark
Dynamically Expand Arraytype() Columns in Structured Streaming PySpark
user_79896480
•
2
1
349
spark-structured-streaming pyspark apache-spark dynamic python
Spark find max of date partitioned column
user_30033630
•
5
4
5142
pyspark apache-spark
Does PySpark code run in JVM or Python subprocess?
user_50929260
•
5
1
3746
pyspark apache-spark python
Hot Questions