apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
I can't load data from hdfs, I use the python pyarrow library. In a docker container
user_104682660
•
2
1
583
hdfs pyarrow apache-spark hadoop python
Is there any way to get max value from a column in Pyspark other than collect()?
user_128045160
•
4
1
5764
pyspark apache-spark
How to copy parquet file and overwrite the old one on HDFS
user_59839140
•
2
1
1307
hdfs parquet apache-spark
pyspark aggregate while find the first value of the group
user_64974600
•
3
1
7138
pyspark apache-spark-sql apache-spark python
Livy session stuck on starting after successful spark context creation
user_111647280
•
6
1
1087
livy apache-spark-standalone apache-spark ubuntu
Why results structure change when I change column name in Python spark?
user_14922290
•
2
1
47
pyspark apache-spark python
How to find the hierarchy levels of a person(employee,manager etc.) using graphframes in pyspark?
user_82739340
•
2
1
642
graphframes pyspark apache-spark breadth-first-search python
spark writeStream into kafka - Difference between awaitTermination() vs awaitAnyTermination()
user_74866210
•
3
1
946
spark-structured-streaming pyspark apache-kafka apache-spark
vacuum not deleting old parquet files
user_43398880
•
2
1
1444
azure-data-lake delta-lake azure-databricks databricks apache-spark
How does apache griffin work with AWS S3?
user_31992850
•
3
0
240
apache-spark amazon-web-services amazon-s3
Hot Questions