pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
how to drop dataframes from pyspark to manage memory?
user_15745510
•
6
1
21586
pyspark apache-spark memory python
Splitting a dictionary in a Pyspark dataframe into individual columns
user_43131540
•
4
2
9066
pyspark apache-spark dataframe dictionary python
PySpark error when converting DF column to list
user_96297710
•
3
1
3118
pyspark-sql pyspark
Using Redshift JDBC Jar in spark submit , doesnt let the spark connect to Glue catalog
user_92280300
•
3
0
317
amazon-emr amazon-redshift aws-glue pyspark apache-spark
Pass a dictionary to pyspark udf
user_20198210
•
4
2
8385
pyspark apache-spark user-defined-functions
Map a text file to key/value pair in order to group them in pyspark
user_55411460
•
3
1
215
pyspark-sql pyspark
How to write PySpark dataframe to DynamoDB table?
user_104295730
•
3
3
10233
amazon-dynamodb pyspark
Creating a row number of each row in PySpark DataFrame using row_number() function with Spark version 2.2
user_83292130
•
17
2
25432
pyspark pandas apache-spark dataframe row-number
Pyspark - Split large text file into multiple files
user_105727940
•
3
1
3628
amazon-emr pyspark apache-spark-sql python-3.x
Pyspark rdd : 'RDD' object has no attribute 'flatmap'
user_87712250
•
4
1
4528
rdd pyspark apache-spark python
Hot Questions