pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
AWS Glue creates struct when long is present
user_35064270
•
3
0
348
aws-glue pyspark amazon-web-services
Spark org.apache.spark.shuffle.FetchFailedException: Caused by: java.nio.channels.ClosedChannelException
user_68755440
•
1
0
528
bigdata hadoop-yarn pyspark apache-spark
PySpark regex to extract string with two conditions
user_95009550
•
1
2
510
pyspark python regex
Find cosine similarity between two columns of type array<double> in pyspark
user_60536650
•
3
2
730
pyspark apache-spark python
Py4JJavaError when writing Pyspark DataFrame to Parquet
user_123686540
•
1
1
988
parquet pyspark apache-spark-sql apache-spark
SPARK 3 - Populate value with value from previous rows (lookup)
user_11443470
•
1
1
235
spark3 pyspark apache-spark-sql apache-spark
PYSPARK : Update value in a row with another row value based on condition?
user_176276330
•
1
1
436
pyspark apache-spark-sql apache-spark dataframe
How to create a function that checks if one row in a PySpark column of a dataframe matches another row in the same column of another dataframe?
Admin1
•
1
1
30
pyspark dataframe python
How to join two data frames without messing up the order? (PySpark SQL)
user_163432970
•
1
2
176
pyspark dataframe
Pyspark on windows throws exception while running job
user_153670970
•
1
0
64
pyspark apache-spark python
Hot Questions