apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Create and cast a new column from existing column with % concatenation
user_165252630
•
1
2
54
pyspark apache-spark-sql apache-spark python
How to join two dataframes where column matches with two columns in the second dataframe?
user_53704890
•
2
1
85
apache-spark-sql apache-spark dataframe scala
Databricks Spark Job writes _SUCCESS files twice
user_49972370
•
1
0
153
databricks apache-spark-sql apache-spark
How to union two tables and remove duplicates with conditions using Spark
user_105351230
•
3
2
382
apache-spark-sql apache-spark scala
Multithreading in Spark: how to modify a shared RDD?
user_178343340
•
1
0
24
pyspark apache-spark multithreading python
Perform Lag over multiple columns using PySpark
user_130148640
•
1
1
756
pyspark apache-spark-sql apache-spark lag python
Update a pyspark Delta Table using a python boolean function
user_85525360
•
1
0
179
delta-lake pyspark apache-spark user-defined-functions
PySpark: applying varying window sizes to a dataframe in pyspark
user_178322650
•
2
1
272
pyspark apache-spark-sql apache-spark window python
How to read parquet files in pyspark from s3 bucket whose path is partially unpredictable?
user_12807260
•
1
2
1036
parquet apache-spark wildcard amazon-s3
How to get rows where at least two distinct values are in a column?
user_108652100
•
2
1
52
pyspark apache-spark-sql apache-spark
Hot Questions