apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pivot and Concatenate columns in pyspark dataframe
user_20198210
•
1
1
39
pyspark apache-spark dataframe pivot
Simulate Workers in SPARK -Java-
user_147829730
•
1
1
20
bigdata apache-spark-sql apache-spark java
pyspark.sql can query local Delta Lake, but fails in case of remote Delta Lake
user_18603140
•
1
1
47
delta-lake pyspark apache-spark-sql apache-spark
Spark UDF input with a List of columns
user_19642020
•
1
1
33
apache-spark scala
Spark SQL - How to create marketing campaign paths for each user until purchase
user_155946870
•
1
1
60
pyspark apache-spark-sql apache-spark sql
How to pass data into udf not from row
user_88037440
•
1
1
35
spark-streaming apache-spark-sql apache-spark
join two date partitioned parquet hive tables on specific dates
user_73439220
•
1
1
39
pyspark apache-spark-sql apache-spark hive sql
Databricks PySpark with PEX: how can I configure a PySpark job on Databricks using PEX for dependencies?
user_109913660
•
1
0
33
pex spark-submit pyspark databricks apache-spark
Why does caching a skewed dataset take more time in spark?
user_45137150
•
2
0
54
pyspark apache-spark-sql apache-spark
How to efficiently split a dataframe in Spark based on a condition?
user_198180120
•
1
1
60
pyspark apache-spark-sql apache-spark dataframe
Hot Questions