apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
HADOOP_HOME and hadoop.home.dir are unset Error when trying to use sc.setCheckpointDir('checkpoint') Pyspark
user_124198320
•
2
0
905
pyspark apache-spark-sql apache-spark hadoop java
Partially replace dataframe with rows from another
user_43126730
•
2
2
105
pyspark apache-spark-sql apache-spark python-3.x
How to merge duplicate columns in pyspark?
user_156602350
•
2
2
1186
pyspark apache-spark-sql apache-spark
Change udf function to a spark sql function
user_95484760
•
1
1
54
pyspark apache-spark-sql apache-spark
Concatenate two string column values to array of integer using pyspark
user_123358380
•
1
1
320
pyspark apache-spark-sql apache-spark
How to create a dataframe based on the lookup dataframe and create mulitple column on dynamic and map values in the specific columns
user_89781910
•
1
1
34
pyspark apache-spark-sql apache-spark arrays python
Scala: in where clause how to get column string value and split, and intersect against another array?
user_74660540
•
1
1
183
apache-spark-sql apache-spark scala
How to append empty row(for loop output) to a data frame in pyspark
user_57824810
•
2
1
511
pyspark apache-spark-sql dataframe for-loop python
Explode multiple columns, keeping column name in PySpark
user_35452190
•
2
1
242
pyspark apache-spark-sql apache-spark python
How to REPLACE INTO using MERGE INTO for upsert in Delta Lake?
user_7608070
•
1
1
372
delta-lake apache-spark-sql apache-spark upsert
Hot Questions