apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Import pipe delimited txt file into spark dataframe in databricks
user_147506690
•
1
1
583
txt pyspark apache-spark-sql apache-spark python
pyspark get element from array Column of struct based on condition
user_105667740
•
2
1
2509
pyspark apache-spark-sql apache-spark dataframe python
How to get the occurence rate of the specific values with Apache Spark
user_17590630
•
1
1
39
apache-spark-sql apache-spark dataframe scala
Pyspark - Join with null values in right dataset
user_127055550
•
2
1
835
pyspark apache-spark-sql apache-spark dataframe
How can I process chunks of data in Spark dataframe
user_157718510
•
2
0
187
data-transform bigdata apache-spark-sql apache-spark scala
Problems running Spark SQL in a loop
user_180327160
•
2
1
340
apache-spark-sql caching scala
How to efficiently count distinct values between all date combinations
user_180455550
•
2
1
314
pyspark apache-spark-sql apache-spark dataframe
pyspark query to find the difference in column value for corresponding values in another column
user_178926210
•
2
1
367
pyspark apache-spark-sql apache-spark dataframe python
How to ensure same partitions for same keys while reading two dataframes in pyspark?
user_80896950
•
3
0
185
pyspark apache-spark-sql apache-spark
Pyspark remove field in struct column
user_91787250
•
2
2
1713
pyspark databricks apache-spark-sql apache-spark dataframe
Hot Questions