apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Create Spark output streams with function
user_73064760
•
2
1
151
pyspark databricks apache-spark-sql apache-spark
Extract Year from (Month Day, Year, HH:MM:SS) datetime format using Regex in Pyspark
user_169317170
•
2
3
165
pyspark apache-spark-sql apache-spark python regex
how to change a column type in array struct by pyspark
user_91723440
•
2
1
678
pyspark-schema pyspark apache-spark-sql
How to overwrite pyspark DataFrame schema without data scan?
user_16614910
•
4
1
998
pyspark apache-spark-sql apache-spark
What is the maximum length limitation for VARCHAR type in Spark?
user_60930880
•
1
1
324
apache-spark-sql apache-spark scala java
How to dynamically add column/values to Map Type in pyspark dataframe
user_38352340
•
1
1
715
pyspark apache-spark-sql apache-spark python
PySpark - merge two DataFrames, overwriting one with the other
user_3969970
•
2
1
556
pyspark apache-spark-sql dataframe
How to take random n sample for each distinct value in a column in spark?
user_109183840
•
1
0
195
pyspark apache-spark-sql apache-spark group-by
Pyspark Order By 1.5B Records With 20 Distinct Values - Performance Issue
user_152850050
•
1
1
39
pyspark apache-spark-sql apache-spark
Spark Sql Array contains on Regex - doesn't work
user_104545620
•
1
1
559
apache-spark-sql apache-spark scala sql
Hot Questions