apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Explode multiple pandas columns and unnest one column as column names
user_45895190
•
2
2
136
pyspark pandas apache-spark-sql dataframe python
Split column and convert empty values to null in Spark
user_94666430
•
2
2
419
apache-spark-sql apache-spark scala
Can I aggregate map data as array at pyspark?
user_151746400
•
3
2
159
pyspark-dataframes pyspark apache-spark-sql apache-spark python
How to create a Pyspark Dataframe of combinations from list column
user_137770190
•
2
1
1723
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Spark: How to parse JSON string of nested lists to spark data frame?
user_95798210
•
2
2
1382
pyspark apache-spark-sql apache-spark python
Pyspark - generate a dates column having all the days between two given dates and add it to an existing dataframe
user_59043420
•
2
1
1396
pyspark apache-spark-sql apache-spark python
Creating PySpark UDFs from python method with numpy array input, to calculate and return a single float value
user_151689300
•
2
1
839
pyspark-dataframes pyspark apache-spark-sql user-defined-functions numpy
Spark multi-stage mapWithState Shuffle issue
user_9777990
•
2
0
59
spark-streaming apache-spark-sql apache-spark hadoop stream
How can I supply multiple conditions in spark startsWith() function?
user_142273520
•
3
2
939
apache-spark-sql apache-spark startswith scala
PySpark pyspark.sql.DataFrameReader.jdbc() doesn't accept datetime type upperbound argument as document says
user_11095470
•
2
1
1302
spark-jdbc pyspark apache-spark-sql apache-spark
Hot Questions