apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Py4JJavaError when writing Pyspark DataFrame to Parquet
user_123686540
•
1
1
988
parquet pyspark apache-spark-sql apache-spark
SPARK 3 - Populate value with value from previous rows (lookup)
user_11443470
•
1
1
235
spark3 pyspark apache-spark-sql apache-spark
PYSPARK : Update value in a row with another row value based on condition?
user_176276330
•
1
1
436
pyspark apache-spark-sql apache-spark dataframe
Filling rows from calendar table with previous values
user_123810270
•
1
2
175
apache-spark-sql apache-spark sql
GroupBy with ApplyInPandas in PySpark - how to implement a UDF correctly?
user_17650080
•
1
1
702
pyspark apache-spark-sql apache-spark
Calculate the geographical distance in pyspark dataframe
user_170755200
•
1
1
1653
geopy pyspark apache-spark-sql apache-spark user-defined-functions
How to split a list of objects to separate columns in pyspark dataframe
user_90835220
•
1
1
426
pyspark apache-spark-sql apache-spark dataframe python
Skip first and last line from a pipe delimited file with 26 columns and make it to dataframe using scala
user_73462410
•
2
1
283
azure-databricks apache-spark-sql apache-spark scala
How to load a dataframe in PySpark to Snowflake
user_136323090
•
1
1
1019
snowflake-cloud-data-platform pyspark apache-spark-sql apache-spark python
Based on same physical plan, why the spark sql is much faster than dataframe when i using WHERE to filter data from hive partitioned table?
user_166644190
•
3
0
76
dask-dataframe apache-spark-sql apache-spark hive
Hot Questions