apache-spark-sql

apache-spark-sql

157 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why does the toPandas() function in PySpark throw a connection error if the size of the file is too large?
user4605670
•
0
0
19
pyspark-pandas java pyspark apache-spark apache-spark-sql
Is there any function in Databricks PySpark that works similar to Unbox class in AWS Glue Dynamic frame?
winnervc0
•
1
0
18
aws-glue databricks pyspark apache-spark-sql
populate json obect array into df table using pyspark?
winnervc0
•
0
0
19
apache-spark-dataset databricks pyspark apache-spark-sql json
how to use replaceWhere option with Apache iceberg while writing data
Leroy Mikenzi0
•
0
0
29
apache-iceberg iceberg apache-spark apache-spark-sql scala
How to save struct column as string to CSV/TSV in PySpark?
Alcibiades0
•
0
0
24
pyspark apache-spark-sql
StackOverflow Error while joining two Data frames
Ashit_Kumar0
•
2
0
37
spark-streaming apache-spark apache-spark-sql
Create 1GB partitions Spark SQL
Michel Senra0
•
0
2
37
delta-lake delta pyspark apache-spark apache-spark-sql
How to merge csv files into single parquet file inside a folder in pyspark?
Anos0
•
0
1
25
merge pyspark apache-spark-sql
Spark timeout on writing to parquet
user200425550
•
0
1
20
pyspark apache-spark apache-spark-sql
Stream data into Silver Delta Table
Learner11220
•
0
1
17
jobs databricks apache-spark-sql
Hot Questions