apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to trim zeros after decimal value without changing the datatype using PySpark?
user_169356120
•
4
1
983
pyspark apache-spark-sql apache-spark trim decimal
Databricks Notebook 8.3 (Apache Spark 3.1.1, Scala 2.12) | pyspark | Parquet write exception | Multiple failures in stage materialization
user_166662070
•
2
2
1041
aws-databricks feature-engineering pyspark databricks apache-spark
How to get result from Spark after submitting a job via REST API?
user_119718170
•
2
0
66
apache-spark-standalone apache-spark
Unable to use MySQL as Hive Metastore for Spark
user_8156380
•
2
2
166
apache-spark hive
How to drop duplicate columns based on another schema in spark scala?
user_66456170
•
2
1
82
apache-spark-sql apache-spark dataframe scala
Spark on K8s: Job proceeds although some executors are still pending
user_7779060
•
3
1
179
apache-spark kubernetes
Reading Excel file Using PySpark: Failed to find data source: com.crealytics.spark.excel
user_152032400
•
2
2
1962
pyspark apache-spark excel python
PySpark generate missing dates and fill data with previous value
user_148202950
•
3
2
2632
pyspark apache-spark-sql apache-spark cross-join dataframe
How to use a column value as key to a dictionary in PySpark?
user_55605290
•
3
2
1552
pyspark apache-spark-sql apache-spark dataframe python
Example for CREATE TABLE on TRINO using HUDI
user_36940520
•
2
1
966
trino apache-hudi create-table apache-spark
Hot Questions