apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to iterate over a group and create an array column with Pyspark?
user_155770670
•
3
1
448
pyspark apache-spark-sql apache-spark group-by
What is DataProcSparkOperator?
user_173284950
•
3
2
297
google-cloud-dataproc apache-spark-sql apache-spark google-cloud-platform
Repartitioned data bottlenecks in few tasks in Spark
user_170720580
•
2
1
95
apache-spark-sql apache-spark
Pyspark: change values in an array column based on another array column
user_130514080
•
2
1
676
pyspark apache-spark-sql apache-spark python
How to configure a custom Spark Plugin in Databricks?
user_77211780
•
3
1
532
aws-databricks azure-databricks databricks apache-spark-sql apache-spark
Exception in thread "main" java.lang.IllegalAccessError: class org.apache.spark.storage.StorageUtils$
user_139004540
•
10
1
8051
sparkcore apache-spark-sql apache-spark scala
Convert Spark DF to a DS with different fields names
user_75512110
•
3
2
243
apache-spark-dataset apache-spark-sql apache-spark pojo java
Cast Spark dataframe existing schema at once
user_75512110
•
2
1
709
apache-spark-dataset apache-spark-sql apache-spark scala java
Cloud Composer - DAG error: java.lang.ClassNotFoundException: Failed to find data source: bigquery
user_172803350
•
3
1
254
google-cloud-composer airflow google-cloud-dataproc apache-spark-sql
Understanding pandas_udf
user_80896950
•
2
1
63
pyspark apache-spark-sql apache-spark
Hot Questions