apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pyspark count for each distinct value in column for multiple columns
user_93811810
•
2
1
323
pyspark apache-spark python
Predictions in PySpark using pickled MLFlow model and pandas_udf
user_98290740
•
2
1
644
lightgbm pyspark pyarrow apache-spark python
How to REPLACE INTO using MERGE INTO for upsert in Delta Lake?
user_7608070
•
1
1
372
delta-lake apache-spark-sql apache-spark upsert
Install package Graphframes using spark-shell
user_153187690
•
5
1
1163
graphframes pyspark apache-spark hadoop scala
How to pass Spark configuration parameters to DBT?
user_3243150
•
1
1
284
dbt apache-spark
how to do nested collect_list in spark sql?
user_77731070
•
2
1
405
pyspark apache-spark-sql apache-spark
java.lang.NoClassDefFoundError: org/apache/spark/sql/catalyst/expressions/codegen/CodegenFallback$class
user_161912210
•
2
0
124
apache-spark scala sql
Spark partition size greater than the executor memory
user_41328880
•
3
2
1707
rdd pyspark databricks apache-spark partitioning
Issue loading data set using spark-redis
user_117884290
•
2
1
896
pyspark apache-spark-sql apache-spark redis
Element-wise sum of arrays across multiple columns of a data frame in Spark / Scala?
user_38196260
•
2
2
431
apache-spark scala
Hot Questions