apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
spark: how to groupby a dataframe and to transform each group with
user_195291880
•
1
1
126
partition apache-spark-sql apache-spark scala
Table with bad format when using pyspark api, but not for spark.sql
user_34822660
•
1
1
26
pyspark apache-spark
Week of month start from Monday in Spark 2.4
user_164052450
•
2
1
85
pyspark apache-spark-sql apache-spark datetime sql
Mean of column in PySpark without using collect
user_97982100
•
1
1
42
pyspark apache-spark mean dataframe python
How to "select" columns from an array of struct?
user_27714550
•
2
1
75
pyspark apache-spark struct select arrays
Python great expectation with Spark : Get result for each row
user_22487610
•
1
1
69
great-expectations apache-spark validation
Can we create a Hadoop Cluster on Dataproc with 0%-2% of HDFS?
user_32565980
•
1
1
80
hdfs google-cloud-dataproc apache-spark hadoop
User Defined Function with multiple parameters is returning NULL value
user_195242650
•
2
1
91
pyspark apache-spark-sql apache-spark user-defined-functions python
Using Update on Delta table is changing the state of an intermediate DataFrame
user_42385090
•
1
1
110
delta-lake azure-databricks databricks apache-spark dataframe
Best option for storage in spark
user_17565980
•
1
0
30
amazon-emr hdfs apache-spark
Hot Questions