apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
What is the best way to build event counts for certain time resolution over multiple names in Spark dataframe while groupby?
user_104527000
•
1
1
150
pyspark azure-databricks databricks apache-spark-sql apache-spark
Import POJO model with Sparkling Water (Scala)
user_180799870
•
1
1
48
sparkling-water h2o.ai apache-spark pojo scala
DecimalType(20, 0) does not hold 7 digit integer in spark
user_95994660
•
2
1
126
pyspark apache-spark-sql apache-spark dataframe
Why does a count query create a ShuffledRowRDD, before MapPartitionsRDD?
user_106818280
•
1
0
65
apache-spark
why colab cannot connect to Scala runtime type after I install Almond and finish all settlement procedures?
user_166954070
•
1
0
144
google-colaboratory apache-spark google-cloud-platform scala python
Speeding up a custom aggregate for window function
user_27893340
•
1
1
56
pyspark apache-spark-sql apache-spark dataframe user-defined-functions
How do I find intersection of value lists in a txt file RDD with pyspark?
user_180120960
•
3
1
156
rdd pyspark apache-spark mapreduce python
How can I pass a RDD from scala to python?
user_1351350
•
1
1
93
apache-spark scala python
How to get all rows with null value in any column in pyspark
user_149822190
•
3
1
1052
pyspark apache-spark-sql apache-spark dataframe
DESCRIBE TABLE see which columns are NOT NULL
user_139630860
•
1
2
607
azure-databricks databricks apache-spark-sql apache-spark
Hot Questions