apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Adding the result of a function in a Dataframe column [Spark Scala]
user_144766900
•
1
1
292
calculation apache-spark dataframe user-defined-functions scala
java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.type. when running go example using apache beam spark runner
user_146938570
•
2
0
192
jackson-databind apache-beam apache-spark go java
orderBy and sort is not applied on the full dataframe
user_27535010
•
3
1
845
incremental-build foundry-code-repositories pyspark palantir-foundry apache-spark
Why Spark DataSet loses all its schema and just returning byte[]?
user_65088190
•
3
1
153
apache-spark-dataset apache-spark-sql apache-spark scala
How Apache Spark uses .crc files
user_20215160
•
2
0
697
apache-spark crc
Using databricks-connect debugging a notebook that runs another notebook
user_31927750
•
3
1
732
databricks-connect pyspark databricks apache-spark
Flattening map<string,string> column in spark scala
user_156826590
•
1
1
303
apache-spark scala
EMR Hudi cannot create hive connection jdbc:hive2://localhost:10000/
user_53722140
•
1
1
416
apache-hudi amazon-emr aws-glue pyspark apache-spark
Add column to Spark dataframe with the max value that is less than the current record's value
user_51527250
•
1
2
120
pyspark databricks apache-spark python
How is duration being calculated in a Spark Structured Streaming UI?
user_7759880
•
4
0
170
spark-structured-streaming apache-spark sql performance
Hot Questions