apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to Replace empty string with N/A in Scala Spark?
user_55367330
•
2
1
344
apache-spark-sql apache-spark scala regex
Is apache spark 3.0.1 vulnerable cause of CVE-2020-27216?
user_14977160
•
3
0
278
apache-spark
Pandas udf error on EMR: class "io.netty.buffer.ArrowBuf"'
user_109700070
•
3
1
211
amazon-emr pyspark pyarrow apache-spark
maven-guava: java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;JJ)V
user_62265110
•
2
1
2448
apache-spark guava maven
Parquet vs Delta format in Azure Data Lake Gen 2 store
user_96283390
•
11
4
25806
azure-data-lake-gen2 azure-data-lake azure-databricks apache-spark-sql apache-spark
Shutdown Hook for spark batch application
user_37960680
•
3
1
1497
apache-spark scala
Add distinct count of a column to each row in PySpark
user_82862120
•
2
3
647
pyspark apache-spark-sql apache-spark python
IllegalArgumentException: A project ID is required for this service but could not be determined from the builder or the environment
user_100304550
•
2
2
2352
databricks-connect pyspark databricks apache-spark google-bigquery
Pyspark window lead function with offset value from value of different column
user_961800
•
2
1
678
rolling-computation pyspark apache-spark-sql apache-spark
Spark Standalone : how to avoid sbt assembly and uber-jar?
user_100980900
•
2
1
490
apache-spark-standalone databricks apache-spark sbt scala
Hot Questions