apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Not able to cat dbfs file in databricks community edition cluster. FileNotFoundError: [Errno 2] No such file or directory:
user_141542590
•
5
1
5560
dbutils databricks-community-edition pyspark databricks apache-spark
PySpark: How to apply UDF to multiple columns to create multiple new columns?
user_852480
•
4
1
4924
pyspark databricks apache-spark python
Append a monotonically increasing id column that increases on column value match
user_141489850
•
2
2
327
apache-spark-sql apache-spark
Why would preferredLocations not be enforced on an empty Spark cluster?
user_141476880
•
2
1
80
apache-spark
Filter values not equal in pyspark
user_55141780
•
2
4
3197
pyspark apache-spark-sql apache-spark null sql
Spark unit test -- Mock Azure SQLJDBC connection
user_70545290
•
2
0
112
apache-spark-sql apache-spark mockito scala unit-testing
How to add a new column to a Delta Lake table?
user_38096790
•
7
2
14236
delta-lake azure-databricks databricks apache-spark
Default tolerance for float columns in Spark
user_8363180
•
2
0
63
apache-spark scala
Airflow fails to add EMR step using EMRAddStep when HadoopJarStep arg has an argument ending with .json
user_8106870
•
2
2
1474
amazon-emr airflow apache-spark
MicroBatchExecution: Query terminated with error UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z
user_141174780
•
2
1
1342
spark-streaming-kafka spark-structured-streaming apache-spark-sql apache-spark java
Hot Questions