apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Mock spark Dataframewriter for unit testing
user_183469020
•
2
0
94
apache-spark-sql apache-spark scala mocking unit-testing
dropDuplicates with non-numeric condition
Admin1
•
1
2
110
apache-spark-sql apache-spark scala
In pyspark how to check the format a pyspark was read in? Delta vs parquet
user_7158580
•
1
1
276
pyspark azure-databricks apache-spark-sql python
Add table description to iceberg table from pyspark
user_74045800
•
1
1
291
iceberg pyspark apache-spark-sql hive python
how to use PySpark to handle get below durations?
Admin1
•
1
1
42
pyspark apache-spark-sql
file transfer from DBFS to Azure Blob Storage
user_137983240
•
2
1
571
azure-blob-storage azure-databricks apache-spark-sql azure
How to calculate time difference in a sql window partition using condition
user_98087640
•
1
0
52
apache-spark-sql window-functions sql
Using createOrReplaceTempView to replace a temp view not working as expected
user_57763790
•
1
1
137
rdd apache-spark-sql apache-spark java
Joining rows from two dataframes with the closest point
user_136837170
•
2
1
172
pyspark apache-spark-sql apache-spark distance
Row column names are ignored when using createDataFrame with schema in pyspark
user_105311860
•
2
0
97
pyspark apache-spark-sql
Hot Questions