apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How can I query a table using the data in a column of an existing dataframe in Spark?
user_35176470
•
1
1
28
pyspark apache-spark python
Why my delta lake table is not collecting statistics (min, max values)?
user_98857860
•
2
1
756
delta-lake azure-databricks databricks apache-spark indexing
Invoking Pyspark script from Scala Spark Code
user_54123150
•
1
1
372
pyspark apache-spark jython scala
How can I set a maximum allowed execution time per task on Spark-YARN?
user_71573520
•
4
1
247
spark-structured-streaming hadoop-yarn apache-kafka apache-spark
Delta tables in Databricks and into Power BI
user_124377210
•
2
1
1086
azure-data-lake delta-lake powerbi databricks apache-spark
Is it relevant to partition by Business Date and Ingest Date for a FACT table on Delta Lake?
user_98857860
•
2
1
185
hadoop-partitioning delta-lake azure-databricks databricks apache-spark
Azure Databricks: Switching from batch to streaming mode
user_160570400
•
2
0
95
spark-structured-streaming azure-databricks databricks apache-spark azure
Pyspark: Read multiple csv files and annotate them with the source
user_144463600
•
2
1
1379
pyspark apache-spark python
Add a range array column in pypsark
user_131789520
•
1
1
41
pyspark apache-spark python
How to sample() exact number of rows, not fraction, of PySpark DataFrame
user_72753980
•
1
1
771
pyspark apache-spark-sql apache-spark
Hot Questions