apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Group by date range overlapping using PySpark
user_16506300
•
1
1
331
pyspark apache-spark-sql apache-spark dataframe sql
Moving Messages received from Azure Service Bus to Azure DataLake with Databricks
user_155206150
•
1
1
336
azureservicebus azure-databricks apache-spark
Multiple S3 credentials in a Spark Structured Streaming application
user_8348640
•
2
1
103
spark-structured-streaming ceph apache-spark amazon-s3
Spark Repartition creates partition more than 128 MB
user_180876600
•
1
1
408
partition bigdata hdfs pyspark apache-spark
java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary Error while writing to Parquet File
user_101673210
•
2
0
379
parquet apache-spark scala
How to access files on Dataproc that were passed using --files
user_34006380
•
2
2
631
google-cloud-dataproc apache-spark google-cloud-platform scala
addSparkListener equivalent in databricks
user_65015270
•
2
1
317
pyspark databricks apache-spark listener
YTD and MTD of Mutual Fund using PySpark
user_67557810
•
1
1
259
pyspark apache-spark-sql apache-spark dataframe python
How to randomly shuffle the values of only one column in pyspark?
user_80896950
•
1
2
283
pyspark apache-spark-sql apache-spark
Custom aggregator for Spark Structured Streaming from Event Hub
user_94693000
•
2
0
86
spark-structured-streaming apache-spark azure scala
Hot Questions