apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Can we connect sql server databases using SPN in databricks using scala?
user_67405470
•
2
1
584
azure-databricks databricks apache-spark sqlconnection sql-server
Kafka S3 Sink Connector - how to mark a partition as complete
user_23889400
•
2
1
238
system-design hadoop-partitioning batch-processing apache-kafka apache-spark
Differences between persist(DISK_ONLY) vs manually saving to HDFS and reading back
user_87880710
•
3
1
530
rdd apache-spark
Spark 3.0 streaming metrics in Prometheus
user_134347190
•
4
1
836
spark3 spark-structured-streaming prometheus apache-spark
How to remove element in an array by index in a Dataframe in Spark
user_130143960
•
3
4
701
apache-spark dataframe scala
Why does Delta Lake seem to store so much redundant information?
user_38112900
•
2
1
225
delta-lake apache-spark amazon-s3
Writing Spark Dataset with Custom Unix Group
user_144769820
•
2
0
27
parquet apache-spark hadoop unix java
PySpark: Length of object does not match with length of fields - creating new schema
Admin1
•
2
0
1705
apache-spark python
multilingual bert in spark nlp
user_141683280
•
2
1
190
johnsnowlabs-spark-nlp bert-language-model apache-spark
Scala DataFrame - How to only print rows with largest values
user_31343830
•
2
2
159
apache-spark-sql apache-spark dataframe scala
Hot Questions