apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to override spark jars while running spark-submit command in cluster mode? (okhttp3)
user_29053770
•
2
1
3157
spark-submit hdfs apache-spark dependency-management maven
Encrypt a CSV column via UDF, Spark - Scala
user_74296240
•
3
2
1063
apache-spark scala
Stream Azure EventHub data to ADLS/Blob using Spark Structured Streaming on a daily basis
user_123358380
•
2
0
161
azure-eventhub spark-structured-streaming azure-blob-storage apache-spark
How to read Parquet file from S3 without spark? Java
user_128306990
•
9
3
6161
parquet apache-spark hadoop amazon-s3 java
In a Spark cluster, is a copy of a broadcast variable kept on every executor process or only on every machine?
user_88128450
•
2
1
137
pyspark apache-spark
How to read a .tar file containing parquets on S3 as dataframes in Spark?
user_132631380
•
2
3
765
parquet apache-spark tar amazon-s3 scala
Execute PySpark code from a Java/Scala application
user_49269420
•
4
0
101
pyspark-dataframes pyspark apache-spark
How random number behaves in spark
user_32407900
•
2
2
1114
apache-spark-sql apache-spark
Spark grouped map UDF in Scala
user_59323640
•
3
1
478
apache-spark dataframe scala
Facing NoClassDefFoundError error at Kafka-Spark Structured Streaming integration via PySpark
user_113520770
•
2
2
4260
pyspark-sql spark-structured-streaming pyspark apache-kafka apache-spark
Hot Questions