apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to create a data frame in a for loop with the variable that is iterating in loop
user_116727560
•
4
3
4106
apache-spark-sql apache-spark scala
How to properly iterate over Array[String]?
user_90108420
•
2
1
140
rdd apache-spark scala
Writing DataFrame as parquet creates empty files
user_100601340
•
3
1
2737
apache-spark-2.3 cloudera parquet apache-spark-sql apache-spark
AvroRuntimeException: Not a union: {"type":"long","logicalType":"timestamp-millis"}
user_54316810
•
5
0
3124
hdfs avro apache-spark
How to add functions from custom JARs to EMR cluster?
user_14740730
•
4
2
3385
livy amazon-emr apache-spark
How to fix 'No symbol could be loaded from org.apache.hbase.classification.InterfaceAudience'?
user_45413230
•
3
0
546
hfile phoenix apache-spark hbase scala
How do I access a MinIO storage bucket from a Jupyter Pyspark notebook?
user_17364070
•
3
3
2595
jupyter-notebook pyspark apache-spark docker python
Spark Structured Streaming with Kafka doesn't honor startingOffset="earliest"
user_104852490
•
8
2
6295
spark-streaming-kafka spark-streaming spark-structured-streaming apache-spark
Parse dates with microseconds precision with dataframe in Spark
user_58771220
•
3
1
881
apache-spark dataframe csv time scala
is it possible (and how) to specify an sql query on command line with spark-submit
user_15010730
•
2
1
537
apache-spark scala
Hot Questions