apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Scala convert Array to DataFrame Column
user_113325690
•
1
1
472
rdd apache-spark-sql apache-spark dataframe scala
PySpark runs in YARN client mode but fails in cluster mode for "User did not initialize spark context!"
user_80896950
•
3
1
681
dataproc hadoop-yarn google-cloud-dataproc pyspark apache-spark
Running Python app on Spark with Conda dependencies
user_21195220
•
1
0
391
conda-pack conda pyspark apache-spark
Spark Structured Streaming, scala - Azure data lake - files created empty BEFORE being populated
user_43856440
•
1
0
43
azure-data-lake-gen2 spark-structured-streaming apache-spark scala
How to remove substring from the end of string using spark sql?
user_124966430
•
1
1
367
databricks apache-spark-sql apache-spark sql database
How to specify a name to CSV file that I save to S3 with Scala
user_105351230
•
1
2
618
aws-glue apache-spark scala
Spark task failure with ClassCastException [C cannot be cast to [J, at org.apache.spark.unsafe.memory.HeapMemoryAllocator.allocate
user_179010150
•
1
0
82
spark-streaming-kafka delta-lake apache-spark java
Spark SQL | Any depth path ($..foo) not working with get_json_object
user_17273110
•
4
1
315
apache-spark-sql apache-spark json
In a java application, if all 3 log4j APIs exists in the classpath, how to choose one of them to be effective?
user_17324180
•
2
0
182
log4j2 apache-spark classpath log4j
apache-spark running with warnings with Illegal reflective access by org.apache.spark.unsafe.Platform java.nio.DirectByteBuffer(long,int)
user_138712250
•
3
1
1935
apache-spark java
Hot Questions