apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How do I convert a spark dataframe to a JSON map?
user_163179990
•
1
1
42
apache-spark-sql apache-spark
Is it possible to run Spark jobs on (1) sorted (2) continuous chunks of an input table?
user_12145470
•
1
0
51
pyspark apache-spark python
What is the best way to migrate delta tables created in spark streaming jobs to a new location?
user_199778230
•
4
0
87
delta-lake spark-structured-streaming pyspark apache-spark amazon-s3
How to check if at least one element of a list is included in a list column?
user_194954700
•
1
2
46
pyspark apache-spark dataframe exists list
External vs Internal table in Delta Lake
user_136978070
•
2
1
38
data-lakehouse azure-data-lake delta-lake apache-spark-sql apache-spark
Unable to Writing data in Delta Format
user_199751140
•
1
1
37
delta-lake databricks apache-spark
A Zeppelin Spark statement fails on a ClassCastException on an $iw class coming from 2 differents classloaders (?). it doesn't happen with spark-shell
user_28271810
•
1
0
18
apache-zeppelin apache-spark classloader scala
Calendarized cost by year and month in Spark
user_15409090
•
3
2
61
pyspark apache-spark-sql apache-spark calendar python
Broadcast join in Spark 3.2.2 returns "NotSerializableException: org.apache.spark.sql.execution.datasources.v2.DataSourcePartitioning"
user_49318240
•
1
0
68
spark-cassandra-connector apache-spark cassandra
Please provide a valid WRITE query
user_199674320
•
2
0
29
apache-spark minimum-spanning-tree neo4j scala
Hot Questions