apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Concurrent update to delta lake table via multiple jobs
user_10958630
•
2
1
4862
delta-lake azure-data-factory azure-databricks databricks apache-spark
Spark3 interperter is not launching from zeppelin
user_53249630
•
2
0
274
apache-zeppelin pyspark apache-spark-sql apache-spark
Spark on Yarn Number of Cores in EMR Cluster
user_21306360
•
3
0
403
spark-submit amazon-emr spark-streaming hadoop-yarn apache-spark
PySpark: cast nullType field as string under struct type column
user_45261510
•
2
1
799
aws-glue pyspark apache-spark
In Pyspark get most frequent string from a column with list of strings
user_40134470
•
4
1
589
pyspark apache-spark
Loading and mapping a field into Hive Table
user_56178670
•
2
1
115
hdfs apache-spark hive hadoop
org.apache.spark.SparkException: Invalid Spark URL: spark://HeartbeatReceiver@xxxx_LPT-324:51380 PySpark
user_86710890
•
2
0
310
pyspark apache-spark
Scala Spark handles Double.NaN differently in dataframe and dataset
user_27972540
•
2
1
277
apache-spark dataframe nan dataset scala
Unable to convert aws glue dynamicframe into spark dataframe
user_85326490
•
2
1
1197
aws-glue-spark aws-glue pyspark apache-spark python
How to trigger catalyst optimizer before spark-submit to reduce execution time?
user_142790520
•
2
1
236
pyspark apache-spark-sql apache-spark
Hot Questions