apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to configure Spark 2.4 correctly with user-provided Hadoop
user_23900830
•
5
2
4434
hadoop2 apache-spark hive hadoop
AWS Glue Job creates new column in Redshift if found different datatype for same column in parquet file from S3
user_68501410
•
3
3
1646
aws-glue-data-catalog pyspark-dataframes amazon-redshift aws-glue apache-spark
Using Pyspark to read S3 data, issue: NoClassDefFoundError: com/amazonaws/AmazonClientException
user_129910240
•
5
0
1420
pyspark apache-spark amazon-web-services python java
"IndentationError: unexpected indent" When trying to copy and paste from text editor to terminal
user_129901070
•
2
2
1585
pyspark apache-spark python
Spark Scheduling Within an Application : performance issue
user_100980900
•
5
1
1167
spark-streaming databricks apache-spark-sql apache-spark scala
Spark Streaming drop duplicates and keep only the first record for each key
user_32771110
•
2
0
184
spark-streaming spark-structured-streaming pyspark apache-spark python
How the number of partitions is decided by Spark when a file is read?
user_38474210
•
2
1
4238
pyspark-dataframes pyspark apache-spark-sql apache-spark
System cannot find the specified route on creating SparkSession with PySpark
user_49913240
•
4
2
672
pyspark apache-spark intellij-idea python
Databricks error java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object;
user_129848230
•
3
2
1992
azure-databricks apache-spark nosuchmethoderror scala
Scala: Error reading Kafka Avro messages from spark structured streaming
user_115933780
•
2
1
529
spark-structured-streaming apache-kafka avro apache-spark scala
Hot Questions