apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to get the N most recent dates in Pyspark
user_72989790
•
3
1
650
pyspark apache-spark-sql apache-spark python
YARN doesn't recognize increased 'yarn.scheduler.maximum-allocation-mb' and 'yarn.nodemanager.resource.memory-mb' values
user_142750090
•
4
1
647
livy hadoop-yarn apache-spark hive hadoop
How can I create an Azure dataset in Azure ML studio (through the GUI) from a parquet file created with Azure Spark
user_45537350
•
2
2
178
azure-machine-learning-studio parquet apache-spark azure
How to handle incorrect parquet schema of some files while reading from HDFS directory?
user_88326410
•
2
1
290
apache-spark-sql apache-spark
install JAR package related to pyspark into foundry
user_143388310
•
4
2
144
conda pyspark palantir-foundry apache-spark
Spark keeps submitting tasks to dead executor
user_115021890
•
2
1
607
apache-spark java
PySpark Keep only Year and Month in Date
user_37358710
•
2
1
3878
pyspark apache-spark-sql apache-spark dataframe date
"Premature end of Content-Length delimited message body" - Error while accessing json file from S3 bucket using pyspark
user_11030700
•
3
0
1019
pyspark apache-spark amazon-s3 python json
Compilation fails with a StackOverflowError with Java 1.8, (Scala 2.12.10 = Spark 2.4.6) driven by scala-maven-plugin, on JavaScanner.skipBlockComment
user_28271810
•
3
0
142
scala-maven-plugin apache-spark compilation scala java
Generate a single row dataframe for lookup
user_11441570
•
2
1
131
spark-structured-streaming apache-spark-sql apache-spark scala
Hot Questions