apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Palantir Foundry spark.sql query
user_11857900
•
3
2
390
pyspark palantir-foundry apache-spark
Apache spark-core and spark-hive are using log4j 1.2.17. How can I upgrade them to log4j 2.17.1?
user_174855230
•
2
0
163
apache-spark maven log4j scala java
Trigger.Once Spark Structured Streaming with KAFKA possible?
user_69339930
•
1
1
464
spark-structured-streaming apache-kafka databricks apache-spark
How to optimize Spark Correlation to work similarly to pandas correlation?
user_183025430
•
2
0
122
pearson-correlation pyspark apache-spark python
Spark fails to parse field from elasticsearch
user_153494790
•
1
0
50
elasticsearch apache-spark scala
Spark: Use JsonSchema to parse Json into DataFrame
user_3191820
•
2
1
245
json-schema-validator apache-spark jsonschema scala json
While loading a csv file in pyspark using inferSchema as true, spark is triggering the second job with 8 tasks
user_166986760
•
1
0
94
pyspark databricks apache-spark
ERROR running spark-shell and pyspark on my windows system
user_106699570
•
1
1
396
pyspark apache-spark hadoop java
How to use PySpark to analysis below events?
Admin1
•
1
1
105
pyspark apache-spark
Using createOrReplaceTempView to replace a temp view not working as expected
user_57763790
•
1
1
137
rdd apache-spark-sql apache-spark java
Hot Questions