apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
spark ETL and spark thrift server
user_166238750
•
1
1
84
spark-thriftserver pyspark apache-spark
How to manage options in PySpark more efficiently
user_21225020
•
3
3
234
pyspark apache-spark python-3.x design-patterns python
Lambda function to groupby first substring?
user_186034550
•
1
0
50
dstream pyspark apache-spark
Why does RDD work when I don't have the implicit encoder? Why does providing an implicit encoder also fix the issue?
user_18109620
•
1
0
24
apache-spark
Extract Year from (Month Day, Year, HH:MM:SS) datetime format using Regex in Pyspark
user_169317170
•
2
3
165
pyspark apache-spark-sql apache-spark python regex
How to variable json field name spark
user_127694700
•
1
1
76
apache-spark scala parsing json
KubernetesClientException: too old resource version in long running spark job
user_39293930
•
1
0
585
apache-spark kubernetes
KeyError: 'PYSPARK_GATEWAY_SECRET' when creating spark context inside aws lambda code
user_153471370
•
1
0
82
py4j johnsnowlabs-spark-nlp aws-lambda pyspark apache-spark
Stream-Stream Left Outer Join in PySpark Structured Streaming causing Java OOM errors
user_97855850
•
1
0
87
spark-structured-streaming pyspark apache-spark
Spark Scala Conditionally add to agg
user_13948270
•
2
1
35
apache-spark scala
Hot Questions