apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Best approach to classify the dataset below into two classes and later remove the redundant rows using Pyspark?
user_135524650
•
2
2
84
churn pyspark apache-spark python
ImportError: No module named 'kafka' in databricks pyspark
user_80852760
•
3
3
952
pyspark databricks apache-spark python
Write to cache using pyspark that is shared with other pyspark processes
user_4546710
•
2
0
215
apache-spark redis
foreachRDD to pull average number of words & characters for each RDD in J8 Spark Streaming of Twitter API
user_59236190
•
2
2
214
twitter-streaming-api spark-streaming java-8 apache-spark
How to upgrade Spark version on AWS EMR cluster?
user_152092680
•
3
1
474
amazon-emr apache-spark hbase
Databricks Spark Dataframe - mismatching schemas - controlling the errors
user_33658860
•
2
0
422
pyspark databricks apache-spark-sql apache-spark
pom.xml dependencies for spark while using scala 2.12.10
user_70600140
•
2
2
1123
apache-spark pom.xml maven dependencies scala
Why is Pandas UDF not being parallelized?
user_158061810
•
7
2
1855
pyspark azure-databricks databricks apache-spark python
Is Spark.read.csv() an Action on Transformation
user_141714530
•
4
2
2298
pyspark apache-spark python
How to get all columns names in spark in a nested structure that are of type string
user_48055610
•
3
2
825
apache-spark scala
Hot Questions