apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Is there a point to cache dataframe if my code has only one action
user_152850050
•
3
0
39
pyspark apache-spark-sql apache-spark
Spark Job Split puzzled
user_95106020
•
3
0
27
apache-spark
PySpark generating combinations of values for each row
user_158826830
•
2
1
394
pyspark apache-spark-sql apache-spark python
PySpark groupby applyInPandas save objects as files problem
user_97219290
•
2
1
714
pyspark apache-spark python
Print Pyspark Streaming Data from a kafka Topic
user_142000740
•
2
1
688
spark-structured-streaming pyspark apache-kafka apache-spark python
How to emulate the array_join() method in spark 2.2
user_107580510
•
2
1
352
apache-spark-sql apache-spark scala
Error: org.apache.spark.SparkException: No executor resource configs were not specified for the following task configs: gpu
user_73525570
•
2
1
350
google-cloud-dataproc tensorflow apache-spark
Pyspark calculate row-wise weighted average with null entries
user_158611950
•
2
1
465
rdd pyspark apache-spark python
SPARK SQL throws AssertionError: assertion failed: Found duplicate rewrite attributes (Spark 3.0.2)
user_7597380
•
2
0
1233
spark3 apache-spark-sql apache-spark
What is the difference between using df.as[T] and df.asInstanceOf[Dataset[T]]?
user_98226290
•
6
1
83
apache-spark scala
Hot Questions