apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
In spark, can I use full outer join with shuffle hash join strategy? If no, then why?
user_109442530
•
2
1
114
apache-spark-sql apache-spark
How many partitions spark will create running on aws emr and reading a table from cassandra?
user_160683930
•
2
1
108
spark-cassandra-connector pyspark apache-spark cassandra
Querying Delta.io tables with Power BI returns the "The table has no visible columns"
user_160349530
•
2
1
336
delta-lake powerbi apache-spark hive
Why does AWS EMR EC2 instances have default spark.yarn.executor.memoryOverhead set to 18.75%
user_88662790
•
2
0
196
amazon-emr hadoop-yarn apache-spark amazon-web-services
Print py_files in pyspark
user_133848050
•
3
0
54
pyspark apache-spark python
Most efficient way in PySpark to "flatten" DataFrame to 1 row per group
user_99919470
•
2
2
195
pyspark pandas apache-spark python
Calculate cumulative sum of pyspark array column
user_88445850
•
3
1
476
pyspark apache-spark-sql apache-spark
Creating a custom counter in Spark based on dataframe conditions
user_75702590
•
4
2
251
pyspark apache-spark-sql apache-spark user-defined-functions
How to check if all the columns of a row are null without hardcoding any column name in the query in spark?
user_74389630
•
2
1
467
pyspark apache-spark
org.apache.spark#hadoop-cloud_2.12;3.1.2: not found
user_10883800
•
2
2
642
apache-spark hadoop scala
Hot Questions