apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Common Table Expressions (CTEs) in Databricks and Spark
user_79969040
•
5
1
7008
databricks apache-spark-sql apache-spark common-table-expression
spark.table vs sql() AccessControlException
user_67772380
•
2
1
966
apache-spark-sql apache-spark
How to programmatically get information about executors in PySpark
user_118396860
•
6
2
818
pyspark apache-spark
How to differentiate between null and missing mongogdb values in a spark dataframe?
user_64290550
•
5
0
211
apache-spark-sql apache-spark mongodb
How can I inspect per executor/node memory usage metrics of a pyspark job on Dataproc?
user_4010220
•
6
2
521
hadoop-yarn google-cloud-dataproc pyspark apache-spark google-cloud-platform
Start DataProc job from Pub/Sub notification
user_5293320
•
2
1
903
google-cloud-pubsub google-cloud-dataproc apache-spark google-cloud-platform
Resolving performance issue with skewed partitions in PySpark Window function
user_45857130
•
4
0
195
pyspark apache-spark
How to fix "origin location must be absolute" error in sbt project (with Spark 2.4.5 and DeltaLake 0.6.1)?
user_1809040
•
2
1
459
delta-lake apache-spark sbt scala
java.lang.ClassNotFoundException: Class com.amazon.ws.emr.hadoop.fs.EmrFileSystem not found
user_109102320
•
2
0
919
amazon-emr pyspark apache-spark amazon-s3
Is there Spark equivalent for Pandas MultiIndex operation like set_index() or unstack()?
user_137889290
•
2
1
775
pyspark pandas apache-spark-sql apache-spark python
Hot Questions