Consider we have several people working on a Databricks cluster in a colaborative way. Spark Context and Spark Session happens in the background.
Are they sharing the same Spark Session by default?
1 Answers
Spark Session Isolation is enabled by default. Users can disable session isolation by setting spark.databricks.session.share to true
You can set it in Spark config in advanced cluster option:
Related