How to start sparksession in pyspark

I want to change the default memory, executor and core settings of a spark session. The first code in my pyspark notebook on HDInsight cluster in Jupyter looks like this:

from pyspark.sql import SparkSession

spark = SparkSession\
    .builder\
    .appName("Juanita_Smith")\
    .config("spark.executor.instances", "2")\
    .config("spark.executor.cores", "2")\
    .config("spark.executor.memory", "2g")\
    .config("spark.driver.memory", "2g")\
    .getOrCreate()

On completion, I read the parameters back, which looks like the statement worked

However if I look in yarn, the setting have indeed not worked.

Which settings or commands do I need to make to let the session configuration take effect ?

Thank you for help in advance