Hi I have created a dataproc cluster using the gcloud command mentioned below -
gcloud dataproc clusters create spark-kerberos --region=us-central1 --zone us-central1-c --master-machine-type custom-4-15360 --master-boot-disk-size 200 --num-workers 2 --worker-machine-type custom-2-7680 --worker-boot-disk-size 200 --image-version 1.4-debian10 --scopes 'https://www.googleapis.com/auth/cloud-platform' --properties "dataproc:kerberos.beta.automatic-config.enable=true" --project $PROJECT_NAME
I am enabled automatic kerberos in this cluster. All services are also running while checking through JPS.
root@spark-kerberos-m:~# jps
3841 ApplicationHistoryServer
5761 JobHistoryServer
4402 NameNode
3842 ResourceManager
5875 HistoryServer
12276 Jps
646 AgentMain
4059 RunJar
4908 SecondaryNameNode
6318 RunJar
root@spark-kerberos-m:~#
Now issue is with the resource manager UI. I am not able to access the UI on port 8088. Meanwhile the UI can be accessible when cluster is created without adding kereberos.