I am running a spark streaming job on yarn with spark diver in the cluster mode. I would like to access the REST endpoints as described in this link.
Spark Version is 2.1
As per the documentation, the running application end points can be accessed at "http://localhost:4040/api/v1"
On the resource manager UI, clicked on the specific application and then Application Master tracking url to get the host name. Still it does not work.
How do i find the node instead of localhost in the above url?
The other option given in the link above is using the base url "http://:18080/api/v1".
I tried the same by going through the RM as described above, but no success.
How do i find the for the above url?