Dataproc can not auto-generate staging bucket

Viewed 224

I am very new to gcloud and dataproc, and I use gcloud console.
Dataproc can not auto-generate staging buckets for my account, and every time I need to specify an existing bucket for every new cluster as 'staging bucket' when I configure cluster or it will show an error.

{
  "code": 400,
  "message": "Google Cloud Storage bucket does not exist 'dataproc-staging-<REDACTED>'.",
  "status": "INVALID_ARGUMENT"
}

What should I do to it auto-generate staging bucket like it supposed to be? Thank you in advance!

1 Answers

I just tried to reproduce this issue by deleting an existing staging bucket in the region and creating cluster in this region again, but during cluster creation Dataproc successfully recreated staging bucket - as expected.

Please, try to create a cluster in an original region to see if this issue is still reproducible for you.

Related