How do I create a bigquery pubsub direct in gcp? I get an error failed to create

Viewed 50

I am trying to publish data directly from pubsub to bigquery. I have created a topic with a schema. I have created a table. But when I create the subscription, I get an error request contains an invalid argument

gcloud  pubsub subscriptions create check-me.httpobs --topic=check-me.httpobs --bigquery-table=agilicus:checkme.httpobs --write-metadata  --use-topic-schema
ERROR: Failed to create subscription [projects/agilicus/subscriptions/check-me.httpobs]: Request contains an invalid argument.
ERROR: (gcloud.pubsub.subscriptions.create) Failed to create the following: [check-me.httpobs].

there's not really a lot of diagnostics i can do here.

Is there any worked out example that shows? What am i doing wrong for this error?

Side note: its really a pain to have to create the BQ schema w/ its native json format, and then create the message schema in avro format. Similar, but different, and no conversion tools that I can find.

If i run with --log-http, it doesn't really enlighten:

{
  "error": {
    "code": 400,
    "message": "Request contains an invalid argument.",
    "status": "INVALID_ARGUMENT"
  }
}
0 Answers
Related