Is there a way to deploy scheduled queries to GCP directly through a github action, with a configurable schedule?

Viewed 365

Currently using GCP BigQuery UI for scheduled queries, everything is manually done.

Wondering if there's a way to automatically deploy to GCP using a config JSON that contains the scheduled query's parameters and scheduled times through github actions?

So far, this is one option I've found that makes it more "automated":

- store query in a file on Cloud Storage. When invoking Cloud Function, you read the file content and you perform a bigQuery job on it.
    - have to update the file content to update the query
    - con: read file from storage, then call BQ: 2 api calls and query file to manage

Currently using DBT in other repos to automate and make this process quicker: https://docs.getdbt.com/docs/introduction

Would prefer the github actions version though, just haven't found a good docu yet :)

0 Answers
Related