We are currently using Stitchdata to periodically sync data over from a PostgreSQL instance to a BigQuery instance. The data is used for building reports. Stitchdata allows a pipeline to be built with a few checkboxes and options without the need for coding.
I am wondering if Google Cloud Platform offers a solution to allow a PostgreSQL database (hosted with GCP) to be synced to a BigQuery table. This is for the purpose of data sovereignty and user data privacy issues.
We do not want to use federated queries since we only want certain columns to be imported to BigQuery from PostgreSQL.
I have looked at:
- Datastream + Data Fusion (Datastream does not support Postgres yet)
- BigQuery Data Transfer + Fivetran Postgres Connector (This will cause the data to be transferred to third-party processor.)
- Data Fusion (Replication is not supported for PostgreSQL)
I am curious if I am missing anything glaring obvious with what Google Cloud Platform offers to sync data from our PostgreSQL database into BgigQuery.
Cheers