How to write GCSToBigQueryOperator Dags?

Viewed 41

I connected PostgresToGCS And save my Data in GCS Then I want to use GCSToBIgqueryOperator with Sql query

But occur

airflow.exceptions.AirflowException:Invalid arguments were passed to GCSToBigQueryOperator(task_id:gcs_to_bigquery)

Already connected airlfow and GCP My GCS Data lol-data/game/mygame.csv [bucket/folder/data]

My Dags:

gcs_to_bigquery = GCSToBigQueryOperator(
    task_id = 'gcs_to_bigquery_task',
    gcp_conn_id='google_cloud_default',
    bucket= 'lol-data',
    source_objects=['game/mygame.csv'], 
    destination_project_dataset_table='airflow-project-362006.game.my-game',
    sql = f"SELECT * FROM game WHERE puuid='{puuid}';",
    source_format='csv'
)
0 Answers
Related