I'm using the Big Query python API to run a sql script on Big Query with the 'WRITE_APPEND' disposition to add the results to an existing table.
I achieve this via bigquery.Client.query(), accessing the result with the result.to_dataframe() method which currently returns the entire destination table, whereas I'd like only the newly generated rows to be returned.
There are a few ways I could get round this, but I'd like to know if there's a way of only returning the rows appended to the existing table, rather than all the rows in that table.