BigQuery supposedly hourly partitioned tables show up as different tables

Viewed 360

When I push data to BQ using pandas (to_gbq()) the ones which are supposed to be hourly partitioned tables, show up as different tables with same naming convention e.g.:

enter image description here

The naming convention I made for each table is yyyyMMddHH as can be seen in above screenshot. Same as described in official documentation here:

A valid entry from the bound DATE, TIMESTAMP or DATETIME column. Currently, date values prior to 1960-01-01 and later than 2159-12-31 are placed in a shared UNPARTITIONED partition. NULL values reside in an explicit NULL partition.

Partitioning identifiers must follow the following formats:

yyyyMMddHH for hourly partitioning.

yyyyMMdd for daily partitioning.

yyyyMM for monthly partitioning.

yyyy for yearly partitioning.

However still they does show up as separate tables. I also made simple daily partitioned tables with daily naming conventions and they seem to show up fine. Problem is just with the hourly partitioned tables.

0 Answers
Related