When setting up amazon athena partitions to be used with Partition Project with a glue catalog. Does the order of partitions within the S3 bucket matter?
Example partition strategies:
- Partition by year/month/day.
s3://year=2022/month=01/day=21 - Partition by day/month/year.
s3://day=21/month=01/year=2022
Scenario 1: A query specifies year, month and day. Does one partition strategy execute the query faster? Does one partition strategy incur less costs - I imagine data scanned costs are the same, but what about costs incurred from S3 operations?
Scenario 2:. A query only specifies day. Does one partition strategy execute the query faster? Does one partition strategy incur less costs - again, I imagine data scanned costs are the same, but what about costs incurred from S3 operations?