Hi i have an s3 bucket with multiple folders inside, each folder has multiple files
example:
bucket:
folder1
- file[0..n].gzip
- anyOtherFile.gzip
folder2
- file[0..n].gzip
- anyOtherFile.gzip
Does Athena have the functionality to process folders independently and wildcard files on that folder.. example file[??].gzip ignoring everything else in the folder?
I searched around and found that wildcard may not be possible unless i know before hand the file names. But how about folders... each folder represents a distinct set of data.
I would like to merge data from different folders.