AWS Athena and processing only select files based on wildcard

Viewed 26

Hi i have an s3 bucket with multiple folders inside, each folder has multiple files

example:

bucket:
   folder1
      - file[0..n].gzip
      - anyOtherFile.gzip
   folder2
     - file[0..n].gzip
     - anyOtherFile.gzip

Does Athena have the functionality to process folders independently and wildcard files on that folder.. example file[??].gzip ignoring everything else in the folder?

I searched around and found that wildcard may not be possible unless i know before hand the file names. But how about folders... each folder represents a distinct set of data.

I would like to merge data from different folders.

0 Answers
Related