So my situation is that I have about 120 million json files in S3 that I would like to query against using AWS Athena. I also have a JSON schema file. Is there a way I use the schema file to build the Athena table schema? The schema is quite complex, to the point that creating the schema by hand is untenable. It also seems ridiculous to scan all 120 million records with Glue when I already have access to the schema.
I've tried searching for answers to this question but I haven't been able to find anything that seemed quite relevant. Any thoughts?