AWS Glue job to unzip a file from S3 and write it back to S3

user_13387714 0
Viewed 1047

I'm very new to AWS Glue, and I want to use AWS Glue to unzip a huge file present in a S3 bucket, and write the contents back to S3.

I couldn't find anything while trying to google this requirement.

My questions are:

  1. How to add a zip file as data source to AWS Glue?
  2. How to write it back to same S3 location?

I am using AWS Glue Studio. Any help will be highly appreciated.

aws-glue amazon-web-services amazon-s3
1 Answers

I couldn't find anything while trying to google this requirement.

You couldn't find anything about this, because this is not what Glue does. Glue can read gzip (not zip) files natively. If you have zip, then you have to convert all the files yourself in S3. Glue will not do it.

To convert the files, you can download them, re-pack, and re-upload in gzip format, or any other format that Glue supports.

user_2488230
Related