A simple way to load dynamodb table with AWS Glue is to load with Glue Crawler. This is described in https://aws.amazon.com/blogs/database/simplify-amazon-dynamodb-data-extraction-and-analysis-by-using-aws-glue-and-amazon-athena/ Now I'm wondering if there is a way to load dynamodb table with AWS Glue ETL directly, say, without AWS Glue Crawler. I don't find any related topic so anyone could help is highly appreciated.
1 Answers
Finally found connection_options works without a crawler.
ddb_table = glueContext.create_dynamic_frame.from_options(
connection_type="dynamodb",
connection_options = {"dynamodb.input.tableName":"table_name", "dynamodb.throughput.read.percent":"0.5"}
)
Related