Use Case: Cleanup old telemetry data from very Big DynamoDb table based on timestamp which is older then 90 days
Date Size: 750 GB ( Ireland + Ohio + Beijing )
Item Count : 5000 million records
Sample Data:
{
"deviceid": "a00a940c-b804-4806-a14f-7c713964fc65",
"timestamp": 1661521317,
"notifications": false,
"payload": [
{
"n": "temprature",
"v": "20"
},
{
"n": "humidity",
"v": "91"
}
]
}
Goal: Needs to clean-up stale data from DynamoDB table which is older than 90 days by keeping cost as low as possible