Needs to clean-up stale data from DynamoDB table which is older than 90 days by keeping cost as low as possible

Viewed 17

Use Case: Cleanup old telemetry data from very Big DynamoDb table based on timestamp which is older then 90 days

Date Size: 750 GB ( Ireland + Ohio + Beijing )

Item Count : 5000 million records

Sample Data:

{
    "deviceid": "a00a940c-b804-4806-a14f-7c713964fc65",
    "timestamp": 1661521317,
    "notifications": false,
    "payload": [
      {
        "n": "temprature",
        "v": "20"
      },
      {
        "n": "humidity",
        "v": "91"
      }
    ]
  }

Goal: Needs to clean-up stale data from DynamoDB table which is older than 90 days by keeping cost as low as possible

1 Answers
Related