Stream Aurora MySQL data changes into Kinesis Streams

user_7837626 0
Viewed 4681

I am trying to stream Aurora MySQL data changes to Kinesis streams. What could be the best possible way to do this considering the fact that each and every record should be streamed into kinesis.

amazon-kinesis amazon-aurora mysql
1 Answers

There are possibly numerous ways to do this, one of the popular one would be as follows:

  1. Enable binlogs in your cluster [1]
  2. Have a client (possibly a lambda function or an ec2 instance) that reads your binlog stream
  3. Create your Kinesis stream
  4. Make the client from Step 2 publish to your Kinesis stream from #3.

You can read articles [2] and [3] for reference. What you need is split between the two docs. ([3] is for postgres, but has some explanation about using lambdas or ec2 clients).

[1] https://aws.amazon.com/premiumsupport/knowledge-center/enable-binary-logging-aurora/

[2] https://aws.amazon.com/blogs/database/streaming-changes-in-a-database-with-amazon-kinesis/

[3] https://aws.amazon.com/blogs/database/stream-changes-from-amazon-rds-for-postgresql-using-amazon-kinesis-data-streams-and-aws-lambda/

user_30699190
Related