How to Auto scale workers in AWS step functions

user_8232707 0
Viewed 1645

We are implementing a process using AWS step functions. Some of the tasks in this process take long time. We are using Activities(workers) running in ECS instances for this step. The state machine is like this:

Trigger -> step 1 (Lambda) -> step2 (ECS) -> final step

Is there a way to find the number of tasks in queue waiting to be picked up by the step2 workers and use this information to auto scale the workers (ECS cluster)?

aws-step-functions amazon-web-services
2 Answers

I found here a very nice use case and for Step Function autoscaling.

I'm going to use some of those insights, such as using cloudwatch alarms to set get the current state (i.e. scale-up /scale-down decisions); using SQS to hold the alarms etc.

user_67925880
Related