Azure Data Factory Until loop slow to end/terminate

Viewed 27

We have an until loop in a ADFv2 pipeline. The time it takes to stop/terminate once the expression is met is a long time. Say another 60 mins or so.

The until loop performs alot of activites and can take anywhere between 90-120 mins to complete.

If I "hack" it so that it only performs a handful of activities it will quickly end once it's finished and met the expression to terminate.

Is there a corrolation between the length of time the until loop takes to completes its activities and the time it takes to decide to actually break out of the loop?

It's like a spinning wheel that keeps spinning even after the power is turned off. The momentum that was built up while connected takes a while to slow down and eventually stop.

How can I troubleshoot the exact cause here?

0 Answers
Related