DIU not going beyond 4

user_11704105 0
Viewed 531

For a simple Copy activity that copies from ADLS Gen1 to Gen2, I set DIU to 32 but this doesn't reflect when I run the copy activity. If I set DIU to Auto, even then the DIU is always 4 but never more than that. (ParallelCopies setting do reflect properly) Region for Gen1, Gen2, Default Azure IR--> East US 2

Attaching screenshots with some details.

Any suggestions please?

Copy - Input and Output results

azure-data-factory-2 azure-data-factory
2 Answers

The range of DIU setting is 2-256.However, specific behaviors of DIU in different copy scenarios are different even though you set the number as you want.

Please see the table list here,especially for the below part:

enter image description here

DIU has some limitations as you seen,so you could choose the optimal setting with your custom scenario.

user_81989460

I was trying to copy 1GB data, thus somehow DIU never crossed 4.

But when I tried to copy 10GB data, I noticed DIU started scaling up beyond 4.

user_117041050
Related