Dynamic Integration Runtime in Azure Data Factory (ADF)

Question

I have multiple IR for each client. I want to use one pipeline to copy data from client SAP system to Blob.

I have created all the configuration variables like in below code but i am not able to create parameter for Integration Runtime variable.

Is there any JSON syntax where we can make it dynamic.

{
    "name": "LS_SAP_TBL",
    "type": "Microsoft.DataFactory/factories/linkedservices",
    "properties": {
        "type": "SapTable",
        "annotations": [],
        "typeProperties": {
            "clientId": "@{linkedService().ClientId}",
            "language": "",
            "sncMode": false,
            "userName": "@{linkedService().userName}",
            "password": {
                "type": "AzureKeyVaultSecret",
                "store": {
                    "referenceName": "KAJDSKJDHLSJDFHALKFD",
                    "type": "LinkedServiceReference"
                },
                "secretName": "@{linkedService().SecretName}"
            },
            "server": "@{linkedService().server}",
            "systemNumber": "@{linkedService().systemNumber}"
        },
        "connectVia": {
            "referenceName": "@IntegrationRuntime_Param - Need to pass this dynamically",
            "type": "IntegrationRuntimeReference"
        },
        "parameters": {
            "SecretName": {
                "type": "String"
            },
            "ClientId": {
                "type": "String"
            },
            "userName": {
                "type": "String"
            },
            "server": {
                "type": "String"
            },
            "systemNumber": {
                "type": "String"
            },
            "IntegrationRuntime_Param": {
                "type": "String"
            }
        }
    }
}```

user_15969041 · Answer

Unfortunately, as of now there in no option to parameterize the Integration Runtime.

You can parameterize the different parameters in a single IR to use it for multiple resources. But different IRs can't be parameterize.

Please refer this similar request on Microsoft Q&A for better understanding.

Need help on parameterization of Integration Runtime and Azure Key vault Secrets on link service in Azure Data Factory pipeline

user_1920917 · Answer

Yes, I second UtkarshPal's response. I hope we get this option ASAP.

In our case, we do have multiple ADFs (one per project), and each ADF has it's own SHIR.

The only method to reuse linked services with self hosted IR is to give all SHIRs the same name..

P.S. - If we are having multiple SHIRs within a single ADF, then it's not possible to have same name.

Dynamic Integration Runtime in Azure Data Factory (ADF)

2 Answers