azure devops for ADF and databricks

Viewed 369

I am trying to create an azure ci/cd pipeline for my azure data factory in which I have used databricks notebook. Pipeline got created successfully with the ARM template for ADF but I am not able to see any override parameter for databricks workspace URL, that's why i got the same databricks URL in my dev and prod environment.

Can anyone help me to set databricks workspace URL for Dev and prod dynamically?

2 Answers

you need to create a token in qa and prod and use that in ur ci cd pipeline..tokens are unique all over and automatically linked to respective service

For anyone facing the same challenge, I just added this code to my arm-template-parameters-definition.json:

"AzureDatabricks": {
            "properties": {
                "typeProperties": {
                    "domain": "=",
                    "existingClusterId":"=",
                    "accessToken": {
                        "secretName": "="
                    }
                }
            }
        }

It will make the parameters explicit to be overriden.

If you are using the default template provided by Microsoft, I inserted the code just under the "ODBC" section factories/linkedServices.

Related