Create pipeline in Azure that runs R script without generalizing the VM

Viewed 270

I have an R script that I need to run once every week. I need it to be done using Azure. One option is to use Azure Data Factory and set up a pipline what will run this R script on a VM (Windows).

The problem I'm facing is that I will have to update every now and then both the R script and the R packages the R script is using.

When setting up this pipeline I will have to generalize the VM (correct me if I'm wrong) and doing so I can no longer log into this VM. And if I can't log into this VM I cannot update the R packages.

What options do I have here?

1 Answers

There is an alternate solution where you can use Azure Batch Service and Azure Data Factory to execute R scripts in your pipeline.

For more information, you can refer this blog: How to execute R Scripts using Azure Batch Services and Azure Data Factory? | by Aditya Kaushal | Medium

Alternatively, to run R scripts in your VM, you can use below options:

  • Custom Script Extension
  • Run Command
  • Hybrid Runbook Worker
  • Serial console

Reference: Run scripts in an Azure Windows VM - Azure Virtual Machines | Microsoft Docs

Related