How do I efficiently migrate MongoDB to azure CosmosDB with the help of azure Databricks?

Viewed 91

While searching for a service to migrate our on-premise MongoDB to Azure CosmosDB with Mongo API, We came across the service called, Azure Data Bricks. We have total of 186GB of data. which we need to migrate to CosmosDB with less downtime as possible. How can we improve the data transfer rate for that. If someone can give some insights to this spark based PaaS provided by Azure, It will be very much helpful. Thank you

1 Answers

Have you referred the article given on our docs page?

In general you can assume the migration workload can consume entire provisioned throughput, the throughout provisioned would give an estimation of the migration speed. You could consider increasing the RUs at the time of migration and reduce it later.

The migration performance can be adjusted through these configurations:

  • Number of workers and cores in the Spark cluster
  • maxBatchSize
  • Disable indexes during data transfer
Related