Read from delta lake, transform into json and send on service bus

Viewed 66

I have question about architecture in azure environment. I have tables on azure delta lake. Naturally would be reading them with azure databricks, but there is condition to transform parquet into json and then send it into azure service bus. I found and tested packages for python, which allow for sending transformed json directly from azure databricks. I have also read that generally azure event hub is meant for such situation instead of azure service bus. There are ready connectors for it. Do you know performance difference between both solutions? Maybe there is also other way for sending such data to azure service bus with some other 'intermediate resource'.

0 Answers
Related