We are migrating our data from on-premise to the cloud. One requirement is to store the attachments (.pdf, .txt, .png etc) data from a SQL Server table in Azure blob containers in a particular format.
The table structure looks like this:
TABLE
(
Id int,
Name nvarchar,
EntityId int,
RecordId int,
BlobData image
)
The files should be saved in following way in the container.
Folder structure : Container//Entity ID//Record ID//Files
For example:
BlobContainer//10//1//xyz.pdf, png.png
Here I consider both files xyz and abc to belong to same entity (10) and record (1).
I tried Azure Data Factory, but I am unable to find a proper solution as I am facing a source sink mismatch issue when trying to use "Copy Data" activity in a pipeline.
Has anyone faced the same problem or do you have any other solution to complete this task?