I have got a pipeline that parses records from AVRO files.
I need to split the incoming records into chunks of 500 items in order to call an API that takes multiple inputs at the same time.
Is there a way to do this with the Python SDK?
1 Answers
Related