Access a single element in large published array with Dask

Viewed 535

Is there a faster way to only retrieve a single element in a large published array with Dask without retrieving the entire array?

In the example below client.get_dataset('array1')[0] takes roughly the same time as client.get_dataset('array1').

import distributed
client = distributed.Client()
data = [1]*10000000
payload = {'array1': data}
client.publish(**payload)

one_element = client.get_dataset('array1')[0]
1 Answers
Related