View Dask Task Graph

Viewed 130

I am using the Dask submit and gather paradigm to do something like:

data_future = client.scatter(data, broadcast=True)

futures = []
for i in range(10):
    futures.append(dask.submit(some_func, i, data_future))

results = dask_client.gather(futures)

Is there some way to view/visualize the DAG in this paradigm after the computation has completed?

The documentation appears to be well suited for the Dask delayed paradigm. In case it matters, this is for a distributed cluster.

1 Answers

As of 2019-06-21, not really, no.

You can view it live on the dashboard's /graph page but there isn't any convenient code to render a static image of the graph today. I would say that this is in scope, but not something that current maintainers are thinking very hard about today.

Related