dask

Few useful tips how to configure Dask Scheduler with the aim of reducing the memory usage and its growth over time.

A collection of tips and tricks for setting up, configuring and deploying dask.distributed in Python projects. Most of topics covered focus on single tenant access pattern, where potentially multiple instances of the same application or a project submit tasks directly to Dask’s scheduler.