B °F.\} ã@s:ddlmZmZmZddlZe e¡ZGdd„deƒZ dS)é)Úprint_functionÚdivisionÚabsolute_importNc@s>eZdZdZd dd„Zdd„Zdd„Zdd d „Zdd d „ZdS)ÚSchedulerPluginaÞ Interface to extend the Scheduler The scheduler operates by triggering and responding to events like ``task_finished``, ``update_graph``, ``task_erred``, etc.. A plugin enables custom code to run at each of those same events. The scheduler will run the analogous methods on this class when each event is triggered. This runs user code within the scheduler thread that can perform arbitrary operations in synchrony with the scheduler itself. Plugins are often used for diagnostics and measurement, but have full access to the scheduler and could in principle affect core scheduling. To implement a plugin implement some of the methods of this class and add the plugin to the scheduler with ``Scheduler.add_plugin(myplugin)``. Examples -------- >>> class Counter(SchedulerPlugin): ... def __init__(self): ... self.counter = 0 ... ... def transition(self, key, start, finish, *args, **kwargs): ... if start == 'processing' and finish == 'memory': ... self.counter += 1 ... ... def restart(self, scheduler): ... self.counter = 0 >>> c = Counter() >>> scheduler.add_plugin(c) # doctest: +SKIP NcKsdS)z2 Run when a new graph / tasks enter the scheduler N©)ÚselfÚ schedulerZdskÚkeysZ restrictionsÚkwargsrrú=lib/python3.7/site-packages/distributed/diagnostics/plugin.pyÚ update_graph*szSchedulerPlugin.update_graphcKsdS)z( Run when the scheduler restarts itself Nr)rrr rrr Úrestart.szSchedulerPlugin.restartcOsdS)a¥ Run whenever a task changes state Parameters ---------- key: string start: string Start state of the transition. One of released, waiting, processing, memory, error. finish: string Final state of the transition. *args, **kwargs: More options passed when transitioning This may include worker ID, compute time, etc. Nr)rÚkeyÚstartZfinishÚargsr rrr Ú transition1s zSchedulerPlugin.transitioncKsdS)z* Run when a new worker enters the cluster Nr)rrÚworkerr rrr Ú add_worker@szSchedulerPlugin.add_workercKsdS)z% Run when a worker leaves the clusterNr)rrrr rrr Ú remove_workerCszSchedulerPlugin.remove_worker)NNN)NN)NN) Ú__name__Ú __module__Ú __qualname__Ú__doc__r r rrrrrrr rs   r) Z __future__rrrZloggingZ getLoggerrZloggerÚobjectrrrrr Ús