ó ßüÚ\c@`sädZddlmZmZmZddlmZddlm Z ddl Z ddl Z ddl Z ddl Z ddlmZe jeƒZe jƒZd„Zd ejfd „ƒYZed „Zd „Ze jƒZdS( sÌ Modified ThreadPoolExecutor to support threads leaving the thread pool This includes a global `secede` method that a submitted function can call to have its thread leave the ThreadPoolExecutor's thread pool. This allows the thread pool to allocate another thread if necessary and so is useful when a function realises that it is going to be a long-running job that doesn't want to take up space. When the function finishes its thread will terminate gracefully. This code copies and modifies two functions from the `concurrent.futures.thread` module, notably `_worker` and ThreadPoolExecutor._adjust_thread_count` to allow for checking against a global `threading.local` state. These functions are subject to the following license, which is included as a comment at the end of this file: https://docs.python.org/3/license.html ... and are under copyright by the Python Software Foundation Copyright 2001-2016 Python Software Foundation; All Rights Reserved i(tprint_functiontdivisiontabsolute_importi(t_concurrent_futures_thread(tEmptyN(ttimecC`sBtt_|t_zyñxçtjr|jW|jr€|jjƒ\}}|jj|ƒ|jj t j ƒƒ|j ƒPnWdQXy|j ddƒ}Wntk r²qnX|dk rÏ|jƒ~qtjsí|dksí|jr|jdƒdSqW~Wn$tk r,tjddtƒnXWdt`t`XdS(NttimeoutisException in workertexc_info(tTruet thread_statetproceedtexecutort _rejoin_lockt _rejoin_listtpopt_threadstaddtremovet threadingtcurrent_threadtsettgetRtNonetruntthreadt _shutdowntputt BaseExceptiontloggertcritical(R t work_queuet rejoin_threadt rejoin_eventttask((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pyt_worker's6            tThreadPoolExecutorcB`s5eZejƒZd„Zd„Zedd„Z RS(cO`sJtt|ƒj||Žg|_tjƒ|_|jddƒ|_dS(Ntthread_name_prefixtDaskThreadPoolExecutor( tsuperR#t__init__R RtLockR Rt_thread_name_prefix(tselftargstkwargs((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pyR'Js  c C`s‰t|jƒ|jkr…tjdtd|jdtjƒt |j ƒfd||j fƒ}t |_ |jj|ƒ|jƒndS(Nttargettnames-%d-%dR+(tlenRt _max_workersRtThreadR"R)tostgetpidtnextt_countert _work_queueRtdaemonRtstart(R*tt((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pyt_adjust_thread_countRs   c C`s®t¢|jt|_|jjdƒWdQX|dk rLtƒ|}n|r¤xO|jD]A}|dk r‡t |tƒdƒ}nd}|j d|ƒq\WnWdQXdS(NiR( t threads_lockt_shutdown_lockRRR6RRRRtmaxtjoin(R*twaitRtdeadlineR9ttimeout2((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pytshutdown^s    N( t__name__t __module__t itertoolstcountR5R'R:RRRB(((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pyR#Fs   cC`sItt_t4tjjjtjƒƒ|r?tjj ƒnWdQXdS(sw Have this thread secede from the ThreadPoolExecutor See Also -------- rejoin: rejoin the thread pool N( tFalseR R R;R RRRRR:(tadjust((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pytsecedens  cC`sntjƒ}tjƒ}tj}|j|jj||fƒWdQX|jd„ƒ|j ƒt t_ dS(s Have this thread rejoin the ThreadPoolExecutor This will block until a new slot opens up in the executor. The next thread to finish a task will leave the pool to allow this one to join. See Also -------- secede: leave the thread pool NcS`sdS(N(R(((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pyt‹t( RRtEventR R R R tappendtsubmitR?RR (Rteventte((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pytrejoin|s     (t__doc__t __future__RRRRKRRt compatibilityRR2tloggingRREtmetricsRt getLoggerRCRtlocalR R"R#RRIRQR(R;(((s=lib/python2.7/site-packages/distributed/threadpoolexecutor.pyts       (   /