σ ίόΪ\c@`sσddlmZmZmZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z ddlmZejeƒZdZd„Zd„Zd efd „ƒYZd efd „ƒYZdS( i(tprint_functiontdivisiontabsolute_importNi(tlocket(tfinalizes.dirlockcC`stjjdƒS(Ns#distributed.worker.use-file-locking(tdasktconfigtget(((s4lib/python2.7/site-packages/distributed/diskutils.pytis_locking_enabledscC`sVytj|ƒWn>tk rQ}|jtjkrRtjdt|ƒƒqRnXdS(NsFailed to remove %r(tostunlinktEnvironmentErrorterrnotENOENTtloggerterrortstr(tpathte((s4lib/python2.7/site-packages/distributed/diskutils.pyt safe_unlinks tWorkDircB`s5eZdZddd„Zd„Zed„ƒZRS(s8 A temporary work directory inside a WorkSpace. cC`sΤ|dks|dkst‚|dkrKtjd|d|jƒ|_n+tjj|j|ƒ|_tj |jƒt ƒr¬yΐtjj|jt ƒ|_ tjj |j ƒ sΊt‚tjd|j ƒy9|jƒ'tj|j ƒ|_|jjƒWdQXWn5tk r=}tjd|j dtƒd|_nXWn*tk rktj|jdtƒ‚nX|jj|j ƒt||j||j |j|jƒ|_n$t||j|dd|jƒ|_dS(Ntprefixtdirs Locking %r...syCould not acquire workspace lock on path: %s .Continuing without lock. This may result in workspaces not being cleaned uptexc_infot ignore_errors( tNonetAssertionErrorttempfiletmkdtemptbase_dirtdir_pathR RtjointmkdirRt DIR_LOCK_EXTt _lock_pathtexistsRtdebugt _global_lockRt lock_filet _lock_filetacquiretOSErrort exceptiontTruet Exceptiontshutiltrmtreet _known_lockstaddRt _finalizet _finalizer(tselft workspacetnameRR((s4lib/python2.7/site-packages/distributed/diskutils.pyt__init__(sB !    cC`s|jƒdS(s, Dispose of this directory. N(R2(R3((s4lib/python2.7/site-packages/distributed/diskutils.pytreleaseYscC`s[z|j|ƒWd|dk r-|jƒn|dk rV|jj|ƒt|ƒnXdS(N(t_purge_directoryRR7R/tremoveR(tclsR4t lock_pathR&R((s4lib/python2.7/site-packages/distributed/diskutils.pyR1_s   N(t__name__t __module__t__doc__RR6R7t classmethodR1(((s4lib/python2.7/site-packages/distributed/diskutils.pyR#s1 t WorkSpacecB`sqeZdZeƒZd„Zd„Zd„Zd„Zd„Z d„Z d„Z d„Z d „Z d „ZRS( sΠ An on-disk workspace that tracks disposable work directories inside it. If a process crashes or another event left stale directories behind, this will be detected and the directories purged. cC`sYtjj|ƒ|_|jƒtjj|jdƒ|_tjj|jdƒ|_dS(Ns global.locks purge.lock(R RtabspathRt_init_workspaceRt_global_lock_patht_purge_lock_path(R3R((s4lib/python2.7/site-packages/distributed/diskutils.pyR6vs cC`sFytj|jƒWn+tk rA}|jtjkrB‚qBnXdS(N(R R RR R tEEXIST(R3R((s4lib/python2.7/site-packages/distributed/diskutils.pyRB|s cK`stj|j|S(N(RR&RC(R3tkwargs((s4lib/python2.7/site-packages/distributed/diskutils.pyR%ƒscK`stj|j|S(N(RR&RD(R3RF((s4lib/python2.7/site-packages/distributed/diskutils.pyt _purge_lock†scC`sμtƒs gS|jddƒ}y|jƒWntjk rDgSXzt|jƒƒ}Wd|jƒXg}|jddƒ}y|jƒWntjk r₯nCXz4x-|D]%}|j |ƒr°|j |ƒq°q°WWd|jƒX|S(Nttimeouti( RR%R(Rt LockErrortlistt_list_unknown_locksR7RGt_check_lock_or_purgetappend(R3tlockt candidatestpurgedR((s4lib/python2.7/site-packages/distributed/diskutils.pyt_purge_leftovers‰s,    cc`suxntjtjj|jdtƒƒD]G}ytj|ƒ}Wntk rRq&Xtj|j ƒr&|Vq&q&WdS(Nt*( tglobR RRRR!tstatR tS_ISREGtst_mode(R3tptst((s4lib/python2.7/site-packages/distributed/diskutils.pyRK°s, cC`stj|d|jƒdS(Ntonerror(R-R.t_on_remove_error(R3R((s4lib/python2.7/site-packages/distributed/diskutils.pyR8ΌscC`sΦ|jtƒst‚||jkr(tStjd|ƒtj|ddƒ}y|j ƒWntj k rrtSXzG|t tƒ }t j j|ƒrΉtjd|ƒ|j|ƒnWd|jƒXt|ƒtS(s¬ Try locking the given path, if it fails it's in use, otherwise the corresponding directory is deleted. Return True if the lock was stale. sChecking lock file %r...RHis/Found stale lock file and directory %r, purgingN(tendswithR!RR/tFalseRR$RR&R(RItlenR RR#tinfoR8R7RR+(R3R;RNR((s4lib/python2.7/site-packages/distributed/diskutils.pyRLΏs"  cC`s/|\}}}tjd||t|ƒƒdS(Ns&Failed to remove %r (failed in %r): %s(RRR(R3tfuncRRttyptexcttb((s4lib/python2.7/site-packages/distributed/diskutils.pyRZέscK`sBy|jƒWn$tk r4tjddtƒnXt||S(s₯ Create and return a new WorkDir in this WorkSpace. Either the *prefix* or *name* parameter should be given (*prefix* is preferred as it avoids potential collisions) Parameters ---------- prefix: str (optional) The prefix of the temporary subdirectory name for the workdir name: str (optional) The subdirectory name for the workdir s<Failed to clean up lingering worker directories in path: %s R(RQR)RRR+R(R3RF((s4lib/python2.7/site-packages/distributed/diskutils.pyt new_work_dirαs   (R<R=R>tsetR/R6RBR%RGRQRKR8RLRZRc(((s4lib/python2.7/site-packages/distributed/diskutils.pyR@ks      '   (t __future__RRRR RStloggingR R-RTRRtRt compatibilityRt getLoggerR<RR!RRtobjectRR@(((s4lib/python2.7/site-packages/distributed/diskutils.pyts           H