ó ßüÚ\c@`s©ddlmZmZmZddlZddlmZddlZddlZddl m Z ddl m Z ddl mZddlmZmZmZd d lmZd d lmZmZmZd d lmZmZd d lmZd dlmZm Z m!Z!m"Z"m#Z#ej$e%ƒZ&d„Z'de(fd„ƒYZ)de)fd„ƒYZ*de)fd„ƒYZ+de(fd„ƒYZ,de,fd„ƒYZ-d„ZdS(i(tprint_functiontdivisiontabsolute_importN(t default_timer(tvalmap(tgen(tIOLoopi(t format_timetProgresst MultiProgressi(t html_escape(tconnecttcoerce_to_addresstCommClosedError(tdefault_clientt futures_of(tdumps(tignoringt key_splitt is_kernelt LoopRunnertparse_timedeltacC`s#|dkrtƒjjSt|ƒS(N(tNoneRt schedulertaddressR (R((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyt get_schedulers  t ProgressBarcB`sMeZdded„Zed„ƒZejd„ƒZ d„Z d„Z RS(t100mscC`s’t|ƒ|_d|_x6|D].}t|dƒrtj|jƒ|_PqqWd„|Dƒ|_t|ddƒ|_ ||_ t ƒ|_ dS(NtclientcS`s.h|]$}t|dƒr$|jn|’qS(tkey(thasattrR(t.0tk((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pys (s tdefaultts( RRRRRtweakreftreftkeysRtintervaltcompleteRt _start_time(tselfR%RR&R'R((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyt__init__s   cC`stƒ|jS(N(RR((R)((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pytelapsed-sc#`s…|j‰|j‰tj‡‡fd†ƒ}d„}t|jd|jrZ|jƒjndƒV|_ t j dƒ|j j idd6t |ƒd6t |ƒd6|jd 6d |jrÆ|jƒjndƒVx£trsy2|j jd |jrþ|jƒjndƒV}Wntk rPnX||_|d |_|j||d dkrÑ|j jƒV|j|PqÑqÑWt j dƒdS(Nc3`s3tˆ|dˆƒ}|jƒVtj|ƒ‚dS(NR'(RtsetupRtReturn(Rtp(R'R%(sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR,6s cS`sVit|jƒd6t|jƒd6|jd6}|jdkrR|j|jƒn|S(Ntallt remainingtstatusterror(tlentall_keysR%R1tupdatetextra(RR.tresult((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pytfunction<s tconnection_argss"Progressbar Connected to schedulertfeedtopR,R8R&t serializerst deserializersR1R2tfinisheds'Progressbar disconnected from scheduler(R2R>(R'R%Rt coroutineR RRR9RtcommtloggertdebugtwriteRR&t _serializerstTruetreadt_deserializersR t_last_responseR1t _draw_bartcloset _draw_stop(R)R,R8tresponse((R'R%sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pytlisten1s:    %        &     cK`sdS(N((R)tkwargs((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRKgscC`s$ttƒ|jjƒWdQXdS(N(RtAttributeErrorR@tabort(R)((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyt__del__js N( t__name__t __module__RRER*tpropertyR+RR?RMRKRQ(((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRs 6 tTextProgressBarcB`s5eZddddeed„Zd„Zd„ZRS(Ri(c C`sftt|ƒj||||ƒ||_|p4tƒ|_|rbt|jƒ}|j|jƒndS(N( tsuperRUR*twidthRtloopRtrun_syncRM( R)R%RR&RWRXR'tstartt loop_runner((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR*ps  c K`sŸ|rd||nd}dt|j|ƒ}td|ƒ}t|jƒ}dj||j||ƒ}ttƒ"tjj |ƒtjj ƒWdQXdS(Nigð?t#ids" [{0:<{1}}] | {2}% Completed | {3}( tintRWRR+tformatRt ValueErrortsyststdoutRCtflush( R)R0R/RNtfractbartpercentR+tmsg((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRI‚s cK`s!tjjdƒtjjƒdS(Ns (R`RaRCRb(R)RN((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRKŽsN(RRRSRRER*RIRK(((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRUos tProgressWidgetcB`sAeZdZddedd„Zd„Zdd„Zd„ZRS(s¼ ProgressBar that uses an IPython ProgressBar widget for the notebook See Also -------- progress: User function TextProgressBar: Text version suitable for the console Rc C`s·tt|ƒj||||ƒddlm}m}m}m} | dƒ|_|ddddddƒ|_ | dƒ|_ ||j |j gƒ|_ ||j|j gƒ|_ dS(Ni(t FloatProgresstHBoxtVBoxtHTMLttmintmaxit description( RVRgR*t ipywidgetsRhRiRjRkt elapsed_timeRdtbar_textt bar_widgettwidget( R)R%RR&R'RXRhRiRjRk((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR*œs"cK`s&tjƒj|jƒ|jj|S(N(Rtcurrentt add_callbackRMRtt_ipython_display_(R)RN((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRwªscK`s€|dkrJd|j_dt|ƒdt|jƒdd|j_n2|s|d|j_dt|jƒd|j_ndS( NR2tdangers=
Exception s:t s
tsuccesss9
Finished: (Rdt bar_styletreprRR+Rqtvalue(R)R0R1t exceptionRN((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRK®s   2 cK`s]||}dt|jƒd|j_|r7||nd|j_d||f|j_dS(Ns:
Computing: s
gð?sH
%d / %d
(RR+RqR}RdRr(R)R0R/RNtndone((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRIÂs  N( RRRSt__doc__RtFalseR*RwRKRI(((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRg“s   tMultiProgressBarcB`sPeZdeded„Zed„ƒZej d„ƒZ d„Z d„Z RS(RcC`st|ƒ|_d|_x6|D].}t|dƒrtj|jƒ|_PqqWd„|Dƒ|_||_||_ ||_ t ƒ|_ dS(NRcS`s.h|]$}t|dƒr$|jn|’qS(R(RR(RR ((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pys Üs ( RRRRRR#R$R%tfuncR&R'RR((R)R%RRƒR&R'R((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR*Ñs     cC`stƒ|jS(N(RR((R)((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR+âsc#`sZ|j‰|j‰|j‰tj‡‡‡fd†ƒ}d„}t|jd|jrf|jƒjndƒV|_ t j dƒ|j j idd6t|ƒd6t|ƒd6|jd 6ƒVxŠtrH|j jd |jré|jƒjndƒV}||_|d |_|j||d dkr¿|j jƒV|j|Pq¿q¿Wt j dƒdS(Nc3`s9tˆ|dˆdˆƒ}|jƒVtj|ƒ‚dS(NR'Rƒ(R R,RR-(RR.(R'RƒR%(sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR,ìs cS`s\itt|jƒd6tt|jƒd6|jd6}|jdkrX|j|jƒn|S(NR/R0R1R2(RR3R4R%R1R5R6(RR.R7((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR8òs R9s"Progressbar Connected to schedulerR:R;R,R8R&R=R1R2R>s'Progressbar disconnected from scheduler(R2R>(R'R%RƒRR?R RRR9RR@RARBRCRR&RERFRGRHR1RIRJRK(R)R,R8RL((R'RƒR%sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRMæs4     %      "    cK`sdS(N((R)RN((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRKscC`s$ttƒ|jjƒWdQXdS(N(RROR@RP(R)((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRQs N( RRRSRRRR*RTR+RR?RMRKRQ(((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR‚Ðs 2 tMultiProgressWidgetcB`sPeZdZdddeed„Zd„Zd„Zddd„Z d„Z RS( sU Multiple progress bar Widget suitable for the notebook Displays multiple progress bars for a computation, split on computation type. See Also -------- progress: User-level function <--- use this MultiProgress: Non-visualization component that contains most logic ProgressWidget: Single progress bar widget igš™™™™™¹?cC`sEtt|ƒj|||||ƒddlm}|gƒ|_dS(Ni(Rj(RVR„R*RpRjRt(R)R%RtminimumR&RƒR'Rj((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR*-s c `sddlm‰m}m}m‰ˆdƒ|_‡fd†|Dƒ|_‡fd†|Dƒ|_‡fd†|Dƒ|_d„}gt |j ƒd|d t ƒD]\}}|^q¤}|g|D]0}||j||j||j|gƒ^qƃ|_ |j|j f|j _dS( Ni(RhRiRjRkRlc `s.i|]$}ˆddddddƒ|“qS(RmiRniRoRl((RR(Rh(sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pys As c`si|]}ˆdƒ|“qS(Rl((RR(Rk(sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pys Bs c`sHi|]>}ˆdtt|tƒr0|jƒn|ƒdƒ|“qS(sQ
s
(R t isinstancetbytestdecode(RR(Rk(sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pys Ds cS`s|ddd…S(s2 Order keys by most numerous, then by string name Niÿÿÿÿ((tkv((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pytkeyfuncNsRtreverse(RpRhRiRjRkRqtbarst bar_textst bar_labelstsortedtitemsREt bar_widgetsRttchildren( R)R/RiRjRŠR tvt key_orderR((RhRksBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyt make_widget=s"   7@cK`s&tjƒj|jƒ|jj|S(N(RRuRvRMRtRw(R)RN((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRw\scK`s©xC|jƒD]5\}}|s2d|j|_q d|j|_q W|dkrˆddt|ƒdt|jƒdd|j_nd t|jƒd|j_dS( NRzRxR2s9
Exception ss:Rys
s9
Finished: (RRŒR{R|RR+RqR}(R)R0R1R~RRNR R“((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRK`s 6cK`s¬|jr&|jj r&|j|ƒnx|jƒD]q\}}|||}dt|jƒd|j_|rz||nd|j |_d||f|j |_q3WdS(Ns:
Computing: s
gð?sH
%d / %d
( R%RtR’R•RRR+RqR}RŒR(R)R0R/R1RNR tntasksR((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyRIys N( RRRSR€RRRR*R•RwRKRI(((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyR„ s   cO`sÓ|jddƒ}|jdtƒ}|jdtƒ}| sCt‚t|ƒ}t|ttfƒsp|g}n|dkrˆtƒ}n|r¿|r©t |d|ƒ}nt |d|ƒ}|St |d|ƒdS(sÅ Track progress of futures This operates differently in the notebook and the console * Notebook: This returns immediately, leaving an IPython widget on screen * Console: This blocks until the computation completes Parameters ---------- futures: Futures A list of futures or keys to track notebook: bool (optional) Running in the notebook or not (defaults to guess) multi: bool (optional) Track different functions independently (defaults to True) complete: bool (optional) Track all keys (True) or only keys that have not yet run (False) (defaults to True) Notes ----- In the notebook, the output of `progress` must be the last statement in the cell. Typically, this means calling `progress` at the end of a cell. Examples -------- >>> progress(futures) # doctest: +SKIP [########################################] | 100% Completed | 1.7s tnotebooktmultiR'N( tpopRREtAssertionErrorRR†tsettlistRR„RgRU(tfuturesRNR—R˜R'Rd((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pytprogressŠs     (.t __future__RRRtloggingttimeitRR`R#ttoolzRttornadoRttornado.ioloopRRžRRR t compatibilityR tcoreR R R RRRtprotocol.pickleRtutilsRRRRRt getLoggerRRRARtobjectRRURgR‚R„(((sBlib/python2.7/site-packages/distributed/diagnostics/progressbar.pyts*   ( Q$=Pj