ó ßüÚ\c@`sddlmZmZmZddlmZddlmZmZddl m Z ddl m Z ddl mZmZmZmZddlmZmZmZmZddlmZmZdd lmZd „Zed ed d"gdƒd„ƒZd„Zeeddƒd„ƒƒZed ed d#gdddƒd„ƒZeddƒd„ƒZ eƒd„ƒZ!edd!ƒd„ƒZ#edd!ƒd„ƒZ$eddƒd„ƒZ%d„Z&edd!ƒd„ƒZ'edd!ƒd„ƒZ(ed ed gƒd „ƒZ)d!S($i(tprint_functiontdivisiontabsolute_import(tsleep(t frequenciestpluck(tgen(tIOLoop(tClienttwaittAdaptivet LocalCluster(t gen_clustertgen_testtslowinctinc(tlooptnodebug(ttimec C`sçtddddtddd|ƒ½}t|j|dddd ƒ}|jƒid d 6ksdt‚t|d|ƒe}|jd „d ƒ}|j ƒd ks¦t‚|j ƒs¸t‚|jƒid d 6ks×t‚WdQXWdQXdS(Nitscheduler_portt silence_logstdashboard_addressRtintervalidt scale_factoriitncS`s|dS(Ni((tx((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pytti( R tFalsetNoneR t schedulertget_scale_up_kwargstAssertionErrorRtsubmittresulttncores(Rtclustertalctctfuture((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyttest_get_scale_up_kwargss!tclientR#s 127.0.0.1iicg`sÝdtfd„ƒY}dtfd„ƒY}|ƒ}d|jds"!   ttimeoutic c`s¥tddddtdtdddtƒV}z\d|j_|jdd ƒ}t|dtƒV}|jt t d ƒd d ƒ}t ƒ}x@|jj sÈt jd ƒVt ƒ|d ks‰t|jƒ‚q‰W|j|ƒV~t ƒ}x@|jj r%t jd ƒVt ƒ|d ksæt|jƒ‚qæW|jj s9t‚t jd ƒV|jj sZt‚|jt t d ƒd d ƒ}|j|ƒVWd|jƒV|jƒVXdS(NiRRt processesRt asynchronousièRidtdelayg{®Gáz„?igš™™™™™É?(R RRtTrueRtallowed_failurestadaptRR9RtrangeRR2RRR tlogtgathertclose(R$R%R&tfuturesR?((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyt)test_adaptive_local_cluster_multi_workersVs:   & & i tactive_rpc_timeoutc g`sždtfd„ƒY}dtfd„ƒY}t|jƒdksGt‚|ƒ}|||dddd d dƒ}tjd ƒVt|jƒdksšt‚dS( NR*cB`seZd„Zd„ZRS(c_`s,|jddƒ|_tj|||ŽdS(Ntmin_sizei(tpopROR t__init__(R+targsR0((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyRQ‡sc[`sUt|jjƒ}|jj|}|t|ƒ|jkrQ|||j }n|S(N(R:RR2tworkers_to_closeRO(R+R0t num_workerstto_close((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyRS‹s (R-R.RQRS(((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyR*†s R/cB`seZd„Zd„ZRS(c[`sts t‚dS(N(RR (R+RR0((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyR1”scS`sts t‚dS(N(RR (R+R2((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyR3—s(R-R.R1R3(((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyR/“s i ROiRgš™™™™™¹?Rg333333Ó?(R R7R:R2R RR(R&R<R2R*R/R$R=((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyt!test_adaptive_scale_down_override„s  !cc`sÈtjƒ}tddddtdtddd|dtƒV}|jƒVzbt|j|dd d d d d ddƒ}t |dtd|ƒV}t ƒ}x7|jj sÐt j dƒVt ƒ|d ksšt‚qšWt j dƒVt|jj ƒd ksýt‚ttd |jƒƒid d6ks(t‚|jttdƒddƒ}t ƒ}xCt|jj ƒd kr”t j dƒVt ƒ|d ksRt‚qRWt|jj ƒd ks³t‚t j dƒVt|jj ƒd ksßt‚t|j ƒd ksút‚ttd |jƒƒid d6ks%t‚~t ƒ}xCt|jj ƒd krvt j dƒVt ƒ|d ks4t‚q4Wttd |jƒƒid d6d d6ks©t‚Wd|jƒV|jƒVXdS(NiRRRBRRRCtminimumitmaximumiRs20 mst wait_counti g{®Gáz„?gš™™™™™É?tupidRDgš™™™™™¹?gà?tdown(RtcurrentR RRREt_startR RRRR2RRR R:RRRIR9RRHRK(RR$RGR&R?RL((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyt test_min_max¥sX     + + 6 c c`såtddtdtdddtddƒV}t|dtƒV}z‰t|j|ddd d ƒ}x9td ƒD]+}|jt |d d ƒVt j d ƒVqlWt t d|jƒƒidd6ksÆt‚Wd|jƒV|jƒVXdS(s» We want to avoid creating and deleting workers frequently Instead we want to wait a few beats before removing a worker in case the user is taking a brief pause between work iRCRBRRRRs20 msRYii RDg{®Gáz¤?iRZN(R RERRRR RRHR!RRRRRRIR RK(R$R)RGti((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyttest_avoid_churnßs  / c c`sotddtdtdddtddƒV}t|dtƒV}t|j|ddd d d d ƒ}zï|jtd ddƒ}t |ƒVt |j ƒd ks£t ‚|j ttdƒddƒ}x7ttd |j ƒƒid d6krútjdƒVqÄWt |j ƒdkst ‚d|j dks/t ‚g|j dD]}t|tƒr=|^q=d}d|dko€|jkns‹t ‚x-t |jjƒ|jkrºtjdƒVqŽW~x*t |jjƒd krêtjdƒVqÁW|jd ƒV}x&tdƒD]}|jt|ƒ}qWtjdƒVt |jjƒd ksPt ‚Wd|jƒV|jƒVXdS(s» We want to avoid creating and deleting workers frequently Instead we want to wait a few beats before removing a worker in case the user is taking a brief pause between work iRCRBRRRRiRYiRXi iRDgš™™™™™¹?ièRZg{®Gáz„?iiÿÿÿÿRidN(R RERRRR RR!RR R:RIR R9RHRRRRt isinstancetdictRXR2tscatterRK(R$R)RGR'RLRtdR_((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyttest_adapt_quicklyüs@ $ (3)" c c`s tddtdtdddtddƒV}t|dtƒV}|jddd d ƒz®|jttd ƒd d ƒ}x*t |j j ƒd kr¡t j d ƒVqxW|jd dƒtƒ}xCt |j j ƒdkrt j d ƒVtƒ|dks¾t‚q¾WWd|jƒV|jƒVXdS(sC Ensure that redefining adapt with a lower maximum removes workers iRCRBRRRRt20msRXiièRDgš™™™™™¹?iiN(R RERRRRGR9RRHR:RR2RRRR RK(R$R)RLR?((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyttest_adapt_down/s(  ! cc`sìtjƒ}tddddtdtddd|dtƒV}|jƒVz†t|j|ddd d d d ƒ}t |dtd|ƒV}d |jj d<|j t dddƒVt |jjƒdksÍt‚Wd|jƒV|jƒVXdS(NiRRRBRRRCRWRXiRs10 msièRiRDgš™™™™™¹?(RR\R RRRER]R RRR8R!RR:R2R RK(RR$RGR)((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyttest_no_more_workers_than_tasksMs&   !" c C`s˜z€tddddtddƒ\}t|ƒ>}|jƒ|jd„dƒ}|jƒdksjt‚WdQX|j}WdQXWd|j |j ƒXdS(NiRRRcS`s|dS(Ni((R((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyRpRii( R RRRRGR!R"R Rt add_callbacktstop(R$R)R'R((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyttest_basic_no_loopis c c`sWtddtdtdddtddƒV}t|dtƒV}|jddd d d d ƒ}d |jjdºs N(R RERRt start_workerR:RR2RRt_adaptive_optionsRGt_adapttvaluesR RK(R$R6Rntnames((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyttest_worker_keys˜s.   .cc`sitd|ƒ}|jtdƒ}x|js>tjdƒVq$W|jjƒV}|ddkset‚dS(NRig{®Gáz„?tstatusRZ( R R!RttasksRRRtadaptive_recommendationsR (R&R<RGR'tresponse((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyttest_without_clusterÀs  N(s 127.0.0.1i(s 127.0.0.1i(*t __future__RRRRRttoolzRRttornadoRttornado.ioloopRt distributedRR R R tdistributed.utils_testR R RRRRtdistributed.metricsR(RER>R@RMRVR^R`RReRgRhRkRoR{R€(((sElib/python2.7/site-packages/distributed/deploy/tests/test_adaptive.pyts."" % -+!:3 !(