ó ßüÚ\c$@`s7ddlmZmZmZddlZddlZddlZddlZddlm Z ddl Z ddl Z ddl Z ddl mZmZddlmZmZddlmZddlmZddlmZmZmZdd lmZdd lmZdd lm Z m!Z!dd l"m#Z#dd l$m%Z%m&Z&ddl'm(Z(ej)dƒZ*e j+de,de,ƒZ-e j.de/de,ƒƒe j0dde1de2ƒe j3dde-ddddƒe j3dde-ddddƒe j3dde-ddddƒe j3dde5dddd ƒe j3d!de5dddd"ƒe j3d#de5dddd$ƒe j3d%de1dd&dd'ƒe j3d(d)de,d*e,de2dd+ƒe j3d,de1dddd-ƒe j3d.de1dddd/ƒe j3d0de1dddd1ƒe j3d2de1dddd3ƒe j3d4de5dddd5ƒe j3d6de5dd7dd8ƒe j3d9de1dd:dd;ƒe j3d<dd=dd>ƒe j3d?de,dd@ƒe j3dAde,ddBƒe j3dCde1dd:ddDƒe j3dEdd:de1ddFƒe j3dGde1dd:ddHƒe j3dIde1dd:ddJƒe j3dKde1ddddLƒe j3dMde1ddddNƒe j3dOde1dPe,dQe,ddRƒe j0dSdTdUde j6dVeƒdW„ƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒƒZ7dX„Z8e9dYkr3e8ƒndS(Zi(tprint_functiontdivisiontabsolute_importN(texit(tNannytWorker(tget_ip_interfacetparse_timedelta(t_ncores(tSecurity(tcheck_python_3turi_from_host_porttinstall_signal_handlers(tget_address_host_port(tvalidate_preload_argv(tenable_proctitle_on_childrentenable_proctitle_on_current(tvalmap(tIOLoopt TimeoutError(tgensdistributed.dask_workertexistst resolve_pathtcontext_settingstignore_unknown_optionst schedulerttypetrequireds --tls-ca-filetdefaultthelps'CA cert(s) file for TLS (in PEM format)s --tls-certs(certificate file for TLS (in PEM format)s --tls-keys(private key file for TLS (in PEM format)s --worker-ports,Serving computation port, defaults to randoms --nanny-ports&Serving nanny port, defaults to randoms --bokeh-ports$Deprecated. See --dashboard-addresss--dashboard-addresss:0s4Address on which to listen for diagnostics dashboards--bokeh/--no-bokehtbokeht show_defaultsLaunch Bokeh Web UIs--listen-addresssBThe address to which the worker binds. Example: tcp://0.0.0.0:9000s--contact-addresss}The address the worker advertises to the scheduler for communication with it and other workers. Example: tcp://127.0.0.1:9000s--hostsÉServing host. Should be an ip address that is visible to the scheduler and other workers. See --listen-address and --contact-address if you need different listen and contact addresses. See --interface.s --interfaces&Network interface like 'eth0' or 'ib0's --nthreadssNumber of threads per process.s--nprocsis7Number of worker processes to launch. Defaults to one.s--nametsŽA unique name for this worker like 'worker-1'. If used with --nprocs then the process number will be appended like name-0, name-1, name-2, ...s--memory-limittautosÂBytes of memory per process that the worker can use. This can be an integer (bytes), float (fraction of total system memory), string (like 5GB or 5000M), 'auto', or zero for no memory managements--reconnect/--no-reconnects&Reconnect to scheduler if disconnecteds--nanny/--no-nannys-Start workers in nanny process for managements --pid-filesFile to write the process PIDs--local-directorysDirectory to place worker filess --resourcess¶Resources for task constraints like "GPU=2 MEM=10e9". Resources are applied separately to each worker process (only relevant when starting multiple worker processes with '--nprocs').s--scheduler-filesXFilename to JSON encoded scheduler information. Use with dask-scheduler --scheduler-files--death-timeouts.Seconds to wait for a scheduler before closings--bokeh-prefixsPrefix for the bokeh apps --preloadtmultipletis_eagersWModule that should be loaded by each worker process like "foo.bar" or "/path/to/foo.py"t preload_argvtnargsiÿÿÿÿtcallbackc-#`sOtjƒ\}}}tj|d|d|dƒtƒtƒ|dk rhtjd|ƒ|}ntd|d|d|ƒ}|dkrµ|dkrµt j dƒt dƒn|dkr∠rât j d ƒt dƒn|r | r t j d ƒt dƒn|dkr5|r5t j d ƒt dƒn|sA|ra|rat j d ƒt dƒnyL|r…t |d t ƒ\}}n|r¦t |d t ƒ\}}n|}Wn4tk rã} t j dt| ƒƒt dƒnXˆró|}!n|}!|s t|}nˆrbtˆdƒ }"|"jttjƒƒƒWdQX‡fd†}#tj|#ƒni}$|rËyddlm}%Wntk r•qËX|r²|%i|d6f}&n|%}&|&|$d|f 1.sQFailed to launch worker. You cannot use the --no-nanny argument when nprocs > 1.sVFailed to launch worker. Must specify --listen-address when --contact-address is givensMFailed to launch worker. You cannot specify --listen-address when nprocs > 1.scFailed to launch worker. You cannot specify --listen-address when --worker-port or --host is given.tstrictsFailed to launch worker. twc`s&tjjˆƒr"tjˆƒndS(N(tostpathRtremove((tpid_file(s:lib/python2.7/site-packages/distributed/cli/dask_worker.pyt del_pid_files(t BokehWorkertprefixRt,t cs`s|]}|jdƒVqdS(t=N(tsplit(t.0tpair((s:lib/python2.7/site-packages/distributed/cli/dask_worker.pys 5st worker_porttlisten_addresstnannyt service_portssscheduler-addresssINeed to provide scheduler address like dask-worker SCHEDULER_ADDRESS:8786s'Can not specify both interface and hosttstscheduler_filetncorestservicestloopt resourcest memory_limitt reconnectt local_dirt death_timeouttpreloadR$tsecuritytcontact_addresstnamet-c3`s1ˆr-gˆD]}|jddƒ^q VndS(Nttimeouti(tclose(tn(tnanniesR;(s:lib/python2.7/site-packages/distributed/cli/dask_worker.pyt close_alltsc`stjd|ƒˆƒdS(NsExiting on signal %d(tloggertinfo(tsignum(RP(s:lib/python2.7/site-packages/distributed/cli/dask_worker.pyt on_signalzsc3`sPgˆD]}|jˆƒ^qVx(td„ˆDƒƒrKtjdƒVq$WdS(Ncs`s|]}|jdkVqdS(tclosedN(tstatus(R7RN((s:lib/python2.7/site-packages/distributed/cli/dask_worker.pys sgš™™™™™É?(t_starttallRtsleep(RN(taddrRO(s:lib/python2.7/site-packages/distributed/cli/dask_worker.pytrun~s!tcleanups End worker(1tgct get_thresholdt set_thresholdRRtNonetwarningstwarnR RQterrorRR tTruet ValueErrortstrRtopentwriteR,tgetpidtatexittregistertdistributed.bokeh.workerR1t ImportErrortreplaceR6tdictRtfloatRtcurrentRRtdasktconfigtgetRR RtrangeRt coroutineR trun_synctKeyboardInterruptRRR(-RthostR9R:RIt nanny_porttnthreadstnprocsR;RJRCR/RDRBRt bokeh_porttlocal_directoryR>t interfaceRFRGR$t bokeh_prefixR'ttls_certttls_keytdashboard_addresstg0tg1tg2tsect_tetporttfR0R@R1tresultRAtkwargstttiRTR[((RZRPROR;R/s:lib/python2.7/site-packages/distributed/cli/dask_worker.pytmain&sÆ­                  cC`stƒtƒdS(N(R R(((s:lib/python2.7/site-packages/distributed/cli/dask_worker.pytgoŽst__main__(:t __future__RRRRjtloggingR]R,tsysRRatclickRrt distributedRRtdistributed.utilsRRtdistributed.workerRtdistributed.securityR tdistributed.cli.utilsR R R tdistributed.commR tdistributed.preloadingRtdistributed.proctitleRRttoolzRttornado.ioloopRRttornadoRt getLoggerRQtPathRdtpem_file_option_typetcommandRotargumentRftFalsetoptionR`tintt UNPROCESSEDRR‘t__name__(((s:lib/python2.7/site-packages/distributed/cli/dask_worker.pyts       xÚ