B F.\@s dZddlmZddlZddlZy ddlZWnek rHddlZYnXddlm Z ddl Z ddl m Z ddl mZddlmZddlmZdd l mZdd lmZdd lmZmZdd lmZd ZddZdddZdddZie_dddZ dddZ!d ddZ"dS)!zUtilities for integrating with IPython These functions should probably reside in Jupyter and IPython repositories, after which we can import them instead of having our own definitions. )print_functionN)Popen)Thread)uuid4) TimeoutError)IOLoop)Event) get_ipython)BlockingKernelClientwrite_connection_file)jupyter_runtime_dir c Cs0||}t|dd}|r2|jj}|jj}|jj}xy|jtd}Wntj k rbt dYnX|d d|krxq4|dd} |d } | d kr| d d krPq4| d krtt | d} | | dq4| dkr4|r|j|| | |dn<| dkrtd| dt jdnt j | d ddq4q4WdS)ziRun a cell on a KernelClient Any output from the cell will be redisplayed in the local session. kernelF)timeoutz"Timeout waiting for IPython output parent_headermsg_idheadermsg_typecontentZstatusZexecution_stateZidlestreamnametext)Z display_dataZexecute_resulterror)parentr traceback)filedataz text/plainN)ZexecutegetattrZ display_pubZ pub_socketsessionrZ get_iopub_msgOUTPUT_TIMEOUTqueueZEmptyrgetsyswritesendprintjoinstderrstdout) ipkccellrZ in_kernelZsocketr rmsgrrrr/9lib/python3.7/site-packages/distributed/_ipython_utils.pyrun_cell_remote!s8     r1workercsltt|}|d}tf||j_dfdd }|_j|d|dj|d|ddS) zRegister a %worker magic, given connection_info. Both a line and cell magic are registered, which run the given cell in a remote kernel. keyNcs|dkr |}t|dS)z/Run the current cell on a remote IPython kernelN)r1)liner-)r+r,r/r0remoteXsz%register_worker_magic..remoter4) magic_kind magic_namer-)N) r dictpopr r r3start_channelsZclientregister_magic_function)connection_infor7infor3r5r/)r+r,r0register_worker_magicKs  r>c Cst}|dd}|d}||jkr,t|t|j|}|sZt|dkrRtd|d}dtt t | }| d}|t jkrt j|}n0tf|}||j_||jdd|t j|<t|||dS) atA magic for running code on a specified remote worker The connection_info dict of the worker will be looked up as the first positional arg to the magic. The rest of the line (or the entire cell for a %%cell magic) will be passed to the remote kernel. Usage: info = e.start_ipython(worker)[worker] %remote info print(worker.data) NrzI need some code to run!,r3r )r)r splituser_ns NameErrorr8len ValueErrorr(mapstrsorteditemsr9 remote_magic_clientsr r r3r:Zwait_for_readyr1) r4r-r+Z split_lineZ info_namer<r3Z session_keyr,r/r/r0rJds(         rJr5cCs6t}|dkrdS|jtd|d|jtd|ddS)zTDefine the parameterized %remote magic See remote_magic above for details. Nr4)r6r7r-)r r;rJ)r7r+r/r/r0register_remote_magics rLcslt}|dkrtj}tj||dtf|dddg}|rN||t|t j fdd}dS)zOpen a QtConsole connected to a worker who has the given future - identify worker with who_has - start IPython kernel on the worker - start qtconsole connected to the kernel Nz.jsonZjupyterZ qtconsolez --existingcs(ytWntk r"YnXdS)z)Cleanup our connection file when we exit.N)osremoveOSErrorr/)pathr/r0_cleanup_connection_filesz3connect_qtconsole.._cleanup_connection_file) r rhexrMrPr(r extendratexitregister)r<rZ extra_argsZ runtime_dircmdrQr/)rPr0connect_qtconsoles   rWc sddlm}|dk rtdddlm}ddlm}t}t | |j|ddj j _ |rt|_d d __tfd d }t|d }d|_|jddstdt | S)aUStart an IPython kernel in a thread Parameters ---------- ip: str The IP address to listen on (likely the parent object's ip). ns: dict Any names that should be injected into the IPython namespace. log: logger instance Hook up IPython's logging to an existing logger instead of the default. r)r Nz+Cannot start IPython, it's already running.) ZMQIOLoop) IPKernelApp)logz:memory:cSsdS)Nr/r/r/r/r0noopszstart_ipython..noopcsXgj_j_jtj_rDjjj  dS)N) Z initializerZpre_handler_hookZpost_handler_hookstartrinstanceZloopshellrBupdatesetr/)appevtr[nszmq_loopr/r0_starts   zstart_ipython.._start)targetT)rz4IPython didn't start in a reasonable amount of time.)IPythonr RuntimeErrorZzmq.eventloop.iolooprXZipykernel.kernelapprYrr]Zclear_instanceZinstallZconfigZHistoryManagerZ hist_filer+Z init_signalZlog_connection_inforrZdaemonr\waitAssertionError) r+rcrZr rXrYZ save_instreZzmq_loop_threadr/)rarbr[rcrdr0 start_ipythons2       rl)r2)N)r5)NN)NNN)#__doc__Z __future__rrTrMr" ImportErrorZQueue subprocessrr$Z threadingrZuuidrZ tornado.genrZtornado.iolooprrrhr Zjupyter_clientr r Zjupyter_core.pathsr r!r1r>rJrKrLrWrlr/r/r/r0s2          *  ,