]c@sdZddlZddlmZddlmZyddlmZWn!ek riddlmZnXyddl m Z Wn!ek rddl m Z nXye Wne k reZ nXddlmZmZmZmZmZmZmZmZmZdd lmZd d lmZd d lmZdefdYZde fdYZ!defdYZ"dZ#defdYZ$e%e%dZ&dZ'dZ(dS(sQModule containing a preprocessor that executes the code cells and updates outputsiN(tdedent(tcontextmanager(t monotonic(ttime(tEmpty( tListtUnicodetBooltEnumtAnytTypetDicttIntegertdefault(toutput_from_msgi(t Preprocessori(tConversionExceptiontDeadKernelErrorcBseZRS((t__name__t __module__(((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRstCellExecutionCompletecBseZdZRS(s Used as a control signal for cell execution across run_cell and process_message function calls. Raised when all execution requests are completed and no further messages are expected from the kernel over zeromq channels. (RRt__doc__(((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyR"stCellExecutionErrorcBs8eZdZdZdZdZedZRS(s Custom exception to propagate exceptions that are raised during notebook execution to the caller. This is mostly useful when using nbconvert as a library, since it allows to deal with failures gracefully. cCs#tt|j|||_dS(N(tsuperRt__init__t traceback(tselfR((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyR2scCs4|j}t|ts0|jdd}n|S(Ntutf8treplace(t __unicode__t isinstancetstrtencode(Rts((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt__str__6s cCs|jS(N(R(R((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyR<sc Cs[dj|jdg}|tjd|d|d|jddd|jddS(svInstantiate from a code cell object and a message contents (message is either execute_reply or error) s Rtcelltenamestevaluet(tjointgett exec_err_msgtformat(tclsR#tmsgttb((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pytfrom_cell_and_msg?s(RRRRR"Rt classmethodR.(((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyR+s    uAn error occurred while executing the following cell: ------------------ {cell.source} ------------------ {traceback} {ename}: {evalue} tExecutePreprocessorcBseZdZeddededjdeZedd0dededjdeZ e e dedjdeZ ed ded jdeZe e ded jdeZe e ded jdeZeeZed dedjdeZe e dedjdeZe ededjdeZedde dedjdeZeddgdddedjdeZeddddjdeZededdZeddZededZ dZ!e"d0dZ#d0d0dZ$dZ%ed Z&d!Z'd0d0d"Z(d#Z)d$Z*d%Z+d0d&Z,d'Z-d(Z.d)ed*Z/d+Z0d,Z1d-Z2d.Z3d/Z4RS(1s. Executes all the cells in a notebook it allow_nonethelpsO The time to wait (in seconds) for output from executions. If a cell execution takes longer, an exception (TimeoutError on python 3+, RuntimeError on python 2) is raised. `None` or `-1` will disable the timeout. If `timeout_func` is set, it overrides `timeout`. tconfigt default_valuesX A callable which, when given the cell source as input, returns the time to wait (in seconds) for output from cell executions. If a cell execution takes longer, an exception (TimeoutError on python 3+, RuntimeError on python 2) is raised. Returning `None` or `-1` will disable the timeout for the cell. Not setting `timeout_func` will cause the preprocessor to default to using the `timeout` trait for all cells. The `timeout_func` trait overrides `timeout` if it is not `None`. s If execution of a cell times out, interrupt the kernel and continue executing other cells rather than throwing an error and stopping. i<s The time to wait (in seconds) for the kernel to start. If kernel startup takes longer, a RuntimeError is raised. sq If `False` (default), when a cell raises an error the execution is stopped and a `CellExecutionError` is raised. If `True`, execution errors are ignored and the execution is continued until the end of the notebook. Output from exceptions is included in the cell output in both cases. s If False (default), errors from executing the notebook can be allowed with a `raises-exception` tag on a single cell, or the `allow_errors` configurable option for all cells. An allowed error will be recorded in notebook output, and execution will continue. If an error occurs when it is not explicitly allowed, a `CellExecutionError` will be raised. If True, `CellExecutionError` will be raised for any error that occurs while executing the notebook. This overrides both the `allow_errors` option and the `raises-exception` cell tag. R&s Name of kernel to use to execute the cells. If not set, use the kernel_spec embedded in the notebook. s If `False` (default), then the kernel will continue waiting for iopub messages until it receives a kernel idle message, or until a timeout occurs, at which point the currently executing cell will be skipped. If `True`, then an error will be raised after the first timeout. This option generally does not need to be used, but may be useful in contexts where there is the possibility of executing notebooks with memory-consuming infinite loops. s If `True` (default), then the state of the Jupyter widgets created at the kernel will be stored in the metadata of the notebook. is The time to wait (in seconds) for IOPub output. This generally doesn't need to be set, but on some slow networks (such as CI systems) the default timeout might not be long enough to get all messages. tgracefult immediates If `graceful` (default), then the kernel is given time to clean up after executing all cells, e.g., to execute its `atexit` hooks. If `immediate`, then the kernel is signaled to immediately terminate. s:memory:sPath to file to use for SQLite history database for an IPython kernel. The specific value `:memory:` (including the colon at both end but not the back ticks), avoids creating a history file. Otherwise, IPython will create a history file for each kernel. When running kernels simultaneously (e.g. via multiprocessing) saving history a single SQLite file can result in database errors, so using `:memory:` is recommended in non-interactive contexts. s The kernel manager class to use.tkernel_manager_classcCs8yddlm}Wntk r3tdnX|S(sBUse a dynamic default to avoid importing jupyter_client at startupi(t KernelManagersW`nbconvert --execute` requires the jupyter_client package: `pip install jupyter_client`(tjupyter_clientR8t ImportError(RR8((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt_kernel_manager_class_defaults  sP mapping of locations of outputs with a given display_id tracks cell index and output index within cell.outputs for each appearance of the display_id { 'display_id': { cell_idx: [output_idx,] } } cKs|js3|jjjdijdd|_n|jd|jd|j}|jr|jr|jdj |jg7_n|j d|j||j }|j y|j d|jWn(tk r|j|jnXt|_||fS( s9Creates a new kernel manager and kernel client. Parameters ---------- kwargs : Any options for `self.kernel_manager_class.start_kernel()`. Because that defaults to KernelManager, this will likely include options accepted by `KernelManager.start_kernel()``, which includes `cwd`. Returns ------- km : KernelManager A kernel manager as created by self.kernel_manager_class. kc : KernelClient Kernel client as created by the kernel manager `km`. t kernelspectnametpythont kernel_nameR3s--HistoryManager.hist_file={}textra_argumentsttimeout(R?tnbtmetadataR(R7R3t ipykerneltipython_hist_fileR@R*t start_kerneltclienttstart_channelstwait_for_readytstartup_timeoutt RuntimeErrort stop_channelstshutdown_kerneltFalset allow_stdin(Rtkwargstkmtkc((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pytstart_new_kernel s$   !      cks|jdijddp!d}||_i|_i|_i|_|dkr||d<|j|\|_|_z||j|jfVWd|jj |jj d|j dkx$dd d gD]}t ||qWXn||_|j s|j d |j|n|j|_|jjy|jjd |jWn!tk rl|jj nXt|j_z||j|jfVWdx$dd d gD]}t ||qWXdS( sj Context manager for setting up the class to execute a notebook. The assigns `nb` to `self.nb` where it will be modified in-place. It also creates and assigns the Kernel Manager (`self.km`) and Kernel Client(`self.kc`). It is intended to yield to a block that will execute codeself. When control returns from the yield it stops the client's zmq channels, shuts down the kernel, and removes the now unused attributes. Parameters ---------- nb : NotebookNode Notebook being executed. resources : dictionary Additional resources used in the conversion process. For example, passing ``{'metadata': {'path': run_path}}`` sets the execution path to ``run_path``. km : KernerlManager (optional) Optional kernel manager. If none is provided, a kernel manager will be created. Returns ------- nb : NotebookNode The executed notebook. resources : dictionary Additional resources used in the conversion process. RCtpathR&tcwdNtnowR6RBRQRRR@RA(R(tNoneRBt_display_id_mapt widget_statetwidget_buffersRSRQRRRLRMtdelattrt has_kernelRFR@RGRHRIRJRKRNRO(RRBt resourcesRQRPRTtattr((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pytsetup_preprocessor0s: $             cCs|si}n|j||d|t|jjd|jtt|j||\}}|j|jj }|dd|j d<|j WdQX||fS(s  Preprocess notebook executing each code cell. The input argument `nb` is modified in-place. Parameters ---------- nb : NotebookNode Notebook being executed. resources : dictionary (optional) Additional resources used in the conversion process. For example, passing ``{'metadata': {'path': run_path}}`` sets the execution path to ``run_path``. km: KernelManager (optional) Optional kernel manager. If none is provided, a kernel manager will be created. Returns ------- nb : NotebookNode The executed notebook. resources : dictionary Additional resources used in the conversion process. RQs"Executing notebook with kernel: %stcontentt language_infoN( R_tlogtinfoR?RR0t preprocesst_wait_for_replyRRt kernel_infoRCtset_widgets_metadata(RRBR]RQtinfo_msg((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRdvs !cCs|jriid|jjDd6dd6dd6d6|jj_xS|jjjddjD]1\}}|jj|}|re||dlib/python2.7/site-packages/nbconvert/preprocessors/execute.pys s Rmit version_majorit version_minors)application/vnd.jupyter.widget-state+jsontbuffers(RYtitemsRBRCtwidgetsRZR((RtkeytwidgetRp((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRgs *c Cs|jdks|jj r)||fS|j|||\}}||_|jpnd|jjdgk}|js| rx5|jD]*}|j dkrt j ||qqW|dk r|dddkrt j ||dqn||fS(s} Executes a single code cell. See base.py for details. To execute all cells see :meth:`preprocess`. tcodesraises-exceptionttagsterrorR`tstatusN( t cell_typetsourcetstriptrun_celltoutputst allow_errorsRCR(tforce_raise_errorst output_typeRR.RW( RR#R]t cell_indext store_historytreplyR}tcell_allows_errorstout((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pytpreprocess_cells    c Cs||jkr,|jjd||jdS|dddkrQd|ddlib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt_update_display_ids     cCs[y9|jjjd|}|djd|kr8|SWntk rV|jnXdS(NRAt parent_headertmsg_id(RRt shell_channeltget_msgR(Rt _check_alive(RRR#RAR,((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt_poll_for_replys  cCsV|jdk r-|dk r-|j|}n |j}| sI|dkrRd}n|S(Ni(t timeout_funcRWRA(RR#RA((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt _get_timeouts   cCsP|jjd|j|jr@|jjd|jjn tddS(Ns(Timeout waiting for execute reply (%is).sInterrupting kernelsCell execution timed out(RbRwRAtinterrupt_on_timeoutRQtinterrupt_kernelt TimeoutError(R((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt_handle_timeouts   cCs2|jjs.|jjdtdndS(Ns,Kernel died while waiting for execute reply.s Kernel died(RRtis_aliveRbRwR(R((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRs cCs|j|}d}d}xtry|jjjd|}WnEtk r|j||7}|r||kr|jPqqX|djd|kr|SqWdS(NiiRARR( RtTrueRRRRRRRR((RRR#RAtcummulative_timettimeout_intervalR,((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRes     cCsH|dk r/|t|kr/|t}n|dkrDd}n|S(Ni(RWR(RRAtdeadline((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt_timeout_with_deadlines   cCs1|dk r-|tdkr-|jtStS(Ni(RWRRRRN(RR((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt_passed_deadlines ic Cs|jj|jd|d|j }|jjd|j|j|}d}|dk rlt|}ng|_ t |_ t }t }xZ|s|r|r|j |rt }qn|jd|} |j||| } | dk rt }qn|ry@|j} |r&|j| |} n|jjjd| } Wqtk r|r[qn|jrstdq|jjdt }qqXn| djd|krqny|j| ||Wqtk rt }qXqW| |j fS( NRt stop_on_errorsExecuting cell: %siRAs Timeout waiting for IOPub outputRR(RRtexecuteRzR~RbRRRWRR}RNtclear_before_next_outputRRRRt iopub_timeoutt iopub_channelRRtraise_on_iopub_timeoutRtwarningR(tprocess_messageR( RR#RRt parent_msg_idt exec_timeoutRt more_outputtpolling_exec_replyRAt exec_replyR,((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyR|!sR          cCsD|d}|jjd||d}|jjd||jdijdd}|r|ddd hkr|j||nd |kr|d |d lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRgs$      c Cs|d}yt|}Wn&tk rB|jjd|dSX|jr||jjdg|(|j|t|_n|r|jj |i}|j |g}|j t |n|j ||S(NRsunhandled iopub msg: sExecuting delayed clear_output( RRRbRwRRtclear_display_id_mappingRNRXt setdefaulttappendtlen( RtoutsR,RRRRtcell_maptoutput_idx_list((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRs"      cCs]|d}|jdr5|jjdt|_n$|jjdg|(|j|dS(NR`twaitsWait to clear outputsImmediate clear output(R(RbRRRR(RRR,RR`((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRs  cCs=x6|jjD]%\}}||krg||lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRs cCs|d}|d}|jrd|kr|jj|dij|dd|kr|drt||j|dlib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRs   $N(5RRRR RRttagRAR RWRRRNRRJR~RRRR@R?RRRRRMRER R7R R;R RXRSRR_RdRgRRRRRRReRRR|RRRRR(((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyR0Ts                          %E&      F 4  cKsLi}|dk r&i|d6|dlib/python2.7/site-packages/nbconvert/preprocessors/execute.pyt executenbs   cCs;i|jdd6|jdd6|jdd6|d6S(sFSerialize a widget state, following format in @jupyter-widgets/schema.Rit model_namet _model_modulet model_modulet_model_module_versiontmodel_module_versionRm(R((Rm((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRjs cCszg}|ddd}|d}xQt||D]@\}}|jitj|jdd6dd6|d6q2W|S( NR`RRRpsutf-8tbase64tencodingRT(tzipRRt b64encodetdecode(R,tencoded_bufferstpathsRpRTtbuffer((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyRs  ()RRttextwrapRt contextlibRRRR:tqueueRtQueueRt NameErrorRKt traitletsRRRRR R R R R t nbformat.v4RtbaseRtutils.exceptionsRRt ExceptionRRR)R0RWRRjR(((s>lib/python2.7/site-packages/nbconvert/preprocessors/execute.pyts:     @ 'z