B 18\_@sdZdZddgZddlZddlZddlZddlZddlZddlZddl m Z m Z m Z m Z mZGdddeZd d ZdddZddZddZddZedkreee dS)zZParser driver. This provides a high-level interface to parse a file into a syntax tree. z#Guido van Rossum Driver load_grammarN)grammarparsetokentokenizepgenc@sHeZdZdddZdddZdddZdd d Zdd d Zdd dZdS)rNcCs&||_|dkrt}||_||_dS)N)rlogging getLoggerloggerconvert)selfrr r rX/oak/stanford/groups/akundaje/marinovg/programs/Python-3.7.3/Lib/lib2to3/pgen2/driver.py__init__ s zDriver.__init__FcCst|j|j}|d}d}d}}}} } d} xR|D]4} | \}}}} } |||fkr||f|ks|t||f|f|\} }|| kr| d| |7} | }d}||kr| | ||7} |}|tjtjfkr| |7} | \}}| dr@|d7}d}q@|t j krtj |}|r,|j dt j||| |||| |frT|rR|j dPd} | \}}| dr@|d7}d}q@Wtd||| |f|jS) z4Parse a series of tokens and return the syntax tree.rrN z%s %r (prefix=%r)zStop.zincomplete input)rParserrr setupAssertionErrorrCOMMENTNLendswithrOPopmapr debugtok_nameZaddtoken ParseErrorrootnode)rtokensrplinenocolumntypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_columnrrr parse_tokens'sT      zDriver.parse_tokenscCst|j}|||S)z*Parse a stream and return the syntax tree.)rgenerate_tokensreadliner))rstreamrr rrrparse_stream_rawWs zDriver.parse_stream_rawcCs |||S)z*Parse a stream and return the syntax tree.)r-)rr,rrrr parse_stream\szDriver.parse_streamc Cs(tj|d|d}|||SQRXdS)z(Parse a file and return the syntax tree.r)encodingN)ioopenr.)rfilenamer0rr,rrr parse_file`szDriver.parse_filecCstt|j}|||S)z*Parse a string and return the syntax tree.)rr*r1StringIOr+r))rtextrr rrr parse_stringeszDriver.parse_string)NN)F)F)F)NF)F) __name__ __module__ __qualname__rr)r-r.r4r7rrrrrs   0   cCs:tj|\}}|dkrd}||dtttjdS)Nz.txtr.z.pickle)ospathsplitextjoinmapstrsys version_info)gtheadtailrrr_generate_pickle_nameksrG Grammar.txtTFc Cs|dkrt}|dkr t|n|}|s2t||s|d|t|}|r|d|y||Wqtk r}z|d|Wdd}~XYqXnt }| ||S)z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %szWriting grammar tables to %szWriting failed: %s) r r rG_newerinfor Zgenerate_grammardumpOSErrorrGrammarload)rDZgpsaveforcer gerrrrrs     cCs8tj|sdStj|s dStj|tj|kS)z0Inquire whether file a was written since file b.FT)r<r=existsgetmtime)abrrrrIs   rIcCsFtj|rt|Sttj|}t||}t }| ||S)aNormally, loads a pickled grammar by doing pkgutil.get_data(package, pickled_grammar) where *pickled_grammar* is computed from *grammar_source* by adding the Python version and using a ``.pickle`` extension. However, if *grammar_source* is an extant file, load_grammar(grammar_source) is called instead. This facilitates using a packaged grammar file when needed but preserves load_grammar's automatic regeneration behavior when possible. ) r<r=isfilerrGbasenamepkgutilget_datarrMloads)packageZgrammar_sourceZ pickled_namedatarQrrrload_packaged_grammars   r^cGsF|stjdd}tjtjtjddx|D]}t|dddq,WdS)zMain program, when run as a script: produce grammar pickle files. Calls load_grammar for each argument, a path to a grammar text file. rNz %(message)s)levelr,formatT)rOrP)rBargvr basicConfigINFOstdoutr)argsrDrrrmains  rf__main__)rHNTFN)__doc__ __author____all__codecsr1r<r rYrBrrrrrr objectrrGrrIr^rfr8exitintrrrr s$M