ó MšV]c@s¡dZddlmZddlmZdefd„ƒYZdefd„ƒYZdefd „ƒYZ d e fd „ƒYZ d „Z d e fd„ƒYZ dS(s· The ``Parser`` tries to convert the available Python code in an easy to read format, something like an abstract syntax tree. The classes who represent this tree, are sitting in the :mod:`parso.tree` module. The Python module ``tokenize`` is a very important part in the ``Parser``, because it splits the code into different words (tokens). Sometimes it looks a bit messy. Sorry for that! You might ask now: "Why didn't you use the ``ast`` module for this? Well, ``ast`` does a very good job understanding proper Python code, but fails to work as soon as there's a single line of broken code. There's one important optimization that needs to be known: Statements are not being parsed completely. ``Statement`` is just a representation of the tokens within the statement. This lowers memory usage and cpu time and reduces the complexity of the ``Parser`` (there's another parser sitting inside ``Statement``, which produces ``Array`` and ``Call``). iÿÿÿÿ(ttree(tReservedStringtParserSyntaxErrorcBseZdZd„ZRS(s_ Contains error information about the parser tree. May be raised as an exception. cCs||_||_dS(N(tmessaget error_leaf(tselfRR((s+lib/python2.7/site-packages/parso/parser.pyt__init__$s (t__name__t __module__t__doc__R(((s+lib/python2.7/site-packages/parso/parser.pyRstInternalParseErrorcBseZdZd„ZRS(s¦ Exception to signal the parser is stuck and error recovery didn't help. Basically this shouldn't happen. It's a sign that something is really wrong. cCsKtj|d||j||fƒ||_t|_||_||_dS(Ns#%s: type=%r, value=%r, start_pos=%r(t ExceptionRtnametmsgttypetvaluet start_pos(RR ttype_RR((s+lib/python2.7/site-packages/parso/parser.pyR0s     (RRR R(((s+lib/python2.7/site-packages/parso/parser.pyR )stStackcBseZd„ZRS(cs‡fd†}t|ƒƒS(Nc3saxZtˆƒD]L}x3|jjD]%}t|tƒr@|jVq |Vq W|jjs Pq q WdS(N(treversedtdfat transitionst isinstanceRRtis_final(t stack_nodet transition(R(s+lib/python2.7/site-packages/parso/parser.pytiterate;s   (tlist(RR((Rs+lib/python2.7/site-packages/parso/parser.pyt)_allowed_transition_names_and_token_types:s (RRR(((s+lib/python2.7/site-packages/parso/parser.pyR9st StackNodecBs)eZd„Zed„ƒZd„ZRS(cCs||_g|_dS(N(Rtnodes(RR((s+lib/python2.7/site-packages/parso/parser.pyRKs cCs |jjS(N(Rt from_rule(R((s+lib/python2.7/site-packages/parso/parser.pyt nonterminalOscCsd|jj|j|jfS(Ns %s(%s, %s)(t __class__RRR(R((s+lib/python2.7/site-packages/parso/parser.pyt__repr__Ss(RRRtpropertyR R"(((s+lib/python2.7/site-packages/parso/parser.pyRJs cCs3|jr/y|j|SWq/tk r+q/Xn|S(N(tcontains_syntaxtreserved_syntax_stringstKeyError(tgrammarRR((s+lib/python2.7/site-packages/parso/parser.pyt_token_to_transitionWs   t BaseParsercBsqeZdZiZejZiZejZ de d„Z d„Z d„Z d„Zd„Zd„Zd„ZRS( sIParser engine. A Parser instance contains state pertaining to the current token sequence, and should not be used concurrently by different threads to parse separate token sequences. See python/tokenize.py for how to get input tokens by a string. When a syntax error occurs, error_recovery() is called. t file_inputcCs||_||_||_dS(N(t _pgen_grammart_start_nonterminalt_error_recovery(Rt pgen_grammartstart_nonterminalterror_recovery((s+lib/python2.7/site-packages/parso/parser.pyRvs  cCsÐ|jj|jd}tt|ƒgƒ|_x|D]}|j|ƒq6Wx|trË|jd}|jj st d|j |j |j ƒ‚nt|jƒdkr²|jƒqP|j|j|jƒSqPWdS(Niiÿÿÿÿsincomplete inputi(R+tnonterminal_to_dfasR,RRtstackt _add_tokentTrueRRR RRRtlent_popt convert_nodeR R(Rttokenst first_dfattokenttos((s+lib/python2.7/site-packages/parso/parser.pytparse{s     cCsU|jrtdƒ‚n9|\}}}}tj||||ƒ}td|ƒ‚dS(Ns!Error Recovery is not implementedsSyntaxError: invalid syntax(R-tNotImplementedErrorRt ErrorLeafR(RR:RRRtprefixR((s+lib/python2.7/site-packages/parso/parser.pyR0‘s  cCs[y|j||ƒ}Wn#tk r<|j||ƒ}nXx|D]}||_qDW|S(N(tnode_mapR&t default_nodetparent(RR tchildrentnodetc((s+lib/python2.7/site-packages/parso/parser.pyR7™s   cCsCy|j||||ƒSWn!tk r>|j|||ƒSXdS(N(tleaf_mapR&t default_leaf(RRRR?R((s+lib/python2.7/site-packages/parso/parser.pyt convert_leaf¢s c Cs*|j}|j}|\}}}}t|||ƒ}xŠtrÂy|djj|} PWq9tk r™|djjr…|jƒq¿|j |ƒdSq9t k r¾t d|||ƒ‚q9Xq9W| j |d_x$| j D]} |jt| ƒƒqÝW|j||||ƒ} |djj| ƒdS(sÐ This is the only core function for parsing. Here happens basically everything. Everything is well prepared by the parser generator and we only apply the necessary steps here. iÿÿÿÿNstoo much input(R+R2R(R4RRR&RR6R0t IndexErrorR tnext_dfat dfa_pushestappendRRHR( RR:R'R2RRRR?Rtplantpushtleaf((s+lib/python2.7/site-packages/parso/parser.pyR3¨s(       cCsj|jjƒ}t|jƒdkr4|jd}n|j|jj|jƒ}|jdjj|ƒdS(Niiiÿÿÿÿ(R2tpopR5RR7RRRL(RR;tnew_node((s+lib/python2.7/site-packages/parso/parser.pyR6Ès (RRR R@RtNodeRARFtLeafRGtFalseRR<R0R7RHR3R6(((s+lib/python2.7/site-packages/parso/parser.pyR)cs       N(R tparsoRtparso.pgen2.generatorRR RR RRtobjectRR(R)(((s+lib/python2.7/site-packages/parso/parser.pyts