\c@sdZddlZddlZddlZddlZddlZddlZddlmZm Z m Z m Z m Z m Z mZddlmZmZddlmZmZerddlmZmZmZmZmZnejdZejdZejd Zejdkr0ej ej!fZ"n ej Z"d Z#d Z$ddZ&dZ'de(fdYZ)de(fdYZ*de*fdYZ+dej,fdYZ-de*fdYZ.de(fdYZ/dS(s sphinx.pycode.parser ~~~~~~~~~~~~~~~~~~~~ Utilities parsing and analyzing Python code. :copyright: Copyright 2007-2019 by the Sphinx team, see AUTHORS. :license: BSD, see LICENSE for details. iN(tNAMEtNEWLINEtINDENTtDEDENTtNUMBERtOPtSTRING(tCOMMENTtNL(tPY2t text_type(tAnytDicttIOtListtTupleu^\s*#: ?(.*) ? ?$u^\s*$u ^\s*(#.*)?$iicCs|jddS(Ns t (treplace(tcode((s3lib/python2.7/site-packages/sphinx/pycode/parser.pytfilter_whitespace%scCs't|tjr|jS|jgSdS(s3Get list of targets from Assign and AnnAssign node.N(t isinstancetasttAssignttargetsttarget(tnode((s3lib/python2.7/site-packages/sphinx/pycode/parser.pytget_assign_targets*scCs|r$tr|j}q$|j}n|jj}|dkrOtd|nB|dkr|dksv|j|kr|jgStd|n|dkrg}x?|jD]4}y|jt ||Wqtk rqXqW|S|d krR|j jjdkr?|r?|j j|kr?d t |j |d gStd|n?|dkre|gS|dkrt |j |St d|dS(sConvert assignment-AST to variable names. This raises `TypeError` if the assignment does not create new variable:: ary[0] = 'foo' dic["bar"] = 'baz' # => TypeError tIndextNumtSlicetStrt Subscripts%r does not create new variabletNames*The assignment %r is not instance variableRRt Attributes%sitstrtStarredsUnexpected node name %rN(RRRRR(RR( R tidtargt __class__t__name__t TypeErrortNoneteltstextendtget_lvar_namestvaluetattrtNotImplementedError(Rtselftself_idt node_nametmemberstelt((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyR,3s8          -  cCs7d}||_tj|}|jdjdS(s1Remove common leading indentation from docstring.cSsdS(N((((s3lib/python2.7/site-packages/sphinx/pycode/parser.pytdummydss (t__doc__tinspecttgetdoctlstriptrstrip(tsR5t docstring((s3lib/python2.7/site-packages/sphinx/pycode/parser.pytdedent_docstringas  tTokencBs;eZdZdZdZdZdZdZRS(s)Better token wrapper for tokenize module.cCs1||_||_||_||_||_dS(N(tkindR-tstarttendtsource(R0R?R-R@RARB((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyt__init__qs     cCst|tr|j|kSt|tr8|j|kSt|ttfri|j|jgt|kS|dkrytSt d|dS(NsUnknown value: %r( RtintR?R"R-tlistttupleR)tFalset ValueError(R0tother((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyt__eq__ys   cCs ||k S(N((R0RI((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyt__ne__scstfd|DS(Nc3s|]}|kVqdS(N((t.0t candidate(R0(s3lib/python2.7/site-packages/sphinx/pycode/parser.pys s(tany(R0t conditions((R0s3lib/python2.7/site-packages/sphinx/pycode/parser.pytmatchscCs!dtj|j|jjfS(Ns(ttokenizettok_nameR?R-tstrip(R0((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyt__repr__s(R't __module__R6RCRJRKRPRT(((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyR>ns    tTokenProcessorcBs,eZdZdZdZdZRS(csFt|||_tjfd|_d|_d|_dS(Ncs tS(N(tnext((tlines(s3lib/python2.7/site-packages/sphinx/pycode/parser.pyts(titertbuffersRQtgenerate_tokensttokensR)tcurrenttprevious(R0R[((RXs3lib/python2.7/site-packages/sphinx/pycode/parser.pyRCs    cCs|j|dS(sReturns specified line.i(R[(R0tlineno((s3lib/python2.7/site-packages/sphinx/pycode/parser.pytget_linescCsLy(|j|_tt|j|_Wntk rDd|_nX|jS(s^Fetch a next token from source code. Returns ``False`` if sequence finished. N(R^R_R>RWR]t StopIterationR)(R0((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyt fetch_tokens    cCsg}x|jr|j|j|j|kr8Pq |jtdgkri||jtdg7}q |jtdgkr||jtdg7}q |jtdgkr ||jtdg7}q q W|S(slFetch tokens until specified token appeared. .. note:: This also handles parenthesis well. t(t)t{t}t[t](RctappendR^Rt fetch_until(R0t conditionR]((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyRks (R'RURCRaRcRk(((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyRVs   tAfterCommentParsercBs)eZdZdZdZdZRS(sPython source code parser to pick up comment after assignment. This parser takes a python code starts with assignment statement, and returns the comments for variable if exists. cCs#tt|j|d|_dS(N(tsuperRmRCR)tcomment(R0RX((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyRCscCs g}x|jr|j|j|jtdgkrV||jtdg7}q |jtdgkr||jtdg7}q |jtdgkr||jtdg7}q |jtkr||jt7}q |jtdgkrPq |jjttt t fkr Pq q W|S(s%Fetch right-hand value of assignment.RdReRfRgRhRit;( RcRjR^RRkRRR?RRR(R0R]((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyt fetch_rvalues cCs~x4|jjtdgtts6|jstqW|jtdgkrY|jn|jtkrz|jj|_ ndS(s3Parse the code and obtain comment after assignment.t=N( RcRPRRRR^tAssertionErrorRqR-Ro(R0((s3lib/python2.7/site-packages/sphinx/pycode/parser.pytparses $ (R'RUR6RCRqRt(((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyRms  tVariableCommentPickercBsqeZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z RS( s7Python source code parser to pick up variable comments.cCsntj|_||_||_g|_g|_d|_i|_ d|_ i|_ t t |jdS(N(t itertoolstcounttcounterR[tencodingtcontexttcurrent_classesR)tcurrent_functiontcommentsR_t defordersRnRuRC(R0R[Ry((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyRCs        cCsv|jrC|jr<|jddkr<|jd |g}qSdSn|j|g}t|j|jdj||jddkr>dj|jd }qWdSndj|j}||j||ftt|j|d|_g|_g|_i|_dS(N(RnRRCR)t decoratorRztindentst definitions(R0RX((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyRCs    cCsD|jr3|jdddkr3|ddkr3n ||j|RVRmt NodeVisitorRuRR(((s3lib/python2.7/site-packages/sphinx/pycode/parser.pyt s6      4+   . &10H