ó µ”ù\c @s+dZddlmZddlZddlZddlmZmZddlm Z ddl m Z m Z d„Z d„Zd efd „ƒYZd efd „ƒYZd efd„ƒYZddeded„ZejdƒZd„Zddd„Zdeeeeeeed„Zd„ZdS(sî babel.messages.pofile ~~~~~~~~~~~~~~~~~~~~~ Reading and writing of files in the ``gettext`` PO (portable object) format. :copyright: (c) 2013-2019 by the Babel Team. :license: BSD, see LICENSE for more details. iÿÿÿÿ(tprint_functionN(tCatalogtMessage(twraptext(t text_typetcmpcCs)d„}tjdƒj||dd!ƒS(s¿Reverse `escape` the given string. >>> print(unescape('"Say:\\n \\"hello, world!\\"\\n"')) Say: "hello, world!" :param string: the string to unescape cSsC|jdƒ}|dkrdS|dkr/dS|dkr?dS|S(Nitns tts trs (tgroup(tmatchtm((s4lib/python2.7/site-packages/babel/messages/pofile.pytreplace_escapes s   s \\([\\trn"])iiÿÿÿÿ(tretcompiletsub(tstringR ((s4lib/python2.7/site-packages/babel/messages/pofile.pytunescapes cCs^d|krP|jƒ}|jdƒr4|d}ntt|ƒ}dj|ƒSt|ƒSdS(sìReverse the normalization done by the `normalize` function. >>> print(denormalize(r'''"" ... "Say:\n" ... " \"hello, world!\"\n"''')) Say: "hello, world!" >>> print(denormalize(r'''"" ... "Say:\n" ... " \"Lorem ipsum dolor sit " ... "amet, consectetur adipisicing" ... " elit, \"\n"''')) Say: "Lorem ipsum dolor sit amet, consectetur adipisicing elit, " :param string: the string to denormalize s s""itN(t splitlinest startswithtmapRtjoin(Rt escaped_linestlines((s4lib/python2.7/site-packages/babel/messages/pofile.pyt denormalize-s    t PoFileErrorcBseZdZd„ZRS(sDException thrown by PoParser when an invalid po file is encountered.cCsGtt|ƒjdjd|d|ƒƒ||_||_||_dS(Ns{message} on {lineno}tmessagetlineno(tsuperRt__init__tformattcatalogtlineR(tselfRR R!R((s4lib/python2.7/site-packages/babel/messages/pofile.pyRNs(  (t__name__t __module__t__doc__R(((s4lib/python2.7/site-packages/babel/messages/pofile.pyRLst_NormalizedStringcBszeZd„Zd„Zd„Zd„ZeZd„Zd„Zd„Z d„Z d„Z d „Z d „Z d „ZRS( cGs+g|_x|D]}|j|ƒqWdS(N(t_strstappend(R"targstarg((s4lib/python2.7/site-packages/babel/messages/pofile.pyRWs  cCs|jj|jƒƒdS(N(R'R(tstrip(R"ts((s4lib/python2.7/site-packages/babel/messages/pofile.pyR(\scCsdjtt|jƒƒS(NR(RRRR'(R"((s4lib/python2.7/site-packages/babel/messages/pofile.pyR_scCs t|jƒS(N(tboolR'(R"((s4lib/python2.7/site-packages/babel/messages/pofile.pyt __nonzero__bscCstjj|jƒS(N(tostlinesepRR'(R"((s4lib/python2.7/site-packages/babel/messages/pofile.pyt__repr__gscCs#|s dStt|ƒt|ƒƒS(Ni(RR(R"tother((s4lib/python2.7/site-packages/babel/messages/pofile.pyt__cmp__jscCs|j|ƒdkS(Ni(R3(R"R2((s4lib/python2.7/site-packages/babel/messages/pofile.pyt__gt__pscCs|j|ƒdkS(Ni(R3(R"R2((s4lib/python2.7/site-packages/babel/messages/pofile.pyt__lt__sscCs|j|ƒdkS(Ni(R3(R"R2((s4lib/python2.7/site-packages/babel/messages/pofile.pyt__ge__vscCs|j|ƒdkS(Ni(R3(R"R2((s4lib/python2.7/site-packages/babel/messages/pofile.pyt__le__yscCs|j|ƒdkS(Ni(R3(R"R2((s4lib/python2.7/site-packages/babel/messages/pofile.pyt__eq__|scCs|j|ƒdkS(Ni(R3(R"R2((s4lib/python2.7/site-packages/babel/messages/pofile.pyt__ne__s(R#R$RR(RR.t__bool__R1R3R4R5R6R7R8R9(((s4lib/python2.7/site-packages/babel/messages/pofile.pyR&Us           t PoFileParsercBs†eZdZddddgZeed„Zd„Zd„Zd„Zed „Z ed „Z d „Z d „Z d „Z d„ZRS(s–Support class to read messages from a ``gettext`` PO (portable object) file and add them to a `Catalog` See `read_po` for simple cases. tmsgidtmsgstrtmsgctxtt msgid_pluralcCs;||_||_d|_d|_||_|jƒdS(Ni(R tignore_obsoletetcountertoffsett abort_invalidt_reset_message_state(R"R R@RC((s4lib/python2.7/site-packages/babel/messages/pofile.pyR’s      cCsgg|_g|_g|_g|_g|_g|_d|_t|_ t|_ t|_ t|_ dS(N( tmessagest translationst locationstflagst user_commentst auto_commentstNonetcontexttFalsetobsoletetin_msgidt in_msgstrt in_msgctxt(R"((s4lib/python2.7/site-packages/babel/messages/pofile.pyRDšs          c CsÑ|jjƒt|jƒdkrMtg|jD]}|jƒ^q/ƒ}n|jdjƒ}t|ttfƒrgt|j j ƒD] }d^qˆ}xU|jD]J\}}||j j krÞ|j d|j dƒq¤n|jƒ||R((s4lib/python2.7/site-packages/babel/messages/pofile.pyt _add_message§s2 +% !    cCs|jr|jƒndS(N(RER^(R"((s4lib/python2.7/site-packages/babel/messages/pofile.pyt_finish_current_messageÊs cCs9|jdƒr"|j||ƒn|j|||ƒdS(Nt"(Rt!_process_string_continuation_linet_process_keyword_line(R"RR!RN((s4lib/python2.7/site-packages/babel/messages/pofile.pyt_process_message_lineÎscCs¸xŒ|jD]j}y=|j|ƒrL|t|ƒd krL|t|ƒ}PnWq tk rs|j||dƒq Xq W|j||dƒdS|d kr¨|jƒn||_|dkrÉ||_n|dkrt|_ t |_ |j j t|ƒƒn´|dkrt|_ t |_|jdƒrn|d jd d ƒ\}}|jj t|ƒt|ƒgƒq´|jj d t|ƒgƒn'|dkr´t |_ t|ƒ|_ndS(Nt t[s$Keyword must be followed by a strings0Start of line didn't match any expected keyword.R<R>R?R=it]i(RdRe(R<R>(R<R?(t _keywordsRRSt IndexErrorRYR_RNRBRMRQtTrueRORER(R&RPtsplitRFtintRL(R"RR!RNtkeywordR*R\tmsg((s4lib/python2.7/site-packages/babel/messages/pofile.pyRbÔs8%            %  cCss|jr|jd}nI|jr6|jdd}n,|jrK|j}n|j||dƒdS|j|ƒdS(Niÿÿÿÿis<Got line starting with " but not in msgid, msgstr or msgctxt(RORERPRFRQRLRYR((R"R!RR,((s4lib/python2.7/site-packages/babel/messages/pofile.pyRaýs    cCsk|jƒ|djdƒr¾xG|djƒjƒD]ƒ}|jdƒ}|dkr¡yt||dƒ}Wntk rƒq4nX|jj|| |fƒq4|jj|dfƒq4Wn©|djdƒrx“|djƒjdƒD]}|j j|j ƒƒqëWnY|djdƒrM|dj ƒ}|rg|j j|ƒqgn|j j|dj ƒƒdS(Nit:iit,t.(R_RtlstripRjtrfindRkt ValueErrorRGR(RKRHR+RJRI(R"R!tlocationtposRtflagtcomment((s4lib/python2.7/site-packages/babel/messages/pofile.pyt_process_comment s&    cCs3x¾t|ƒD]°\}}|jƒ}t|tƒsL|j|jjƒ}n|sXq n|jdƒr­|djdƒr|j||dj ƒdt ƒq½|j |ƒq |j||ƒq W|j ƒ|j r/|jsð|jsð|jr/|jjtdƒƒ|jjdtdƒgƒ|jƒndS( s˜ Reads from the file-like object `fileobj` and adds any po file units found in it to the `Catalog` supplied to the constructor. t#it~iRNu""iN(t enumerateR+RURtdecodeR tcharsetRRcRqRiRxR_RARHRIRJRER(R&RFR^(R"tfileobjRR!((s4lib/python2.7/site-packages/babel/messages/pofile.pytparse$s  # %cCsO|jr$t||j||ƒ‚ntd|ƒtdj|d|ƒƒdS(NsWARNING:u!WARNING: Problem on line {0}: {1}i(RCRR tprintR(R"R!RRm((s4lib/python2.7/site-packages/babel/messages/pofile.pyRYAs  (R#R$R%RgRMRRDR^R_RcRbRaRxRRY(((s4lib/python2.7/site-packages/babel/messages/pofile.pyR;„s  #   )  cCsAtd|d|d|ƒ}t||d|ƒ}|j|ƒ|S(sRead messages from a ``gettext`` PO (portable object) file from the given file-like object and return a `Catalog`. >>> from datetime import datetime >>> from babel._compat import StringIO >>> buf = StringIO(''' ... #: main.py:1 ... #, fuzzy, python-format ... msgid "foo %(name)s" ... msgstr "quux %(name)s" ... ... # A user comment ... #. An auto comment ... #: main.py:3 ... msgid "bar" ... msgid_plural "baz" ... msgstr[0] "bar" ... msgstr[1] "baaz" ... ''') >>> catalog = read_po(buf) >>> catalog.revision_date = datetime(2007, 4, 1) >>> for message in catalog: ... if message.id: ... print((message.id, message.string)) ... print(' ', (message.locations, sorted(list(message.flags)))) ... print(' ', (message.user_comments, message.auto_comments)) (u'foo %(name)s', u'quux %(name)s') ([(u'main.py', 1)], [u'fuzzy', u'python-format']) ([], []) ((u'bar', u'baz'), (u'bar', u'baaz')) ([(u'main.py', 3)], []) ([u'A user comment'], [u'An auto comment']) .. versionadded:: 1.0 Added support for explicit charset argument. :param fileobj: the file-like object to read the PO file from :param locale: the locale identifier or `Locale` object, or `None` if the catalog is not bound to a locale (which basically means it's a template) :param domain: the message domain :param ignore_obsolete: whether to ignore obsolete messages in the input :param charset: the character set of the catalog. :param abort_invalid: abort read if po file is invalid tlocaletdomainR}RC(RR;R(R~RR‚R@R}RCR tparser((s4lib/python2.7/site-packages/babel/messages/pofile.pytread_poHs/ sL(\s+|[^\s\w]*\w+[a-zA-Z]-(?=\w+[a-zA-Z])|(?<=[\w\!\"\'\&\.\,\?])-{2,}(?=\w))cCsDd|jddƒjddƒjddƒjdd ƒjd d ƒS( sõEscape the given string so that it can be included in double-quoted strings in ``PO`` files. >>> escape('''Say: ... "hello, world!" ... ''') '"Say:\\n \\"hello, world!\\"\\n"' :param string: the string to escape s"%s"s\s\\s s\ts s\rs s\ns"s\"(treplace(R((s4lib/python2.7/site-packages/babel/messages/pofile.pytescape„s    RiLc Cs±|r-|dkr-t|ƒ}g}x|jtƒD]ò}tt|ƒƒ||krtj|ƒ}|jƒx´|rg}d}xu|rûtt|dƒƒd|} || |krÛ|j|jƒƒ|| 7}q‡|s÷|j|jƒƒnPq‡W|jdj |ƒƒqrWq4|j|ƒq4Wn|jtƒ}t|ƒdkrXt|ƒS|rƒ|d rƒ|d=|dcd7>> print(normalize('''Say: ... "hello, world!" ... ''', width=None)) "" "Say:\n" " \"hello, world!\"\n" >>> print(normalize('''Say: ... "Lorem ipsum dolor sit amet, consectetur adipisicing elit, " ... ''', width=32)) "" "Say:\n" " \"Lorem ipsum dolor sit " "amet, consectetur adipisicing" " elit, \"\n" :param string: the string to normalize :param prefix: a string that should be prepended to every line :param width: the maximum line width; use `None`, 0, or a negative number to completely disable line wrapping iiiÿÿÿÿuis u"" u ( RSRRiR†tWORD_SEPRjtreverseR(tpopR( Rtprefixtwidtht prefixlenRR!tchunkstbuftsizetl((s4lib/python2.7/site-packages/babel/messages/pofile.pyt normalize–s6      c  sBd‡fd†‰‡‡fd†‰d‡‡fd†} d‡‡‡fd†} d} |rfd} n|rud} nx_tˆd| ƒD]K} | js|r£qˆnˆj}ˆr ˆd kr g}x0|jƒD]"}|t|d ˆd d ƒ7}qÑWd j|ƒ}nˆ|d ƒnx| jD]}| |ƒq$Wx!| jD]}| |ddƒqBW|s g}yt | j ƒ}Wnt k r—| j }nXxi|D]a\}}|rà| rà|j d|j tjdƒ|fƒqŸ|j d|j tjdƒƒqŸW| dj|ƒddƒn| jrSˆddjdgt | jƒƒƒn| jr¿|r¿| dˆ| jd ƒddƒt| jƒdkr¿| dˆ| jdƒddƒq¿n| | ƒˆdƒqˆW|s>x^tˆjjƒd| ƒD]>} x| jD]}| |ƒq W| | ddƒˆdƒqùWndS(sØWrite a ``gettext`` PO (portable object) template file for a given message catalog to the provided file-like object. >>> catalog = Catalog() >>> catalog.add(u'foo %(name)s', locations=[('main.py', 1)], ... flags=('fuzzy',)) >>> catalog.add((u'bar', u'baz'), locations=[('main.py', 3)]) >>> from babel._compat import BytesIO >>> buf = BytesIO() >>> write_po(buf, catalog, omit_header=True) >>> print(buf.getvalue().decode("utf8")) #: main.py:1 #, fuzzy, python-format msgid "foo %(name)s" msgstr "" #: main.py:3 msgid "bar" msgid_plural "baz" msgstr[0] "" msgstr[1] "" :param fileobj: the file-like object to write to :param catalog: the `Catalog` instance :param width: the maximum line width for the generated output; use `None`, 0, or a negative number to completely disable line wrapping :param no_location: do not emit a location comment for every message :param omit_header: do not include the ``msgid ""`` entry at the top of the output :param sort_output: whether to sort the messages in the output by msgid :param sort_by_file: whether to sort the messages in the output by their locations :param ignore_obsolete: whether to ignore obsolete messages and not include them in the output; by default they are included as comments :param include_previous: include the old msgid as a comment when updating the catalog :param include_lineno: include line number in the location comment Rcst|d|dˆƒS(NRŠR‹(R‘(tkeyRŠ(R‹(s4lib/python2.7/site-packages/babel/messages/pofile.pyt _normalizescs8t|tƒr'|jˆjdƒ}nˆj|ƒdS(Ntbackslashreplace(RURtencodeR}twrite(ttext(R R~(s4lib/python2.7/site-packages/babel/messages/pofile.pyt_writescsYˆrˆdkrˆ}nd}x1t||ƒD] }ˆd||jƒfƒq1WdS(NiiLs#%s %s (RR+(RwRŠt_widthR!(R˜R‹(s4lib/python2.7/site-packages/babel/messages/pofile.pyt_write_comment s  csjt|jttfƒrô|jrDˆd|ˆ|j|ƒfƒnˆd|ˆ|jd|ƒfƒˆd|ˆ|jd|ƒfƒx×tˆjƒD]Q}y|j|}Wntk rÌd}nXˆd||ˆ||ƒfƒqœWnr|jr ˆd|ˆ|j|ƒfƒnˆd|ˆ|j|ƒfƒˆd|ˆ|jpXd|ƒfƒdS( Ns %smsgctxt %s s %smsgid %s is%smsgid_plural %s iRs%smsgstr[%d] %s s %smsgstr %s ( RUtidRVRTRLRWRXRRh(RRŠR\R(R“R˜R (s4lib/python2.7/site-packages/babel/messages/pofile.pyt_write_messages(  $  !   RRttsort_byiR‹tsubsequent_indents# u RŠRpu%s:%dt/u%sRdRns#%s s, smsgid %st|ismsgid_plural %ss s#~ N(RKt_sort_messagesR›theader_commentRRRRIRJtsortedRGt TypeErrorR(R…R/tsepRHt previous_idRSRNtvalues(R~R R‹t no_locationt omit_headert sort_outputt sort_by_fileR@tinclude_previoustinclude_linenoRšRœRRtcomment_headerRR!RwtlocsRGtfilenameR((R“R˜R R~R‹s4lib/python2.7/site-packages/babel/messages/pofile.pytwrite_poÓsn.        )$ *    cCsKt|ƒ}|dkr%|jƒn"|dkrG|jdd„ƒn|S(sø Sort the given message iterable by the given criteria. Always returns a list. :param messages: An iterable of Messages. :param sort_by: Sort by which criteria? Options are `message` and `location`. :return: list[Message] RRtR’cSs|jS(N(RG(R ((s4lib/python2.7/site-packages/babel/messages/pofile.pyt~R(RVRR(RER((s4lib/python2.7/site-packages/babel/messages/pofile.pyR¡ps    (R%t __future__RR/R tbabel.messages.catalogRRt babel.utilRt babel._compatRRRRt ExceptionRtobjectR&R;RKRMR„RR‡R†R‘RiR±R¡(((s4lib/python2.7/site-packages/babel/messages/pofile.pyt s&     /Ä5 =  ›