ó ‹²,]c@sŽdZddlmZmZmZddlZddlZddlZddlZddl m Z ddl m Z m Z mZmZddlmZejƒZeed„Zd„ZeƒZd „Zd „Zejd ƒZd d ddddddddddddddddddgZed „Zd!„Zd"„Zd#„Z d d$d%„Z!d d$d&„Z"d d'„Z#d d(„Z$d)„Z%dS(*s Text encoding utilities, text file I/O Functions 'get_coding', 'decode', 'encode' and 'to_unicode' come from Eric4 source code (Utilities/__init___.py) Copyright © 2003-2009 Detlev Offenbach iÿÿÿÿ(tBOM_UTF8t BOM_UTF16t BOM_UTF32N(tUniversalDetector(t is_stringtto_text_stringtis_binary_stringt is_unicode(t is_binarycCsay|jdƒjdƒSWn@tk r\y|jdƒj|ƒSWq]tk rX|SXnXdS(sTranscode a text stringtcp437tcp1252N(tdecodetencodet UnicodeError(ttexttinputtoutput((s4lib/python2.7/site-packages/spyder/utils/encoding.pyt transcode s  cCs%tjƒ}|dkr!t}n|S(sg Query the filesystem for the encoding used to encode filenames and environment variables. N(tsystgetfilesystemencodingtNonetPREFERRED_ENCODING(tencoding((s4lib/python2.7/site-packages/spyder/utils/encoding.pyR1s   cCsht|ƒs$t|jƒdƒ}n@t|ƒrdy|jtƒ}Wnttfk r\qdX|Sn|S(sT Return a unicode version of string decoded using the file system encoding. sutf-8(RRttoUtf8RR t FS_ENCODINGR t TypeError(tstringtunic((s4lib/python2.7/site-packages/spyder/utils/encoding.pytto_unicode_from_fs>s  cCsDt|ƒr@y|jtƒ}Wnttfk r8q@X|Sn|S(s[ Return a byte string version of unic encoded using the file system encoding. (RR RR R(RR((s4lib/python2.7/site-packages/spyder/utils/encoding.pytto_fs_from_unicodeNs scoding[:=]\s*([-\w_.]+)sutf-8s iso8859-1s iso8859-15tasciiskoi8-rtcp1251skoi8-us iso8859-2s iso8859-3s iso8859-4s iso8859-5s iso8859-6s iso8859-7s iso8859-8s iso8859-9s iso8859-10s iso8859-13s iso8859-14slatin-1sutf-16cCsÜ|syxp|jƒd D][}ytjt|ƒƒ}Wntk rIqX|r|jdƒ}|tkrr|SqqWnt|ƒrØtƒ}x2|jƒd D] }|j |ƒ|j rŸPqŸqŸW|j ƒ|j dSdS(sr Function to get the coding of a text. @param text text to inspect (string) @return coding string iiRN(t splitlinest CODING_REtsearchRtUnicodeDecodeErrortgrouptCODECSRRtfeedtdonetclosetresultR(Rt force_chardettlineR)tcodectdetector((s4lib/python2.7/site-packages/spyder/utils/encoding.pyt get_codingjs&        cCs y­|jtƒr/t|ttƒdƒdfS|jtƒr[t|ttƒdƒdfS|jtƒr‡t|ttƒdƒdfSt|ƒ}|r¬t||ƒ|fSWnttfk rÆnXyt|dƒdfSWnttfk r÷nXt|dƒdfS(sr Function to decode a text. @param text text to decode (string) @return decoded text and encoding sutf-8s utf-8-bomsutf-16sutf-32s utf-8-guessedslatin-1slatin-1-guessed( t startswithRRtlenRRR.R t LookupError(Rtcoding((s4lib/python2.7/site-packages/spyder/utils/encoding.pyR s" cCsm|dkr#t|jdƒdfS|r]y|j|ƒ|fSWq]ttfk rYq]Xnt|ƒ}|r³y|j|ƒ|fSWq³ttfk r¯td|ƒ‚q³Xn|rÈ|jdƒs×|jdƒr/|jddƒ}|jddƒ}y|j|ƒ|fSWq/ttfk r+q/Xny|jdƒdfSWntk rYnX|jdƒdfS(s® Function to encode a text. @param text text to encode (string) @param orig_coding type of the original coding (string) @return encoded text and encoding s utf-8-bomsutf-8sIncorrect encoding (%s)s-defaults-guessedtR(RR R R1R.t RuntimeErrortendswithtreplace(Rt orig_codingR2((s4lib/python2.7/site-packages/spyder/utils/encoding.pyR ªs4   cCs`t|ƒs\xMtD]B}yt||ƒ}Wn"tk r?qtk rPPqX|SqWn|S(sConvert a string to unicode(RR%RR R(RR,R((s4lib/python2.7/site-packages/spyder/utils/encoding.pyt to_unicodeÔs     twbcCs>t||ƒ\}}t||ƒ}|j|ƒWdQX|S(sd Write 'text' to file ('filename') assuming 'encoding' Return (eventually new) encoding N(R topentwrite(RtfilenameRtmodettextfile((s4lib/python2.7/site-packages/spyder/utils/encoding.pyR;ãscCsttjj|ƒ|||ƒS(se Write 'lines' to file ('filename') assuming 'encoding' Return (eventually new) encoding (R;tostlineseptjoin(tlinesR<RR=((s4lib/python2.7/site-packages/spyder/utils/encoding.pyt writelinesíscCs+tt|dƒjƒƒ\}}||fS(sG Read text from file ('filename') Return text and encoding trb(R R:tread(R<RR((s4lib/python2.7/site-packages/spyder/utils/encoding.pyREôs!cCs+t||ƒ\}}|jtjƒ|fS(sI Read lines from file ('filename') Return lines and encoding (REtsplitR?R@(R<RR((s4lib/python2.7/site-packages/spyder/utils/encoding.pyt readlinesüscCs.yt|ƒ SWnttfk r)tSXdS(s5 Test if the given path is a text-like file. N(RtOSErrortIOErrortFalse(R<((s4lib/python2.7/site-packages/spyder/utils/encoding.pyt is_text_files(&t__doc__tcodecsRRRtlocaletreR?Rtchardet.universaldetectorRtspyder.py3compatRRRRt'spyder.utils.external.binaryornot.checkRtgetpreferredencodingRRRRRRtcompileR!R%RJR.R R R8R;RCRERGRK(((s4lib/python2.7/site-packages/spyder/utils/encoding.pyt s:    "        #  *