๓ าbc@`siddlmZmZddlZddlZddlmZddlmZm Z m Z ddl Z ddl jjZddlmZyddlZWn;ek rีejjdƒejjƒejeƒnXyddlmZWn!ek r ddlmZnXyeWnek r/eZnXgZ ej!d ƒZ"ej!d ej#ƒZ$d „Z%e j&d ƒd „Z'e j&dƒd„Z(e j&dƒd„Z)e j&dƒd„Z*e j&dƒdde+d„Z,e j&dƒdde+d„Z-e j&dƒdd„Z.e j&dƒdd„Z/e j&dƒe0e+d„Z1e j&d ƒde+d!„Z3e j&d"ƒe+d#„Z4e j&d$ƒd%„Z5e j&d&ƒd'„Z6e j&d(ƒd)„Z7e j&d*ƒd+„Z8e j&d,ƒd-„Z9e j&d.ƒd/„Z:e j&d0ƒd1„Z;e j&d2ƒd3„Z<e j&d4ƒd5„Z=e j&d6ƒd7„Z>e j&d8ƒdS(9i(tabsolute_importtdivisionN(ttimegm(tdebugtwarningterrori(t EX_OSFILEu* !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! ImportError trying to import dateutil.parser. Please install the python dateutil module: $ sudo apt-get install python-dateutil or $ sudo yum install python-dateutil or $ pip install python-dateutil !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! (tquotes\.[0-9]*(?:[Z\-\+]*?)s9^(]+?>\s*|\s*)(<\w+) xmlns=['"](https?://[^'"]+)['"]cC`s(tjd|ƒ}tjj|dtƒS(Ns.000tfuzzy(tRE_S3_DATESTRINGtsubtdateutiltparsertparsetTrue(tdate((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytdateS3toPython?sRcC`stt|ƒjƒƒS(N(RRt utctimetuple(R((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pyt dateS3toUnixFsRcC`stjj|dtƒS(sV Convert a string formated like '2020-06-27T15:56:34Z' into a python datetime R(R R R R(R((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytdateRFC822toPythonLsRcC`stt|ƒjƒƒS(N(RRR(R((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytdateRFC822toUnixTsRcC`s%tjj|dtƒ}|jdƒS(NRs%Y-%m-%d %H:%M(R R R Rtstrftime(t s3timestamptdate_obj((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytformatDateTimeYsRsUTF-8treplacecC`sot|ƒtkr|S|s3td||fƒnyt|||ƒSWn!tk rjtd|ƒ‚nXdS(s< Convert 'string' to Unicode or raise an exception. sUnicodising %r using %ss Conversion to unicode failed: %rN(ttypetunicodeRtUnicodeDecodeError(tstringtencodingterrorstsilent((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytbase_unicodisebs R!cC`sot|ƒtkr|S|s3td||fƒny|j||ƒSWn!tk rjtd|ƒ‚nXdS(s Convert unicode 'string' to , by default replacing all invalid characters with '?' or raise an exception. sDeUnicodising %r using %ss"Conversion from unicode failed: %rN(RRRtencodetUnicodeEncodeError(RRRR ((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytbase_deunicodisers R$cC`st|d|tƒS(sE Convert S3 UTF-8 'string' to Unicode or raise an exception. sUTF-8(R!R(RR((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytdecode_from_s3ƒsR%cC`st|d|tƒS(s Convert Unicode to S3 UTF-8 'string', by default replacing all invalid characters with '?' or raise an exception. sUTF-8(R$R(RR((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pyt encode_to_s3‹sR&cC`sX|rd}nd}t|ƒ}t|d|ƒ}|rHt|ƒ}n t|ƒ}|S(sš URI encode every byte. UriEncode() must enforce the following rules: - URI encode every byte except the unreserved characters: 'A'-'Z', 'a'-'z', '0'-'9', '-', '.', '_', and '~'. - The space character is a reserved character and must be encoded as "%20" (and not as "+"). - Each URI encoded byte is formed by a '%' and the two-digit hexadecimal value of the byte. - Letters in the hexadecimal value must be uppercase, for example "%1A". - Encode the forward slash character, '/', everywhere except in the object key name. For example, if the object key name is photos/Jan/sample.jpg, the forward slash in the key name is not encoded. t~s~/tsafe(R&RR%(tparamtquote_backslashestunicode_outputt safe_chars((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pyts3_quote”s    R-cC`s`t|ƒ}|dkr|St|ddƒ}td||fƒ|rRt|ƒSt|ƒSdS(NtverbatimR(s~/sString '%s' encoded to '%s'(R&RRR%(Rturlencoding_modeR+tencoded((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytbase_urlencode_stringฌs   R1cC`sดd}d}x~|D]v}t|ƒ}|dkr\|dttdƒ|ƒ7}|d7}q|dkr|d7}|d7}q||7}qW|rฐ|rฐtd ||fƒn|S( s replace_nonprintables(string) Replaces all non-printable characters 'ch' in 'string' where ord(ch) <= 26 with ^@, ^A, ... ^Z tiit^t@iis^?s+%d non-printable characters replaced in: %s(tordtchrR(Rt with_messaget new_stringtmodifiedtcto((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytbase_replace_nonprintablesผs        R<cC`sธg}xซ|D]ฃ}i}x~|D]v}t|jƒ}t|ƒrWt|gƒ||tgetDictFromTreettextRAR%R=RtlistRB(R\tret_dictRGtcontentt child_tag((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pyRas  $ RacC`skt|ƒ}|jj|ƒr>|jdk r:t|jƒSdS|j|ƒ}|dk rct|ƒSdSdS(N(R^R=tendswithRbRAR%R@(RJtxpathR\tresult((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytgetTextFromXml.s   RjcC`s,t|ƒ}|jdk r(t|jƒSdS(N(R^R=RAR%(RJR\((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytgetRootTagName8s RkcC`s"tj|ƒ}t|ƒ|_|S(N(RXtElementR%Rb(ttag_nameRbtel((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pyt xmlTextNode>sRocC`s t||ƒ}|j|ƒ|S(sฏ Creates a new Node and sets its content to 'text'. Then appends the created Node to 'parent' element if given. Returns the newly created Node. (RoRB(RmRbtparentRn((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pytappendXmlTextNodeEs Rq(?t __future__RRtretsystcalendarRtloggingRRRtxml.dom.minidomRJtxml.etree.ElementTreetetreet ElementTreeRXt ExitCodesRtdateutil.parserR t ImportErrortstderrtwritetflushtexitturllibRt urllib.parseRt NameErrortstrt__all__tcompileR t MULTILINERRRRBRRRRtFalseR!R$R%R&RR-RAR1R<R?RQRWR^R`RaRjRkRoRq(((sL/oak/stanford/groups/akundaje/marinovg/programs/s3cmd-master/S3/BaseUtils.pyt sŠ