B è?F[¦ã@s‚ddlZddlZddlZddlmZdZdeZdZefdd„Zefdd „Z d d „Z dd d „Z dd„Z dd„Z Gdd„deƒZdS)éN)Úsixééi'cCslt}|t|krd|dtdkr,td|ƒ‚|d}d}x ||krXt t|¡}|d7}q:Wt|ƒ}n|}|S)a"Calculate the minimum part size needed for a multipart upload. Glacier allows a maximum of 10,000 parts per upload. It also states that the maximum archive size is 10,000 * 4 GB, which means the part size can range from 1MB to 4GB (provided it is one 1MB multiplied by a power of 2). This function will compute what the minimum part size must be in order to upload a file of size ``size_in_bytes``. It will first check if ``default_part_size`` is sufficient for a part size given the ``size_in_bytes``. If this is not the case, then the smallest part size than can accomodate a file of size ``size_in_bytes`` will be returned. If the file size is greater than the maximum allowed archive size of 10,000 * 4GB, a ``ValueError`` will be raised. ii'zFile size too large: %séé)Ú _MEGABYTEÚMAXIMUM_NUMBER_OF_PARTSÚ ValueErrorÚmathZldexpÚint)Z size_in_bytesZdefault_part_sizeZ part_sizeZ min_part_sizeZpower©r ú1lib/python3.7/site-packages/boto/glacier/utils.pyÚminimum_part_size"s      rcCsxtt t|ƒt|ƒ¡ƒ}g}x@t|ƒD]4}||}|d|}| t |||…¡  ¡¡q(W|stt d¡  ¡gS|S)Nró) r r ZceilÚlenÚfloatÚrangeÚappendÚhashlibÚsha256Údigest)Z bytestringÚ chunk_sizeZ chunk_countÚhashesÚiÚstartÚendr r r Ú chunk_hashesJs  rcCsšg}| |¡x‚t|ƒdkrg}xbt|ƒdkr\| d¡}| d¡}| t ||¡ ¡¡q"t|ƒdkr~| d¡}| |¡q"Pq"W| |¡qW|dS)z¤ Given a hash of each 1MB chunk (from chunk_hashes) this will hash together adjacent hashes until it ends up with one big one. So a tree of hashes. rr)ÚextendrÚpoprrrr)ZforZ new_hashesÚfirstÚsecondZonlyr r r Ú tree_hashVs       r!cCs²tjr"t|dƒr"d|jkr"tdƒ‚t ¡}g}| |¡}xP|rˆt|t ƒs^|  t |ddƒpZd¡}|  |¡|  t |¡ ¡¡| |¡}q:W|sžt d¡ ¡g}| ¡tt|ƒƒfS)aÎCompute the linear and tree hash from a fileobj. This function will compute the linear/tree hash of a fileobj in a single pass through the fileobj. :param fileobj: A file like object. :param chunk_size: The size of the chunks to use for the tree hash. This is also the buffer size used to read from `fileobj`. :rtype: tuple :return: A tuple of (linear_hash, tree_hash). Both hashes are returned in hex. ÚmodeÚbz/File-like object must be opened in binary mode!ÚencodingÚzutf-8r)rZPY3Úhasattrr"r rrÚreadÚ isinstanceÚbytesÚencodeÚgetattrÚupdaterrZ hexdigestÚ bytes_to_hexr!)ZfileobjrZ linear_hashZchunksÚchunkr r r Úcompute_hashes_from_fileobjns   r/cCs t |¡S)N)ÚbinasciiZhexlify)Ú str_as_bytesr r r r-”sr-cCsttt|ƒƒƒS)z² :type str_as_bytes: str :param str_as_bytes: The string for which to compute the tree hash. :rtype: str :return: The computed tree hash, returned as hex. )r-r!r)r1r r r Útree_hash_from_str˜s r2c@seZdZdd„Zdd„ZdS)ÚResettingFileSendercCs||_| ¡|_dS)N)Ú_archiveÚtellÚ_starting_offset)ÚselfÚarchiver r r Ú__init__¦szResettingFileSender.__init__c Cs0z| |||j|¡| ¡S|j |j¡XdS)N)Zrequestr4Z getresponseÚseekr6)r7Z connectionÚmethodÚpathZbodyZheadersr r r Ú__call__ªszResettingFileSender.__call__N)Ú__name__Ú __module__Ú __qualname__r9r=r r r r r3¥sr3)r)rr r0Z boto.compatrrZDEFAULT_PART_SIZErrrr!r/r-r2Úobjectr3r r r r Ús  (  &