B T\V @sddlmZmZmZddlZddlZddlmZddlm Z m Z m Z m Z ddl mZddZe ejejed Ze ejejed Zd d ed ZdeiZee"ddlZejed <ejed <WdQRXy$ddlZejjed<ejjed<WnNek r8y ddlZejed<ejed<Wnek r2YnXYnXee2ddlmZmZmZeed<eed<eed<WdQRXe sddlZejed<ddZddZ dS))print_functiondivisionabsolute_importN)identity) gzip_compressgzip_decompressGzipFilePY2)ignoringcKs|S)N)filekwargsr r 5lib/python3.7/site-packages/dask/bytes/compression.py noop_file sr)gzipzlibbz2NcKstfd|i|S)NZfileobj)r )frr r rsr)rNsnappylz4)LZMAFile lzma_compresslzma_decompressZxzrc Csddlm}m}m}m}|dddd}|d|krD|d|ddd}x&||d d krz|dd|d 7}qVW|| d d||||}||j d||||j|}d d |Dd d |D|jdS)Nr)STREAM_HEADER_SIZEdecode_stream_footer decode_index LZMAErrorrcSs||}|| d|S)N)readseek)rsizedatar r r_peekIs zget_xz_blocks.._peekzfile too smallrscSsg|]\}}|jqSr )Zcompressed_file_offset).0ibr r r ^sz!get_xz_blocks..cSsg|]\}}|jqSr ) unpadded_size)r'r(r)r r rr*_s)ZoffsetsZlengthscheck) lzmaffirrrrr!tellZ backward_sizer,) fprrrrr$ZpaddingZ stream_flagsindexr r r get_xz_blocksDs"      r1cCsZddlm}m}m}||dd}|d|}|||t||d}||t|dS)Nr)decode_block_header_sizeLZMADecompressor FORMAT_BLOCKr)formatheaderr+r,)r-r2r3r4len decompress)r#r,r2r3r4Zhsizer6Zdcr r r xz_decompresscs  r9)!Z __future__rrrrrZtoolzrZ compatibilityrrr r Zutilsr rcompressr8filesZseekable_files ImportErrorrZ lz4.blockrblockZ LZ4_compressZLZ4_uncompressrrrZBZ2Filer1r9r r r rsT