B F.\@ @s`ddlmZmZmZddlZddlmZmZdZefddZ dd Z d d Z d d Z ddZ dS))print_functiondivisionabsolute_importN) ensure_bytesnbytesic Cs|s|Sttt||kr|Sg}x|D]}t||krt|ttfrNt|}y |j}Wntk rpd}YnXxFt dt||||D]}| |||||qWq(| |q(W|S)a Split a list of frames into a list of frames of maximum size This helps us to avoid passing around very large bytestrings. Examples -------- >>> frame_split_size([b'12345', b'678'], n=3) # doctest: +SKIP [b'123', b'45', b'678'] r) maxmapr isinstancebytes bytearray memoryviewitemsizeAttributeErrorrangeappend)framesnoutframerir9lib/python3.7/site-packages/distributed/protocol/utils.pyframe_split_size s"      rcCst|d}|s|St|ttt|ks.ttddt||DrJ|S|ddd}|ddd}g}x|r|}g}xd|r|}t||kr|||t|8}q~t |}||d||||dd}q~W|d tt |qlW|S)z Merge frames into original lengths Examples -------- >>> merge_frames({'lengths': [3, 3]}, [b'123456']) [b'123', b'456'] >>> merge_frames({'lengths': [6]}, [b'123', b'456']) [b'123456'] lengthscss|]\}}t||kVqdS)N)len).0flrrr <szmerge_frames..Nr) listsumr rAssertionErrorallzippoprrjoinr)headerrrrrLrZmvrrr merge_frames+s.   r,cCs8dd|D}tdt|gdd|D}d|S)NcSsg|] }t|qSr)r)rrrrr Usz'pack_frames_prelude..QcSsg|]}tdt|qS)r.)structpackr)rrrrrr-Wsr")r/r0rr))rrrrrpack_frames_preludeTsr1cCs*t|g}t|tst|}d||S)z Pack frames into a byte-like object This prepends length information to the front of the bytes-like object See Also -------- unpack_frames r")r1r r#r))rZpreluderrr pack_frames[s  r2cCstd|dd\}g}d|d}xXt|D]L}td||dd|dd\}||||}||||7}q0W|S)z Unpack bytes into a sequence of frames This assumes that length information is at the front of the bytestring, as performed by pack_frames See Also -------- pack_frames r.Nrr)r/Zunpackrr)bZn_framesrstartrlengthrrrr unpack_framesls  &  r7)Z __future__rrrr/ZutilsrrZBIG_BYTES_SHARD_SIZErr,r1r2r7rrrrs !)