B \uJ@sdZddlmZddlZddlmZddlZddlm Z m Z ddZ Gd d d e Z Gd d d e ZGd ddeZGdddeZGdddeZddZddZddZddZddZdS)z4 High-level access to HDF5 dataspace selections )absolute_importN)xrange)h5sh5rc Cst|ts|f}t|dkr|d}t|trD|j|kr@td|St|tjrdt|}|||St|t j rt ||}||jkrtdt||dSxn|D]f}t|t s|t k ry(t|t|tjr|jdkrtWqtk rt|}|||SXqWt|}|||S)a" High-level routine to generate a selection from arbitrary arguments to __getitem__. The arguments should be the following: shape Shape of the "source" dataspace. args Either a single argument or a tuple of arguments. See below for supported classes of argument. dsid A h5py.h5d.DatasetID instance representing the source dataset. Argument classes: Single Selection instance Returns the argument. numpy.ndarray Must be a boolean mask. Returns a PointSelection instance. RegionReference Returns a Selection instance. Indices, slices, ellipses only Returns a SimpleSelection instance Indices, slices, ellipses, lists or boolean index arrays Returns a FancySelection instance. rzMismatched selection shapez,Reference shape does not match dataset shape)spaceid)r) isinstancetuplelen Selectionshape TypeErrornpndarrayPointSelectionrZRegionReferenceZ get_regionsliceEllipsisint ExceptionFancySelectionSimpleSelection)r argsdsidargZselsidar2lib/python3.7/site-packages/h5py/_hl/selections.pyselects<            rc@s eZdZdZddZddZdS) _RegionProxyz Thin proxy object which takes __getitem__-style index arguments and produces RegionReference objects. Example: >>> dset = myfile['dataset'] >>> myref = dset.regionref[0:100,20:30] >>> data = dset[myref] cCs ||_dS)z& Supply a h5py.h5d.DatasetID instance N)id)selfrrrr__init__msz_RegionProxy.__init__cCs(t|jj||j}t|jdtj|jS)z Takes arbitrary selection terms and produces a RegionReference object. Selection must be compatible with the dataset. .)rr!r rZcreateZDATASET_REGION)r"rZ selectionrrr __getitem__qsz_RegionProxy.__getitem__N)__name__ __module__ __qualname____doc__r#r%rrrrr as r c@sZeZdZdZdddZeddZeddZed d Zed d Z d dZ ddZ dS)r a Base class for HDF5 dataspace selections. Subclasses support the "selection protocol", which means they have at least the following members: __init__(shape) => Create a new selection on "shape"-tuple __getitem__(args) => Perform a selection with the range specified. What args are allowed depends on the particular subclass in use. id (read-only) => h5py.h5s.SpaceID instance shape (read-only) => The shape of the dataspace. mshape (read-only) => The shape of the selection region. Not guaranteed to fit within "shape", although the total number of points is less than product(shape). nselect (read-only) => Number of selected points. Always equal to product(mshape). broadcast(target_shape) => Return an iterable which yields dataspaces for read, based on target_shape. The base class represents "unshaped" selections (1-D). NcCsN|dk r||_|j|_n2t|}||_t|tjft||_|jdS)z= Create a selection. Shape may be None if spaceid is given. N) _idr _shaper rZ create_simpleZ UNLIMITEDr select_all)r"r rrrrr#s zSelection.__init__cCs|jS)z SpaceID instance )r*)r"rrrr!sz Selection.idcCs|jS)z Shape of whole dataspace )r+)r"rrrr szSelection.shapecCs |jS)z' Number of elements currently selected )r*get_select_npoints)r"rrrnselectszSelection.nselectcCs|jfS)z0 Shape of selection (always 1-D for this class) )r.)r"rrrmshapeszSelection.mshapeccs$t||jkrtd|jVdS)z" Get an iterable for broadcasting z7Broadcasting is not supported for point-wise selectionsN)rproductr.rr*)r" target_shaperrr broadcastszSelection.broadcastcCs tddS)Nz$This class does not support indexing)NotImplementedError)r"rrrrr%szSelection.__getitem__)N) r&r'r(r)r#propertyr!r r.r/r2r%rrrrr xs    r c@s8eZdZdZddZddZddZdd Zd d Zd S) rz Represents a point-wise selection. You can supply sequences of points to the three methods append(), prepend() and set(), or a single boolean array to __getitem__. cCsntj|ddd}t|jdkr.d|jdf|_|jtjkrDtj}t|dkr\|j n|j ||dS)z7 Internal method which actually performs the selection Cu8)orderdtyperrN) rZasarrayr r r*get_select_typer SEL_POINTS SELECT_SET select_noneZselect_elements)r"pointsoprrr_perform_selections  z!PointSelection._perform_selectioncCsPt|tjr|jjdks td|j|jks4tdt|}| ||S)z9 Perform point-wise selection from a NumPy boolean array bz6PointSelection __getitem__ only works with bool arraysz-Boolean indexing array has incompatible shape) r rrr8Zkindrr Z transposenonzeroset)r"rr=rrrr%s  zPointSelection.__getitem__cCs||tjdS)z@ Add the sequence of points to the end of the current selection N)r?rZ SELECT_APPEND)r"r=rrrappendszPointSelection.appendcCs||tjdS)zF Add the sequence of points to the beginning of the current selection N)r?rZSELECT_PREPEND)r"r=rrrprependszPointSelection.prependcCs||tjdS)z@ Replace the current selection with the given sequence of pointsN)r?rr;)r"r=rrrrBszPointSelection.setN) r&r'r(r)r?r%rCrDrBrrrrrs  rc@s4eZdZdZeddZddZddZdd Zd S) rz A single "rectangular" (regular) selection composed of only slices and integer arguments. Can participate in broadcasting. cCs|jS)z Shape of current selection )_mshape)r"rrrr/szSimpleSelection.mshapecOsFtj||f||t|j}d||jd|d|f|_|j|_dS)N)r)r)F)r r#r r _selrE)r"r rkwdsrankrrrr#s zSimpleSelection.__init__cCst|ts|f}|jdkrLt|dkr>|dtdfkr>td|j|St|j|\}}}}|j |||||||f|_ tddt ||D|_ |S)Nrrz7Invalid index for scalar dataset (only ..., () allowed)css|]\}}|s|VqdS)Nr).0xyrrr sz.SimpleSelection.__getitem__..) r r r r rrr*r,_handle_simpleselect_hyperslabrFziprE)r"rstartcountstepscalarrrrr%s   zSimpleSelection.__getitem__ccs|jdkr:t|dkr$td||j|jVdS|j\}}}}t|}t|}g}xtt d|dD]b} t|dks|| r| dql| } | dks|| | kr| | qltd||j fqlWt dd|Drtd||j f|t|}td d t||D} tt| } | dkr@|jVnd|j} | d |||xFt | D]:} td d tt| | |||D}| || VqfWdS) z Return an iterator over target dataspaces for broadcasting. Follows the standard NumPy broadcasting rules against the current selection shape (self.mshape). rrzCan't broadcast %s to scalarNrzCan't broadcast %s -> %scSsg|] }|dkqS)rr)rInrrr -sz-SimpleSelection.broadcast..css|]\}}||VqdS)Nr)rIrJrKrrrrL5sz,SimpleSelection.broadcast..)rcss&|]\}}}}||||VqdS)Nr)rIrJrKzsrrrrL>s)r rr0rr*r,rFr listrrCpopr/anyreverser rOrcopyrNZ unravel_indexZ offset_simple)r"r1rPrQrRrSrHtargetZtshapeidxtZchunksZnchunksroffsetrrrr2s>        $ zSimpleSelection.broadcastN) r&r'r(r)r4r/r#r%r2rrrrrs  rc@s4eZdZdZeddZddZddZdd Zd S) ra( Implements advanced NumPy-style selection operations in addition to the standard slice-and-int behavior. Indexing arguments may be ints, slices, lists of indicies, or per-axis (1D) boolean arrays. Broadcasting is not supported for these selections. cCs|jS)N)rE)r"rrrr/OszFancySelection.mshapecOs tj||f|||j|_dS)N)r r#r rE)r"r rrGrrrr#SszFancySelection.__init__c sJt|ts|f}t|t|j}i}xt|D]\}}t|ts.t|dr||jt dkr|t|jdkrpt d| d}yt |||<Wnt k rYq.Xt |}t |dd|dd}tdd|Dr.t d q.Wt|dkrt d t|dkr t d tt |dtfd d|DsHt d |g}xJtD]>}t |}x$t|D]\} } | ||| <qnW||qVW|jx@t|D]4\}} t|j| \} } }}|jj| | |tjdqWt | }xDtt|D]4}||krt||||<n||rd||<qWtdd|D|_dS)Nr8boolrz#Boolean indexing arrays must be 1-Drcss|]\}}||kVqdS)Nr)rIZfstZsndrrrrLnsz-FancySelection.__getitem__..z-Indexing elements must be in increasing orderzMOnly one indexing vector or array is currently allowed for advanced selectionz Advanced selection inappropriatec3s|]}t|kVqdS)N)r )rIrJ) vectorlengthrrrLwsz3All sequence arguments must have the same length %s)r>css|]}|dkr|VqdS)rNr)rIrJrrrrLs)r r _expand_ellipsisr r enumeraterhasattrr8rrrArXrOrZvaluesallrsixZ iteritemsrCr*r<rMrNrZ SELECT_ORrE)r"rZ sequenceargsr^rZlist_argZadjacentZ argvectorentryZpositionseqZvectorrPrQrRrSr/r)rcrr%WsT         zFancySelection.__getitem__ccs||jkstd|jVdS)Nz4Broadcasting is not supported for complex selections)r/rr*)r"r1rrrr2s zFancySelection.broadcastN) r&r'r(r)r4r/r#r%r2rrrrrCs   @rcCstdd|D}|dkr$tdn|dkrBt||krB|tf}g}t|}x@|D]8}|tkr|tdddf||dqT||qTWt||krtd|S)z7 Expand ellipsis objects and fill in missing axes. css|]}|tkrdVqdS)rN)r)rIrrrrrLsz#_expand_ellipsis..rzOnly one ellipsis may be used.rNzArgument sequence too long)sum ValueErrorr rextendrrCr)rrHZn_elZ final_argsZn_argsrrrrrds   " rdc Cst|t|}g}g}g}g}xt||D]\}}t|trRt||\}} } d} n>ytt||\}} } d} Wn tk rtd|YnX| || | | | | | q*Wt |t |t |t |fS)aU Process a "simple" selection tuple, containing only slices and integer objects. Return is a 4-tuple with tuples for start, count, step, and a flag which tells if the axis is a "scalar" selection (indexed by an integer). If "args" is shorter than "shape", the remaining axes are fully selected. FTz.Illegal index "%s" (must be a slice or number)) rdr rOr r_translate_slice_translate_intrrrCr ) r rrPrQrRrSrlengthrJrKrVrWrrrrMs&     rMcCsD|dkr||}d|kr$|ks:ntd||df|ddfS)zk Given an integer index, return a 3-tuple (start, count, step) for hyperslab selection rzIndex (%s) out of range (0-%s)r)rm)exprqrrrrps rpcCsN||\}}}|dkr$td|||kr0dSd||d|}|||fS)z Given a slice object, return a 3-tuple (start, count, step) for use with the hyperslab selection routines rzStep must be >= 1 (got %d))rrr)indicesrm)rrrqrPstoprRrQrrrros rocs8}}|tjkrdS|tjkrH|tjkr6dS|tjkr^tSn|tjkr^t d| t j }|tjkrd|S|tjkrj S|tj krfS|tjkrt d|dkrd|SddD\}|t|ffdd tfd dt|D}t|kr4fS|S) a0 Given a dataspace, try to deduce the shape of the selection. Returns one of: * A tuple with the selection shape, same length as the dataspace * A 1D selection shape for point-based and multiple-hyperslab selections * None, for unselected scalars and for NULL dataspaces NzUnrecognized dataspace class %s)rz Unrecognized selection method %srcss|]}t|VqdS)N)rZarray)rIrJrrrrL%szguess_shape..csr|dkrdS}||d7<}||d8<|}|jt|t|tjd|}|S)a Determine the number of elements selected along a particular axis. To do this, we "mask off" the axis by making a hyperslab selection which leaves only the first point along the axis. For a 2D dataset with selection box shape (X, Y), for axis 1, this would leave a selection of shape (X, 1). We count the number of points N_leftover remaining in the selection and compute the axis selection length by N_axis = N/N_leftover. r)r>)r\rNr rZ SELECT_NOTBr-)rZaxisrPrQZ masked_sidZ N_leftover)N bottomcornerboxshaperr get_n_axis*s zguess_shape..get_n_axisc3s|]}|VqdS)Nr)rIrJ)rxrrrrLFs)Zget_simple_extent_typer9rZNULLZSCALARZSEL_NONEZSEL_ALLr ZSIMPLErr-r r r:ZSEL_HYPERSLABSZget_select_boundsrZonesrr0)rZ sel_classZsel_typerHZ topcornerr r)rurvrwrxrr guess_shapes<             ry)r)Z __future__rriZ six.movesrZnumpyrrrrobjectr r rrrrdrMrproryrrrrs   FC.ZY!