B q\ @sddlZddlZddlZddlmZddlZddlmZyddlm Z Wne k r`dZ YnXddl m Z m Z ddlmZddlmZddlmZmZdd lmZd d lmZd d lmZd d lmZd dlmZmZeZ Gddde!Z"e#de"ddZ$e%ej&ej'ej(ej)ej*ej+ej,ej-ej.ej/ej0g Z1d#ddZ2Gdddej3Z4GdddeZ5Gdddeej3Z6Gddde6Z7Gdd d e5Z8Gd!d"d"e7eej9Z:dS)$N)deepcopy)ma)MaskedArrayFutureWarning)UnitQuantity) color_print)MetaData)BaseColumnInfodtype_info_name)dtype_bytes_or_chars)groups)pprint)fix_column_name)_ColumnGetitemShim_MaskedColumnGetitemShimc@seZdZdZdS)StringTruncateWarninga% Warning class for when a string column is assigned a value that gets truncated because the base (numpy) string length is too short. This does not inherit from AstropyWarning because we want to use stacklevel=2 to show the user where the issue occurred in their code. N)__name__ __module__ __qualname____doc__rr3lib/python3.7/site-packages/astropy/table/column.pyr&sralwayscs"ddlmfddt|DS)Nr )confcsg|]}tj|qSr)strZ auto_colnameformat).0i)rrr 8sz_auto_names..)rrange)Zn_colsr)rr _auto_names6s r"TcCst|tr|S|jj}|jj}d|j_g|j_z\t|drF|nt|}|j|_|rft|pbgng|j_x|jjD]}|||qxWWd||j_||j_X|S)a Mixin-safe version of Column.copy() (with copy_data=True). Parameters ---------- col : Column or mixin column Input column copy_indices : bool Copy the column ``indices`` attribute Returns ------- col : Copy of input column Ncopy) isinstance BaseColumnr#info parent_tableindiceshasattrr replace_col)col copy_indicesr'r(Znewcolindexrrrcol_copyDs  r.c@s eZdZdZddZddZdS) FalseArraya Boolean mask array that is always False. This is used to create a stub ``mask`` property which is a boolean array of ``False`` used by default for mixin columns and corresponding to the mixin column data shape. The ``mask`` looks like a normal numpy array but an exception will be raised if ``True`` is assigned to any element. The consequences of the limitation are most obvious in the high-level table operations. Parameters ---------- shape : tuple Data shape cCstj|td|}|S)N)dtype)npzerosboolview)clsshapeobjrrr__new__~szFalseArray.__new__cCs*t|}t|r&td|jjdS)Nz+Cannot set any element of {0} class to True)r1asarrayany ValueErrorr __class__r)selfitemvalrrr __setitem__s  zFalseArray.__setitem__N)rrrrr8r@rrrrr/nsr/c@s$eZdZdZejZdZdddZdS) ColumnInfoz Container for meta information like name, description, format. This is required when the object is used as a mixin column within a table, but can be used as a general way to store meta information. TwarnNcCs$||||d}|jfd|i|S)a Return a new Column instance which is consistent with the input ``cols`` and has ``length`` rows. This is intended for creating an empty column object whose elements can be set in-place for table operations like join or vstack. Parameters ---------- cols : list List of input columns length : int Length of the output column object metadata_conflicts : str ('warn'|'error'|'silent') How to handle metadata conflicts name : str Output column name Returns ------- col : Column (or subclass) New instance of this class consistent with ``cols`` )metaunitr descriptionlength)Zmerge_cols_attributesZ _parent_cls)r=ZcolsrFZmetadata_conflictsnameattrsrrrnew_likes zColumnInfo.new_like)rBN) rrrrr attr_namesZattrs_from_parentZ_supports_indexingrIrrrrrAsrAc s~eZdZeZdBddZedd Zed d Zej d d Ze Z dCddZ ddZ ddZfddZdDfdd ZeddZej ddZeddZej ddZeddZd d!Zd"d#Zed$d%ZdEd&d'ZdFd(d)ZdGd*d+Zed,d-Zej d.d-Zejd/d-Zgfd0d1Zed2d3Zd4d5Zd6d7Zd8d9Z ed:d;Z!gfdd?Z#e$d@dAZ%Z&S)Hr%NrrFTc Cs|dkr*t|j|f}tj||d} nt|trt|drtj|j|| d} |dkr^|j }|dkrp|pn|j }|dkr~|j }| dkrt |j } |dkr|j}nt|tr|dkrtj||| d} |j }ntj|||| d} |dkr|jj }|dkr|jj }| dkrHt |jj } n,t|jdkr8||}tj||| d} | |} t|| _d| _|| _ || _|| _ | | _ | rt t|dgng| _x| jD]}||| qW| S)N)r0_name)r0r#Sr()r1r0rr2r$r%r)arraydatarErDrrrCrGrtor&char _encode_strr4rrK _parent_table_formatgetattrr(r*)r5rNrGr0r6rFrErDrrCr#r, self_datar=r-rrrr8sP         zBaseColumn.__new__cCs |tjS)N)r4r1ndarray)r=rrrrNszBaseColumn.datacCs t|dddkrdS|SdS)NrR)rTrR)r=rrrr'szBaseColumn.parent_tablecCs |dkrd|_n t||_dS)N)rRweakrefref)r=tablerrrr'sCcCsR|dkr|j}|r||}||j}||t|trD|j|_|||S)am Return a copy of the current instance. If ``data`` is supplied then a view (reference) of ``data`` is used, and ``copy_data`` is ignored. Parameters ---------- order : {'C', 'F', 'A', 'K'}, optional Controls the memory layout of the copy. 'C' means C-order, 'F' means F-order, 'A' means 'F' if ``a`` is Fortran contiguous, 'C' otherwise. 'K' means match the layout of ``a`` as closely as possible. (Note that this function and :func:numpy.copy are very similar, but have different default values for their order= arguments.) Default is 'C'. data : array, optional If supplied then use a view of ``data`` instead of the instance data. This allows copying the instance attributes and meta. copy_data : bool, optional Make a copy of the internal numpy array instead of using a reference. Default is True. Returns ------- col : Column or MaskedColumn Copy of the current column (same type as original) N) rNr#r4r<__array_finalize__r$ MaskedColumnZ_mask _copy_groups)r=orderrNZ copy_dataoutrrrr#s     zBaseColumn.copycCsxd}ddt||dD}|dd}t|tjr:tjntj}|||x |D]\}}t|||qVWd|_ dS)z Restore the internal state of the Column/MaskedColumn for pickling purposes. This requires that the last element of ``state`` is a 5-tuple that has Column-specific state values. )rK_unitrSrErCr(cSsi|]\}}||qSrr)rrGr?rrr 8sz+BaseColumn.__setstate__..N) zipr$r MaskedArrayr1rV __setstate__itemssetattrrR)r=statenamesrH super_classrGr?rrrre0s  zBaseColumn.__setstate__cCsXt|tjrtjntj}||\}}}|j|j|j|j |j |j f}||f}|||fS)z Return a 3-tuple for pickling a Column. Use the super-class functionality but then add in a 5-tuple of Column-specific values that get used in __setstate__. ) r$rrdr1rV __reduce__rGrDrrErCr()r=rjZreconstruct_funcZreconstruct_func_argsrhZ column_staterrrrkJs   zBaseColumn.__reduce__csH|dkr dSttjr$t|d|_t|ds:g|_||dS)Nr()callablesuperr[r'r)r( _copy_attrs)r=r7)r<rrr[Zs   zBaseColumn.__array_finalize__csJt||}|j|jks8t|trB|dk rB|dtkrB|jdS|SdS)a __array_wrap__ is called at the end of every ufunc. Normally, we want a Column object back and do not have to do anything special. But there are two exceptions: 1) If the output shape is different (e.g. for reduction ufuncs like sum() or mean()), a Column still linking to a parent_table makes little sense, so we return the output viewed as the column content (ndarray or MaskedArray). For this case, we use "[()]" to select everything, and to ensure we convert a zero rank array to a scalar. (For some reason np.sum() returns a zero rank scalar array while np.mean() returns a scalar; So the [()] is needed for this case. 2) When the output is created by any function that returns a boolean we also want to consistently return an array rather than a column (see #1446 and #1685) Nrr)rm__array_wrap__r6r$r%_comparison_functionsrN)r=Zout_arrcontext)r<rrrojs    zBaseColumn.__array_wrap__cCs|jS)z* The name of this column. )rK)r=rrrrGszBaseColumn.namecCs2t|}|jdk r(|j}|j|j|||_dS)N)rr'columnsZ_rename_columnrGrK)r=r?rYrrrrGs  cCs|jS)zE Format string for displaying values in this column. )rS)r=rrrrszBaseColumn.formatc Csht|dd}||_y|jddWn@tk rb}z"||_td|j|jdWdd}~XYnXdS)NrSr ) max_linesz`Invalid format for column '{0}': could not display values in this column using this format ({1})r)rTrSpformat Exceptionr;rrGargs)r= format_stringZ prev_formaterrrrrrs cCs|j|jj|jddfS)zArray-interface compliant full description of the column. This returns a 3-tuple (name, type, shape) that can always be used in a structured array dtype definition. r N)rGr0rr6)r=rrrdescrszBaseColumn.descrccs0|jj}x"||ddddidD] }|VqWdS)z Return an iterator that yields the string-formatted values of this column. Returns ------- str_vals : iterator Column values formatted as strings rbF) show_name show_unit show_dtypeoutsN) _formatter_pformat_col_iter)r=rZstr_valrrr iter_str_valss  zBaseColumn.iter_str_valscs2ttstdd}tfdd|D}|S)a{Compare the column attributes of ``col`` to this object. The comparison attributes are: ``name``, ``unit``, ``dtype``, ``format``, ``description``, and ``meta``. Parameters ---------- col : Column Comparison column Returns ------- equal : boolean True if all attributes are equal z8Comparison `col` must be a Column or MaskedColumn object)rGrDr0rrErCc3s"|]}t|t|kVqdS)N)rT)rx)r+r=rr sz)BaseColumn.attrs_equal..)r$r%r;all)r=r+rHequalr)r+r=r attrs_equals  zBaseColumn.attrs_equalcCs|jdkrtS|jjS)N)r' FORMATTERZ formatter)r=rrrr~szBaseColumn._formatterc Cs$|jj}|||||||d\}}|S)aReturn a list of formatted string representation of column values. If no value of ``max_lines`` is supplied then the height of the screen terminal is used to set ``max_lines``. If the terminal height cannot be determined then the default will be determined using the ``astropy.conf.max_lines`` configuration item. If a negative value of ``max_lines`` is supplied then there is no line limit applied. Parameters ---------- max_lines : int Maximum lines of output (header + data rows) show_name : bool Include column name. Default is True. show_unit : bool Include a header row for unit. Default is False. show_dtype : bool Include column dtype. Default is False. html : bool Format the output as an HTML table. Default is False. Returns ------- lines : list List of lines with header and formatted column values )rzr{r|html)r~ _pformat_col) r=rsrzr{r|rrlinesr}rrrrts " zBaseColumn.pformatc Cs\|jj}||||||d\}}|d}x0t|D]$\} } | |krLt| dq0t| q0WdS)a Print a formatted string representation of column values. If no value of ``max_lines`` is supplied then the height of the screen terminal is used to set ``max_lines``. If the terminal height cannot be determined then the default will be determined using the ``astropy.conf.max_lines`` configuration item. If a negative value of ``max_lines`` is supplied then there is no line limit applied. Parameters ---------- max_lines : int Maximum number of values in output show_name : bool Include column name. Default is True. show_unit : bool Include a header row for unit. Default is False. show_dtype : bool Include column dtype. Default is True. )rzr{r|n_headerZredN)r~r enumeraterprint) r=rsrzr{r|rrr}rrlinerrrrs   zBaseColumn.pprintcCs|jj}|||||ddS)aInteractively browse column with a paging interface. Supported keys:: f, : forward one page b : back one page r : refresh same page n : next row p : previous row < : go to beginning > : go to end q : quit browsing h : print this help Parameters ---------- max_lines : int Maximum number of lines in table output. show_name : bool Include a header row for column names. Default is True. show_unit : bool Include a header row for unit. Default is False. )rsrzr{N)r~ _more_tabcol)r=rsrzr{rrrrmore3szBaseColumn.morecCs|jS)a The unit associated with this column. May be a string or a `astropy.units.UnitBase` instance. Setting the ``unit`` property does not change the values of the data. To perform a unit conversion, use ``convert_unit_to``. )r`)r=rrrrDRs zBaseColumn.unitcCs"|dkrd|_nt|dd|_dS)NZsilent)Z parse_strict)r`r)r=rDrrrrD]scCs d|_dS)N)r`)r=rrrrDdscCs:|jdkrtd|jj||j|d|jdd<||_dS)a Converts the values of the column in-place from the current unit to the given unit. To change the unit associated with this column without actually changing the data values, simply set the ``unit`` property. Parameters ---------- new_unit : str or `astropy.units.UnitBase` instance The unit to convert to. equivalencies : list of equivalence pairs, optional A list of equivalence pairs to try if the unit are not directly convertible. See :ref:`unit_equivalencies`. Raises ------ astropy.units.UnitsError If units are inconsistent NzNo unit set on column) equivalencies)rDr;rOrN)r=Znew_unitrrrrconvert_unit_tohs  zBaseColumn.convert_unit_tocCst|dst||_|jS)N_groups)r)r ColumnGroupsr)r=rrrr s  zBaseColumn.groupscCs t||S)a Group this column by the specified ``keys`` This effectively splits the column into groups which correspond to unique values of the ``keys`` grouping object. The output is a new `Column` or `MaskedColumn` which contains a copy of this column but sorted by row according to ``keys``. The ``keys`` input to ``group_by`` must be a numpy array with the same length as this column. Parameters ---------- keys : numpy array Key grouping object Returns ------- out : Column New column with groups attribute set accordingly )r Zcolumn_group_by)r=keysrrrgroup_byszBaseColumn.group_bycCsL|jr*t|jdrHtj||jjjd|_nt|drHtj||jjd|_dS)zA Copy current groups into a copy of self ``out`` r)r(N)r'r)r rrZ_indices)r=r_rrrr]s   zBaseColumn._copy_groupscCst|S)N)r1r9__repr__)r=rrrrszBaseColumn.__repr__cCst||jd|jdddS)z A view of this table column as a `~astropy.units.Quantity` object with units given by the Column's `unit` parameter. FAT)r#r0r^Zsubok)rrDr0)r=rrrquantitys zBaseColumn.quantitycKs|j||S)a Converts this table column to a `~astropy.units.Quantity` object with the requested units. Parameters ---------- unit : `~astropy.units.Unit` or str The unit to convert to (i.e., a valid argument to the :meth:`astropy.units.Quantity.to` method). equivalencies : list of equivalence pairs, optional Equivalencies to use for this conversion. See :meth:`astropy.units.Quantity.to` for more details. Returns ------- quantity : `~astropy.units.Quantity` A quantity object with the contents of this column in the units ``unit``. )rrO)r=rDrkwargsrrrrOsz BaseColumn.tocCs<x$dD]}t||d}t|||qWtt|di|_dS)zA Copy key column attributes from ``obj`` to self )rGrDrSrENrC)rTrgrrC)r=r7attrr?rrrrns  zBaseColumn._copy_attrscCs~t|tr|d}ndt|tsz|tjjkr.nLt|}|jj dkrvtj j|dd}t|tjj rvtjj ||j dd}|}|S)zm Encode anything that is unicode-ish as utf-8. This method is only called for Py3+. zutf-8U)encodingF)maskr#) r$rencodebytesr1rmaskedr9r0rPrdrMr)valueZarrrrrrQs    zBaseColumn._encode_str) NNNrrNNNNFT)rZNT)N)NTFFF)NTFF)NTF)'rrrrrCr8propertyrNr'setterrAr&r#rerkr[rorGrryrrr~rtrrrDdeleterrr rr]rrrOrn staticmethodrQ __classcell__rr)r<rr%sL 4   ,      ' #       r%c seZdZdZd#fdd Zfd d Zd$d d Zd dZddZddZ ddZ ddZ ddZ ddZ e dZe dZe dZe dZe dZe d Zd%d!d"ZejZejZejZejZejZejZejZejZejZZS)&Columna Define a data column for use in a Table object. Parameters ---------- data : list, ndarray or None Column data values name : str Column name and key for reference within Table dtype : numpy.dtype compatible value Data type for column shape : tuple or () Dimensions of a single row element in the column data length : int or 0 Number of row elements in column data description : str or None Full description of column unit : str or None Physical unit format : str or None or function or callable Format string for outputting column values. This can be an "old-style" (``format % value``) or "new-style" (`str.format`) format specification string or a function or any callable object that accepts a single value and returns a string. meta : dict-like or None Meta-data associated with the column Examples -------- A Column can be created in two different ways: - Provide a ``data`` value but not ``shape`` or ``length`` (which are inferred from the data). Examples:: col = Column(data=[1, 2], name='name') # shape=(2,) col = Column(data=[[1, 2], [3, 4]], name='name') # shape=(2, 2) col = Column(data=[1, 2], name='name', dtype=float) col = Column(data=np.array([1, 2]), name='name') col = Column(data=['hello', 'world'], name='name') The ``dtype`` argument can be any value which is an acceptable fixed-size data-type initializer for the numpy.dtype() method. See ``_. Examples include: - Python non-string type (float, int, bool) - Numpy non-string type (e.g. np.float32, np.int64, np.bool\_) - Numpy.dtype array-protocol type strings (e.g. 'i4', 'f8', 'S15') If no ``dtype`` value is provide then the type is inferred using ``np.array(data)``. - Provide ``length`` and optionally ``shape``, but not ``data`` Examples:: col = Column(name='name', length=5) col = Column(name='name', dtype=int, length=10, shape=(3,4)) The default ``dtype`` is ``np.float64``. The ``shape`` argument is the array shape of a single cell in the column. NrrFTc sFt|trt|jrtdtj|||||||||| | | d } | S)Nz;Cannot convert a MaskedColumn with masked value to a Column) rNrGr0r6rFrErDrrCr#r,)r$r\r1r:r TypeErrorrmr8) r5rNrGr0r6rFrErDrrCr#r,r=)r<rrr83s  zColumn.__new__cst|ts|dkrtdt|||dkr~t|jjtj r~y|j |}Wntk rdYnX||k r~|j |j |dS)Nrz5cannot set mask value to a column in non-masked TablerD)r$r\AttributeErrorrm __setattr__ issubclassr0typer1Znumberr'Z_convert_col_for_tableZreplace_columnrG)r=r>rZ converted)r<rrrAszColumn.__setattr__c Cs|jdkrt|S|jjg}|jdkr.dnt|j}|jdkrFdn |jdd}xdd|jfdt |j fd|fd|fd|j fd|j fd t |ffD]"\}}|dk r|d ||qWd d |d }|rddlm}||}|jj|ddd|d\} } |d| } | S)Nrr rGr0r6rDrrErFz {0}={1!r}< z> ) xml_escapeF)rzr{Z show_lengthr )ndimreprr>r<rrDrr6rGr r0rrElenappendjoinZastropy.utils.xml.writerrr~r) r=rZ descr_valsrDr6rr?ryrZ data_linesr}r_rrr _base_repr_Os,      zColumn._base_repr_cCs |jddS)NT)r)r)r=rrr _repr_html_oszColumn._repr_html_cCs |jddS)NF)r)r)r=rrrrrszColumn.__repr__cCs0|jdkrt|S|j|\}}d|S)Nrr)rrr>r~rr)r=rr}rrr__str__us  zColumn.__str__cCst|dS)Nzutf-8)rr)r=rrr __bytes__}szColumn.__bytes__cCs\tj||jjd}|jdkr dStj|}t|j}||krXt j d |t dddS)z{ Emit a warning if any elements of ``value`` will be truncated when ``value`` is assigned to self. )r0rNzLtruncated right side string(s) longer than {} character(s) during assignment) stacklevel) r1 asanyarrayr0rsizerPZstr_lenmaxr warningsrBrr)r=rZ value_str_lenZ self_str_lenrrr_check_string_truncates  zColumn._check_string_truncatecCsR|jjdkr||}t|jjtjr0|||j ||t |||j |<dS)NrL) r0rPrQrrr1 characterrr&adjust_indicesrrN)r=r-rrrrr@s    zColumn.__setitem__cs(dddddddfdd }|S) z Make comparison methods which encode the ``other`` object to utf-8 in the case of a bytestring dtype for Py3+. __eq____ne____lt____gt____le____ge__)rrrrrrcsd}t|tr>|jjdkr>t|tr>|jjdkr>||}}}|jjdkrT||}t|j||S)NrrL)r$r\r0kindrPrQrTrN)r=otherop)oper swapped_operrr_compares    z&Column._make_compare.._comparer)rrr)rrr _make_compares zColumn._make_comparerrrrrrcCsd|jjdkr(tj||d|d}|||<n"tj||jd}tj||||d}||j}|||S)a Insert values before the given indices in the column and return a new `~astropy.table.Column` object. Parameters ---------- obj : int, slice or sequence of ints Object that defines the index or indices before which ``values`` is inserted. values : array_like Value(s) to insert. If the type of ``values`` is different from that of quantity, ``values`` is converted to the matching type. ``values`` should be shaped so that it can be broadcast appropriately axis : int, optional Axis along which to insert ``values``. If ``axis`` is None then the column array is flattened before insertion. Default is 0, which will insert a row. Returns ------- out : `~astropy.table.Column` A copy of column with ``values`` and ``mask`` inserted. Note that the insertion does not occur in-place: a new column is returned. ON)axis)r0)r0rr1insertr9r4r<r[)r=r7valuesrrNr_rrrrs    z Column.insert) NNNrrNNNNFT)F)r) rrrrr8rrrrrrrr@rrrrrrrrr%rGrDr#rrrtrrrOrrr)r<rrs<?  # )rcsFeZdZdZejdhBZdZejj Z d fdd Z fddZ Z S) MaskedColumnInfoa Container for meta information like name, description, format. This is required when the object is used as a mixin column within a table, but can be used as a general way to store meta information. In this case it just adds the ``mask_val`` attribute. serialize_methodrNFcs$t||r ddddd|_dS)N null_value data_mask)ZfitsZecsvZhdf5N)rm__init__r)r=Zbound)r<rrrs  zMaskedColumnInfo.__init__cslt}|j}|j|j}|dkrVt|jrh|jj|d<|j|d<|j d7_ n|dkr`nt d|S)NrrNr)rNrrz;serialize method must be either "data_mask" or "null_value") rm_represent_as_dictZ_parentrZ_serialize_contextr1r:rrNZ_represent_as_dict_attrsr;)r=r_r+method)r<rrr(s     z#MaskedColumnInfo._represent_as_dict)F)rrrrrArJZ_represent_as_dict_primary_datar1rrZmask_valrrrrr)r<rrs   rc seZdZdZeZdddZed d Zej d d Zed d Z dfdd Z dddZ ddZ ddZejZejZejZejZejZejZZS)r\a Define a masked data column for use in a Table object. Parameters ---------- data : list, ndarray or None Column data values name : str Column name and key for reference within Table mask : list, ndarray or None Boolean mask for which True indicates missing or invalid data fill_value : float, int, str or None Value used when filling masked column elements dtype : numpy.dtype compatible value Data type for column shape : tuple or () Dimensions of a single row element in the column data length : int or 0 Number of row elements in column data description : str or None Full description of column unit : str or None Physical unit format : str or None or function or callable Format string for outputting column values. This can be an "old-style" (``format % value``) or "new-style" (`str.format`) format specification string or a function or any callable object that accepts a single value and returns a string. meta : dict-like or None Meta-data associated with the column Examples -------- A MaskedColumn is similar to a Column except that it includes ``mask`` and ``fill_value`` attributes. It can be created in two different ways: - Provide a ``data`` value but not ``shape`` or ``length`` (which are inferred from the data). Examples:: col = MaskedColumn(data=[1, 2], name='name') col = MaskedColumn(data=[1, 2], name='name', mask=[True, False]) col = MaskedColumn(data=[1, 2], name='name', dtype=float, fill_value=99) The ``mask`` argument will be cast as a boolean array and specifies which elements are considered to be missing or invalid. The ``dtype`` argument can be any value which is an acceptable fixed-size data-type initializer for the numpy.dtype() method. See ``_. Examples include: - Python non-string type (float, int, bool) - Numpy non-string type (e.g. np.float32, np.int64, np.bool\_) - Numpy.dtype array-protocol type strings (e.g. 'i4', 'f8', 'S15') If no ``dtype`` value is provide then the type is inferred using ``np.array(data)``. When ``data`` is provided then the ``shape`` and ``length`` arguments are ignored. - Provide ``length`` and optionally ``shape``, but not ``data`` Examples:: col = MaskedColumn(name='name', length=5) col = MaskedColumn(name='name', dtype=int, length=10, shape=(3,4)) The default ``dtype`` is ``np.float64``. The ``shape`` argument is the array shape of a single cell in the column. NrrFTc Cs|dkr,t|dd}|dk rFtj|| d}n|tjjkr>d}nt|}t|||||| | || | | d }tjj|||d}|dkrt|dddk r|j |j }||_ d|_ x|j D]}|||qW|S)NrF)r#) r0r6rFrGrDrrErCr#r,)rNr fill_value)rTr1rMrZnomaskrr%rdr8r0rrr'r(r*)r5rNrGrrr0r6rFrErDrrCr#r,rUr=r-rrrr8s$     zMaskedColumn.__new__cCs|S)N)Zget_fill_value)r=rrrrszMaskedColumn.fill_valuecCsd|_||dS)zSet fill value both in the masked column view and in the parent table if it exists. Setting one or the other alone doesn't work.N)Z _fill_valueZset_fill_value)r=r?rrrrscCs|tj}|j|_|S)N)r4rrdr)r=r_rrrrNs zMaskedColumn.datacsV|dkr|j}t|}|jdk r,|jjnt}||j||j|j|jt |j d}|S)aReturn a copy of self, with masked values filled with a given value. Parameters ---------- fill_value : scalar; optional The value to use for invalid entries (`None` by default). If `None`, the ``fill_value`` attribute of the array is used instead. Returns ------- filled_column : Column A copy of ``self`` with masked entries replaced by `fill_value` (be it the function argument or the attribute of ``self``). N)rGrNrDrrErC) rrmfilledr'rrGrDrrErrC)r=rrNZ column_clsr_)r<rrrs  zMaskedColumn.filledc Cs|j}|jjdkr0tj|j|d|d}|||<n$tj||jd}tj|j|||d}|dkr~|jjdkrnd}ntj|jtd}tj|j |||d}tj j ||dd}| |j } d| _g| _| ||j| _| S)a Insert values along the given axis before the given indices and return a new `~astropy.table.MaskedColumn` object. Parameters ---------- obj : int, slice or sequence of ints Object that defines the index or indices before which ``values`` is inserted. values : array_like Value(s) to insert. If the type of ``values`` is different from that of quantity, ``values`` is converted to the matching type. ``values`` should be shaped so that it can be broadcast appropriately mask : boolean array_like Mask value(s) to insert. If not supplied then False is used. axis : int, optional Axis along which to insert ``values``. If ``axis`` is None then the column array is flattened before insertion. Default is 0, which will insert a row. Returns ------- out : `~astropy.table.MaskedColumn` A copy of column with ``values`` and ``mask`` inserted. Note that the insertion does not occur in-place: a new masked column is returned. rN)r)r0F)rr#)rNr0rr1rr9r2r6r3rrrMr4r<r'r(rnr) r=r7rrrZself_maZnew_dataZnew_maskZnew_mar_rrrrs$     zMaskedColumn.insertcCs2|j|jkr.d|_|j|jkr$g|_|||S)N)r<r'r(rn)r=r_rrr_copy_attrs_slice2s    zMaskedColumn._copy_attrs_slicec Cs|jjdkr||}t|jjtjrJtjj||jjd}| | d|j ||t |tdkrxtj|||n0t"tdttj|||WdQRXdS)NrL)r0r ignore)r0rPrQrrr1rrrrrr&rrrrdr@rcatch_warnings simplefilter)r=r-rrrrr@=s    zMaskedColumn.__setitem__) NNNNNrrNNNNFT)N)Nr)rrrrrr&r8rrrrNrrrr@r%rGr#rrrtrrrr)r<rr\As&F .   9 r\)T);rrWrer#rZnumpyr1rZ numpy.ma.corer ImportErrorZ astropy.unitsrrZastropy.utils.consolerZastropy.utils.metadatarZastropy.utils.data_infor r Zastropy.utils.miscr r r rZnp_utilsrZ_column_mixinsrrZTableFormatterr UserWarningrrr"setZgreaterZ greater_equalZlessZ less_equalZ not_equalrZisfiniteZisinfZisnanZsignZsignbitrpr.rVr/rAr%rrrdr\rrrrsN           *)D=