B q\q9@s|dZddlZddlZddlZddlmZmZdZdZ ddgZ dd Z d d Z d d Z dddZddZdddZddZdS)z This package contains functions for reading and writing HDF5 tables that are not meant to be used directly, but instead are available as readers/writers in `astropy.table`. See :ref:`table_io` for more details. N)AstropyUserWarningAstropyDeprecationWarningsHDF  Z__table_column_meta__read_table_hdf5write_table_hdf5cCs |dtS)N.)META_KEY)pathr 3lib/python3.7/site-packages/astropy/io/misc/hdf5.py meta_pathsr cs(ddlgfdd}||S)z4 Find all structured arrays in an HDF5 file rNcs&t|jr"|jjdkr"|dS)NV) isinstanceDatasetdtypekindappend)nameobj)h5pystructured_arraysr r append_structured_arrays"sz=_find_all_structured_arrays..append_structured_arrays)rZ visititems)Zhandlerr )rrr _find_all_structured_arrayss  rc Os|dk r4|}z|d}Wd||X|tkS|dk rF|dSy ddl}Wntk rfdSXt|d|j|j |j fSdS)N)z.hdf5z.h5rF) tellreadseekHDF5_SIGNATUREendswithr ImportErrorr FileGroupr)originfilepathZfileobjargskwargsZlocZ signaturerr r r is_hdf5)s   r%Tc Csy ddl}Wntk r(tdYnX|}t||j|jfr|dk r|y ||}Wn&ttfk rztd |YnXt||jrt |}t |dkrtd |nJt |dkr|dkr|dn|d|d}t d |tt||dSnjt||jsbt|d r`_ to be installed. If more than one table is present in the HDF5 file or group, the first table is read in and a warning is displayed. Parameters ---------- input : str or :class:`h5py:File` or :class:`h5py:Group` or :class:`h5py:Dataset` If a string, the filename to read the table from. If an h5py object, either the file or the group object to read the table from. path : str The path from which to read the table inside the HDF5 file. This should be relative to the input file or group. character_as_bytes: boolean If `True` then Table columns are left as bytes. If `False` then Table columns are converted to unicode. rNz-h5py is required to read and write HDF5 fileszPath {0} does not existz no table found in HDF5 group {0}/zdpath= was not specified but multiple tables are present, reading in first available table (path={0}))rrz h5py can only open regular filesr)rcharacter_as_bytes)Tablemeta serializecss|]}|dVqdS)zutf-8N)decode).0hr r r sz"read_table_hdf5..css|]}|dVqdS)zutf-8N)r,)r-r.r r r r/sr*css|]}|d|fVqdS)rNr )r-xr r r r/sZdatatype) descriptionformatunitr*))rr Exceptionr rr KeyError ValueErrorOSErrorr2rlenwarningswarnrrrhasattrrAttributeError TypeErrorclose astropy.tabler)r*r+npZarrayrattrsr Zget_header_from_yamllistkeysdictcolumnsvaluessetattrZ_construct_mixins_from_columnsupdateZconvert_bytestring_to_unicode)inputrr(rZ input_saveZarraysfr)r*r+tableZold_version_metaZnew_version_metaheaderZ header_colscolattrr r r r=sn               " c Csddlm}ddlm}ddlm}ddlm}m}y ddl }WnTt k rx>| D]2}|||rZ|j |j k rZtd|j j|jjqZWYnX|d||}WdQRX|S) zEncode a Table ``tbl`` that may have mixin columns to a Table with only astropy Columns + appropriate meta-data to allow subsequent decoding. r)r+)has_info_class)units) MixinInfoserialize_context_asNzBcannot write type {} column '{}' to HDF5 without PyYAML installed.hdf5)r?r+Zastropy.table.tablerOZastropyrPZastropy.utils.data_inforQrRyamlritercols __class__ZQuantityr=r2__name__inforZ_represent_mixins_as_columns) Ztblr+rOurQrRrTrMZ encode_tblr r r _encode_mixinss       rZFc Cs,ddlm}y ddl} Wntk r4tdYnX|dkrHtdn|drZtdd|krt|dd\} } n d|} } t|| j | j fr| ry || } Wqt tfk r| | } YqXn|} nt|t rNtj|r|s|r|st|ntd || ||r"d nd } zt|| ||||||d S| Xntd | | kr|rt|rt| | =ntd|t|}tdd|Dr|jdd}||dkrxF|D]:}x2dD]*}t|j|ddifkrtdt qWqW|r2|dkrd}| j!| |"|d}n| j!| |"d}|r|#|}dd|D}|rtdt$y||j%t&<Wn4tk r}ztd|Wdd}~XYnXn| j!t'| |dnZxX|jD]N}|j|}y||j%|<Wn.tk r td|t(|t YnXqWdS)a Write a Table object to an HDF5 file This requires `h5py `_ to be installed. Parameters ---------- table : `~astropy.table.Table` Data table that is to be written to file. output : str or :class:`h5py:File` or :class:`h5py:Group` If a string, the filename to write the table to. If an h5py object, either the file or the group object to write the table to. path : str The path to which to write the table inside the HDF5 file. This should be relative to the input file or group. compression : bool or str or int Whether to compress the table inside the HDF5 file. If set to `True`, ``'gzip'`` compression is used. If a string is specified, it should be one of ``'gzip'``, ``'szip'``, or ``'lzf'``. If an integer is specified (in the range 0-9), ``'gzip'`` compression is used, and the integer denotes the compression level. append : bool Whether to append the table to an existing HDF5 file. overwrite : bool Whether to overwrite any existing file without warning. If ``append=True`` and ``overwrite=True`` then only the dataset will be replaced; the file/group will not be overwritten. r)r*Nz-h5py is required to read and write HDF5 filesz/table path should be set via the path= argumentr&z,table path should end with table name, not /zFile exists: {0}aw)r compressionr overwriteserialize_metacompatibility_modez9output should be a string or an h5py File or Group objectzTable {0} already existscss|]}|jjjdkVqdS)UN)rXrr)r-rMr r r r/Asz#write_table_hdf5..F)Z copy_data)r3r2r1r*ztable contains column(s) with defined 'unit', 'format', 'description', or 'meta' info attributes. These will be dropped since serialize_meta=False.TZgzip)datar^)rccSsg|]}|dqS)zutf-8)encode)r-r.r r r ]sz$write_table_hdf5..z,compatibility mode for writing is deprecatedzr=rZanyrUcopyZconvert_unicode_to_bytestringgetattrrXr9r:rZcreate_datasetZas_arrayZget_yaml_from_tablerrArr type)rKoutputrr^rr_r`rar*rgrouprZ output_grouprJrMrNZdsetZ header_yamlZheader_encodedekeyvalr r r rs                        cCsFddlm}ddlm}|d|t|d|t|d|t dS)z) Register HDF5 with Unified I/O. r)registry)r)rSN) Z astropy.iortr?r)Zregister_readerrZregister_writerrZregister_identifierr%)Z io_registryr)r r r register_hdf5|s   ru)NT)NFFFFF)__doc__rhr9Znumpyr@Zastropy.utils.exceptionsrrrr__all__r rr%rrZrrur r r r s$