B q\,@sdZddlZddlmZddlZddlZddlmZmZddl m Z m Z ddl m Z ddlmZd d giZd Zd ZGd ddejZGdddejZGdddejZGdd d ejZdS)z Define the Enhanced Character-Separated-Values (ECSV) which allows for reading and writing all the meta data associated with an astropy Table object. N) OrderedDict)corebasic)meta serialize)serialize_context_as)AstropyWarningEcsvZyamlz0.9) ,cs@eZdZdZddZddZddZdd Zfd d ZZ S) EcsvHeaderzHeader class for which the column definition line starts with the comment character. See the :class:`CommentedHeader` class for an example. ccsZt|j}xH|D]@}|}|s$q||}|rN||d}|rR|VqdSqWdS)zReturn only non-blank lines that start with the comment regexp. For these lines strip out the matching characters and leading/trailing whitespace.N)recompilecommentstripmatchend)selflinesZ re_commentlineroutr4lib/python3.7/site-packages/astropy/io/ascii/ecsv.py process_liness   zEcsvHeader.process_linescsjjtkrtdx4jD]*}tt|dddkrtd|jj qWjdd}j rfj |d<jjd kr~jj|d <d t d gt |}|fd d|D|jddjDdS)a  Write header information in the ECSV ASCII format. This format starts with a delimiter separated list of the column names in order to make this format readable by humans and simple csv-type readers. It then encodes the full table meta and column attributes and meta as YAML and pretty-prints this in the header. Finally the delimited column names are repeated again, for humans and readers that look for the *last* comment line as defining the column names. z=only space and comma are allowed for delimiter in ECSV formatshaperrz:ECSV format does not support multidimensional column '{0}'z astropy-2.0)colsZschemarr delimiterz %ECSV {0}z---csg|]}j|qSr)Z write_comment).0r)rrr Lsz$EcsvHeader.write..cSsg|] }|jjqSr)infoname)rxrrrrMsN)splitterr DELIMITERS ValueErrorrlengetattrformatr r! table_meta ECSV_VERSIONrZget_yaml_from_headerextendappendjoin)rrcolheaderZheader_yaml_linesr)rrwrite,s       zEcsvHeader.writecCsdS)z} Override the default write_comments to do nothing since this is handled in the custom write method. Nr)rrrrrrwrite_commentsOszEcsvHeader.write_commentscCsdS)z~ Override the default update_meta to do nothing. This process is done in get_cols() for this reader. Nr)rrrrrr update_metaVszEcsvHeader.update_metac s|}t||}d}d}|s(t|t||dtj}|sNt|yt |}Wnbt k r}z&dt |krt dttdWdd}~XYn tjk rtdYnXd |kr|d |_d |kr|d }|tkrtd ||j_||jj_td d |dD} dd|dD|_tt|} t|| g} | |jkrptd|j| |x~|jD]t} x4dD],} | | | jkrt| | | | j| qW| | jd| _| jdkrd| _| j drt!dqWdS)z Initialize the header Column objects from the table ``lines``. Parameters ---------- lines : list List of table lines z%ECSV [ ] (?P \d+) \. (?P \d+) \.? (?P \d+)? $zeECSV header line like "# %ECSV " not found as first line. This is required for a ECSV file.rzPyYAML package is requiredzVfile looks like ECSV format but PyYAML is not installed so it cannot be parsed as ECSVz@unable to parse yaml in meta header (PyYAML package is required)Nz#unable to parse yaml in meta headerrrz=only space and comma are allowed for delimiter in ECSV formatcss|]}|d|fVqdS)r!Nr)rr"rrr sz&EcsvHeader.get_cols..ZdatatypecSsg|] }|dqS)r!r)rr"rrrrsz'EcsvHeader.get_cols..zScolumn names from ECSV header {} do not match names from header line of CSV data {})Z descriptionr(Zunitrstringstrcomplexz1ecsv reader does not support complex number types)"listrrZInconsistentTableErrorrrrVERBOSErZget_header_from_yaml ImportErrorr5warningswarnr ZYamlParseErrorr)r$r%r#rdatarnamesnextsuperr(Z_set_cols_from_namesrr!setattrdtype startswith TypeError)rrZ raw_linesZecsv_header_reZ no_header_msgrr/excrZ header_colsZ header_lineZ header_namesr.attr) __class__rrget_cols]sV            zEcsvHeader.get_cols) __name__ __module__ __qualname____doc__rr0r1r2rG __classcell__rr)rFrr s #r cs$eZdZdZgZfddZZS) EcsvOutputtera After reading the input lines and processing, convert the Reader columns and metadata to an astropy.table.Table object. This overrides the default converters to be an empty list because there is no "guessing" of the conversion function. cst||}t|}|S)N)r?__call__rZ_construct_mixins_from_columns)rrrr)rFrrrNs zEcsvOutputter.__call__)rHrIrJrKZdefault_convertersrNrLrr)rFrrMsrMcseZdZfddZZS)EcsvDatac stt|y|jjd}Wnttfk r4dSXx8|D]0}|jdkr<|j|kr<||jddkr>> from astropy.table import Table >>> ecsv_content = '''# %ECSV 0.9 ... # --- ... # datatype: ... # - {name: a, unit: m / s, datatype: int64, format: '%03d'} ... # - {name: b, unit: km, datatype: int64, description: This is column b} ... a b ... 001 2 ... 004 3 ... ''' >>> Table.read(ecsv_content, format='ascii.ecsv') a b m / s km int64 int64 ----- ----- 001 2 004 3 ecsvz Enhanced CSVz.ecsvc Cs"tdt|}WdQRX|S)a Update table columns in place if mixin columns are present. This is a hook to allow updating the table columns after name filtering but before setting up to write the data. This is currently only used by ECSV and is otherwise just a pass-through. Parameters ---------- table : `astropy.table.Table` Input table for writing Returns ------- table : `astropy.table.Table` Output table for writing rSN)rrZ_represent_mixins_as_columns)rtablerrrrupdate_table_datas zEcsv.update_table_dataN)rHrIrJrKZ _format_nameZ _descriptionZ_io_registry_suffixr Z header_classrOZ data_classrMZoutputter_classrUrrrrr s)rKr collectionsr contextlibr:rrZ astropy.tablerrZastropy.utils.data_inforZastropy.utils.exceptionsr Z__doctest_requires__r*r$Z BasicHeaderr ZTableOutputterrMZ BasicDatarOZBasicr rrrrs