B q\;@sdZddlmZddlmZmZddlmZGdddejZGdddeZGd d d ej Z Gd d d ej Z Gd ddej ZGddde ZGddde ZGdddeZGddde ZGdddeZGddde ZGdddeZdS)zAn extensible ASCII table reader and writer. fixedwidth.py: Read or write a table with fixed width columns. :Copyright: Smithsonian Astrophysical Observatory (2011) :Author: Tom Aldcroft (aldcroft@head.cfa.harvard.edu) )core)InconsistentTableErrorDefaultSplitter)basicc@s,eZdZdZdZdZdZddZddZd S) FixedWidthSplittera Split line based on fixed start and end positions for each ``col`` in ``self.cols``. This class requires that the Header class will have defined ``col.start`` and ``col.end`` for each column. The reference to the ``header.cols`` gets put in the splitter object by the base Reader.read() function just in time for splitting data lines by a ``data`` object. Note that the ``start`` and ``end`` positions are defined in the pythonic style so line[start:end] is the desired substring for a column. This splitter class does not have a hook for ``process_lines`` since that is generally not useful for fixed-width input. F|c#sHxB|D]:fddjD}jr:fdd|DVq|VqWdS)Ncsg|]}|j|jqS)startend).0x)liner :lib/python3.7/site-packages/astropy/io/ascii/fixedwidth.py (sz/FixedWidthSplitter.__call__..csg|]}|qSr ) process_val)r r )selfr rr*s)colsr)rlinesvalsr )rrr__call__&s  zFixedWidthSplitter.__call__cCsf|jpd}|jpd}|||}|jr8||}||}nd}d}ddt||D}||||S)NrcSs$g|]\}}d|t||qS) )len)r valwidthr r rr8sz+FixedWidthSplitter.join..) delimiter_pad delimiterbookendzipjoin)rrwidthsZpadrZ padded_delimZ bookend_leftZ bookend_rightr r rr.s    zFixedWidthSplitter.joinN) __name__ __module__ __qualname____doc__rrrrrr r r rrs rc@seZdZdZdZdS)FixedWidthHeaderSplitterz$Splitter class that splits on ``|``.rN)r!r"r#r$rr r r rr%<sr%c@s@eZdZdZeZdZedZddZ ddZ dd Z d d Z dS) FixedWidthHeaderz* Fixed width table header reader. Nz`~!#$%^&*-_+=\|":'cCs2x,t||D]\}}||krPqWtd|S)NzNo header line found in table) enumerate process_linesr)rrindexirr r rget_lineKs zFixedWidthHeader.get_linec stj|}tj|}|dkr|dk r@tdj|}|sXtd|d\}}}fddt dt |dD_ n|dk r& ||}t t |t jjdgdkrtd jt jjdg} t || std | |\}_} d d| D_ ||}|\}}}|_ x,tjD]\} } || | _|| | _q\WdS) a: Initialize the header Column objects from the table ``lines``. Based on the previously set Header attributes find or create the column names. Sets ``self.cols`` with the list of Columns. Parameters ---------- lines : list List of table lines Nz:Cannot set position_line without also setting header_startz7No data lines found so cannot autogenerate column namescsg|]}j|qSr )Z auto_formatformat)r r*)rr rrqsz-FixedWidthHeader.get_cols..rrz]Position line should only contain delimiters and one other character, e.g. "--- ------- ---".z/Characters in position line must be part of {0}cSs g|]}|dk r|dndqS)Nrr )r r r r rrs)rZ_get_line_index start_liner( position_line ValueErrordatarget_fixedwidth_paramsrangernamesr+setsplitterrset_of_position_line_charactersunionissubsetr- col_startscol_endsZ_set_cols_from_namesr'rr r ) rrr.r/Z data_linesrstartsendsrcharsetr;r*colr )rrget_colsSs8       zFixedWidthHeader.get_colscs|jdk rb|jdk rbt|j}dd|jD}t|t|krFtdfddt||D}n(|jdkr&|jdkr&|jj}dg}g}xJ|D]B}|r| |dt|| |ddq|dd7<qW|dd}d d|D}t|t|kst|t|krt d nd|jdk rPt|j}|dddg}n"d d|jD}dg|dd}fd dt||D}|||fS) a Split ``line`` on the delimiter and determine column values and column start and end positions. This might include null columns with zero length (e.g. for ``header row = "| col1 || col2 | col3 |"`` or ``header2_row = "----- ------- -----"``). The null columns are stripped out. Returns the values between delimiters and the corresponding start and end positions. Parameters ---------- line : str Input line Returns ------- vals : list List of values. starts : list List of starting indices. ends : list List of ending indices. NcSs g|]}|dk r|dndqS)Nrr )r r r r rrsz:FixedWidthHeader.get_fixedwidth_params..z=Fixed width col_starts and col_ends must have the same lengthcs g|]\}}||qSr )strip)r r r )rr rrsr,rcSsg|]}|r|qSr )rA)r r r r rrsz Error parsing fixed width headercSsg|] }|dqS)rr )r r r r rrscs g|]\}}||qSr )rA)r r r )rr rrs) r:r;listrr0rsplitr6rappendr)rrr<r=rrr )rrr2s4   $   z&FixedWidthHeader.get_fixedwidth_paramscCsdS)Nr )rrr r rwriteszFixedWidthHeader.write) r!r"r#r$r%splitter_classr/r5r7r+r@r2rFr r r rr&AsK>r&c@seZdZdZeZddZdS)FixedWidthDataz! Base table data reader. cs6g}|}xt|D]}||qWxPt|jD]B\}tfdd|D|_|jjdk r4t|jt |j j |_q4Wdd|jD}|jjdk r||j dd|jD||jjdk r|jjt dkrtdfdd|jD}||j ||x"|D]}||j ||qW|S)Ncsg|]}t|qSr )r)r r)r*r rrsz(FixedWidthData.write..cSsg|] }|jqSr )r)r r?r r rrscSsg|] }|jjqSr )infoname)r r?r r rrsrz-Position_char="{}" must be a single charactercsg|]}|jqSr )r)r r?)charr rrs)Zstr_valsrrEr'rmaxrheaderr.rrIrJr6rr/ position_charr0r-)rrZ vals_listZ col_str_itersrr?r r )rKr*rrFs,    zFixedWidthData.writeN)r!r"r#r$rrGrFr r r rrHsrHcs2eZdZdZdZdZeZeZ d fdd Z Z S) FixedWidthar Read or write a fixed width table with a single header line that defines column names and positions. Examples:: # Bar delimiter in header and data | Col1 | Col2 | Col3 | | 1.2 | hello there | 3 | | 2.4 | many words | 7 | # Bar delimiter in header only Col1 | Col2 | Col3 1.2 hello there 3 2.4 many words 7 # No delimiter with column positions specified as input Col1 Col2Col3 1.2hello there 3 2.4many words 7 See the :ref:`fixed_width_gallery` for specific usage examples. Z fixed_widthz Fixed widthNrTcs2t||jj_||jj_||j_||j_dS)N) super__init__r1r6rrrMr:r;)rr:r;rr) __class__r rrQ(s    zFixedWidth.__init__)NNrT) r!r"r#r$ _format_name _descriptionr& header_classrH data_classrQ __classcell__r r )rRrrOs rOc@seZdZdZdZdS)FixedWidthNoHeaderHeaderz7Header reader for fixed with tables with no header lineN)r!r"r#r$r.r r r rrX0srXc@seZdZdZdZdS)FixedWidthNoHeaderDataz6Data reader for fixed width tables with no header liner,N)r!r"r#r$r.r r r rrY5srYcs2eZdZdZdZdZeZeZ d fdd Z Z S) FixedWidthNoHeaderaH Read or write a fixed width table which has no header line. Column names are either input (``names`` keyword) or auto-generated. Column positions are determined either by input (``col_starts`` and ``col_stops`` keywords) or by splitting the first data line. In the latter case a ``delimiter`` is required to split the data line. Examples:: # Bar delimiter in header and data | 1.2 | hello there | 3 | | 2.4 | many words | 7 | # Compact table having no delimiter and column positions specified as input 1.2hello there3 2.4many words 7 This class is just a convenience wrapper around the ``FixedWidth`` reader but with ``header.start_line = None`` and ``data.start_line = 0``. See the :ref:`fixed_width_gallery` for specific usage examples. Zfixed_width_no_headerzFixed width with no headerNrTcstj||||ddS)N)rr)rPrQ)rr:r;rr)rRr rrQYs zFixedWidthNoHeader.__init__)NNrT) r!r"r#r$rSrTrXrUrYrVrQrWr r )rRrrZ:s rZc@seZdZdZeZdS)FixedWidthTwoLineHeaderzHeader reader for fixed width tables splitting on whitespace. For fixed width tables with several header lines, there is typically a white-space delimited format line, so splitting on white space is needed. N)r!r"r#r$rrGr r r rr[^sr[c@seZdZdZdZdS)FixedWidthTwoLineDataSplitterz5Splitter for fixed width tables splitting on ``' '``.rN)r!r"r#r$rr r r rr\hsr\c@seZdZdZeZdS)FixedWidthTwoLineDataz8Data reader for fixed with tables with two header lines.N)r!r"r#r$r\rGr r r rr]msr]cs2eZdZdZdZdZeZeZ d fdd Z Z S) FixedWidthTwoLinea Read or write a fixed width table which has two header lines. The first header line defines the column names and the second implicitly defines the column positions. Examples:: # Typical case with column extent defined by ---- under column names. col1 col2 <== header_start = 0 ----- ------------ <== position_line = 1, position_char = "-" 1 bee flies <== data_start = 2 2 fish swims # Pretty-printed table +------+------------+ | Col1 | Col2 | +------+------------+ | 1.2 | "hello" | | 2.4 | there world| +------+------------+ See the :ref:`fixed_width_gallery` for specific usage examples. Zfixed_width_two_linez#Fixed width with second header liner-NFcs0tj||d||j_||j_|d|j_dS)N)rrr)rPrQrMr/rNr1r.)rr/rNrr)rRr rrQszFixedWidthTwoLine.__init__)rr_NF) r!r"r#r$rSrTr]rVr[rUrQrWr r )rRrr^rs r^N)r$rrrrrZ BaseSplitterrr%Z BasicHeaderr&Z BasicDatarHZBasicrOrXrYrZr[r\r]r^r r r r s   *"&($