ó šßÈ[c@`s1dZddlmZmZmZddlZddlZddlZddlZddl Z ddl Z ddl m Z ddl m Z ddl mZddl mZdd l mZdd l mZdd l mZdd l mZdd l mZddl mZddl mZddl mZddlmZddlmZddlmZddlmZm Z gZ!yddl"Z"e#Z$Wne%k r¥e&Z$nXe#a'dd„Z(d„Z)dddd„Z+d„Z,dd„Z-d„Z.d„Z/d)Z0de#d&„Z1ddde#d'„Z2d(„Z3dS(*sèAn extensible ASCII table reader and writer. ui.py: Provides the main user functions for reading and writing tables. :Copyright: Smithsonian Astrophysical Observatory (2010) :Author: Tom Aldcroft (aldcroft@head.cfa.harvard.edu) i(tabsolute_importtdivisiontprint_functionNi(tcore(tbasic(tcds(tdaophot(tecsv(t sextractor(tipac(tlatex(thtml(t fastbasic(tcparser(t fixedwidthi(tTable(tget_readable_fileobj(tsix(tAstropyWarningtAstropyDeprecationWarningi †c`sUtˆtjƒsšyqˆdˆd d}x:tˆƒD],\}}|t|ƒ7}||kr8Pq8q8Wtjjˆ|d ƒ‰Wqštk r–qšXntˆtjƒrQˆ| ‰t j dˆt j t j BƒrÙt St jdˆdt j ƒr tjjˆƒr t St j dˆt j t j Bƒr.t St‡fd†d DƒƒrQt SntS( so Determine if ``table`` probably contains HTML content. See PR #3693 and issue #3691 for context. iis+( http[s]? | ftp | file ) :// .+ \.htm[l]?$s \.htm[l]?$iûÿÿÿs\s* ]* >N(tretsearchtformatt IGNORECASEtVERBOSE(t.0telement(ttable(s2lib/python2.7/site-packages/astropy/io/ascii/ui.pys YsRttrttd(RRR(t isinstanceRt string_typest enumeratetlentostlineseptjoint ExceptionRtmatchRRtTrueRtpathtexiststalltFalse(Rtmaxcharstsizetitline((Rs2lib/python2.7/site-packages/astropy/io/ascii/ui.pyt_probably_html2s2    . cC`s |adS(s° Set the default value of the ``guess`` parameter for read() Parameters ---------- guess : bool New default ``guess`` value (e.g., True or False) N(t_GUESS(tguess((s2lib/python2.7/site-packages/astropy/io/ascii/ui.pyt set_guess`s cK`s:|dkrtj}ntj|d|d||}|S(s  Initialize a table reader allowing for common customizations. Most of the default behavior for various parameters is determined by the Reader class. Parameters ---------- Reader : `~astropy.io.ascii.BaseReader` Reader class (DEPRECATED). Default is :class:`Basic`. Inputter : `~astropy.io.ascii.BaseInputter` Inputter class Outputter : `~astropy.io.ascii.BaseOutputter` Outputter class delimiter : str Column delimiter string comment : str Regular expression defining a comment line in table quotechar : str One-character string to quote fields containing special characters header_start : int Line index for the header line not counting comment or blank lines. A line with only whitespace is considered blank. data_start : int Line index for the start of data not counting comment or blank lines. A line with only whitespace is considered blank. data_end : int Line index for the end of data not counting comment or blank lines. This value can be negative to count from the end. converters : dict Dictionary of converters. data_Splitter : `~astropy.io.ascii.BaseSplitter` Splitter class to split data columns. header_Splitter : `~astropy.io.ascii.BaseSplitter` Splitter class to split header columns. names : list List of names corresponding to each data column. include_names : list, optional List of names to include in output. exclude_names : list List of names to exclude from output (applied after ``include_names``). fill_values : dict Specification of fill values for bad or missing table values. fill_include_names : list List of names to include in fill_values. fill_exclude_names : list List of names to exclude from fill_values (applied after ``fill_include_names``). Returns ------- reader : `~astropy.io.ascii.BaseReader` subclass ASCII format reader instance tInputtert OutputterN(tNoneRtBasicRt _get_reader(tReaderR4R5tkwargstreader((s2lib/python2.7/site-packages/astropy/io/ascii/ui.pyt get_readerns6  cC`sƒ|dk r0|dk r0tdj|ƒƒ‚n|dk r|tjkr[tj|}qtdj|ttjƒƒƒ‚n|S(Ns*Cannot supply both format and {0} keywordss*ASCII format {0!r} not in allowed list {1}(R6t ValueErrorRRtFORMAT_CLASSEStsorted(Rt ReaderWritertlabel((s2lib/python2.7/site-packages/astropy/io/ascii/ui.pyt_get_format_classªs  cK`s÷t2d|kr dg|dSuccess with slow reader after failing with fast (no guessing)s1Success with specified Reader class (no guessing)(RDRE(t _read_tracetgetR'R+tupdateRBR6t _format_nameR1R0RtreadR=R%RRR"R#t_guessR<RRt FAST_CLASSEStcopytappendtParameterErrorR t CParserError(RR2R:t new_kwargstfast_reader_paramRR9RItfileobjtdatR;t fast_kwargsRFte((s2lib/python2.7/site-packages/astropy/io/ascii/ui.pyRP·spJ                      c `sŽg}t|ƒ}|rr|dk rrdj|ƒtjkrr|jƒ}tjdj|ƒ|d<|g|}nd}g}|jdƒ}xî|D]æ}|tkrÅ|dtjjƒkrÅq”n|dkrð|dtjjƒkrðq”nt } xY|j ƒD]K\} } | |kr(| || t|}|j|ƒ}tj i|d6dd 6ƒ|SWn| k r‰}tj i|d6d j|jjt|ƒƒd 6ƒ|j |ƒdg}xÚ|D]Ò‰tgtˆƒD]}|d kr€|^q€ƒ}tˆjdtj ƒƒ}dt!j"d|ƒj#dƒg}‡fd†|Dƒ}|j$g|D]\} } dj| | ƒ^qƒ|j dj%|ƒƒqjWdddddddddg }|j$|ƒtj dj%|ƒƒ‚nXdS(!s” Try to read the table using various sets of keyword args. Start with the standard guess list and filter to make it unique and consistent with user-supplied read keyword args. Finally, if none of those work then try the original user-supplied keyword args. Parameters ---------- table : str, file-like, list Input table as a file name, file-like object, list of strings, or single newline-separated string. read_kwargs : dict Keyword arguments from user to be supplied to reader format : str Table format fast_reader : bool fast_reader : bool or dict Whether to use the C engine, can also be a dict with options which defaults to `False`; parameters for options dict: use_fast_converter: bool enable faster but slightly imprecise floating point conversion method parallel: bool or int multiprocessing conversion using ``cpu_count()`` or ``'number'`` processes exponent_style: str Character to use for exponent or ``'Fortran'`` to auto-detect any Fortran-style scientific notation like ``'3.14159D+00'`` (``'E'``, ``'D'``, ``'Q'``), all case-insensitive; default ``'E'``, all other imply ``use_fast_converter`` Returns ------- dat : `~astropy.table.Table` or None Output table or None if only one guess format was available sfast_{0}R9RFRKit strict_namesR:sSuccess (guessing)RJs {0:.3f} msiètdts{0}: {1}s<Success with original kwargs without strict_names (guessing)sC ERROR: Unable to guess table format with the guesses listed below:R5sReader:s \.(\w+)'>c3`s|]}|ˆ|fVqdS(N((Rtkey(R:(s2lib/python2.7/site-packages/astropy/io/ascii/ui.pys ùss{}: {!r}t RDsH************************************************************************sH** ERROR: Unable to guess table format with the guesses listed above. **sH** **sH** To figure out why the table did not read, use guess=False and **sH** fast_reader=False, along with any appropriate arguments to read(). **sH** In particular specify the format and any known attributes like the **sH** delimiter. **s N(R9R5(&t_get_guess_kwargs_listR6RRRRRSRMR+tvaluesR'titemsRTR!tInconsistentTableErrorR=t TypeErrortAttributeErrortOptionalTableImportErrorRUR RVttimeR<tguessingRPRLt __class__t__name__tstrR?treprRR7RRtgrouptextendR$(Rt read_kwargsRRFt failed_kwargstfull_list_guessR[tfiltered_guess_kwargst guess_kwargstguess_kwargs_okR_tvaltguess_exception_classestt0R;RZterrtlinestxt sorted_keyst reader_reprt keys_valst kwargs_sortedtmsg((R:s2lib/python2.7/site-packages/astropy/io/ascii/ui.pyRQisž%    %%           ""     "2  cC`sûg}|jdd ƒr4|jtdtjƒƒntrV|jtdtjƒƒnt |ƒdkr½xRt j t j tjgD]5}|jƒ}|jtd|ƒƒ|j|ƒqWn|jtdt j ƒtdt j ƒtdtjƒtdtjƒtdt jƒtdtjƒtdtjƒtdtjƒtdtjƒtdtjƒtdtjƒtdtj ƒg ƒxvt j!tj"t j tjt j#tj$fD]J}xAd D]9}x0dD](}|jtd|d |d |ƒƒqÃWq¶Wq©W|S(sQ Get the full list of reader keyword argument dicts that are the basis for the format guessing process. The returned full list will then be: - Filtered to be consistent with user-supplied kwargs - Cleaned to have only unique entries - Used one by one to try reading the input table Note that the order of the guess list has been tuned over years of usage. Maintainers need to be very careful about any adjustments as the reasoning may not be immediately evident in all cases. This list can (and usually does) include duplicates. This is a result of the order tuning, but these duplicates get removed later. Parameters ---------- read_kwargs : dict User-supplied read keyword args Returns ------- guess_kwargs_list : list List of read format keyword arg dicts RGR9it|t,R`s\st"t't delimitert quotecharN(RR‚R`s\s(RƒR„(%tpopR6RTtdictR tHTMLtHAS_YAMLRtEcsvR!RtFixedWidthTwoLineR t FastBasicRR7RSRNRotRdbtFastTabtTabRtCdsRtDaophotRt SExtractorR tIpacR tLatextAASTextFastCommentedHeadertCommentedHeadert FastNoHeadertNoHeader(Rptguess_kwargs_listR;t first_kwargsR9R…R†((s2lib/python2.7/site-packages/astropy/io/ascii/ui.pyRa s@      "R…tcommentR†tformatstnamest include_namest exclude_nameststrip_whitespacecK`s“|dkrtj}nd|kr1t|d sT           . < ² ¡ M6]