ó šßÈ[c@`sëdZddlmZmZmZmZddlmZddlm Z m Z ddl m Z ddl Z ddlZddlZddlmZmZddlZdd lmZdd lmZd d lmZd d lmZd dlmZmZddddgZdd„Zd„Z d„Z!dddddgdd„Z#ddd„Z$ddddd„Z%de&dd „Z'ddd!„Z(d"„Z)d#„Z*dddddgddd$„Z+dddd%„Z,ddddd&„Z-dS('u> High-level table operations: - join() - hstack() - vstack() i(tabsolute_importtdivisiontprint_functiontunicode_literalsi(tsix(tziptrange(tdeepcopyN(t OrderedDicttCounter(tma(tmetadatai(tColumn(t _np_utils(tfix_column_nametTableMergeErrorujoinuhstackuvstackuuniqueuwarncC`sWt|djƒ}x-|dD]!}tj||jd|ƒ}qW|jj|ƒdS(Niitmetadata_conflicts(RtmetaR tmergetupdate(toutttablesRtout_metattable((s7lib/python2.7/site-packages/astropy/table/operations.pyt_merge_table_meta sc`s¬ddlm‰m‰t|tjƒs4|g}nt‡‡fd†|Dƒƒset|ƒdkrttdƒ‚ng|D]'}t|ˆƒr–|n ˆ|ƒ^q{}|S(ul Check that tables is a Table or sequence of Tables. Returns the corresponding list of Tables. i(tTabletRowc3`s%|]}t|ˆˆfƒ VqdS(N(t isinstance(t.0tx(RR(s7lib/python2.7/site-packages/astropy/table/operations.pys 3siu:`tables` arg must be a Table or sequence of Tables or Rows( RRRRt collectionstSequencetanytlent TypeError(RR((RRs7lib/python2.7/site-packages/astropy/table/operations.pyt_get_list_of_tables's 14c`s‘|dj‰x0|dD]$}t|jˆƒr|j‰qqWt‡fd†|Dƒƒrtdjg|D]}|jj^qlƒƒ‚nˆS(u¹ From a list of input objects ``objs`` get merged output object class. This is just taken as the deepest subclass. This doesn't handle complicated inheritance schemes. iic3`s"|]}tˆ|jƒ VqdS(N(t issubclasst __class__(Rtobj(t out_class(s7lib/python2.7/site-packages/astropy/table/operations.pys Hsuunmergeable object classes {}(R%R$R t ValueErrortformatt__name__(tobjsR&((R's7lib/python2.7/site-packages/astropy/table/operations.pyt_get_out_class<s  (uinneru{col_name}_{table_name}u1u2c C`s“ddlm}t||ƒs.||ƒ}nt||ƒsL||ƒ}ntƒ}t||||||||ƒ} t| ||gd|ƒ| S(uf Perform a join of the left table with the right table on specified keys. Parameters ---------- left : Table object or a value that will initialize a Table object Left side table in the join right : Table object or a value that will initialize a Table object Right side table in the join keys : str or list of str Name(s) of column(s) used to match rows of left and right tables. Default is to use all columns which are common to both tables. join_type : str Join type ('inner' | 'outer' | 'left' | 'right'), default is 'inner' uniq_col_name : str or None String generate a unique output column name in case of a conflict. The default is '{col_name}_{table_name}'. table_names : list of str or None Two-element list of table names used when generating unique output column names. The default is ['1', '2']. metadata_conflicts : str How to proceed with metadata conflicts. This should be one of: * ``'silent'``: silently pick the last conflicting meta-data value * ``'warn'``: pick the last conflicting meta-data value, but emit a warning (default) * ``'error'``: raise an exception. Returns ------- joined_table : `~astropy.table.Table` object New table containing the result of the join operation. i(RR(RRRRt_joinR( tlefttrighttkeyst join_typet uniq_col_namet table_namesRRt col_name_mapR((s7lib/python2.7/site-packages/astropy/table/operations.pytjoinOs" uoutercC`s[t|ƒ}t|ƒdkr&|dStƒ}t||||ƒ}t||d|ƒ|S(ux Stack tables vertically (along rows) A ``join_type`` of 'exact' means that the tables must all have exactly the same column names (though the order can vary). If ``join_type`` is 'inner' then the intersection of common columns will be the output. A value of 'outer' (default) means the output will have the union of all columns, with table values being masked where no common values are available. Parameters ---------- tables : Table or list of Table objects Table(s) to stack along rows (vertically) with the current table join_type : str Join type ('inner' | 'exact' | 'outer'), default is 'outer' metadata_conflicts : str How to proceed with metadata conflicts. This should be one of: * ``'silent'``: silently pick the last conflicting meta-data value * ``'warn'``: pick the last conflicting meta-data value, but emit a warning (default) * ``'error'``: raise an exception. Returns ------- stacked_table : `~astropy.table.Table` object New table containing the stacked data from the input tables. Examples -------- To stack two tables along rows do:: >>> from astropy.table import vstack, Table >>> t1 = Table({'a': [1, 2], 'b': [3, 4]}, names=('a', 'b')) >>> t2 = Table({'a': [5, 6], 'b': [7, 8]}, names=('a', 'b')) >>> print(t1) a b --- --- 1 3 2 4 >>> print(t2) a b --- --- 5 7 6 8 >>> print(vstack([t1, t2])) a b --- --- 1 3 2 4 5 7 6 8 iiR(R#R!Rt_vstackR(RR1RR4R((s7lib/python2.7/site-packages/astropy/table/operations.pytvstack„s5  cC`s^t|ƒ}t|ƒdkr&|dStƒ}t|||||ƒ}t||d|ƒ|S(u§ Stack tables along columns (horizontally) A ``join_type`` of 'exact' means that the tables must all have exactly the same number of rows. If ``join_type`` is 'inner' then the intersection of rows will be the output. A value of 'outer' (default) means the output will have the union of all rows, with table values being masked where no common values are available. Parameters ---------- tables : List of Table objects Tables to stack along columns (horizontally) with the current table join_type : str Join type ('inner' | 'exact' | 'outer'), default is 'outer' uniq_col_name : str or None String generate a unique output column name in case of a conflict. The default is '{col_name}_{table_name}'. table_names : list of str or None Two-element list of table names used when generating unique output column names. The default is ['1', '2', ..]. metadata_conflicts : str How to proceed with metadata conflicts. This should be one of: * ``'silent'``: silently pick the last conflicting meta-data value * ``'warn'``: pick the last conflicting meta-data value, but emit a warning (default) * ``'error'``: raise an exception. Returns ------- stacked_table : `~astropy.table.Table` object New table containing the stacked data from the input tables. Examples -------- To stack two tables horizontally (along columns) do:: >>> from astropy.table import Table, hstack >>> t1 = Table({'a': [1, 2], 'b': [3, 4]}, names=('a', 'b')) >>> t2 = Table({'c': [5, 6], 'd': [7, 8]}, names=('c', 'd')) >>> print(t1) a b --- --- 1 3 2 4 >>> print(t2) c d --- --- 5 7 6 8 >>> print(hstack([t1, t2])) a b c d --- --- --- --- 1 3 5 7 2 4 6 8 iiR(R#R!Rt_hstackR(RR1R2R3RR4R((s7lib/python2.7/site-packages/astropy/table/operations.pythstackÆs:   ufirstcC`s€|d krtdƒ‚nt|tjƒr9|g}n|d krQ|j}n-tt|ƒƒt|ƒkr~tdƒ‚n|jr d}xV|D]M}t j ||j ƒr•|sÏtdj |ƒƒ‚n||j |ƒ=q•q•Wt|ƒdkr tdƒ‚q n|j|ƒ}|jj}|dkr>|d }n:|dkr[|d d }n|d t j|ƒd k}||S( uË Returns the unique rows of a table. Parameters ---------- input_table : `~astropy.table.Table` object or a value that will initialize a `~astropy.table.Table` object keys : str or list of str Name(s) of column(s) used to create unique rows. Default is to use all columns. keep : one of 'first', 'last' or 'none' Whether to keep the first or last row for each set of duplicates. If 'none', all rows that are duplicate are removed, leaving only rows that are already unique in the input. Default is 'first'. silent : boolean If `True`, masked value column(s) are silently removed from ``keys``. If `False`, an exception is raised when ``keys`` contains masked value column(s). Default is `False`. Returns ------- unique_table : `~astropy.table.Table` object New table containing only the unique rows of ``input_table``. Examples -------- >>> from astropy.table import unique, Table >>> import numpy as np >>> table = Table(data=[[1,2,3,2,3,3], ... [2,3,4,5,4,6], ... [3,4,5,6,7,8]], ... names=['col1', 'col2', 'col3'], ... dtype=[np.int32, np.int32, np.int32]) >>> table col1 col2 col3 int32 int32 int32 ----- ----- ----- 1 2 3 2 3 4 3 4 5 2 5 6 3 4 7 3 6 8 >>> unique(table, keys='col1')
col1 col2 col3 int32 int32 int32 ----- ----- ----- 1 2 3 2 3 4 3 4 5 >>> unique(table, keys=['col1'], keep='last')
col1 col2 col3 int32 int32 int32 ----- ----- ----- 1 2 3 2 5 6 3 6 8 >>> unique(table, keys=['col1', 'col2'])
col1 col2 col3 int32 int32 int32 ----- ----- ----- 1 2 3 2 3 4 2 5 6 3 4 5 3 6 8 >>> unique(table, keys=['col1', 'col2'], keep='none')
col1 col2 col3 int32 int32 int32 ----- ----- ----- 1 2 3 2 3 4 2 5 6 3 6 8 >>> unique(table, keys=['col1'], keep='none')
col1 col2 col3 int32 int32 int32 ----- ----- ----- 1 2 3 ufirstulastunoneu/'keep' should be one of 'first', 'last', 'none'uduplicate key namesiu_cannot use columns with masked values as keys; remove column '{0}' from keys and rerun unique()uRno column remained in ``keys``; unique() cannot work with masked value key columnsiÿÿÿÿi(ufirstulastunoneN(R(RRt string_typestNonetcolnamesR!tsettmaskedtnpR tmaskR)tindextgroup_bytgroupstindicestdiff(t input_tableR0tsilenttkeeptnkeystkeyt grouped_tableRD((s7lib/python2.7/site-packages/astropy/table/operations.pytunique s6]         c`s´tj‡fd†ƒ‰g}|dkr_gttˆƒƒD]}tj|dƒ^q=}nxÔtˆƒD]Æ\}}||}x­|jD]¢‰ˆ} ˆ|krÈ|kr |j ˆƒq n]t ˆƒ} | j |ƒt ‡fd†| Dƒƒr|j d|dˆƒ} n|j | ƒˆˆ| |Ÿsic3`s|]}ˆ|jkVqdS(N(R<(Rtother(tname(s7lib/python2.7/site-packages/astropy/table/operations.pys ´st table_nametcol_nameuhMerging column names resulted in duplicates: {0}. Change uniq_col_name or table_names args to fix this.c3`s|]}|ˆ|fVqdS(N((RRP(R4(s7lib/python2.7/site-packages/astropy/table/operations.pys ÃsN(Rt defaultdictR;RR!Rt text_typet enumerateR<tappendtlisttpopR R)R t iteritemsRR(RMt common_namesR2R3t col_name_listtiitidxtarrayRQtout_nametotherstcol_name_counttcounttrepeated_names((RMR4RPs7lib/python2.7/site-packages/astropy/table/operations.pytget_col_name_maps0 5       4 c C`s4g}x'tj|ƒD]\}}gt||ƒD]"\}}|dk r2||^q2}g|D]}|dk ra|^qa}yt|ƒ} Wn2tk rÃ} tdj|d| jƒƒ‚nXtd„|Dƒƒ} t | ƒdkrtdj|ƒƒ‚n| j ƒ} |j t |ƒ| | fƒqW|S(u´ Find the dtypes descrs resulting from merging the list of arrays' dtypes, using the column name mapping ``col_name_map``. Return a list of descrs for the output. u.The '{0}' columns have incompatible types: {1}ics`s|]}|jdVqdS(iN(tshape(Rtcol((s7lib/python2.7/site-packages/astropy/table/operations.pys ãsiu&Key columns {0!r} have different shapeN( RRYRR;t common_dtypeRR)t_incompat_typesR=R!RXRVR( RMR4t out_descrsR_tin_namestarrRPtin_colstnamestdtypettmet uniq_shapesRe((s7lib/python2.7/site-packages/astropy/table/operations.pyt get_descrsÈs8%   cC`sXytj|ƒSWn@tjk rS}tdj|jƒƒ}|j|_|‚nXdS(uÉ Use numpy to find the common dtype for a list of columns. Only allow columns within the following fundamental numpy data types: np.bool_, np.object_, np.number, np.character, np.void u#Columns have incompatible types {0}N(R RgtMergeConflictErrorRR)Rh(tcolsterrRo((s7lib/python2.7/site-packages/astropy/table/operations.pyRgís  c(`sÀ|}|dkr*tdj|ƒƒ‚n|dkryt‡fd†|jDƒƒ}t|ƒdkr—tdƒ‚q—nt|tj ƒr—|f}nxÓ|d fˆd ffD]¹\} } xª|D]¢} | | jkrótd j| | ƒƒ‚nt | | d ƒr7t j | | j ƒr7td j| | ƒƒ‚nt| | t jƒsÃtdj| ƒƒ‚qÃqÃWq°Wt|ƒtˆƒ} } | dksž| dkr­tdƒ‚nt|ˆg|||ƒ}t|ˆg|ƒ}g|D]}|d|krä|^qä}t j| | d|ƒ}x2|D]*}||||| *ˆ|||| )q&W|jd|ƒ}||}t jtg|d|d ktgfƒ}t j|ƒ}idd6dd6dd6dd6|}tj||| |ƒ\}}}}}}|js ˆjrt}nt|ƒ}t|ˆgƒd|ƒ}xZ|D]R\}}} ||\}!}"|!rˆ|"rˆ||!ˆ|"g}#t|#ƒ}$t |$jdƒs¼tdj|$jƒƒ‚n|$jj|#|||ƒ||(siu/No keys in common between left and right tablesuLeftuRightu({0} table does not have key column {1!r}umasku'{0} key column {1!r} has missing valuesu3non-ndarray column '{}' not allowed as a key columnu5input tables for join must both have at least one rowRntorderiiÿÿÿÿiiR>unew_likeu-join unavailable for mixin column type(s): {}u*Unexpected column names (maybe one is ""?)uMjoin requires masking column '{}' but column type {} does not support masking(uinneruouterulefturightN(i((R(R)R;ttupleR<R!RRRR:thasattrR?R R@tndarrayRdRqtemptytargsortt concatenatetTruet flatnonzeroR t join_innerR>tboolR,tinfotNotImplementedErrorR*tnew_likeR$R twherettakeReR%RtMappingR((R.R/R0R1R2R3R4Rt _col_name_mapRkt arr_labelRPtlen_leftt len_rightRitdescrtout_keys_dtypetout_keysRJtidx_sorttdiffstidxst int_join_typeR>tn_outtleft_outt left_maskt right_outt right_maskRR_RnRet left_namet right_nameRstcol_clsR^t array_outt array_mask((R/s7lib/python2.7/site-packages/astropy/table/operations.pyR-ýsž"    %  )  )  ,&*      !! 0  $cC`sg|}|dkr!tdƒ‚nt|ƒdkr;|dSttjg|D]}|j^qKŒƒ}t||ƒ}|dkrÉx<tj|ƒD]+}t d„|Dƒƒr‘t dƒ‚q‘q‘Wd}n|dkrt d „tj |ƒDƒƒ}t|ƒdkrt d ƒ‚qnt d „|Dƒƒ}x7tj|ƒD]&}t d „|Dƒƒr>t }Pq>q>Wg|D]}t|ƒ^qo}t|ƒ} t|ƒd |ƒ} x–tj |ƒD]…\} } gt|| ƒD]"\}} | dk rÔ|| ^qÔ}t|ƒ}t|jdƒs5tdj|jƒƒ‚ny#|jj|| || ƒ| | ÉsueInconsistent columns in input arrays (use 'inner' or 'outer' join_type to allow non-matching columns)cs`s7|]-\}}td„|Dƒƒr||fVqdS(cs`s|]}|dk VqdS(N(R;(RR((s7lib/python2.7/site-packages/astropy/table/operations.pys ÒsN(tall(RRPRj((s7lib/python2.7/site-packages/astropy/table/operations.pys Ñs u&Input arrays have no columns in commoncs`s!|]}t|dtƒVqdS(umaskedN(tgetattrtFalse(RRk((s7lib/python2.7/site-packages/astropy/table/operations.pys Ùscs`s|]}|dkVqdS(N(R;(RR((s7lib/python2.7/site-packages/astropy/table/operations.pys ÛsR>unew_likeu/vstack unavailable for mixin column type(s): {}u.The '{0}' columns have incompatible types: {1}uOvstack requires masking column '{}' but column type {} does not support masking(uinneruexactuouterN(!R(R!R=t itertoolstchainR<RdRt itervaluesR RRRYR|tsumR,RR;RwR€RR)R*R‚R RrRhR@R%RRR…R(RMR1R4RR†RkRmR>tlenstn_rowsRR_RjRPRsR˜Rttidx0R^tidx1((s7lib/python2.7/site-packages/astropy/table/operations.pyR6œsd +    8  #  cC`sã|}|d kr!tdƒ‚n|dkrbgtt|ƒƒD]}dj|dƒ^q@}nt|ƒt|ƒkr‰tdƒ‚nt|ƒdkr£|dSt|g||ƒ}g|D]}t|ƒ^q¿}|dkrtt|ƒƒdkr td ƒ‚nd}n|dkrt|ƒ} tt|ƒƒdkrcg|D]}|| ^qJ}ng|D] }| ^qj}nt d „|Dƒƒpªtt|ƒƒdk} t |ƒ} t |ƒd | ƒ} xìt j |ƒD]Û\} }xÌt|||ƒD]¸\}}}|dkrqýn| |kr£tj| ƒ}d||)|||| | LsR>uOhstack requires masking column '{}' but column type {} does not support masking(uinneruexactuouterN(R(R;RR!R)RdR=RtminR tmaxR,RRYRR?tarangeR|R@RR%R*RRR…R(RMR1R2R3R4R†R\Rktarr_lenst min_arr_lenR>R£RR_RjRPR^tarr_lenRD((s7lib/python2.7/site-packages/astropy/table/operations.pyR8 sR  5     . "     (.t__doc__t __future__RRRRtexternRtextern.six.movesRRtcopyRtwarningsRRžRR tnumpyR?R tutilsR tcolumnR tR tnp_utilsRRt__all__RR#R,R;R5R7R9RRLRdRqRgR-R6R8(((s7lib/python2.7/site-packages/astropy/table/operations.pytsJ"       3B Eƒ 7 %  œm