[c@sddlZddlZddlZddlZddlmZddlZddlmZ ddl m Z m Z m Z mZmZmZmZmZmZmZmZmZmZmZddlmZmZddlmZmZdd lm Z m!Z!dd l"m#Z#dd l$m%Z%d e&fd YZ'dej(fdYZ)dZ*e+dZ,de-fdYZ.e+dZ/dZ0dS(iN(treduce(tchari(t ASCIITNULLt FITS2NUMPYt ASCII2NUMPYt ASCII2STRtColDefst _AsciiColDefst_FormatXt_FormatPt_VLFt _get_indext_wrapxt_unwrapxt_makeptDelayed(t decode_asciit encode_asciii(t string_typestPY2(trangetzip(t lazyproperty(tsuppresst FITS_recordcBsteZdZdd d d d dZdZdZdZdZdZ dZ e d Z d Z RS( s FITS record class. `FITS_record` is used to access records of the `FITS_rec` object. This will allow us to deal with scaled columns. It also handles conversion/scaling of columns in ASCII tables. The `FITS_record` class expects a `FITS_rec` object as input. ic Kss||_||_|r't|}n |jj}t|||j|} | \|_|_|_||_ dS(s Parameters ---------- input : array The array to wrap. row : int, optional The starting logical row of the array. start : int, optional The starting column in the row associated with this object. Used for subsetting the columns of the `FITS_rec` object. end : int, optional The ending column in the row associated with this object. Used for subsetting the columns of the `FITS_rec` object. N( tarraytrowtlent_nfieldstslicetindiceststarttendtsteptbase( tselftinputRRR R!R"tkwargstwidthts((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt__init__"s   cCst|trat|jj|}||jksF||jdkrtdj|qnqt|t rt ||j|j |j|j |j |S|j|}||jjdkrtdn|jj||j S(NisKey '{}' does not exist.sIndex out of bounds(t isinstanceRR RtnamesRR tKeyErrortformatRttypeRtstopR!Rt IndexErrortfield(R#tkeytindx((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt __getitem__As"! cCst|trat|jj|}||jksF||jdkrtdj|qnt|t rxt t jt j t j D].}|j |}||jj||jRRBR (((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRs        tFITS_reccBseZdZeZdZdZdZdZdZ e de dZ dZ d Zd Zerd Zd Znd dZedZedZejdZejdZdZedZedZedZdZdZdZdZ dZ!dZ"dZ#dZ$dZ%d Z&d!Z'e(d"Z)d#Z*d$Z+RS(%s FITS record array class. `FITS_rec` is the data part of a table HDU's data part. This is a layer over the `~numpy.recarray`, so we can deal with scaled columns. It inherits all of the standard methods from `numpy.ndarray`. cCs|jjdkr<tjj||j|jd|j}n0tjj||j|jd|jd|j}|j |jj rt |jj |_ n|S(s@ Construct a FITS record array from a recarray. tbuftstridesN( tdtypetsubdtypeRFRCtrecarrayt__new__tshapetdataRLt_inittfieldsRR(tsubtypeR$R#((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRPs  cCsw|d}|d}|d }tt|j|tj|_x-t||D]\}}t|||qSWdS(Nii(tsuperRJt __setstate__R?tWeakSett _col_weakrefsRtsetattr(R#tstatetmetat column_statetattrR5((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRWs   c Cstt|j\}}}g}g}xddddddddgD]d}ttP|dkr|j|jjd n|jt |||j|Wd QXqIW|||f}|||fS( s Return a 3-tuple for pickling a FITS_rec. Use the super-class functionality but then add in a tuple of FITS_rec-specific values that get used in __setstate__. t _convertedt _heapoffsett _heapsizeRt_gapt_uinttparnamest_coldefsN( RVRJt __reduce__RtAttributeErrorR8Ret __deepcopy__RFtgetattr(R#t reconst_functreconst_func_argsR[R]R\tattrs((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRfs  cCss|dkrdSt|tr|j|jkr|j|_|j|_|j|_|j|_|j|_|j |_ |j |_ |j |_ n|jj dk ret |jj |_ i|_t|dd|_t|dd|_t|dd|_ t|dt|_ tj|_t||_x6|jD]}|`tj||_q@Wn |jdS(NR`iRaRbRc(RFR)RJRMR_R`RaRYReRRbRcRTRRitFalseR?RXRRtreft_parent_fits_recRS(R#tobjtcol((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt__array_finalize__s0 !        cCsRd|_i|_d|_d|_tj|_d|_d|_ t |_ dS(s6Initializes internal attributes specific to FITS-isms.iN( RR_R`RaR?RXRYRFReRbRmRc(R#((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRSs      ic Cs+t|tst|}nxb|D]Z}|j}t|tr%|jjd krad |_qt|jj|j|_q%q%W|` |dkrxK|j D]=}|d k r|j d}nd}||kr|}qqWnt j |j j|dt j}|jt|jt j|d|j d|j|}|j|||_|rb|Sxt|D]\} }|j}|d krd} n t|} t| |} | sqont|| } |j} |j}|j}| | }|| }t|tr?|j d|jkrt|||jqoqnt|t rv|j!| t"|| |d|qon|dt#dkr|j t$krtd| (t j%| j dt$}||| *|j!| |t j&|t j'ktdtd }n || j(r|| j)r|j*}t j%| j d|j }||| *|j!| || |krw| | | )n||}nt|t+r|j,r| jt jt j-| }nH|j j.dkr|j!| t j%|d|j |j/| | }n||(qon|j |j kr|j j.|j j.kr|j j.dkr|j |j kr|dj0}|j1j|j }n|j2d kr|dj0}|j3| |f}||d d d |fscCs|jjdS(NRe(Rtget(R#((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyReHscCsG||jd|jjSdSdS(sList of column names.ReN(RMRTRR*RiRFRe(R#((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyR*ws   cCs&t|dddk r"|jjSdS(sList of column FITS formats.ReN(RiRFRetformats(R#((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRs cCsut|rjd}xQ|jjjD]=}|dj}|djdkrX|d}n||7}q%W|S|jSdS(s Returns the size of row items that would be written to the raw FITS file, taking into account the possibility of unicode columns being compactified. Currently for internal use only. iRxiN(t_has_unicode_fieldsRMRTtvaluesR}R(R#ttotal_itemsizeR0R}((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt _raw_itemsizes   c Cs|j|}|j}|j}|jjdkr]tjdj|tjgd|jS|}x1t |t rt |j tj r|j }qfWt ||}||jkr|j}t |tr|j|||}n|j|||}|j|||S|j|S(s: A view of a `Column`'s data as an array. isQField {!r} has a repeat count of 0 in its format code, indicating an empty field.RM(RRR,RMR}twarningstwarnRCRR)RJR"RORzR_RR t _convert_pt_convert_otherR( R#R1RRR,R"R0RR((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyR0s*      cCs|}xwtr|}x?trV||kr.dSt|dddk rR|j}qPqWt|dddk r{|j}q Pq W||j|`` s_update_column_{0}N(R,thasattrRi(R#RR<R^t old_valuet new_valuet method_name((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt _update_column_attribute_changeds cCs3|j}|j| |f|j|d|_dS(s;Update the dtype field names when a column name is changed.iN(RMR*(R#RR<told_nameRRM((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt_update_column_names cCs<tj|j|jfdtj}t|||j|S(s]Convert a raw table column to a bit array as specified by the FITS X format. RM(RCRRQRtbool_R (R#R0RR((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt _convert_xs%c Cstdgt|d|j}|j}|dkrUtdj|jnxAtt|D]-}||df|j }||df}|jdkrt j|jt d} || j } |||| !j | } t jj| j d| d|} t| ||N(R RFRRMt _get_raw_datatIOErrorR,RRR`RCtstrR}RRRRt newbyteorderR( R#RR0RRRR<toffsettcounttdttarr_lentda((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRs,"   $  c Csu|j}t|d}t|jjjd}t||jkrZ||j }ntj j ||j}tj j |t dt d}t tt j|j}tjtj j||k||}|dkrtjtj j|dk||}nytj|d|}WnDtk rp}|jj|j} tdj|| dnX|S( s Special handling for ASCII table columns to convert columns containing numeric types to actual numeric arrays from the string representation. itasciitDtEtRMs^{}; the header may be missing the necessary TNULL{} keyword or the table contains invalid datai(R,RRtnulltstriptencodeRR&RCRtljusttreplaceRRtrjustRRRR*tindexR( R#RR0R,RtnullvalRt null_fillRR2((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt_convert_ascii9s& $' *cCsMt|tr|j||S|j|\}}}}}} } } |jj|j} | rt|jtr|j ||}n| r|j dkr|j d} |r| |j f} qn |j d} | | krd} qttj| }|r |j }n+t|j dkr+d}n |j d}||krtjdj| d|j| j|| dd} qn|j r|jjr|jj}n |jj}|rS|s|rS|j rS|jr| dkr |dkr tj|dtj}q| dkr=|d kr=tj|dtj}q| dkr|d krtj|dtj}tjd}qtj|dtj}ntj|dtj}|rtj || |n|rG|jr:|d kr:|j!}y||7}Wn+t"k r0tjd j| dqDX|}qG|| 7}nt#|_nX|r|j$t%krtj&|t'd }n(|rt(t)t*|}WdQXn| rIttj| }|j dkr|ddd|f}n|r/|j$j+}dj|| d| d f}||_$qI|j df| |_ n|S(sPerform conversions on any other fixed-width column data types. This may not perform any conversion at all if it's not necessary, in which case the original column array is returned. iisbTDIM{} value {:d} does not fit with the size of the array items ({:d}). TDIM{:d} will be ignored.iitIRMitJi?tKsEOverflow detected while applying TZERO{0:d}. Returning unscaled data.RvNs|{}{}iiIll(,R)RRt_get_scale_factorsR*RRReRRRRQR}RFRtoperatortmulRRRR,tdimsRtp_formatRRcRCRtuint16tuint32tuint64tfloat64tmultiplyRt OverflowErrorRRMRtequalRRtUnicodeDecodeErrorRR(R#RR0Rt_strt_boolt_numbert_scalet_zerotbscaleRRR2t actual_shapetnitemst actual_nitemst format_codetbzero64t test_overflowtfmtRM((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRbs'                     cCsY|jr?|jjtj}|j|j}||j|!StjgdtjSdS(s Returns a pointer into the table's raw data to its heap (if present). This is returned as a numpy byte array. RMN(RaRRRCtubyteR`R(R#Rtheap_end((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyt_get_heap_datas  cCsj|j|j}|}xMt|dre|jdk re|j}t|dr|j|kr|SqWdS(s Returns the base array of self that "raw data array" that is the array in the format that it was first read from a file before it was sliced or viewed as a different type in any way. This is determined by walking through the bases until finding one that has at least the same number of bytes as self, plus the heapsize. This may be the immediate .base but is not always. This is used primarily for variable-length array support which needs to be able to find the heap (the raw data *may* be larger than nbytes + heapsize if it contains a gap or padding). May return ``None`` if no array resembling the "raw data" according to the stated criteria can be found. R"tnbytesN(R RaRR"RF(R#traw_data_bytesR"((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRs ! c Cs|jjdk}|jjdk}|p-| }|j}|j}|dk}|dk}|sjd}n|syd}n|j} |||||||| fS( s5Get all the scaling flags and factors for one column.tARtRiiN(RNi(RNi(R,RRRFt_dims( R#RRRRRRRRR((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyR s        c Csd}xt|jjD]t\}}|j|}|jj}t||}t|trVt j gd|jj}|r,||j kr,d|(g|j |D]} t | ^q} | |dt | dfRt}t RuRRs9Value {!r} does not fit into the output's itemsize of {}.t.N(RuRR(RetstartstspansR,RVRJR0R}R8RRR:Rt precisionRRRRR(R#R$R%R&R*R+R,R tleadttrailt_pcRttrailing_decimaltjdxR5((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRsD   %      " (,RGRHRIRRRPRWRfRrRSt classmethodRmRR=R3R6RRRRtpropertyRRetsettertdeleterRR*RRR0RRRRRRRR RRRRRR(((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRJsL   %   &         2    * )    f /cCsStjj||}|jjdkrOt|tj rO|jtj}n|S(s Compatibility function for using the recarray base class's field method. This incorporates the legacy functionality of returning string arrays as Numeric-style chararray objects. RwRx(RwRx(RCROR0RMRR)RR(RR1R0((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRzs cCsIxBtj|ddgddgD]}|jj||dQscss|]}|jdkVqdS(RxN(R(RNRO((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pys Rs(RMRTRtany(Rtdtypes((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyRLs(1RRRR?t functoolsRtnumpyRCRRRRRRRRRRR R R R R RRtutilRRt extern.sixRRtextern.six.movesRRtutilsRt utils.compatRtobjectRRORJRzRFR#RER!R R(((s6lib/python2.7/site-packages/astropy/io/fits/fitsrec.pyts.     ^zt   #