[c@ sddlmZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z mZddlmZmZmZmZmZmZmZmZmZddlmZmZd d lmZmZd d lm Z d d l!m"Z"d d l#m$Z$d dl%m&Z&m'Z'd dl(m)Z)d dl*m+Z+de,fdYZ-e-Z.idd6dd6dd6dd6dd6dd6Z/i dd6dd6dd6dd6dd 6dd6dd!6dd6dd6Z0d"e1fd#YZ2d$Z3d%e4fd&YZ5ee5d'e,fd(YZ6e6Z7e6j8Z8e6j9Z9d)e6fd*YZ:d+e6efd,YZ;d-e6efd.YZ<d/e<fd0YZ=e=Z>d1e=fd2YZ?e?Z@dS(3i(tdivisionNi(tconf(t_File(tHeadert _pad_length( t_is_intt_is_pseudo_unsignedt_unsigned_zerotitersubclassest decode_asciit_get_array_mmaptfirstt_free_space_checkt_extract_number(t_Verifyt_ErrListi(t string_typest add_metaclass(trange(t lazyproperty(tsuppress(t signaturet Parameter(tAstropyUserWarning(tdeprecated_renamed_argumentt_DelayedcB seZRS((t__name__t __module__(((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRstuint8itint16itint32i tint64i@tfloat32itfloat64ituint16tuint32tuint64tInvalidHDUExceptioncB seZdZRS(s A custom exception class used mainly to signal to _BaseHDU.__new__ that an HDU cannot possibly be considered valid, and must be assumed to be corrupted. (RRt__doc__(((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR%3scC s|}|rxttt|D]}yD|jjdpL||jksUw%n|j|rn|}PnWq%tk rq%q%tk r}t j dj |t t j dt t }~Pq%Xq%Wn|S(s Used primarily by _BaseHDU.__new__ to find an appropriate HDU class to use based on values in the header. See the _BaseHDU.__new__ docstring. sastropy.io.fits.sMAn exception occurred matching an HDU header to the appropriate HDU type: {0}s%The HDU will be treated as corrupted.(treversedtlistRRt startswitht _hdu_registryt match_headertNotImplementedErrort ExceptiontwarningstwarntformatRt _CorruptedHDU(tclstheadertklasstctexc((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt_hdu_class_from_header;s.   t _BaseHDUMetacB seZdZRS(cC sfd|krb|d}t|ttfrb|jdkrbd}t|d|j|qbndS(NtdatacS sW|jdk rS|jrStj|j}|jd=|dkrS|jjqSndS(NR9i(t_filetNonet _data_loadedtsyst getrefcountR9t__dict__t_maybe_close_mmap(tselft data_refcount((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR9js   (t isinstanceRtpropertytfdelR;tsetattrtdeleter(R2tnametbasestmemberst data_propR9((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt__init__^s    (RRRL(((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR8]st_BaseHDUcB s eZdZeZeZdZdZd)d)dZ d)d)dZ e dZ e jdZ e dZejdZe d Zejd Ze d Zejd Ze d Ze dZe dZedZedZedZeeedZeeedZeddddeedZed)eedZdZeedZ dZ!ddd Z"d!Z#d"Z$d#Z%d$Z&d%Z'eed&Z(d'Z)ed(Z*RS(*s2Base class for all HDU (header data unit) classes.stcO s%t||}tt|j|S(s? Iterates through the subclasses of _BaseHDU and uses that class's match_header() method to determine which subclass to instantiate. It's important to be aware that the class hierarchy is traversed in a depth-last order. Each match_header() should identify an HDU type as uniquely as possible. Abstract types may choose to simply return False or raise NotImplementedError to be skipped. If any unexpected exceptions are raised while evaluating match_header(), the type is taken to be _CorruptedHDU. (R7tsuperRMt__new__(R2R9R3targstkwargsR4((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRPscO s|dkrt}n||_d|_d|_d|_d|_d|_t|_ t|_ t |_ t|_ d|jkrd|jkrd|_ nd|jkrt |_ ndS(NtDATASUMtCHECKSUMtdatasum(R;Rt_headerR:t_buffert_header_offsett _data_offsett _data_sizetFalset_data_replacedt_data_needs_rescaletTruet_newt_output_checksum(RAR9R3RQRR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRLs              cC s|jS(N(RV(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR3scC s ||_dS(N(RV(RAtvalue((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR3scC st|jjd|jS(NtEXTNAME(tstrRVtgett _default_name(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRHscC slt|tstdntjs6|j}nd|jkrU||jdsR9R3RxN((R;RCRttellRtfromfiletnptndarrayRfR0t _from_blocksR^RR7RRLtcopyRt VAR_KEYWORDt parameterstvaluesRsR:RWRXRYtsizeRRZt _ValidHDUt_verify_checksum_datasum(R2R9R3RzR{RRt hdu_buffert hdu_fileobjt header_offsett data_offsetRt header_strtsigt new_kwargstkeyRR((R9s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR|{sT         "      !cC svt|tr|f}n|jrFtj|d|d|jd|S|jrn|jjd|d|d|SdSdS(sb Return raw array from either the HDU's memory buffer or underlying file. RRtoffsettshapeN(RCtintRWRRR:t readarrayR;(RARtcodeR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt _get_raw_datas   cC s|j|j|dS(N(t_update_uint_scale_keywordst_update_checksum(RARztinplace((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt _prewritetos cC s|jr|jrt|jjrd|jkrO|jjddddn>d|jkrz|jjddddn|jjdd|jjdt|jjddndS(se If the data is unsigned int 16, 32, or 64 add BSCALE/BZERO cards to header. tTFIELDStBSCALEitaftertGCOUNTtBZERON(Rtt _standardRR9RRVtsetR(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRsRTRScC sn|jjp|j}|dkr\||jkr=|j|=n||jkrj|j|=qjn|s|js|rjd|jksd|jkrj|dkr|jd|qj|dkr|jddd|qj|d kr|j|jd||j|jtd |d|qj|dkrB|jddd |d|qj|rj|jdd d |d|qjnd S( s!Update the 'CHECKSUM' and 'DATASUM' keywords in the header (or keywords with equivalent semantics given by the ``checksum_keyword`` and ``datasum_keyword`` arguments--see for example ``CompImageHDU`` for an example of why this might need to be overridden). RxRTRSRUtdatasum_keywordtnonstandard_datasumtblockingt nonstandardttesttchecksum_keywordtstandardN( RVt _modifiedR<R_t add_datasumt_datasum_commentt add_checksumt_checksum_commentR^(RARzRRtmodified((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRs8          cC sY|jrU|jrUt|jjrUx.dD]#}tt|j|=WdQXq+WndS(NRR(RR(RtRRR9RRtKeyErrorRV(RAtkeyword((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt _postwriteto*s   cC sd}|jsttt|j}WdQX|jj|y|j|}Wqttfk rtt|j}qXntt|j}||fS(Ni( t simulateonlyRtAttributeErrortIOErrorRRVttofileRRc(RARRR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt _writeheader3s cC sd}d}|jsL|jy|j}WqLtk rHd}qLXn|js^|jr|jdk r||j|7}n|dkrt ||j }|j |j d|t |7}qn||j|7}|js|jn||fS(Nitascii(RtflushRRR<R]R9R;t_writedata_internalRt _padding_bytetwritetencodeRt_writedata_direct_copy(RARRRtpadding((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt _writedataDs&       cC s0|js|j|jn|jj|jjS(s# The beginning and end of most _writedata() implementations are the same, but the details of writing the data array itself can vary between HDU types, so that should be implemented in this method. Should return the size in bytes of the data written. (Rt writearrayR9Rtitemsize(RAR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRjs cC sC|j|jd|j}|dk r;|j||jSdSdS(sCopies the data directly from one file/buffer to the new file. For now this is handled by loading the raw data from the existing data (including any padding) via a memory map or from an already in-memory buffer and using Numpy's existing file-writing facilities to write to the new file. If this proves too slow a more direct approach may be used. RiN(RRZRYR;RR(RARtraw((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRws   cC siytjj|jj}Wnttfk r;d}nXt|||j |||WdQXdS(N( RtpathtdirnameR:RHRRfR;R t_writeto_internal(RARRRR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt_writetos  c C s| s|jre|j|\}}|j|\}}|jra||_||_||_ndS|j}|j|j} |j} |j} |jjr|jj ||j|\}} || } nJ|r|jj ||j }|j |jj | |j } n|j r|jdk r|s?|jrHd} nt|j} | dk rp| jq|jj |j|j|\} } qn|r|j|} n||_| |_| |_t|_dS(N(R_RRRXRYRZRVRR:R~RRtreadR<R9R;R\R RRR[( RARRRRt_Rt data_sizethdrlocthdrsizetdatloctdatsizet array_mmap((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRsH                 cC s1|r-|jr-t|jdk r-|`ndS(N(R<R R9R;(RAtclosed((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt_closesN(+RRR&RR*R^RRReR;RPRLRDR3tsetterRHRjRlRrR<Rtt classmethodRwRyR+R[R}RRRR|RRRRRRRRRRRR(((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRM~sX     &%&V   (  &  AR1cB s/eZdZedZdZdZRS(sQ A Corrupted HDU class. This class is used when one or more mandatory `Card`s are corrupted (unparsable), such as the ``BITPIX``, ``NAXIS``, or ``END`` cards. A corrupted HDU usually means that the data size cannot be calculated or the ``END`` card is not found. In the case of a missing ``END`` card, the `Header` may also contain the binary data .. note:: In future, it may be possible to decipher where the last block of the `Header` ends, but this task may be difficult when the extension is a `TableHDU` containing ASCII data. cC s4|jdk r#t|j|jS|jj|jS(sE Returns the size (in bytes) of the HDU's data part. N(RWR;RRYR:R(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRscC s|j|jdfS(Nt CorruptedHDU(RHRj(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt_summary scC sdS(N((RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pytverify s(RRR&RDRRR(((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR1s t_NonstandardHDUcB s_eZdZeZedZedZdZ dZ e dZ ddZ RS(sx A Non-standard HDU class. This class is used for a Primary HDU when the ``SIMPLE`` Card has a value of `False`. A non-standard HDU comes from a file that resembles a FITS file but departs from the standards in some significant way. One example would be files where the numbers are in the DEC VAX internal storage format rather than the standard FITS most significant byte first. The header for this HDU should be valid. The data for this HDU is read from the file as a byte stream that begins at the first byte after the header ``END`` card and continues until the end of the file. cC sL|jd}|jdkrDd|kr;|jtkr;tStntSdS(st Matches any HDU that has the 'SIMPLE' keyword but is not a standard Primary or Groups HDU. itSIMPLEtGROUPSN(tcardsRRaR[R^R%(R2R3tcard((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR+!s   cC s4|jdk r#t|j|jS|jj|jS(sE Returns the size (in bytes) of the HDU's data part. N(RWR;RRYR:R(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR5scC sd}d}|jsL|jy|j}WqLtk rHd}qLXn|jdk r|js|j|j|jt|j}qn||fS(s Differs from the base class :class:`_writedata` in that it doesn't automatically add padding, and treats the data as a string of raw bytes instead of an array. iN(RRRRR9R;RR(RARRR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR@s      cC s|j|jdt|jfS(NtNonstandardHDU(RHRjRRV(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR[scC s|j|jd|jS(s' Return the file data. R(RRRY(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR9^sR/cC sCtgdd}x*|jjD]}|j|j|qW|S(NtunittCard(RRVRtappendt_verify(RAtoptionterrsR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRfs(RRR&R[RRR+RDRRRRR9R(((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRs   Rc B sCeZdZd+d+d+dZedZedZdZ dZ dZ ddZ d Z d+d d d Zd+ed d d dZd dZd dZdZdZdZd dZdd dZddZddddgZddddd d!d"d#d$d%d&d'd(g Zd)Zd*ZRS(,s: Base class for all HDUs which are not corrupted. cK s;tt|jd|d||dk r7||_ndS(NR9R3(RORRLR;RH(RAR9R3RHRR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRLus cC st|jdkS(s Matches any HDU that is not recognized as having either the SIMPLE or XTENSION keyword in its header's first card, but is nonetheless not corrupted. TODO: Maybe it would make more sense to use _NonstandardHDU in this case? Not sure... RRn(RRn(R tkeys(R2R3((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyR+zs cC sd}|jjdd}|dkrd}x3t|D]%}||jdt|d}q:W|jd}|jjdd}|jjdd}t||||d}n|S(sA Size (in bytes) of the data portion of the HDU. itNAXISitBITPIXRtPCOUNTi(RVRdRRctabs(RARtnaxisRtbitpixtgcounttpcount((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRs # cC s+t}|j|d|j|dS(sh Calculates and returns the number of bytes that this HDU will write to a file. i(RRR(RAtf((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyt filebytess cC sYt|drQ|jrQi|jd6|jjd6|jd6|jd6|jd6SdSdS(sx Returns a dictionary detailing information about the locations of this HDU within any associated file. The values are only valid after a read or write of the associated file with no intervening changes to the `HDUList`. Returns ------- dict or None The dictionary details information about the locations of this HDU within an associated file. Returns `None` when the HDU is not associated with a file. Dictionary contents: ========== ================================================ Key Value ========== ================================================ file File object associated with the HDU filemode Mode in which the file was opened (readonly, copyonwrite, update, append, ostream) hdrLoc Starting byte location of header in file datLoc Starting byte location of data block in file datSpan Data size including padding ========== ================================================ R:tfiletfilemodethdrLoctdatLoctdatSpanN(thasattrR:tmodeRXRYRZR;(RA((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pytfileinfos  cC sF|jdk r!|jj}nd}|jd|d|jjS(sJ Make a copy of the HDU, both header and data are copied. R9R3N(R9R;Rt __class__RV(RAR9((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRsR/c  stgdd}tjt|tr<d}|j}n d}t}|j|dd||||jddfdd |||jd d d d|||j j d d}|d krxat d|dD]L}d t |d }|j||dt |j |dd||qWx|j D]}|jd r7t|dkr7y5t|d} | dks| |krtnWqtk rdj||} ||d} |j|jd|d| d| ddqXq7q7Wnd|j krkt|j dtskd} d} |j d} |j|j|d| d| d| qknx*|j jD]} |j| j|qxW|S(NRRRnRiRic st|o|S(N(R(tv(tis_valid(s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pytsiRicS s"t|o!|dko!|dkS(Nii(R(R((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRsiicS st|o|dkS(Ni(R(R((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRstdefaultis3NAXISj keyword out of range ('{}' when NAXIS == {})cS s|j|=dS(N(RV(RAR((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pytfixsRterr_textRtfix_textsDeleted.Rbs-The EXTNAME keyword must have a string value.s0Converted the EXTNAME keyword to a string value.cS st|d|d 10`` this will check that the keyword's index is greater than 10. test : callable This should be a callable (generally a function) that is passed the value of the given keyword and returns `True` or `False`. This can be used to validate the value associated with the given keyword. fix_value : str, int, float, complex, bool, None A valid value for a FITS keyword to to use if the given ``test`` fails to replace an invalid value. In other words, this provides a default value to use as a replacement if the keyword's current value is invalid. If `None`, there is no replacement value and the keyword is unfixable. option : str Output verification option. Must be one of ``"fix"``, ``"silentfix"``, ``"ignore"``, ``"warn"``, or ``"exception"``. May also be any combination of ``"fix"`` or ``"silentfix"`` with ``"+ignore"``, ``+warn``, or ``+exception" (e.g. ``"fix+warn"``). See :ref:`verify` for more info. errlist : list A list of validation errors already found in the FITS file; this is used primarily for the validation system to collect errors across multiple HDUs and multiple calls to `req_cards`. Notes ----- If ``pos=None``, the card can be anywhere in the header. If the card does not exist, the new card will have the ``fix_value`` as its value when created. Also check the card's value by using the ``test`` argument. ic s |kS(N((R(t insert_pos(s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRZss'{}' card does not exist.s#Fixed by inserting a new '{}' card.cS s|jj||dS(N(RVtinsert(RAR!R((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyResRRRtfixables''{}' card at the wrong place (card {}).s0Fixed by moving it to the right place (card {}).cS s1|jj|}|j|=|jj||dS(N(RVRR"(RAtindexR!R((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRss s!'{}' card has invalid value '{}'.s"Fixed by setting a new value '{}'.c s|j|7}n|||>7}||?} ||?} x@| s.| ra||@| }||@| }||?} ||?} q"W||>|S( s Translated from FITS Checksum Proposal by Seaman, Pence, and Rots. Use uint32 literals as a hedge against type promotion to int64. This code should only be called with blocks of 2880 bytes Longer blocks result in non-standard checksums with carry overflow Historically, this code *was* called with larger blocks and for that reason still needs to be for backward compatibility. iiiiiis>u2NRi(RR#RR>RutreduceR$( RAR9RHtu8tu16tuFFFFtlastthitlothicarrytlocarry((s7lib/python2.7/site-packages/astropy/io/fits/hdu/base.pyRGs.      ,,   Iiiii:i;i<i=i>i?i@i[i\i]i^i_i`cC s|dtd}|d}tj|||||gdd}t}x|rt}xy|jD]n}xeddgD]W}|||ks||d|kru||cd7<||dcd8sV     @   "! e  %`7/