B îq\éÃã@sdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddlZ ddlZ ddlZddlmZmZddlmZddlmZddlmZddlmZmZdd d d d d ddddddddddddgZiZGdd„dej ƒZ!e!ƒZ"Gdd„deƒZ#dd„Z$dd„Z%ej&d@d"d „ƒZ'd#d „Z(ej&dAd$d „ƒZ)dBd%d „Z*dCd&d„Z+dDd(d„Z,dEd)d„Z-d*d„Z.dFd+d,„Z/d-d.„Z0d/d„Z1d0d„Z2dGd1d„Z3d2d„Z4d3d4„Z5dHd5d„Z6ga7ej8d6d7„ƒZ9dId8d„Z:d9d:„Z;d;d<„Z„Z=d?d„Z>dS)Jz[ This module contains helper functions for accessing, downloading, and caching data files. éN)ÚNamedTemporaryFileÚ gettempdir)Úwarn)Úconfig)ÚAstropyWarning)Úfind_current_moduleÚ resolve_nameÚConfÚconfÚget_readable_fileobjÚget_file_contentsÚget_pkg_data_fileobjÚget_pkg_data_filenameÚget_pkg_data_contentsÚget_pkg_data_fileobjsÚget_pkg_data_filenamesÚ compute_hashÚclear_download_cacheÚCacheMissingWarningÚget_free_space_in_dirÚcheck_free_space_in_dirÚ download_fileÚdownload_files_in_parallelÚis_url_in_cacheÚget_cached_urlsc@sjeZdZdZe dd¡Ze dd¡Zejdddgd Ze d d ¡Z e d d ¡Z e d d¡Z e dd¡Z dS)r z< Configuration parameters for `astropy.utils.data`. zhttp://data.astropy.org/z)Primary URL for astropy remote data site.z$http://www.astropy.org/astropy-data/z(Mirror URL for astropy remote data site.g$@z2Time to wait for remote data queries (in seconds).z5astropy.coordinates.name_resolve.name_resolve_timeout)Úaliasesiz)Block size for computing MD5 file hashes.z4Number of bytes of remote data to download per step.ézWNumber of times to try to get the lock while accessing the data cache before giving up.TzzIf True, temporary download files created when the cache is inaccessible will be deleted at the end of the python session.N) Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú_configZ ConfigItemÚdataurlÚdataurl_mirrorÚremote_timeoutÚcompute_hash_block_sizeÚdownload_block_sizeÚdownload_cache_lock_attemptsÚ"delete_temporary_downloads_at_exit©r)r)ú1lib/python3.7/site-packages/astropy/utils/data.pyr *s. c@seZdZdZdS)ra1 This warning indicates the standard cache directory is not accessible, with the first argument providing the warning message. If args[1] is present, it is a filename indicating the path to a temporary file that was created to store a remote data download in the absence of the cache. N)rrrr r)r)r)r*rLscCstj |¡}|j ¡dkS)zy Test whether a string is a valid URL Parameters ---------- string : str The string to test )ZhttpZhttpsZftpZsftpZsshÚfile)ÚurllibÚparseZurlparseZschemeÚlower)ÚstringÚurlr)r)r*Ú_is_urlUs r1cCs4tj |¡ tj |¡¡p2tj |¡ tj |¡¡S)N)ÚosÚpathÚabspathÚ startswithÚrealpath)r3Ú parent_pathr)r)r*Ú _is_insideesr8FTc cs´ttjf}g}g}|dkr tj}t||ƒrxt|ƒ}t|ƒ}|rNt||||d}t  |d¡} |rl|sl|  | ¡|  | ¡n|} t | dƒs”t  |   ¡¡} |   d¡} |  d¡| dd…dkr*ddl} y$ddl} | j| d d } |   d ¡Wn0tt| jfk r|  d¡|  ¡YnX|  d¡| } nš| dd…d kry ddl}Wn6tk r~x|D]}| ¡q`Wtd ƒ‚YnXyLtddd,}| |   ¡¡| ¡|j|jd d} WdQRX|   d ¡Wn(tk rô|  d¡|  ¡YnX|  d¡|  | ¡| } n´| dd…dkrÄy$ddl}|j| d d} |   d ¡Wnntk r|x|D]}| ¡q^Wtdƒ‚YnHttfk r´}z|  d¡|  ¡Wdd}~XYnX|  d¡| } |dk}|rny ddl}Wntk rôYnXXt| |jƒrLtddd}|   ¡}| |¡| ¡|  |¡t  |jd¡} |  | ¡t | ¡} tj | |d} |  d¡z | VWdx|D]}| ¡q€Wx|D]}t! "|j¡q˜WXdS)a• Given a filename, pathlib.Path object or a readable file-like object, return a context manager that yields a readable file-like object. This supports passing filenames, URLs, and readable file-like objects, any of which can be compressed in gzip, bzip2 or lzma (xz) if the appropriate compression libraries are provided by the Python installation. Notes ----- This function is a context manager, and should be used for example as:: with get_readable_fileobj('file.dat') as f: contents = f.read() Parameters ---------- name_or_obj : str or file-like object The filename of the file to access (if given as a string), or the file-like object to access. If a file-like object, it must be opened in binary mode. encoding : str, optional When `None` (default), returns a file-like object with a ``read`` method that returns `str` (``unicode``) objects, using `locale.getpreferredencoding` as an encoding. This matches the default behavior of the built-in `open` when no ``mode`` argument is provided. When ``'binary'``, returns a file-like object where its ``read`` method returns `bytes` objects. When another string, it is the name of an encoding, and the file-like object's ``read`` method will return `str` (``unicode``) objects, decoded from binary using the given encoding. cache : bool, optional Whether to cache the contents of remote URLs. show_progress : bool, optional Whether to display a progress bar if the file is downloaded from a remote server. Default is `True`. remote_timeout : float Timeout for remote requests in seconds (default is the configurable `astropy.utils.data.Conf.remote_timeout`, which is 3s by default) Returns ------- file : readable file-like object N)ÚcacheÚ show_progressÚtimeoutÚrÚseekérés‹Úrb)ÚfileobjÚmodeésBZhz`.bz2 format files are not supported since the Python interpreter does not include the bz2 moduleÚwbF)Údelete)rBsý7zza.xz format files are not supported since the Python interpreter does not include the lzma module.Zbinary)Úencoding)#ÚstrÚpathlibZPathr r$Ú isinstancer1rÚioÚFileIOÚappendÚhasattrÚBytesIOÚreadr=ÚstructÚgzipZGzipFileÚOSErrorÚEOFErrorÚerrorÚcloseÚbz2Ú ImportErrorÚ ValueErrorrÚwriteZBZ2FileÚnameÚlzmaZLZMAFileÚBufferedReaderÚ TextIOWrapperr2Úremove)Z name_or_objrFr9r:r$Z PATH_TYPESZ close_fdsZ delete_fdsZis_urlrAZ signaturerPrQZ fileobj_newrVÚfdZtmpr[ÚeZneeds_textio_wrapperÚdatar)r)r*r ns´@                              c Ost||Ž }| ¡SQRXdS)zó Retrieves the contents of a filename or file-like object. See the `get_readable_fileobj` docstring for details on parameters. Returns ------- content The content of the file (as requested by ``encoding``). N)r rO)ÚargsÚkwargsÚfr)r)r*r As c csìt||d}tj |¡r"tdƒ‚nÆtj |¡rNt||d }|VWdQRXnštjtj f}xŒ|D]\}y>t||||d"}|  d¡|  d¡|VPWdQRXWq`t j jk rºYq`Xq`Wd d d „|Dƒ¡}t j  d  ||¡¡‚dS) aî Retrieves a data file from the standard locations for the package and provides the file as a file-like object that reads bytes. Parameters ---------- data_name : str Name/location of the desired data file. One of the following: * The name of a data file included in the source distribution. The path is relative to the module calling this function. For example, if calling from ``astropy.pkname``, use ``'data/file.dat'`` to get the file in ``astropy/pkgname/data/file.dat``. Double-dots can be used to go up a level. In the same example, use ``'../data/file.dat'`` to get ``astropy/data/file.dat``. * If a matching local file does not exist, the Astropy data server will be queried for the file. * A hash like that produced by `compute_hash` can be requested, prefixed by 'hash/' e.g. 'hash/34c33b3eb0d56eb9462003af249eff28'. The hash will first be searched for locally, and if not found, the Astropy data server will be queried. package : str, optional If specified, look for a file relative to the given package, rather than the default of looking relative to the calling module's package. encoding : str, optional When `None` (default), returns a file-like object with a ``read`` method returns `str` (``unicode``) objects, using `locale.getpreferredencoding` as an encoding. This matches the default behavior of the built-in `open` when no ``mode`` argument is provided. When ``'binary'``, returns a file-like object where its ``read`` method returns `bytes` objects. When another string, it is the name of an encoding, and the file-like object's ``read`` method will return `str` (``unicode``) objects, decoded from binary using the given encoding. cache : bool If True, the file will be downloaded and saved locally or the already-cached local copy will be accessed. If False, the file-like object will directly access the resource (e.g. if a remote URL is accessed, an object like that from `urllib.request.urlopen` is returned). Returns ------- fileobj : file-like An object with the contents of the data file available via ``read`` function. Can be used as part of a ``with`` statement, automatically closing itself after the ``with`` block. Raises ------ urllib2.URLError, urllib.error.URLError If a remote file cannot be found. OSError If problems occur writing or reading a local file. Examples -------- This will retrieve a data file and its contents for the `astropy.wcs` tests:: >>> from astropy.utils.data import get_pkg_data_fileobj >>> with get_pkg_data_fileobj('data/3d_cd.hdr', ... package='astropy.wcs.tests') as fobj: ... fcontents = fobj.read() ... This next example would download a data file from the astropy data server because the ``allsky/allsky_rosat.fits`` file is not present in the source distribution. It will also save the file locally so the next time it is accessed it won't need to be downloaded.:: >>> from astropy.utils.data import get_pkg_data_fileobj >>> with get_pkg_data_fileobj('allsky/allsky_rosat.fits', ... encoding='binary') as fobj: # doctest: +REMOTE_DATA +IGNORE_OUTPUT ... fcontents = fobj.read() ... Downloading http://data.astropy.org/allsky/allsky_rosat.fits [Done] This does the same thing but does *not* cache it locally:: >>> with get_pkg_data_fileobj('allsky/allsky_rosat.fits', ... encoding='binary', cache=False) as fobj: # doctest: +REMOTE_DATA +IGNORE_OUTPUT ... fcontents = fobj.read() ... Downloading http://data.astropy.org/allsky/allsky_rosat.fits [Done] See Also -------- get_pkg_data_contents : returns the contents of a file or url as a bytes object get_pkg_data_filename : returns a local name for a file containing the data )ÚpackagezDTried to access a data file that's actually a package data directory)rFN)rFr9rCrÚ css|]}d |¡VqdS)z - {0}N)Úformat)Ú.0r0r)r)r*ú Ísz'get_pkg_data_fileobj..z>> from astropy.utils.data import get_pkg_data_filename >>> fn = get_pkg_data_filename('data/3d_cd.hdr', ... package='astropy.wcs.tests') >>> with open(fn) as f: ... fcontents = f.read() ... This retrieves a data file by hash either locally or from the astropy data server:: >>> from astropy.utils.data import get_pkg_data_filename >>> fn = get_pkg_data_filename('hash/34c33b3eb0d56eb9462003af249eff28') # doctest: +SKIP >>> with open(fn) as f: ... fcontents = f.read() ... See Also -------- get_pkg_data_contents : returns the contents of a file or url as a bytes object get_pkg_data_fileobj : returns a file-like object with the data Nzhash/rT)r9r:r;rfcss|]}d |¡VqdS)z - {0}N)rg)rhr0r)r)r*ri8sz(get_pkg_data_filename..z>Failed to download {0} from the following repositories: {1} )rezDTried to access a data file that's actually a package data directorycss|]}d |¡VqdS)z - {0}N)rg)rhr0r)r)r*riOsz>> from astropy.utils.data import get_pkg_data_filenames >>> for fn in get_pkg_data_filenames('maps', 'astropy.wcs.tests', ... '*.hdr'): ... with open(fn) as f: ... fcontents = f.read() ... )rezDTried to access a data directory that's actually a package data filezPath not foundN) rjr2r3rlrRrkÚlistdirÚfnmatchrn)ÚdatadirreÚpatternr3Úfilenamer)r)r*r s,    c cs:x4t|||dD]"}t||d }|VWdQRXqWdS)a| Returns readable file objects for all of the data files in a given directory that match a given glob pattern. Parameters ---------- datadir : str Name/location of the desired data files. One of the following: * The name of a directory included in the source distribution. The path is relative to the module calling this function. For example, if calling from ``astropy.pkname``, use ``'data'`` to get the files in ``astropy/pkgname/data`` * Remote URLs are not currently supported package : str, optional If specified, look for a file relative to the given package, rather than the default of looking relative to the calling module's package. pattern : str, optional A UNIX-style filename glob pattern to match files. See the `glob` module in the standard library for more information. By default, matches all files. encoding : str, optional When `None` (default), returns a file-like object with a ``read`` method that returns `str` (``unicode``) objects, using `locale.getpreferredencoding` as an encoding. This matches the default behavior of the built-in `open` when no ``mode`` argument is provided. When ``'binary'``, returns a file-like object where its ``read`` method returns `bytes` objects. When another string, it is the name of an encoding, and the file-like object's ``read`` method will return `str` (``unicode``) objects, decoded from binary using the given encoding. Returns ------- fileobjs : iterator of file objects File objects for each of the files on the local filesystem in *datadir* matching *pattern*. Examples -------- This will retrieve the contents of the data file for the `astropy.wcs` tests:: >>> from astropy.utils.data import get_pkg_data_filenames >>> for fd in get_pkg_data_fileobjs('maps', 'astropy.wcs.tests', ... '*.hdr'): ... fcontents = fd.read() ... )rer{)rFN)rr )rzrer{rFÚfnr_r)r)r*rÙs: c CsRt|dƒ:}t ¡}| tj¡}x|r>| |¡| tj¡}q"WWdQRX| ¡S)ag Computes the MD5 hash for a file. The hash for a data file is used for looking up data files in a unique fashion. This is of particular use for tests; a test may require a particular version of a particular file, in which case it can be accessed via hash to get the appropriate version. Typically, if you wish to write a test that requires a particular data file, you will want to submit that file to the astropy data servers, and use e.g. ``get_pkg_data_filename('hash/34c33b3eb0d56eb9462003af249eff28')``, but with the hash for your file in place of the hash in the example. Parameters ---------- localfn : str The path to the file for which the hash should be generated. Returns ------- md5hash : str The hex digest of the MD5 hash for the contents of the ``localfn`` file. r@N)ÚopenÚhashlibÚmd5rOr r%ÚupdateÚ hexdigest)ZlocalfnrdÚhÚblockr)r)r*rs   cCsÄ|dkr`tdddgd}|dkr$|St|dƒr4|jsXd|jkrP|j d¡d}q^|j}qh|j}nt|ƒ}| d¡d}t|ƒ}tj  |j ¡}tj  ||¡}tj  |j ¡}t ||ƒsÀt d  |¡ƒ‚|S) zX Look for data in the source-included data directories and return the path. NrCzastropy.utils.dataÚ contextlib)ZfinddiffÚ __package__Ú.rz:attempted to get a local data file outside of the {} tree.)rrMr†rÚ rpartitionrÚ partitionr2r3ÚdirnameÚ__file__rnr8Ú RuntimeErrorrg)roreÚmoduleZ rootpkgnameZrootpkgZ module_pathr3Zroot_dirr)r)r*rj>s&  rjc Cspytƒ\}}Wn:tk rH}zd}tt|t|ƒƒƒdSd}~XYnXtj ||¡}tj |¡rh|SdSdS)zs Looks for a local file by hash - returns file name if found and a valid file, otherwise returns None. z:Could not access cache directory to search for data file: N) Ú_get_download_cache_locsrRrrrGr2r3rnrl)ÚhashÚdldirÚurlmapfnr`Úmsgrur)r)r*rsfs rscCsttj d¡rZddl}| d¡}|jj | |¡dd|  |¡¡}|dkrTt d  |¡ƒ‚|j St  |¡}|j|jSdS)a5 Given a path to a directory, returns the amount of free space (in bytes) on that filesystem. Parameters ---------- path : str The path to a directory Returns ------- bytes : int The amount of free space on the partition that the directory is on. ÚwinrNz0Checking free space on {!r} failed unexpectedly.)ÚsysÚplatformr5ÚctypesZ c_ulonglongZwindllZkernel32ZGetDiskFreeSpaceExWZ c_wchar_pZpointerrRrgÚvaluer2ÚstatvfsÚf_bavailÚf_frsize)r3r–Z free_bytesZretvalÚstatr)r)r*rys   cCs4ddlm}t|ƒ}||kr0td |||ƒ¡ƒ‚dS)ag Determines if a given directory has enough space to hold a file of a given size. Raises an OSError if the file would be too large. Parameters ---------- path : str The path to a directory size : int A proposed filesize (in bytes) Raises ------- OSError : There is not enough room on the filesystem r)Úhuman_file_sizez5Not enough free space in '{0}' to download a {1} fileN)Úastropy.utils.consolerœrrRrg)r3ÚsizerœZspacer)r)r*r˜s  c CsVddlm}|dkrtj}d}|r–ytƒ\}}Wndtk r”}zFd} t|jƒdkrXdn dt|ƒ} t t | |j j | ƒƒd}d }Wdd}~XYnX|} |   tj¡rtjtkry6tjjtj|d } tj|  ¡gttj<WdQRXWn(tjjk rtjgttj<YnXyŽ|rŒt |¡^} | | kr<| | SxDt tjg¡D]2}|   |¡rL|  |tj¡}|| krL| |SqLWWdQRXtjj||d b} t ¡}|  ¡}d |krèyt|d ƒ}Wntk räd}YnXnd}|dk rt t!ƒ|ƒ|rt ||ƒ|r,t"j# $¡r,t"j#}nt% &¡}d  '|¡}||||d ª}t(dd”}yXd}|  )tj*¡}xB|r®| +|¡| ,|¡|t|ƒ7}| ,|¡|  )tj*¡}qnWWn4t-k ræt.j/ 0|j1¡ràt. 2|j1¡‚YnXWdQRXWdQRXWdQRX|rrt3ƒzTt |¡@} | | kr2| | St.j/ 4|| 5¡¡}t6 7|j1|¡|| | <WdQRXWdt8ƒXn0|j1}|rd} t t | |ƒƒtj9r¢t: ;|¡Wn¬tjjk r }zXt<|dƒr t<|j=dƒr |j=j>dkr |j=j?d||j=_?|j=j>|j=j?f|j=_|‚Wdd}~XYn2t@jAk rP}ztj |¡‚Wdd}~XYnX|S)aÔ Accepts a URL, downloads and optionally caches the result returning the filename, with a name determined by the file's MD5 hash. If ``cache=True`` and the file is present in the cache, just returns the filename. Parameters ---------- remote_url : str The URL of the file to download cache : bool, optional Whether to use the cache show_progress : bool, optional Whether to display a progress bar during the download (default is `True`). Regardless of this setting, the progress bar is only displayed when outputting to a terminal. timeout : float, optional The timeout, in seconds. Otherwise, use `astropy.utils.data.Conf.remote_timeout`. Returns ------- local_path : str Returns the local path that the file was download to. Raises ------ urllib2.URLError, urllib.error.URLError Whenever there's a problem getting the remote file. r)ÚProgressBarOrSpinnerNFz/Remote data cache could not be accessed due to rCÚz: T)r;zContent-LengthzDownloading {0})r+)rEzaFile downloaded to temporary location due to problem with cache directory and will not be cached.ÚreasonÚerrnoéz. requested URL: )BrrŸr r$rŽrRÚlenrbrGrrÚ __class__rr5r"Ú_dataurls_to_aliasr,ZrequestZurlopenZgeturlrTrmÚshelver~ÚgetÚreplacer#rr€ÚinfoÚintrXrrr”ÚstdoutÚisattyrJÚStringIOrgrrOr&rYrÚ BaseExceptionr2r3ÚexistsrZr^Ú_acquire_download_cache_lockrnr‚ÚshutilZmoveÚ_release_download_cache_lockr(Ú_tempfilestodelrLrMr¡r¢ÚstrerrorÚsocketr;)Z remote_urlr9r:r;rŸZ missing_cacherr‘r`r’ÚestrÚurl_keyZremoteÚurl2hashZcur_urlZ url_mirrorrrªržZprogress_streamZdlmsgÚprdZ bytes_readr„Z local_pathr)r)r*r³s°#  "                 &   (c Cs’ytƒ\}}Wn\tk rj}z>d}t|jƒdkr6dn dt|ƒ}tt||jj|ƒƒdSd}~XYnXt   |¡}||kr„dSWdQRXdS)zø Check if a download from ``url_key`` is in the cache. Parameters ---------- url_key : string The URL retrieved Returns ------- in_cache : bool `True` if a download from ``url_key`` is in the cache z/Remote data cache could not be accessed due to rCr z: FNT) rŽrRr¤rbrGrrr¥rr§r~)r¸rr‘r`r’r·r¹r)r)r*rNs cCst|ŽS)N)r)rbr)r)r*Ú_do_download_files_in_parallelksr»c s˜ddlm}ˆdkrtj‰ˆs,tdtƒd‰|r8tj}nt  ¡}t t |ƒƒ}|j t ‡‡fdd„|Dƒ|dd}g}x |D]} | || | ¡¡qxW|S) añ Downloads multiple files in parallel from the given URLs. Blocks until all files have downloaded. The result is a list of local file paths corresponding to the given urls. Parameters ---------- urls : list of str The URLs to retrieve. cache : bool, optional Whether to use the cache (default is `True`). .. versionchanged:: 3.0 The default was changed to ``True`` and setting it to ``False`` will print a Warning and set it to ``True`` again, because the function will not work properly without cache. show_progress : bool, optional Whether to display a progress bar during the download (default is `True`) timeout : float, optional Timeout for each individual requests in seconds (default is the configurable `astropy.utils.data.Conf.remote_timeout`). Returns ------- paths : list of str The local file paths corresponding to the downloaded URLs. rC)Ú ProgressBarNz–Disabling the cache does not work because of multiprocessing, it will be set to ``True``. You may need to manually remove the cached files afterwards.Tcsg|]}|ˆdˆf‘qS)Fr))rhÚx)r9r;r)r*ú ¨sz.download_files_in_parallel..)r+Z multiprocess)Zconsoler¼r r$rrr”r¬rJrNÚlistÚsetÚmapr»rLÚindex) rrr9r:r;r¼ZprogressZ combined_urlsZcombined_pathsÚpathsr0r))r9r;r*ros(!   cCs<tdk r8x.ttƒdkr6t ¡}tj |¡r t |¡q WdS)Nr)r´r¤Úpopr2r3rlr^)r}r)r)r*Ú _deltemps¶s  rÅc Csdytƒ\}}Wn\tk rj}z>d}t|jƒdkr6dn dt|ƒ}tt||jj|ƒƒdSd}~XYnXt ƒzÌ|dkr”t j   |¡r’t  |¡n¨t |¡˜}t j  ||¡}t||ƒsÀtdƒ‚|}t j   |¡rx"| ¡D]\} } | |krÜ|| =qÜWt  |¡n0||kr2||}||=t j   |¡r2t  |¡WdQRXWdt j   t j  |d¡¡r^tƒXdS)aJ Clears the data file cache by deleting the local file(s). Parameters ---------- hashorurl : str or None If None, the whole cache is cleared. Otherwise, either specifies a hash for the cached file that is supposed to be deleted, or a URL that should be removed from the cache if present. z3Not clearing data cache - cache inacessable due to rCr z: NzPattempted to use clear_download_cache on a path outside the data cache directoryÚlock)rŽrRr¤rbrGrrr¥rr±r2r3r°r²Zrmtreer§r~rnr8rŒÚitemsÚunlinkr³) Z hashorurlrr‘r`r’r·r¹ÚfilepathZhash_keyÚkÚvr)r)r*rÂs:        c CsÎddlm}dttjjƒ}tj |ƒd|¡}tj |d¡}tj  |¡sŠyt  |¡Wq¨t k r†}ztj  |¡sv‚Wdd}~XYq¨Xntj  |¡s¨d}t |  |¡ƒ‚tj  |¡rÆd}t |  |¡ƒ‚||fS) a Finds the path to the data cache directory and makes them if they don't exist. Returns ------- datadir : str The path to the data cache directory. shelveloc : str The path to the shelve object that stores the cache info. r)Ú get_cache_dirÚpyZdownloadZurlmapNz+Data cache directory {0} is not a directoryz4Data cache shelve object location {0} is a directory)Zastropy.config.pathsrÌrGr”Ú version_infoÚmajorr2r3rnr°ÚmakedirsrRrkrg)rÌZ py_versionrzZ shelvelocr`r’r)r)r*rŽûs"     rŽc Cs¢tj tƒdd¡}xvttjƒD]h}y@t |¡ttj |d¡dƒ}|  t t  ¡ƒ¡WdQRXWnt k r‚t  d¡Yq XdSq Wd}t| |¡ƒ‚dS)z„ Uses the lock directory method. This is good because `mkdir` is atomic at the system call level, so it's thread-safe. rrÆÚpidÚwNrCzUnable to acquire lock for cache directory ({0} exists). You may need to delete the lock if the python interpreter wasn't shut down properly.)r2r3rnrŽÚranger r'Úmkdirr~rYrGÚgetpidrRÚtimeZsleeprŒrg)ÚlockdirÚirdr’r)r)r*r±$s  r±cCsftj tƒdd¡}tj |¡rPtj |d¡}tj |¡rDt |¡t |¡nd}t|  |¡ƒ‚dS)NrrÆrÑzHError releasing lock. "{0}" either does not exist or is not a directory.) r2r3rnrŽrkr°r^ÚrmdirrŒrg)r×Zpidfnr’r)r)r*r³<s    r³c CsŽytƒ\}}Wn\tk rj}z>d}t|jƒdkr6dn dt|ƒ}tt||jj|ƒƒdSd}~XYnXt   |¡}t |  ¡ƒSQRXdS)zç Get the list of URLs in the cache. Especially useful for looking up what files are stored in your cache when you don't have internet access. Returns ------- cached_urls : list List of cached URLs. z/Remote data cache could not be accessed due to rCr z: FN) rŽrRr¤rbrGrrr¥rr§r~r¿Úkeys)rr‘r`r’r·r¹r)r)r*rKs  )NFTN)NNT)NTN)NNT)Nrw)NrwN)N)FTN)TTN)N)?r Úatexitr…ryrr2rJrHr²r¶r”rÖZurllib.requestr,Z urllib.errorZ urllib.parser§ZtempfilerrÚwarningsrZastropyrr!Zastropy.utils.exceptionsrZastropy.utils.introspectionrrÚ__all__r¦ZConfigNamespacer r rr1r8Úcontextmanagerr r r rrrrrrjrsrrrrr»rr´ÚregisterrÅrrŽr±r³rr)r)r)r*Ús‚       R   L 9 @% (  C 9)