B S£†\\ã @s dZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z ddl m Z ej  d¡rrd Zd Znd Zd Zy(ed ejded ejded dhZWne k r¼eƒZYnXejdkrDe ej ejd¡¡ye ej ejd¡¡WnHek rBye ej ejd¡¡Wnek r<YnXYnXe ¡dkr ej ejd¡Ze e¡ye ej ejd¡¡Wnek rœYnX[ejdkry ejZWnek rÒejZYnXdd„Ze edƒ¡ejdkre edƒ¡eƒZe ¡dkZ e! "ej#d ¡Z$Gdd„de%ƒZ&dd„Z'dd „Z(e fd!d"„Z)d#d$„Z*iZ+d%d&„Z,dPd'd(„Z-dQd)d*„Z.dRd+d,„Z/d-d.„Z0d/d0„Z1dSd1d2„Z2dTd3d4„Z3dUd5d6„Z4dVd7d8„Z5dWd9d:„Z6dXdd?„Z8d@dA„Z9dZdBdC„Z:dDdE„Z;d[dFdG„ZdLdM„Z?dNdO„Z@dS)\aVPython modules manipulation utility functions. :type PY_SOURCE_EXTS: tuple(str) :var PY_SOURCE_EXTS: list of possible python source file extension :type STD_LIB_DIRS: set of str :var STD_LIB_DIRS: directories where standard modules are located :type BUILTIN_MODULES: dict :var BUILTIN_MODULES: dictionary with builtin module names has key éN)Úget_python_lib)ÚDistutilsPlatformErroré)Úspec)ÚutilÚwin)ÚpyZpyw)ZdllZpyd)r)ZsoT)Ú standard_libÚprefix)r ÚntZdllsZPyPyZlib_pypyÚposixcCs"dtjdd…}tj t||¡S)Nz python%d.%dé)ÚsysÚ version_infoÚosÚpathÚjoinr )rZ base_python©rú/lib/python3.7/site-packages/astroid/modutils.pyÚ _posix_pathhsrÚliblZlib64ZJythonc@seZdZdZdS)Ú NoSourceFilezaexception raised when we are not able to get a python source file for a precompiled file N)Ú__name__Ú __module__Ú __qualname__Ú__doc__rrrrr|srcCstj tj |¡¡S)N)rrÚnormcaseÚabspath)rrrrÚ_normalize_path‚srcCstj tj |¡¡S)N)rrÚrealpathÚ expanduser)rrrrÚ_canonicalize_path†sr!cCsL|s,tjdkr|S| d¡r(|dd…S|S| d¡\}}}|rH|dS|S)N)érz.pycéÿÿÿÿz $py.classz.py)rrÚendswithÚ partition)ÚfilenameZ is_jythonÚheadZ has_pyclassÚ_rrrÚ_path_from_filenameŠs   r)cCs8x2|D]*}||kr| |¡q||kr| |¡qWdS)z`remove files/directories in the black list dirnames/filenames are usually from os.walk N)Úremove)Ú blacklistÚdirnamesÚ filenamesZnorecursrrrÚ_handle_blacklist—s   r.cCs>yt|Stk r8|s$t|ƒSt|ƒ}t|<|SXdS)zabspath with cachingN)Ú_NORM_PATH_CACHEÚKeyErrorr)rÚresultrrrÚ_cache_normalize_path¦sr2cCst| d¡||ƒS)a"Load a Python module from its name. :type dotted_name: str :param dotted_name: python name of a module or package :type path: list or None :param path: optional list of path where the module or package should be searched (use sys.path if nothing or None is given) :type use_sys: bool :param use_sys: boolean indicating whether the sys.modules dictionary should be used or not :raise ImportError: if the module or package is not found :rtype: module :return: the loaded module Ú.)Úload_module_from_modpathÚsplit)Ú dotted_namerÚuse_sysrrrÚload_module_from_name´sr8c Cs4|r*ytjd |¡Stk r(YnXg}d}xü|D]ô}| |¡d |¡}d}t|ƒt|ƒkrrtj |¡}n|r‚tj |¡}|dkr¸t ||¡\}} } t  ||| | ¡}|r¸|  ¡|rÈt |||ƒt |ddƒ} |}| sèt  |¡rèq8| st|ƒt|ƒkrtdd |t|ƒd…¡ƒ‚tj | ¡g}q8W|S)a<Load a python module from its split name. :type parts: list(str) or tuple(str) :param parts: python name of a module or package split on '.' :type path: list or None :param path: optional list of path where the module or package should be searched (use sys.path if nothing or None is given) :type use_sys: bool :param use_sys: boolean indicating whether the sys.modules dictionary should be used or not :raise ImportError: if the module or package is not found :rtype: module :return: the loaded module r3NÚ__file__Úzno module in %s)rÚmodulesrr0ÚappendÚlenÚgetÚimpÚ find_moduleÚ load_moduleÚcloseÚsetattrÚgetattrrÚ is_namespaceÚ ImportErrorrrÚdirname) Úpartsrr7ÚmodpathZ prevmoduleÚpartZcurnameÚmoduleZmp_fileZ mp_filenameZmp_descZ_filerrrr4Ís<      r4cCst||ƒ}t|||ƒS)aLoad a Python module from it's path. :type filepath: str :param filepath: path to the python module or package :type path: list or None :param path: optional list of path where the module or package should be searched (use sys.path if nothing or None is given) :type use_sys: bool :param use_sys: boolean indicating whether the sys.modules dictionary should be used or not :raise ImportError: if the module or package is not found :rtype: module :return: the loaded module )Úmodpath_from_filer4)Úfilepathrr7Ú extrapathrIrrrÚload_module_from_files rOcCsNg}xD|D]<}| |¡tj ||¡}t|ƒs t d |¡¡}|s dSq WdS)z2check there are some __init__.py all along the wayr3FT)r<rrrÚ _has_initrrE)rZmod_pathrIrJZ old_namespacerrrÚcheck_modpath_has_inits  rQcCs’d}tj |¡}tj |¡}tj |¡ |¡r2|}tj |¡}tj |¡ |¡rT|}|rŽtj |¡d}|t|ƒd…}dd„| tj ¡DƒSdS)a=Extracts the relative mod path of the file to import from Check if a file is within the passed in path and if so, returns the relative mod path from the one passed in. If the filename is no in path_to_check, returns None Note this function will look for both abs and realpath of the file, this allows to find the relative base path even if the file is a symlink of a file in the passed in path Examples: _get_relative_base_path("/a/b/c/d.py", "/a/b") -> ["c","d"] _get_relative_base_path("/a/b/c/d.py", "/dev") -> None NrcSsg|] }|r|‘qSrr)Ú.0Úpkgrrrú Isz+_get_relative_base_path..) rrrrÚ startswithrÚsplitextr=r5Úsep)r&Z path_to_checkZimportable_pathZ abs_filenameZ real_filenameÚ base_pathZrelative_base_pathrrrÚ_get_relative_base_path,s   rYcCsêtj t|ƒ¡}|dk rzx`t tt|ƒ|¡D]J}tj |¡}|sBq,t ||ƒ}|sRq,|||dd…ƒr,||  d¡|Sq,WxRt ttt jƒt j¡D]8}t |ƒ}|s¤q’t ||ƒ}|s´q’|||dd…ƒr’|Sq’Wt d|d t j¡fƒ‚dS)Nr#r3z"Unable to find module for %s in %sz, )rrr r)Ú itertoolsÚchainÚmapr!rrYr5rr2rFr)r&rNZ is_package_cbZpath_rZ submodpathrIrrrÚmodpath_from_file_with_callbackNs,   r]cCs t||tƒS)aigiven a file path return the corresponding split module's name (i.e name of a module or package split on '.') :type filename: str :param filename: file's path for which we want the module's name :type extrapath: dict :param extrapath: optional extra search path, with path as key and package name for the path as value. This is usually useful to handle package split in multiple directories using __path__ trick. :raise ImportError: if the corresponding module's name has not been found :rtype: list(str) :return: the corresponding split module's name )r]rQ)r&rNrrrrLksrLcCst|||ƒjS)N)Úfile_info_from_modpathÚlocation)rIrÚ context_filerrrÚfile_from_modpath‚sracCsŽ|dk rtj |¡}n|}|ddkr`ytdg|dd…||ƒStk r\t|||ƒSXn"|ddgkr‚tjdtjjtj d St|||ƒS) aÿgiven a mod path (i.e. split module / package name), return the corresponding file, giving priority to source file over precompiled file if it exists :type modpath: list or tuple :param modpath: split module's name (i.e name of a module or package split on '.') (this means explicit relative imports that start with dots have empty strings in this list!) :type path: list or None :param path: optional list of path where the module or package should be searched (use sys.path if nothing or None is given) :type context_file: str or None :param context_file: context file to consider, necessary if the identifier has been introduced using a relative import unresolvable in the actual context (i.e. modutils) :raise ImportError: if there is no such module in the directory :rtype: (str or None, import type) :return: the path to the module's file or None if it's an integrated builtin module such as 'sys' NrZxmlZ_xmlplusrrrzos.path)Únamer_Ú module_type) rrrGÚ_spec_from_modpathrFrÚ ModuleSpecr9r?Ú PY_SOURCE)rIrr`Úcontextrrrr^†s  r^c Cs| d¡rdS| d¡}|dk rH|dtkrHt|ƒdkr@t|ƒ‚|dSd}d}|ddkrt|dk sltdƒ‚g}d}x$||dkr˜|d7}tj |¡}qvWxrt |t|ƒƒD]`}yt |||d…||d Wqªtk r|t dt|ƒdƒkrö‚d  |d|…¡SXqªW|S) agiven a dotted name return the module part of the name : >>> get_module_part('astroid.as_string.dump') 'astroid.as_string' :type dotted_name: str :param dotted_name: full name of the identifier we are interested in :type context_file: str or None :param context_file: context file to consider, necessary if the identifier has been introduced using a relative import unresolvable in the actual context (i.e. modutils) :raise ImportError: if there is no such module in the directory :rtype: str or None :return: the module part of the name or None if we have not been able at all to import the given name XXX: deprecated, since it doesn't handle package precedence over module (see #10066) zos.pathr3Nrr r:z.explicit relative import, but no context_file?r)rr`) rUr5ÚBUILTIN_MODULESr=rFÚAssertionErrorrrrGÚrangeraÚmaxr)r6r`rHrZstartiÚirrrÚget_module_part¶s6      rmFc Cs€g}xvt |¡D]h\}}}||kr$qt|||ƒ|sJd|krJd|dd…<qx,|D]$}t|ƒrPtj ||¡}| |¡qPWqW|S)aNgiven a package directory return a list of all available python module's files in the package and its subpackages :type src_directory: str :param src_directory: path of the directory corresponding to the package :type blacklist: list or tuple :param blacklist: iterable list of files or directories to ignore. :type list_all: bool :param list_all: get files from all paths, including ones without __init__.py :rtype: list :return: the list of all available python module's files in the package and its subpackages z __init__.pyrN)rÚwalkr.Ú_is_python_filerrr<) Z src_directoryr+Zlist_allÚfilesÚ directoryr,r-r&ÚsrcrrrÚget_module_filesós    rscCsntj t|ƒ¡}tj |¡\}}x(tD] }d||f}tj |¡r&|Sq&W|rb|sbtj |¡rb|St|ƒ‚dS)ašgiven a python module's file name return the matching source file name (the filename will be returned identically if it's already an absolute path to a python source file...) :type filename: str :param filename: python module's file name :raise NoSourceFile: if no source file exists on the file system :rtype: str :return: the absolute path of the source file if it exists z%s.%sN)rrrr)rVÚPY_SOURCE_EXTSÚexistsr)r&Zinclude_no_extÚbaseZorig_extÚextÚ source_pathrrrÚget_source_files   rycCstj |¡ddd…tkS)zN rtype: bool return: True if the filename is a python source file rN)rrrVrt)r&rrrÚis_python_source1srzcCs| d¡d}yt|gƒ}Wntk r0dSX|dkrFt |¡ St|ƒ}| ttƒ¡r`dS|dkrlt }x|D]}| t|ƒ¡rrdSqrWdS)aÐtry to guess if a module is a standard python module (by default, see `std_path` parameter's description) :type modname: str :param modname: name of the module we are interested in :type std_path: list(str) or tuple(str) :param std_path: list of path considered has standard :rtype: bool :return: true if the module: - is located on the path listed in one of the directory in `std_path` - is a built-in module r3rFNT) r5rarFrrErrUr2Ú EXT_LIB_DIRÚ STD_LIB_DIRS)ÚmodnameZstd_pathr&rrrrÚis_standard_module9s   r~cCsntj |¡stj |¡}|tjkr&dSy.t | d¡d|g¡\}}}|rR| ¡dSt k rhdSXdS)avreturn true if the given module name is relative to the given file name :type modname: str :param modname: name of the module we are interested in :type from_file: str :param from_file: path of the module from which modname has been imported :rtype: bool :return: true if the module has been imported relatively to `from_file` Fr3rTN) rrÚisdirrGrr?r@r5rBrF)r}Z from_fileÚstreamr(rrrÚ is_relativeas   rcCsô|st‚d}|dk rVyt ||g¡}|j}Wqbtk rRt ||¡}|j}YqbXn t ||¡}|jtjjkr¬yt|jƒ}|j |tjj dSt k r¨|j |dSXnD|jtjj krÆ|j ddS|jtjj krðt|jƒ}|j |tjj dS|S)zÃgiven a mod path (i.e. split module / package name), return the corresponding spec this function is used internally, see `file_from_modpath`'s documentation for more information N)r_Útype)r_)rirÚ find_specr_rFr‚Ú ModuleTypeÚ PY_COMPILEDryÚ_replacerfrZ C_BUILTINÚ PKG_DIRECTORYrP)rIrrgr_Z found_specrrrrd‚s.      rdcCs xdD]}| |¡rdSqWdS)zkreturn true if the given filename should be considered as a python file .pyc and .pyo are ignored )z.pyz.soz.pydz.pywTF)r$)r&rwrrrro¥s  rocCsDtj |d¡}x0tdD]$}tj |d|¡r|d|SqWdS)z\if the given directory has a valid __init__ file, return its path, else return None Ú__init__)ZpycZpyor3N)rrrrtru)rqZ mod_or_packrwrrrrP°s rPcCs|jtjjkS)N)r‚rr„Z PY_NAMESPACE)ÚspecobjrrrrE»srEcCs|jtjjkS)N)r‚rr„r‡)r‰rrrÚ is_directory¿srŠ)NT)Nr)NTN)NN)N)NN)NN)N)F)F)N)NN)Arr?rÚplatformrrZZdistutils.sysconfigrZdistutils.errorsrZinterpreter._importrrrUrtZPY_COMPILED_EXTSr Ú exec_prefixr|ÚsetrbÚaddrrZ real_prefixÚAttributeErrorÚbase_exec_prefixZpython_implementationZ_rootrÚmaxsizer{Z IS_JYTHONÚdictÚfromkeysÚbuiltin_module_namesrhÚ Exceptionrrr!r)r.r/r2r8r4rOrQrYr]rLrar^rmrsryrzr~rrdrorPrErŠrrrrÚs˜                    8  "    0 = %  (! #