Your IP : 216.73.216.196
B
A!p\�� � @ sf d Z ddlZddlmZ ddlZddlZddlZddlZddlmZm Z ddl
m Z m Z ddl
Z
ddlmZ ddlmZ ddlmZ dd lmZ dd
lmZmZmZ dd lmZm Z dd l m Z m Z d
d� Z dd� Z!dd� Z"dd� Z#dd� Z$d:dd�Z%dd� Z&dd � Z'd d d d d!gifd"d#d$d%d&d'd(d)d*ifd+d,d-d.d/d0d1d2d3�Z(d4Z)d5Z*G d6d7� d7e�Z+d8d9� Z,dS );z imports checkers for Python code� N)� sysconfig)�
are_exclusive�
decorators)�get_module_part�is_standard_module)�IAstroidChecker)�get_global_option)�EmptyReportError)� BaseChecker)�check_messages�node_ignores_exception�is_from_fallback_block)�
get_cycles�
DotBackend)� VerbatimText� Paragraphc s$ | � d�� � fdd�tt� ��D �S )z�Split the names of the given module into subparts
For example,
_qualified_names('pylint.checkers.ImportsChecker')
returns
['pylint', 'pylint.checkers', 'pylint.checkers.ImportsChecker']
�.c s" g | ]}d � � d|d � ��qS )r r � )�join)�.0�i)�names� �H/opt/alt/python37/lib/python3.7/site-packages/pylint/checkers/imports.py�
<listcomp>A s z$_qualified_names.<locals>.<listcomp>)�split�range�len)�modnamer )r r �_qualified_names8 s
r c C s: t | tj�r6| jr6| �� }t |tj�r6|j|| jd�}|S )a Get a prepared module name from the given import node
In the case of relative imports, this will return the
absolute qualified module name, which might be useful
for debugging. Otherwise, the initial module name
is returned unchanged.
)�level)�
isinstance�astroid�
ImportFromr �root�ModuleZrelative_to_absolute_name)�
importnoder r$ r r r �_get_import_nameD s r' c
s� |rd||f n|� d}d}x�|j D ]�}|| kr2q$|�� | �� krP|j| jkrPq$t|tj�r|t� fdd�|jD ��r�d}P q$t|tj�r$||j kr$xH|jD ]>\}} � d|j
|f kr�d}P |dkr�||kr�|s�| s�d}P q�W |r$P q$W |r�t || �s�|S dS )zIreturn the node where [base.]<name> is imported or None if not found
z%s.%sNFc 3 s | ]}� |d kV qdS )r Nr )r Ziname)�fullnamer r � <genexpr>c s z$_get_first_import.<locals>.<genexpr>T�*) �body�scope�
fromlinenor! r" �Import�anyr r# r r r )
�node�context�name�baser �alias�first�found�
imported_nameZimported_aliasr )r( r �_get_first_importV s8
r8 c C s( x t |�D ]}||kr
dS q
W t| t�S )NT)r r � ImportError)r0 r Zignored_modulesZ submoduler r r �_ignore_import_failurez s r: c C sZ i }xP| D ]H\}}|df}x&|� d�D ]}|d �|i g g�}q&W |d |7 < q
W |S )z�get a list of 2-uple (module, list_of_files_which_import_this_module),
it will return a dictionary to represent this as a tree
r r r r )r �
setdefault)Zmod_files_listZ tree_defs�mod�filesr0 �prefixr r r �_make_tree_defs� s r? c C s� g }| � � }x�tt|dd� d��D ]�\}\}\}}|s<d}ndd�t|�� }|dkrn|�d||f � d }n6|�d
|||f � |t|�d kr�d | }nd
| }|r"|�t||�� q"W d�|�S )z2return a string which represents imports as a treec S s | d S )Nr r )�xr r r �<lambda>� � z!_repr_tree_defs.<locals>.<lambda>)�key� z(%s)�,Nz%s %sz z %s\-%s %sr z%s z%s| �
)�items� enumerate�sortedr �appendr �_repr_tree_defs) �dataZ
indent_str�linesZnodesr r< �subr= Zsub_indent_strr r r rK � s &
rK c C s� i }t | dd� dd�}|�d� xRt|�� �D ]B\}}d||< |�|� x&|D ] }||krPd||< |�|� qPW q0W x2t|�� �D ]"\}}x|D ]}|�||� q�W q�W |�| � dS )z0write dependencies as a dot (graphviz) file
N���ZLR)ZrankdirzURL="." node[shape="box"]r )r �emitrI rG Z emit_nodeZ emit_edgeZgenerate)�filename�dep_info�done�printerr � dependenciesZ
depmodnamer r r �_dependencies_graph� s
rV c C s$ t | |� |�td|| f �� dS )z`generate a dependencies graph and add some information about it in the
report's section
z&%simports graph has been written to %sN)rV rJ r )rQ rR �sectZgtyper r r � _make_graph� s
rX zUnable to import %sz import-errorz4Used when pylint has been unable to import a module.Z old_names)ZF0401z import-error)z2Attempted relative import beyond top-level packagezrelative-beyond-top-levelzSUsed when a relative import tries to access too many levels in the current package.)zCyclic import (%s)z
cyclic-importzBUsed when a cyclic import between two or more modules is detected.)zWildcard import %szwildcard-importz-Used when `from module import *` is detected.)z Uses of a deprecated module %rzdeprecated-modulez/Used a module marked as deprecated is imported.z Relative import %r, should be %rzrelative-importzBUsed when an import relative to the package directory is detected.Z
maxversion)� r )z Reimport %r (imported line %s)�
reimportedz0Used when a module is reimported multiple times.)zModule import itselfz import-selfz'Used when a module is importing itself.)z:__future__ import is not the first non docstring statementzmisplaced-futurezgPython 2.5 and greater require __future__ import to be the first non docstring statement in the module.)z!Multiple imports on one line (%s)zmultiple-importszBUsed when import statement importing multiple modules is detected.)z %s should be placed before %szwrong-import-orderzuUsed when PEP8 import order is not respected (standard imports first, then third-party libraries, then local imports))z'Imports from package %s are not groupedzungrouped-importsz-Used when imports are not grouped by packages)z5Import "%s" should be placed at the top of the modulezwrong-import-positionz$Used when code and imports are mixed)z-Import alias does not rename original packagezuseless-import-aliaszsUsed when an import alias is same as original package.e.g using import numpy as numpy instead of import numpy as np)ZE0401ZE0402ZR0401ZW0401ZW0402ZW0403ZW0404ZW0406ZW0410ZC0410ZC0411ZC0412ZC0413ZC0414r )Zenchantc
@ s� e Zd ZdZeZdZeZdZ e
j dk r,dZ ndZ de dd d
d �fd d
dddd �fdd
dddd �fdd
dddd �fde
dd dd �fdedd dd �fdddd d d �fd ddd d d �ffZd[d!d"�Zed#d$� �Zd%d&� Zd'd(� Zd)d*� Zee� d+d,� �Zee� d-d.� �Zee� d/d0� �Zd1d2� Ze Z Z Z Z Z Z Z!Z"d3d4� Z#e# Z$ Z%Z&d5d6� Z'd7d8� Z(d9d:� Z)d;d<� Z*ed=d>� �Z+d?d@� Z,dAdB� Z-dCdD� Z.dEdF� Z/dGdH� Z0dIdJ� Z1d\dKdL�Z2dMdN� Z3dOdP� Z4dQdR� Z5e6j7dSdT� �Z8e6j7dUdV� �Z9dWdX� Z:dYdZ� Z;d S )]�ImportsCheckerz�checks for
* external modules dependencies
* relative / wildcard imports
* cyclic imports
* uses of deprecated modules
�imports���)rY � )�optparse)r_ z tkinter.tixzdeprecated-modulesZcsvz <modules>zBDeprecated modules which should not be used, separated by a comma.)�default�type�metavar�helpz import-graphrD �stringz
<file.dot>zyCreate a graph of every (i.e. internal and external) dependencies in the given file (report RP0402 must not be disabled).zext-import-graphz_Create a graph of external dependencies in the given file (report RP0402 must not be disabled).zint-import-graphz_Create a graph of internal dependencies in the given file (report RP0402 must not be disabled).zknown-standard-libraryzYForce import order to recognize a module as part of the standard compatibility libraries.zknown-third-partyzJForce import order to recognize a module as part of a third party library.zanalyse-fallback-blocksFZynz<y_or_n>z�Analyse import fallback blocks. This can be used to support both Python 2 and 3 compatible code, which means that the block might have code that exists only in one or another interpreter, leading to false positives when analysed.zallow-wildcard-with-allz8Allow wildcard imports from modules that define __all__.Nc C sR t �| |� d | _d | _g | _d | _i | _dd| jfdd| jff| _ | �
� | _ d S )NZRP0401zExternal dependenciesZRP0402zModules dependencies graph) r
�__init__�stats� import_graph�_imports_stack�_first_non_import_node� _module_pkg� _report_external_dependencies�_report_dependencies_graphZreports�_compute_site_packagesZ_site_packages)�self�linterr r r re � s
zImportsChecker.__init__c C s� dd� } t � }ttdd �}x6td |tjf�D ]"}tj|d�}| |�}|�|� q,W tj �
d�r�x>td |tjf�D ]*}tj � |dddt� � d �}|�|� qpW |S )
Nc S s t j�t j�| ��S )N)�os�path�normcase�abspath)rq r r r �_normalized_path� s z?ImportsChecker._compute_site_packages.<locals>._normalized_path� real_prefix)r> z/etc/debian_version�local�lib�pythonz
dist-packages)
�set�getattr�sys�filterr> r �get_python_lib�addrp rq �isfiler �get_python_version)rt �pathsru r> rq � libpythonr r r rm � s"
z%ImportsChecker._compute_site_packagesc C sX | j ji d� | j jg d� | j j| _t�t�| _i | _t�t�| _t | dg d�| _
dS )z3called before visiting project (i.e set of modules))rU )Zcycleszignored-modules)r` N) ro Z add_statsrf � collections� defaultdictry rg rj �_excluded_edgesr �_ignored_modules)rn r r r �open� s
zImportsChecker.openc C s2 t �| j�}x |D ]}|| �| j| � qW |S )N)�copy�deepcopyrg �difference_updater� )rn Zfiltered_graphr0 r r r �#_import_graph_without_ignored_edges� s
z2ImportsChecker._import_graph_without_ignored_edgesc C sJ | j �d�rF| �� }t|�}x(t||d�D ]}| jdd�|�d� q*W dS )z3called before visiting project (i.e set of modules)z
cyclic-import)�verticesz -> )�argsN)ro �is_message_enabledr� �listr � add_messager )rn �graphr� �cycler r r �close� s
zImportsChecker.closec C s� | � |� | �|� |�� }dd� |jD �}t|�dkrN| jdd�|�|d� x�|D ]x}| �||� | �||�}t |j
t j �r�| �
|� t |�� t j �r�| �||� |dkr�qT| �||||� | �||j� qTW dS )z*triggered when an import statement is seenc S s g | ] \}}|�qS r r )r r2 �_r r r r � s z/ImportsChecker.visit_import.<locals>.<listcomp>� zmultiple-importsz, )r� r0 N)�_check_reimport�_check_import_as_renamer$ r r r� r �_check_deprecated_module�_get_imported_moduler! �parentr" r% �_check_positionr, �_record_import�_check_relative_import�_add_imported_moduler2 )rn r0 �modnoder r2 �imported_moduler r r � visit_import� s"
zImportsChecker.visit_importc C s� |j }| �||�}| �|� | �|� | �||� | �||� | �|� | j|||jd� t |j
t j �rr| �
|� t |�� t j �r�| �||� |dkr�dS |�� }| �||||� x@|jD ]6\}}|dkr�| �|d|j|f � q�| �||j� q�W dS )z'triggered when a from statement is seen)�basenamer Nr* z%s.%s)r r� r� �_check_misplaced_futurer� �_check_wildcard_imports�_check_same_line_importsr� r r! r� r" r% r� r, r� r$ r� r r� r2 )rn r0 r� r� r� r2 r� r r r �visit_importfrom� s(
z ImportsChecker.visit_importfromc C s� | � |�\}}}t� }d }xl|| | D ]\\}}| j�d|j�sBq(|�d�\} }
}
|rv|| krv| |krv| jd|| d� | }|�| � q(W g | _d | _ d S )Nzungrouped-importsr )r0 r� )
�_check_imports_orderry ro r� r- � partitionr� r~ rh ri ) rn r0 � std_importsZ ext_importsZ loc_importsZmetZcurrent_package� import_nodeZ import_name�packager� r r r � leave_module� s
zImportsChecker.leave_modulec s� | j �d� j�sd S | jr d S t� jtj�s0d S tjtj g}� fdd�|D �}|rlt
� � tj tj
f��rld S t� tj�r�dd� � jD �}t|�r�d S � | _d S )Nzwrong-import-positionc s g | ]}t � |�r|�qS r )r! )r Zallowed)r0 r r r s z@ImportsChecker.compute_first_non_import_node.<locals>.<listcomp>c S s0 g | ](}t |tj�o*|j�d �o*|j�d ��qS )�__)r! r" Z
AssignNamer2 �
startswith�endswith)r �targetr r r r % s )ro r� r- ri r! r� r" r% � TryExcept�
TryFinallyr/ �nodes_of_classr. r# ZAssign�targets�all)rn r0 Znested_allowedZis_nested_allowedZ
valid_targetsr )r0 r � compute_first_non_import_node s"
z,ImportsChecker.compute_first_non_import_nodec C s� | j �d|j�sd S | jr d S t|j�� tj�s4d S |}xt|jtj�sP|j}q:W t|tj tj
tj f�r�t |�
tjtjf��r�d S || _d S )Nzwrong-import-position)ro r� r- ri r! r� r, r" r% ZIfr� r� r/ r� r. r# )rn r0 r$ r r r �visit_functiondef8 s
z ImportsChecker.visit_functiondefc C sF |j }|dkrB|�� }|r>t|tj�r0|j dks>| jd|d� d S d S )N�
__future__zmisplaced-future)r0 )r Zprevious_siblingr! r" r# r� )rn r0 r� �prevr r r r� P s
z&ImportsChecker._check_misplaced_futurec C sR dd� |j D �}t�|�}x2|�� D ]&\}}|dkr$| jd|||jfd� q$W d S )Nc s s | ]\}}|V qd S )Nr )r r2 r� r r r r) ` s z:ImportsChecker._check_same_line_imports.<locals>.<genexpr>r rZ )r0 r� )r r� �CounterrG r� r- )rn r0 r �counterr2 �countr r r r� ^ s
z'ImportsChecker._check_same_line_importsc C s | j r| jd||�� d� dS )z�Check `node` import or importfrom node position is correct
Send a message if `node` comes before another instruction
zwrong-import-position)r0 r� N)ri r� � as_string)rn r0 r r r r� f s z ImportsChecker._check_positionc C st t |tj�r|j}n|r |jnd}|s>|jd d �d�d }t |tj�r`|jpRddkr`d| }| j� ||f� dS )z&Record the package `node` imports fromNr r r )
r! r" r# r r2 r r r rh rJ )rn r0 �importedmodnodeZ importednamer r r r� p s z ImportsChecker._record_importc s$ dd� |D �}t � fdd�|D ��S )Nc S s g | ] \}}|�qS r r )r r� r� r r r r � s z6ImportsChecker._is_fallback_import.<locals>.<listcomp>c 3 s | ]}t �|� �V qd S )N)r" r )r r� )r0 r r r) � s z5ImportsChecker._is_fallback_import.<locals>.<genexpr>)r/ )r0 r\ r )r0 r �_is_fallback_import� s z"ImportsChecker._is_fallback_importc C s8 g }g }g }g }g }g }g }g } t jd| jj| jjd�}
�x�| jD �]�\} } | �d�rjd| �d�d }
n| �d�d }
t| j t
j � }| j �
d| j� }|
�|
�}| |
f}|dk�r|�|� |p�|p�| }| �| |�r�qB|�r*|�s*| jd| d| �� d |d d �� fd
� qB|d k�r�|�|� |�|� |�sH|�sH|�|� |�pP| }|�r*|�s*| jd| d | �� d |d d �� fd
� qB|d
k�r�|�|� |�|� |�s�|�s�|�|� | }|�r*|�s*| jd| d| �� d |d d �� fd
� qB|dkrB|�| |
f� |sB|sB| �| |
f� qBW |||fS )z�Checks imports of module `node` are grouped by category
Imports must follow this order: standard, 3rd party, local
rD )�
file_contents�known_third_party�known_standard_libraryr r r zwrong-import-order)ZFUTUREZSTDLIBzstandard import "%s"z"%s")r0 r� Z
THIRDPARTYzthird party import "%s"Z
FIRSTPARTYzfirst party import "%s"Z LOCALFOLDER)�isortZ SortImports�configr� r� rh r� r r! r� r" r% ro r� r- Z place_modulerJ r� r� r� )rn Z _module_noder� Zthird_party_importsZfirst_party_importsZexternal_importsZ
local_importsZthird_party_not_ignoredZfirst_party_not_ignoredZlocal_not_ignoredZ isort_objr0 r r� �nestedZignore_for_import_orderZimport_categoryZnode_and_package_importZ wrong_importr r r r� � s~
z#ImportsChecker._check_imports_orderc
C s� y
|� |�S tjk
r@ t||| j�r.d S | jd|d� Y n� tjk
r� } z(d�|t|j ��}| jd|j
|d� W d d }~X Y nj tj k
r� | j �
d�s�d S t||| j�r�d S | jjs�t|�r�d S t||�}| jdt|�|d� Y nX d S )Nzrelative-beyond-top-level)r0 z+Cannot import {!r} due to syntax error {!r}z syntax-error)�liner� z import-error)r� r0 )Zdo_import_moduler" ZTooManyLevelsErrorr: r� r� ZAstroidSyntaxError�format�str�error�linenoZAstroidBuildingExceptionro r� r� Zanalyse_fallback_blocksr
r' �repr)rn r& r �exc�messageZdotted_modnamer r r r� � s(
"
z#ImportsChecker._get_imported_modulec C sj | j �d�sdS |jdkr dS ||kr*dS |�� s>t|dd�rBdS |j|krf| jd||jf|d� dS dS )zpcheck relative import. node is either an Import or From node, modname
the imported module name.
zrelative-importNFr )r� r0 )ro r� �fileZabsolute_import_activatedrz r2 r� )rn r� r& r� Zimportedasnamer r r r� � s
z%ImportsChecker._check_relative_importc C s� |� � j}|� � j}tj�tj�|��d }yt||�}W n tk
rN Y nX ||krh| j d|d� n�t
|�s�|dkr�|| j kr�|� dd�d | j |< | j
d �|t� �}||kr�|�|� | j| �|� | jjd|jd �s�| j| �|� d
S ) z7notify an imported module, used to analyze dependenciesr z import-self)r0 re r r rU z
cyclic-import)r� N)r$ r� r2 rp rq �splitextr� r r9 r� r rj �rsplitrf r; ry r~ rg ro r� r� r� )rn r0 Zimportedmodname� module_fileZ context_namer3 Zimportedmodnamesr r r r� s&
z#ImportsChecker._add_imported_modulec C s< x6| j jD ]*}||ks$|�|d �r
| jd||d� q
W dS )z!check if the module is deprecatedr zdeprecated-module)r0 r� N)r� �deprecated_modulesr� r� )rn r0 Zmod_path�mod_namer r r r� 2 s z'ImportsChecker._check_deprecated_modulec C sh |j }x\|D ]T}t|�s d S |d }|�d�}|d }|d }||kr t|�dkr | jd|d� q W d S )Nr r ���r zuseless-import-alias)r0 )r r� r� r r� )rn r0 r r2 Z real_nameZsplitted_packagesr7 r r r r� 8 s
z&ImportsChecker._check_import_as_renamec C s� | j �d�sdS |�� }|�� }||fg}||k r@|�|df� xT|D ]L\}}xB|jD ]8\} }
t||| |||
�} | dk rV| jd|| | jfd� qVW qFW dS )z8check if the import is necessary (i.e. not already done)rZ N)r0 r� ) ro r� �framer$ rJ r r8 r� r- ) rn r0 r� r r� r$ ZcontextsZ
known_contextZ known_levelr2 r4 r5 r r r r� I s
z ImportsChecker._check_reimportc C s4 t | �� �� �}|st� �t|�}|�t|�� dS )z4return a verbatim layout for displaying dependenciesN)r? �_external_dependencies_inforG r rK rJ r )rn rW r� �_dummyrR Ztree_strr r r rk ^ s
z,ImportsChecker._report_external_dependenciesc C s� | j d }|r&| jjs,| jjs,| jjs,t� �| jj}|rFt|||d� | jj}|rdt|| �� |d� | jj}|r�t|| �� |d� dS )z+write dependencies as a dot (graphviz) filerU rD z external z internal N) rf r� rg Zext_import_graphZint_import_graphr rX r� �_internal_dependencies_info)rn rW r� r� rR rQ r r r rl f s
z)ImportsChecker._report_dependencies_graphc C sn t �t�}x^| jd �� D ]L\}}xB|D ]:}| j�||�}|�|�}|rL|sT|s(|s(|| �|� q(W qW |S )z2build the internal or the external depedency graphrU ) r� r� ry rf rG rj �getr� r~ )rn �internalr� Zimportee� importers�importerr� Z is_insider r r �_filter_dependencies_graphy s
z)ImportsChecker._filter_dependencies_graphc C s | j dd�S )zXreturn cached external dependencies information or build and
cache them
F)r� )r� )rn r r r r� � s z*ImportsChecker._external_dependencies_infoc C s | j dd�S )zXreturn cached internal dependencies information or build and
cache them
T)r� )r� )rn r r r r� � s z*ImportsChecker._internal_dependencies_infoc C sN |� � jrd S | �|�}x0|jD ]&\}}|dkr |s | jd|j|d� q W d S )Nr* zwildcard-import)r� r0 )r$ r� �_wildcard_import_is_allowedr r� r )rn r0 r� Zwildcard_import_is_allowedr2 r� r r r r� � s
z&ImportsChecker._check_wildcard_importsc C s | j jo|d k od|jkS )N�__all__)r� Zallow_wildcard_with_all�locals)rn r� r r r r� � s z*ImportsChecker._wildcard_import_is_allowed)N)NN)<�__name__�
__module__� __qualname__�__doc__r Z__implements__r2 �MSGSZmsgs�priorityr{ � version_infor� �DEFAULT_STANDARD_LIBRARY�DEFAULT_KNOWN_THIRD_PARTY�optionsre � staticmethodrm r� r� r� r r� r� r� r� Zvisit_tryfinallyZvisit_tryexceptZvisit_assignattrZ visit_assignZ visit_ifexpZvisit_comprehensionZ
visit_exprZvisit_ifr� Zvisit_classdefZ visit_forZ visit_whiler� r� r� r� r� r� r� r� r� r� r� r� rk rl r� r �cachedr� r� r� r� r r r r r[ s�
(
T!
r[ c C s | � t| �� dS )z.required method to auto register this checker N)Zregister_checkerr[ )ro r r r �register� s r� )N)-r� r� � distutilsr rp r{ r� r" r r Zastroid.modutilsr r r� Zpylint.interfacesr Z pylint.utilsr Zpylint.exceptionsr Zpylint.checkersr
Zpylint.checkers.utilsr r r
Z pylint.graphr r Z pylint.reporters.ureports.nodesr r r r' r8 r: r? rK rV rX r� r� r� r[ r� r r r r �<module> sj $