Your IP : 216.73.216.213
B
2tX^� � @ s� d Z ddlZddlZddlZddlZejdk Zejdk Zejdk Zejdk Z yej
dZ W n e k
rr dZ Y nX e
eer�d nd
��Zy ddlZW n@ ek
r� ddlZd ejjkr�d ej_ed
d� �ej_Y nX ddlmZ er�dd� Zndd� Ze�rdd� Zndd� Ze �r$ej ej fZ nej ej ej fZ G dd� de �Z!dd� Z"de!� fdd�Z#d d � Z$G d d � d e%�Z&G d d!� d!e&�Z'G d"d#� d#e%�Z(G d$d%� d%e%�Z)G d&d'� d'e'�Z*G d(d)� d)e*�Z+G d*d+� d+e*�Z,G d,d-� d-e*�Z-G d.d/� d/e,�Z.G d0d1� d1e&�Z/G d2d3� d3e&�Z0G d4d5� d5e'�Z1G d6d7� d7e'�Z2G d8d9� d9e&�Z3G d:d;� d;e �Z4G d<d=� d=e4�Z5G d>d?� d?e4�Z6G d@dA� dAe4�Z7G dBdC� dCe4�Z8G dDdE� dEe8�Z9dFdGdHgZ:dIdJ� Z;G dKdL� dLe%�Z<dS )Mz]
Main module.
Implement the central Checker class.
Also, it models the Bindings and Scopes.
� N)� r )r r )r � )r � TFZ __builtin__�builtins�decorator_list� c C s | j S )N)Z
decorators)�sr r �A/opt/alt/python37/lib/python3.7/site-packages/pyflakes/checker.py�<lambda> � r
)�messagesc C s t t| j��� �S )N)�strZunicode�__name__�upper)�
node_classr r r � getNodeType& s r c C s
| j �� S )N)r r )r r r r r * s c C sH t | tjtjf�r| jgS t | tj�rD| j| j gdd� | jD � S d S )Nc S s g | ]
}|g�qS r r )�.0�hdlr r r �
<listcomp>3 s z#getAlternatives.<locals>.<listcomp>)�
isinstance�ast�IfZ
TryFinally�bodyZ TryExcept�orelse�handlers)�nr r r �getAlternatives/ s r c C sB t | tj�r| jgS t | tj�r>| j| j gdd� | jD � S d S )Nc S s g | ]
}|g�qS r r )r r r r r r 9 s z#getAlternatives.<locals>.<listcomp>)r r r r ZTryr r )r r r r r 5 s c @ s e Zd ZdZdd� Zdd� ZdS )� _FieldsOrderz Fix order of AST node fields.c C s> |j }d|krdj}nd|kr&dj}ndj}tt||dd��S )N�iterZ
generators�valueT)�key�reverse)�_fields�find�tuple�sorted)�selfr �fieldsZ key_firstr r r � _get_fieldsD s z_FieldsOrder._get_fieldsc C s | � |� | |< }|S )N)r( )r& r r' r r r � __missing__O s z_FieldsOrder.__missing__N)r �
__module__� __qualname__�__doc__r( r) r r r r r A s r c C s* i }x | D ]}|� |d�d ||< q
W |S )z|
Simplest required implementation of collections.Counter. Required as 2.6
does not have Counter in collections.
r � )�get)�itemsZresults�itemr r r �counterT s
r1 c c s` xZ|| j D ]L}||krq t| |d�}t|tj�r:|V q t|t�r x|D ]
}|V qJW q W dS )z�
Yield all direct child nodes of *node*, that is, all fields that
are nodes and all items of fields that are lists of nodes.
N)� __class__�getattrr r ZAST�list)�node�omitZ
_fields_order�nameZfieldr0 r r r �iter_child_nodes_ s
r8 c C s� t | tj�r| jS ttd�r.t | tj�r.| jS t | tj�rNtdd� | jD ��S t | tj �r`| j
S t | tj �r�t | d�}ddd d�}|�
|j|�S ts�t | tj�r�| jS t� S d S )N�Bytesc s s | ]}t |�V qd S )N)�convert_to_value)r �ir r r � <genexpr>u s z#convert_to_value.<locals>.<genexpr>)r0 TF)�True�False�None)r r �Strr �hasattrr9 �Tupler$ �eltsZNumr �Name� VariableKeyr. r7 �PY33Z NameConstantr �UnhandledKeyType)r0 �resultZconstants_lookupr r r r: o s&
r: c @ s0 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
S ) �Bindingar
Represents the binding of a value to a name.
The checker uses this to keep track of which names have been bound and
which names have not. See L{Assignment} for a special type of binding that
is checked with stricter rules.
@ivar used: pair of (L{Scope}, node) indicating the scope and
the node that this binding was last used.
c C s || _ || _d| _d S )NF)r7 �source�used)r& r7 rJ r r r �__init__� s zBinding.__init__c C s | j S )N)r7 )r& r r r �__str__� s zBinding.__str__c C s d| j j| j| jjt| �f S )Nz#<%s object %r from line %r at 0x%x>)r2 r r7 rJ �lineno�id)r& r r r �__repr__� s zBinding.__repr__c C s t |t�o| j|jkS )N)r �
Definitionr7 )r& �otherr r r � redefines� s zBinding.redefinesN)r r* r+ r, rL rM rP rS r r r r rI � s
rI c @ s e Zd ZdZdS )rQ z7
A binding that defines a function or a class.
N)r r* r+ r, r r r r rQ � s rQ c @ s e Zd ZdZdS )rG zS
A dictionary key of a type that we cannot or do not check for duplicates.
N)r r* r+ r, r r r r rG � s rG c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) rE zY
A dictionary key which is a variable.
@ivar item: The variable AST object.
c C s |j | _d S )N)rO r7 )r& r0 r r r rL � s zVariableKey.__init__c C s |j | j ko|j| jkS )N)r2 r7 )r& Zcomparer r r �__eq__� s zVariableKey.__eq__c C s
t | j�S )N)�hashr7 )r& r r r �__hash__� s zVariableKey.__hash__N)r r* r+ r, rL rT rV r r r r rE � s rE c sF e Zd ZdZd
� fdd� Zdd� Zdd� Zed d
� �Zd d � Z � Z
S )� Importationz�
A binding created by an import statement.
@ivar fullName: The complete name given to the import statement,
possibly including multiple dotted components.
@type fullName: C{str}
Nc s& |p|| _ g | _tt| ��||� d S )N)�fullName� redefined�superrW rL )r& r7 rJ � full_name)r2 r r rL � s
zImportation.__init__c C s, t |t�r| j|jkS t |t�o*| j|jkS )N)r �SubmoduleImportationrX rQ r7 )r& rR r r r rS � s
zImportation.redefinesc C s | j �d�d | jk S )z.Return whether importation needs an as clause.�.���)rX �splitr7 )r& r r r �
_has_alias� s zImportation._has_aliasc C s& | � � rd| j| jf S d| j S dS )z5Generate a source statement equivalent to the import.zimport %s as %sz import %sN)r` rX r7 )r& r r r �source_statement� s z Importation.source_statementc C s" | � � r| jd | j S | jS dS )z#Return import full name with alias.z as N)r` rX r7 )r& r r r rM � s zImportation.__str__)N) r r* r+ r, rL rS r` �propertyra rM �
__classcell__r r )r2 r rW � s rW c s@ e Zd ZdZ� fdd�Z� fdd�Zdd� Zedd � �Z� Z S )
r\ a�
A binding created by a submodule import statement.
A submodule import is a special case where the root module is implicitly
imported, without an 'as' clause, and the submodule is also imported.
Python does not restrict which attributes of the root module may be used.
This class is only used when the submodule import is without an 'as' clause.
pyflakes handles this case by registering the root module name in the scope,
allowing any attribute of the root module to be accessed.
RedefinedWhileUnused is suppressed in `redefines` unless the submodule
name is also the same, to avoid false positives.
c sF d|kr|r t |tj�s t�|�d�d }tt| ��||� || _d S )Nr] r ) r r ZImport�AssertionErrorr_ rZ r\ rL rX )r& r7 rJ Z package_name)r2 r r rL s z SubmoduleImportation.__init__c s& t |t�r| j|jkS tt| ��|�S )N)r rW rX rZ r\ rS )r& rR )r2 r r rS s
z SubmoduleImportation.redefinesc C s | j S )N)rX )r& r r r rM s z SubmoduleImportation.__str__c C s
d| j S )Nzimport )rX )r& r r r ra s z%SubmoduleImportation.source_statement)
r r* r+ r, rL rS rM rb ra rc r r )r2 r r\ � s
r\ c s2 e Zd Zd� fdd� Zdd� Zedd� �Z� ZS ) �ImportationFromNc sL || _ |p || _|�d�r&|| j }n|d | j }tt| ��|||� d S )Nr] )�module� real_name�endswithrZ re rL )r& r7 rJ rf rg r[ )r2 r r rL s
zImportationFrom.__init__c C s& | j | jkr | jd | j S | jS dS )z#Return import full name with alias.z as N)rg r7 rX )r& r r r rM ! s zImportationFrom.__str__c C s4 | j | jkr d| j| j | jf S d| j| jf S d S )Nzfrom %s import %s as %szfrom %s import %s)rg r7 rf )r& r r r ra ( s
z ImportationFrom.source_statement)N)r r* r+ rL rM rb ra rc r r )r2 r re s re c s4 e Zd ZdZ� fdd�Zedd� �Zdd� Z� ZS )�StarImportationz3A binding created by a 'from x import *' statement.c s& t t| ��d|� |d | _|| _d S )N�*z.*)rZ ri rL r7 rX )r& r7 rJ )r2 r r rL 5 s
zStarImportation.__init__c C s d| j d S )Nzfrom z import *)rX )r& r r r ra < s z StarImportation.source_statementc C s | j �d�r| jS | jS d S )Nr] )rX rh ra r7 )r& r r r rM @ s zStarImportation.__str__) r r* r+ r, rL rb ra rM rc r r )r2 r ri 2 s ri c s e Zd ZdZ� fdd�Z� ZS )�FutureImportationzs
A binding created by a from `__future__` import statement.
`__future__` imports are implicitly used.
c s" t t| ��||d� ||f| _d S )N�
__future__)rZ rk rL rK )r& r7 rJ �scope)r2 r r rL O s zFutureImportation.__init__)r r* r+ r, rL rc r r )r2 r rk H s rk c @ s e Zd ZdZdS )�Argumentz3
Represents binding a name as an argument.
N)r r* r+ r, r r r r rn T s rn c @ s e Zd ZdZdS )�
Assignmenta
Represents binding a name with an explicit assignment.
The checker will raise warnings for any Assignment that isn't used. Also,
the checker does not consider assignments in tuple/list unpacking to be
Assignments, rather it treats them as simple Bindings.
N)r r* r+ r, r r r r ro Z s ro c @ s e Zd ZdS )�FunctionDefinitionN)r r* r+ r r r r rp d s rp c @ s e Zd ZdS )�ClassDefinitionN)r r* r+ r r r r rq h s rq c s e Zd ZdZ� fdd�Z� ZS )�
ExportBindinga
A binding created by an C{__all__} assignment. If the names in the list
can be determined statically, they will be treated as names for export and
additional checking applied to them.
The only C{__all__} assignment that can be recognized is one which takes
the value of a literal list containing literal strings. For example::
__all__ = ["foo", "bar"]
Names which are imported and not otherwise used but appear in the value of
C{__all__} will not have an unused import warning reported for them.
c s� d|kr&t |tj�r&t|d j�| _ng | _t |jtjtjf�rlx*|jjD ] }t |tj �rJ| j�
|j � qJW t t
| ��||� d S )N�__all__)r r Z AugAssignr4 �namesr ZListrB rC r@ �appendr rZ rr rL )r& r7 rJ rm r5 )r2 r r rL { s zExportBinding.__init__)r r* r+ r, rL rc r r )r2 r rr l s
rr c @ s e Zd ZdZdd� ZdS )�ScopeFc C s | j j}d|t| �t�| �f S )Nz<%s at 0x%x %s>)r2 r rO �dictrP )r& Z scope_clsr r r rP � s zScope.__repr__N)r r* r+ �
importStarredrP r r r r rv � s rv c @ s e Zd ZdS )�
ClassScopeN)r r* r+ r r r r ry � s ry c s: e Zd ZdZdZedddg�Z� fdd�Zdd � Z� Z S )
�
FunctionScopezp
I represent a name scope for a function.
@ivar globals: Names declared 'global' in this function.
FZ__tracebackhide__Z__traceback_info__Z__traceback_supplement__c s* t t| ��� | j�� | _d | _d| _d S )NF)rZ rz rL �
alwaysUsed�copy�globals� returnValue� isGenerator)r& )r2 r r rL � s zFunctionScope.__init__c c sD x>| � � D ]2\}}|js
|| jkr
| js
t|t�r
||fV q
W dS )zR
Return a generator for the assignments which have not been used.
N)r/ rK r} �
usesLocalsr ro )r& r7 �bindingr r r �unusedAssignments� s
z FunctionScope.unusedAssignments)
r r* r+ r, r� �setr{ rL r� rc r r )r2 r rz � s
rz c @ s e Zd ZdS )�GeneratorScopeN)r r* r+ r r r r r� � s r� c @ s e Zd ZdZdZdS )� ModuleScopezScope for a module.TN)r r* r+ r, �_futures_allowedr r r r r� � s r� c @ s e Zd ZdZdS )� DoctestScopezScope for a doctest.N)r r* r+ r, r r r r r� � s r� �__file__� __builtins__Z WindowsErrorc C s$ t | d�r| jS t | d�r | jS d S )NrO r7 )rA rO r7 )r5 r r r � getNodeName� s
r� c @ sB e Zd ZdZdZdZdZee�� e
�Z e j
�d�ZerFe �e�d�� [ddde j
kfd d
�Zd d � Zd
d� Zdd� Zdd� Zedd� �Zejdd� �Zedd� �Zdd� Zdd� Z e fd d �Z d d � Z d d!� Z d"d#� Z!d$d%� Z"d&d'� Z#d(d)� Z$d*d+� Z%d,d-� Z&d.d/� Z'd0d1� Z(ddd2d3�Z)d4d5� Z*d6d7� Z+d8d9� Z,d:d;� Z-e.�/� j0Z1d<d=� Z2d>d?� Z3e) Z4 Z5 Z6 Z7 Z8 Z9 Z: Z; Z< Z= Z> Z? Z@ ZAZBe3ZCe) ZD ZE ZF ZG ZH ZI ZJ ZK ZL ZM ZNZOe3 ZP ZQ ZRZSe) ZT ZUZVe3 ZW ZX ZY ZZ Z[Z\e3 Z] Z^ Z_ Z` Za Zb Zc Zd Ze Zf Zg Zh Zi Zj Zk Zl Zm Zn Zo Zp Zq Zr Zs Zt Zu Zv Zw ZxZye) Zz Z{ Z|Z}d@dA� Z~dBdC� ZdDdE� Z�e�Z�dFdG� Z�e��r�e)ne�Z�e� Z�Z�dHdI� Z�dJdK� Z�e�Z�dLdM� Z�dNdO� Z�e� Z�Z�dPdQ� Z�e�Z�dRdS� Z�dTdU� Z�dVdW� Z�dXdY� Z�e�Z�dZd[� Z�d\d]� Z�d^d_� Z�e�Z�d`da� Z�dbdc� Z�dS )e�Checkera�
I check the cleanliness and sanity of Python code.
@ivar _deferredFunctions: Tracking list used by L{deferFunction}. Elements
of the list are two-tuples. The first element is the callable passed
to L{deferFunction}. The second element is a copy of the scope stack
at the time L{deferFunction} was called.
@ivar _deferredAssignments: Similar to C{_deferredFunctions}, but for
callables which are deferred assignment checks.
r NFZPYFLAKES_BUILTINS�,z(none)ZPYFLAKES_DOCTESTc C s� i | _ g | _g | _g | _g | _|| _|r6| j�|�| _|| _t � g| _
dg| _ || _ | �
|� | �| j� d | _| �| j� d | _| j
dd �= | �� | �� d S )Nr r- )�
_nodeHandlers�_deferredFunctions�_deferredAssignments�
deadScopesr �filename�builtIns�union� withDoctestr� �
scopeStack�exceptHandlers�root�handleChildren� runDeferred�popScope�checkDeadScopes)r& �treer� r r� r r r rL � s(
zChecker.__init__c C s" | j �|| jdd� | jf� dS )a{
Schedule a function handler to be called just before completion.
This is used for handling function bodies, which must be deferred
because code later in the file might modify the global scope. When
`callable` is called, the scope at the time this is called will be
restored, however it will contain any new bindings added to it.
N)r� ru r� �offset)r& �callabler r r �
deferFunction� s zChecker.deferFunctionc C s" | j �|| jdd� | jf� dS )zl
Schedule an assignment handler to be called just after deferred
function handlers.
N)r� ru r� r� )r& r� r r r �deferAssignment s zChecker.deferAssignmentc C s* x$|D ] \}}}|| _ || _|� qW dS )zV
Run the callables in C{deferred} using their associated scope stack.
N)r� r� )r& Zdeferred�handlerrm r� r r r r�
s zChecker.runDeferredc C s t | j�dko t| jd t�S )N� r- )�lenr� r r� )r& r r r � _in_doctest s zChecker._in_doctestc C s t dd� | jD ��sdS | jjS )Nc s s | ]}t |t�V qd S )N)r r� )r rm r r r r< s z)Checker.futuresAllowed.<locals>.<genexpr>F)�allr� rm r� )r& r r r �futuresAllowed s zChecker.futuresAllowedc C s$ |dks t �t| jt�r d| j_d S )NF)rd r rm r� r� )r& r r r r r� " s c C s
| j d S )Nr^ )r� )r& r r r rm ( s z
Checker.scopec C s | j �| j�� � d S )N)r� ru r� �pop)r& r r r r� , s zChecker.popScopec C sj �xb| j D �]V}t|t�r q
|�d�}|r8t|t�s8d}|rRt|j�}|�|�}ng }}|r�|js�t j
� | j �dkr�x"|D ]}| �
tj|d j|� q|W |jr�x |�� D ]}t|t�r�||_q�W x�|�� D ]�}t|t�r�|jp�|j|k}|�s
tj} | �
| |jt|�� xR|jD ]H}
t| �|
�tj��r2tj } n|�r>�qntj } | �
| |
|j|j� �qW q�W q
W dS )z�
Look at scopes which have been fully examined and report names in them
which were imported but unused.
rs Nz __init__.py) r� r ry r. rr r� rt �
differencerx �os�path�basenamer� �reportr ZUndefinedExportrJ �valuesri rK rW r7 Z UnusedImportr
rY � getParentr �For�ImportShadowedByLoopVar�RedefinedWhileUnused) r& rm Z all_bindingZ all_namesZ undefinedr7 r� r rK Zmessgr5 r r r r� / sB
zChecker.checkDeadScopesc C s | j �|� � d S )N)r� ru )r& Z
scopeClassr r r � pushScopea s zChecker.pushScopec O s | j �|| jf|�|�� d S )N)r ru r� )r& Z messageClass�args�kwargsr r r r� d s zChecker.reportc C s( x"|j }t|d�st|d�s|S qW d S )NrC �ctx)�parentrA )r& r5 r r r r� g s zChecker.getParentc C sz |||fks t |d�r t |d�s$d S ||kr0|S |j|jkrL| �|j||�S |j|jk rh| �||j|�S | �|j|j|�S )Nr� )rA �depth�getCommonAncestorr� )r& �lnode�rnode�stopr r r r� n s
zChecker.getCommonAncestorc C s$ x |D ]}| � |||�rdS qW dS )NTF)r� )r& r5 Z ancestorsr� �ar r r � descendantOf{ s
zChecker.descendantOfc C sN | � ||| j�}t|�}|rJx,|D ]$}| �|||�| �|||�A r"dS q"W dS )zATrue, if lnode and rnode are located on different forks of IF/TRYTF)r� r� r r� )r& r� r� Zancestor�partsr/ r r r �differentForks� s
zChecker.differentForksc C sD x$| j ddd� D ]}|j|krP qW |�|j�}|�r| �||j��s| �|j�}t|t�r�t|tj �r�| �
t j ||j|j� n�|| j
kr�t|tj�r�t| �|j�tj tjf�s�| �
t j||j|j� n&|js�|�|�r�| �
t j||j|j� n$t|t��r|�|��r|j�|� |j| j
k�r4| j
|j j|_|| j
|j< dS )z�
Called when a binding is altered.
- `node` is the statement responsible for the change
- `value` is the new value, a Binding instance
Nr^ )r� r7 r. r� rJ r� r rW r r� r� r r� rm �
comprehensionZRedefinedInListComprK rS r� rY ru )r& r5 r rm Zexisting� parent_stmtr r r �
addBinding� s.
zChecker.addBindingc C s@ y
| j | S tk
r& t|�}Y nX t| |� | j |< }|S )N)r� �KeyErrorr r3 )r& r ZnodeTyper� r r r �getNodeHandler� s
zChecker.getNodeHandlerc C s` t |�}|sd S d }d }xv| jdd d� D ]b}|dkrBt|t�rBq*y| j|f|| _W n tk
rj Y nX d S |px|j}|dk r*t|t�}q*W || j kr�d S |�rg }xL| jdd d� D ]8}x2|�
� D ]&}t|t �r�| j|f|_|� |j
� q�W q�W d�t|��}| �tj|||� d S |dk�r<tj�| j�dk�r<d S d| jd k�r\| �tj||� d S )Nr^ Fz, �__path__z __init__.py� NameError)r� r� r ry rm rK r� rx r� r� r� ri ru rX �joinr% r� r ZImportStarUsager� r� r� r� r� �
UndefinedName)r& r5 r7 Z
in_generatorsrx rm � from_listr� r r r �handleNodeLoad� s@
zChecker.handleNodeLoadc C s" t |�}|sd S t| jt�r�|| jkr�xz| jd d� D ]h}t|ttf�sJq6||koZ|| j}|r6|d | jkr6|| jjkr6| �t j
|| jd ||| j � P q6W | � |�}t|t
jt
jf�s�||jkr�| �|�s�t||�}n4|dk�rt| jt��rt||j| j�}n
t||�}| �||� d S )Nr^ r r- rs )r� r rm rz r� r� rK r} r� r ZUndefinedLocalrJ r� r r� r� r� �isLiteralTupleUnpackingrI rr ro r� )r& r5 r7 rm rK r� r� r r r �handleNodeStore� s*
zChecker.handleNodeStorec s� � fdd�}t � �}|s d S |� r&d S t| jt�rN|| jjkrN| jj�|� n2y | j|= W n$ tk
r~ | �tj � |� Y nX d S )Nc s@ t � dd�} x.| r:t| tjtjtjf�r,dS t | dd�} qW dS )zN
Return `True` if node is part of a conditional body.
r� NTF)r3 r r r �WhileZIfExp)�current)r5 r r �on_conditional_branch s z7Checker.handleNodeDelete.<locals>.on_conditional_branch)
r� r rm rz r} �remover� r� r r� )r& r5 r� r7 r )r5 r �handleNodeDelete s zChecker.handleNodeDeletec C s& x t ||d�D ]}| �||� qW d S )N)r6 )r8 �
handleNode)r& r� r6 r5 r r r r� . s zChecker.handleChildrenc C s: t |tj�r6x$|j|jg D ]}t|d�s dS q W dS d S )NrC FT)r r ZAssign�targetsr rA )r& r5 �childr r r r� 2 s
z Checker.isLiteralTupleUnpackingc C s& t |tj�p$t |tj�o$t |jtj�S )z}
Determine if the given node is a docstring, as long as it is at the
correct place in the node tree.
)r r r@ �Exprr )r& r5 r r r � isDocstring9 s zChecker.isDocstringc C sR t |tj�r|j}t |tj�s"dS tr2|jd }n|j|j�d� d }|j|fS )N)NNr- �
) r r r� r r@ �PYPYrN r �count)r& r5 Zdoctest_linenor r r � getDocstringA s zChecker.getDocstringc C s� |d kr d S | j rJt|dd �d k rJ| j| j d 7 _| j| j d 7 _| jrftd| j |jj � | j r�t
|t j �s�| �
|�s�d| _ | jd7 _| j|_||_z| �|j�}||� W d | jd8 _X | jr�td| j d |jj � d S )NrN r r- z Fzend )r� r3 rN �
col_offset� traceTree�print� nodeDepthr2 r r� r r Z
ImportFromr� r� r� r� )r& r5 r� r� r r r r� O s&
zChecker.handleNodec C sr y&| � |jd �\}}|o"| �|�}W n ttfk
r> d S X |sHd S | j}| jd g| _| jpdd}| �t� d| j k}|s�| j �
d� x�|D ]�}yt |j ddt
j�} W nh tk
�r t�� d }
tr�|
jd7 _||j |
j |jd |
jp�d f} | �tj|| � Y q�X |d | |j |d |j d f| _| �| � || _q�W |�s`| j �d� | �� || _d S )Nr )r r �_z <doctest>�execr- r )r� r �_getDoctestExamples�
ValueError�
IndexErrorr� r� r� r� r� �add�compilerJ r Z
PyCF_ONLY_AST� SyntaxError�sys�exc_infor� rN �indentr� r ZDoctestSyntaxErrorr� r� r� ) r& r5 Z docstringZ node_linenoZexamplesZ saved_stackZ node_offsetZunderscore_in_builtinsZexampler� �eZpositionr r r �handleDoctestsg s@
zChecker.handleDoctestsc C s d S )Nr )r& r5 r r r �ignore� s zChecker.ignorec s� dd� �j D �}t|�}dd� |�� D �}x�|D ]�� � fdd�t|�D �}t�fdd�|D ��}tdd� |�� D ��r0xD|D ]<}�j | }t� t�r�| �tj |� j
� q|| �tj |� � q|W q0W | � �� d S )Nc S s g | ] }t |��qS r )r: )r r r r r r � s z Checker.DICT.<locals>.<listcomp>c S s g | ]\}}|d kr|�qS )r- r )r r r� r r r r � s c s g | ]\}}|� kr|�qS r r )r r; Zi_key)r r r r � s c 3 s | ]}t � j| �V qd S )N)r: r� )r �index)r5 r r r< � s z Checker.DICT.<locals>.<genexpr>c s s | ]\}}|d kV qdS )r- Nr )r r r� r r r r< � s )
�keysr1 r/ � enumerate�anyr rE r� r Z MultiValueRepeatedKeyVariabler7 Z MultiValueRepeatedKeyLiteralr� ) r& r5 r� Z
key_countsZduplicate_keysZ key_indicesr� Z key_indexZkey_noder )r r5 r �DICT� s(
z Checker.DICTc C s6 t |jtj�r(|jjg kr(| �tj|� | �|� d S )N) r Ztestr rB rC r� r Z AssertTupler� )r& r5 r r r �ASSERT� s zChecker.ASSERTc s� | � � r dnd}| j| }| j|k r�xh|jD ]^� t� |�}� fdd�| jD �| _|�� |� ||f|_x"| j|d d� D ] }||� < qzW q,W dS )z5
Keep track of globals declarations.
r- r c s* g | ]"}t |tj�r"|jd � kr|�qS )r )r r r� Z message_args)r �m)� node_namer r r � s z"Checker.GLOBAL.<locals>.<listcomp>N)r� r� rm rt ro r �
setdefaultrK )r& r5 Zglobal_scope_indexZ global_scopeZ
node_valuerm r )r� r �GLOBAL� s
zChecker.GLOBALc C s | � t� | �|� | �� d S )N)r� r� r� r� )r& r5 r r r � GENERATOREXP� s
zChecker.GENERATOREXPc C s� t |jtjtjf�rL| �|� |jdkr�t | jt�r�t |j tj
�r�d| j_ nJt |jtj tj
f�rl| �|� n*t |jtj�r�| �|� ntd|jf ��dS )zV
Handle occurrence of Name (which can be a load/store/delete access.)
�localsTz%Got impossible expression context: %rN)r r� r ZLoadZAugLoadr� rO rm rz r� ZCallr� �StoreZAugStorer� ZDelr� � RuntimeError)r& r5 r r r �NAME s
z Checker.NAMEc C s� |}xxt |d�r||j| }}t|t�r4||jkr4d S t|tjtjf�rHP t |d�rt|tj�r||j kr| �
t j |� d S qW t|tj�r�| �
t j
|� n| �
t j|� d S )Nr� � finalbody)rA r� r �
LOOP_TYPESr r � FunctionDef�ClassDefZContinuer� r� r ZContinueInFinallyZContinueOutsideLoopZBreakOutsideLoop)r& r5 r Zn_childr r r �CONTINUE s
zChecker.CONTINUEc C sX t | jttf�r"| �tj|� d S |jrFt| jd�rF| jj sF|j| j_ | �
|j|� d S )Nr~ ) r rm ry r� r� r ZReturnOutsideFunctionr rA r~ r� )r& r5 r r r �RETURN- s
zChecker.RETURNc C s< t | jttf�r"| �tj|� d S d| j_| �|j |� d S )NT)
r rm ry r� r� r ZYieldOutsideFunctionr r� r )r& r5 r r r �YIELD: s
z
Checker.YIELDc sl x� j D ]}��|� � qW ��� � ��� t� j� �� �jrh��� sht�j t
�sh�� � �fdd�� d S )Nc s
�� � �S )N)r� r )r5 r& r r r
N r z%Checker.FUNCTIONDEF.<locals>.<lambda>) r r� �LAMBDAr� rp r7 r� r� r rm rz r� )r& r5 �decor )r5 r& r � FUNCTIONDEFD s
zChecker.FUNCTIONDEFc s� g �g }t r0� �fdd�� � �jj� �jj}nBx0�jj�jj D ] }��|j� |�|j� qBW �jj�jj }t�d�}xbdD ]Z}t �j|�}|s�q���t
r�|n|j� |r�t
r�|d }|�t �j|�� q�|�|j� q�W |r�|��j � t t
���t ��k �r@x8t��D ],\} }|�d | � k�r��tj�|� �qW x$|| D ]}
|
�rJ��|
�� �qJW ���fdd�} ��| � d S )Nc s6 x0| D ](}t |tj�r"� |j� q��|j� qW d S )N)r r rB rC ru rO )Zarglist�arg)�addArgsr� r r r W s
z Checker.LAMBDA.<locals>.addArgs�returns)ZvarargZkwarg�
annotationc s� �� � x � D ]} ���t| ��� qW t�jt�rRx*�jD ]}��|�� q<W n���j�� �fdd�}��|� tr��fdd�}��|� �� � d S )Nc s. x(� j �� D ]\} }� �tj|j| � q W dS )zU
Check to see if any assignments have not been used.
N)rm r� r� r ZUnusedVariablerJ )r7 r� )r& r r �checkUnusedAssignments� s zCChecker.LAMBDA.<locals>.runFunction.<locals>.checkUnusedAssignmentsc s& � j jr"� j jr"� �tj� j j� dS )z�
Check to see if there is any return statement with
arguments but the function is a generator.
N)rm r r~ r� r Z ReturnWithArgsInsideGeneratorr )r& r r �&checkReturnWithArgumentInsideGenerator� s zSChecker.LAMBDA.<locals>.runFunction.<locals>.checkReturnWithArgumentInsideGenerator)
r� r� rn r r r4 r� r� �PY32r� )r7 �stmtr
r )r� r5 r& r r � runFunction� s
z#Checker.LAMBDA.<locals>.runFunction)�PY2r� �defaultsZ
kwonlyargsru r r Z kw_defaultsrA r3 rF r r� r� r� r� r ZDuplicateArgumentr� r� ) r& r5 Z annotationsr r Z is_py3_funcZarg_nameZwildcardZ
argannotation�idxr� r r )r r� r5 r& r r R s@
!zChecker.LAMBDAc s� x� j D ]}��|� � qW x� jD ]}��|� � q$W tsXx� jD ]}��|� � qDW ��t� �jr���� s�t �j
t �s��� � �fdd�� x� j
D ]}��|� � q�W ��� ��� t� j� �� dS )z�
Check names used in a class definition, including its decorators, base
classes, and the body of its definition. Additionally, add its name to
the current scope.
c s
�� � �S )N)r� r )r5 r& r r r
� r z"Checker.CLASSDEF.<locals>.<lambda>N)r r� �basesr �keywordsr� ry r� r� r rm rz r� r r� r� rq r7 )r& r5 r ZbaseNodeZ keywordNoder
r )r5 r& r �CLASSDEF� s
zChecker.CLASSDEFc C s, | � |j� | �|j|� | �|j|� d S )N)r� �targetr� r )r& r5 r r r � AUGASSIGN� s zChecker.AUGASSIGNc C s� t s�t|jtj�r�d}d}x>t|j�D ]0\}}t|tj�r&|rN| �t j
|� P d}|}q&W |dksxt |j�| d dkr�| �t j |� | �
|� d S )NFr^ T� r- i )r r r� r r� r� rC ZStarredr� r ZTwoStarredExpressionsr� Z%TooManyExpressionsInStarredAssignmentr� )r& r5 Z has_starredZstar_locr; r r r r �TUPLE� s z
Checker.TUPLEc C sX xR|j D ]H}d|jkr*|js*t|j|�}n|jp4|j}t|||j�}| �||� qW d S )Nr] )rt r7 �asnamer\ rW r� )r& r5 �alias� importationr7 r r r �IMPORT� s zChecker.IMPORTc C s |j dkr.| js4| �tj|dd� |jD �� nd| _d|j |j pDd }x�|jD ]�}|jp^|j}|j dkr�t ||| j
�}|jt j kr�| �tj
||j� n`|jdkr�ts�t| j
t�s�| �tj||� qPd| j
_| �tj||� t||�}nt||||j�}| �||� qPW d S ) Nrl c S s g | ]
}|j �qS r )r7 )r r r r r r � s z&Checker.IMPORTFROM.<locals>.<listcomp>Fr] � rj T)rf r� r� r ZLateFutureImportrt �levelr r7 rk rm rl Zall_feature_namesZFutureFeatureNotDefinedr r r� ZImportStarNotPermittedrx ZImportStarUsedri re r� )r& r5 rf r r7 r r r r �
IMPORTFROM� s0
zChecker.IMPORTFROMc C s� g }x�t |j�D ]x\}}t|jtj�rHx6|jjD ]}|�t|�� q0W n|jr^|�t|j�� |jd kr|t |j�d k r| �
t j |� qW | j
�|� x|jD ]}| �||� q�W | j
�� | j|dd� d S )Nr- r )r6 )r� r r �typer rB rC ru r� r� r� r ZDefaultExceptNotLastr� r r� r� r� )r& r5 Z
handler_namesr; r� �exc_typer� r r r �TRY s
z Checker.TRYc C s� t s|jd kr | �|� d S x,| jd d d� D ]}|j|kr.d}P q.W d}| �|� | �|� |s�y| j|j= W n tk
r� Y nX d S )Nr^ TF)r r7 r� r� r� rm r� )r& r5 rm Zis_name_previously_definedr r r �
EXCEPTHANDLER s
zChecker.EXCEPTHANDLERc C sF |j r| �|j|� t| jt�s.| �|j|� |j rB| �|j |� dS )z�
Annotated assignments don't have annotations evaluated on function
scope, hence the custom implementation.
See: PEP 526.
N)r r� r r rm rz r )r& r5 r r r � ANNASSIGN; s zChecker.ANNASSIGN)N)�r r* r+ r, r� r� r� r� � builtin_varsr� �_MAGIC_GLOBALSr� r� �environr. Z_customBuiltIns�updater_ rL r� r� r� r� rb r� �setterrm r� r� rz r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� �doctestZ
DocTestParserZ get_examplesr� r� r� ZDELETEZPRINTZFORZASYNCFORZWHILEZIFZWITHZWITHITEMZ ASYNCWITHZ
ASYNCWITHITEMZRAISEZ
TRYFINALLYZEXECZEXPRZASSIGNZPASSZBOOLOPZBINOPZUNARYOPZIFEXPZSETZCOMPARE�CALLZREPRZ ATTRIBUTEZ SUBSCRIPTZSTARREDZ NAMECONSTANTZNUMZSTRZBYTES�ELLIPSISZSLICEZEXTSLICEZINDEXZLOADZSTOREZDELZAUGLOADZAUGSTOREZPARAMZAND�ORZADDZSUBZMULTZDIVZMODZPOWZLSHIFTZRSHIFTZBITORZBITXORZBITANDZFLOORDIVZINVERTZNOTZUADDZUSUBZEQZNOTEQZLTZLTEZGTZGTEZISZISNOT�INZNOTINZMATMULTZ
COMPREHENSIONZKEYWORDZFORMATTEDVALUEZ JOINEDSTRr� r� r� ZNONLOCALr� r ZLISTCOMPZDICTCOMPZSETCOMPr� r ZBREAKr r ZAWAITZ YIELDFROMr ZASYNCFUNCTIONDEFr r r r ZLISTr r r" Z TRYEXCEPTr# r$ r r r r r� � s� 2
'6
'<0 t$
Q "r� )=r, rl r* r� r� � version_infor r rF ZPY34Zpypy_version_infor� �AttributeError�dir�
__import__r% r � ImportError�_astr� r" r rb r� Zpyflakesr r r r� r� r� ZAsyncForrw r r1 r8 r: �objectrI rQ rG rE rW r\ re ri rk rn ro rp rq rr rv ry rz r� r� r� r& r� r� r r r r �<module> st
(%