Your IP : 216.73.216.85
U
i�f�j � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl Z d dl Z d dl
Z
d dlZd dl
mZmZ zd dlmZ dZW n ek
r� dZY nX d dlmZ d dlmZ dd lmZ dd
lmZ G d d � d �ZG d
d� dee
j edd�Z G dd� dee
j edd�Z G dd� de
j �Z G dd� d�Z G dd� de e
j edd�Z!G dd� de e
j edd�Z"e#dk�r~e
�$� dS )� N)�mock�
skipUnless)�ProcessPoolExecutorTF)�support)�
script_helper� )�without_source_date_epoch)�SourceDateEpochTestMetac @ s� e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Ze�d �d d � �Zd d!� Ze�d �d"d#� �Ze�d �e�d$�d%d&� ��Zejd d'd(�e�d$�d)d*� ��Zd'S )+�CompileallTestsBasec C s� t �� | _tj�| jd�| _tj� | j�| _
t | jd��}|� d� W 5 Q R X tj�| jd�| _
tj� | j
�| _t�| j| j
� tj�| jd�| _t�| j� tj�| jd�| _t�| j| j� d S )N�_test.py�wzx = 123
z _test2.pyZ_subdirz _test3.py)�tempfile�mkdtemp� directory�os�path�join� source_path� importlib�util�cache_from_source�bc_path�open�write� source_path2�bc_path2�shutilZcopyfileZ subdirectory�mkdir� source_path3��self�file� r" �9/opt/alt/python38/lib64/python3.8/test/test_compileall.py�setUp s
zCompileallTestsBase.setUpc C s t �| j� d S �N�r �rmtreer �r r" r" r# �tearDown- s z CompileallTestsBase.tearDownc C s8 t j�| jd�| _t| jd��}|�d� W 5 Q R X d S )Nz _test_bad.pyr zx (
)r r r r �bad_source_pathr r r r" r" r# �add_bad_source_file0 s z'CompileallTestsBase.add_bad_source_filec C sP t | jd��}|�d�}W 5 Q R X tt�| j�j�}t� dt
j j d|�}||fS )N�rb� �<4sllr )
r r �read�intr �statr �st_mtime�struct�packr r � MAGIC_NUMBER)r r! �data�mtimeZcomparer" r" r# �timestamp_metadata5 s
z&CompileallTestsBase.timestamp_metadatac C s� t j�d�rt�d��t�| j� | j| � � � t
| j d��}|� � t
|�d� }W 5 Q R X t
| j d��}|�|� |�|� W 5 Q R X | j| � � � tj| jddd� | j| � � � dS ) zOCheck that compileall recreates bytecode when the new metadata is
used.�SOURCE_DATE_EPOCHzSOURCE_DATE_EPOCH is setr, N�wbFT��force�quiet)r �environ�get�unittest�SkipTest�
py_compile�compiler � assertEqualr8 r r r/ �lenr �assertNotEqual�
compileall� compile_dirr �
assertTrue)r Zmetadatar! Zbcr" r" r# �recreation_check< s
z$CompileallTestsBase.recreation_checkc C s | � t�dtjjdd�� d S )Nr. r r )rJ r3 r4 r r r5 r( r" r" r# �
test_mtimeL s �z CompileallTestsBase.test_mtimec C s | � d� d S )Ns )rJ r( r" r" r# �test_magic_numberQ s z%CompileallTestsBase.test_magic_numberc C s | j | jfD ] }zt�|� W q Y q X q | �tj| jddd�� | �tj� | j �oftj� | j� � t�| j � | �tj
| j ddd�� | �tj� | j �o�tj� | j�� t�| j � t�| j� | � � | �
tj| jddd�� | �
tj
| j ddd�� d S )NFTr; � )r r r �unlinkrI rG � compile_filer r �isfilerH r r+ � assertFalser* )r �fnr" r" r# �test_compile_filesU s< �� � � � �z&CompileallTestsBase.test_compile_filesc C sh | � tj�| j�� t�� � }| �t� t
� | j ��� W 5 Q R X | �
|�� d� | �tj�| j�� d S )Nz&Compiling ([^WindowsPath|PosixPath].*))rQ r r rP r r �captured_stdoutrI rG rO �pathlib�Pathr � assertRegex�getvalue)r �stdoutr" r" r# �test_compile_file_pathliken s
"z.CompileallTestsBase.test_compile_file_pathlikec C sP | � tj�| j�� | �tjt� | j
�t� d�dd�� | �tj�| j�� d S )NZ ddir_pathrM )�ddirr= ) rQ r r rP r rI rG rO rU rV r r( r" r" r# � test_compile_file_pathlike_ddirv s �z3CompileallTestsBase.test_compile_file_pathlike_ddirc C st t jjj| jgd�� | �tjdd�� W 5 Q R X t jjj| jgd��$ | �� | � tjdddd�� W 5 Q R X d S )N)r rM �r= FT)Z skip_curdirr< r= )
�test�test_importlibr Z import_stater rI rG Z compile_pathr+ rQ r( r" r" r# �test_compile_path} s
�z%CompileallTestsBase.test_compile_pathc C sh t j�| jd�}t j�|d�}t �|� t|d�� W 5 Q R X t�|� | �t j� t j�|d��� d S )Nr6 r! r � __pycache__)
r r r r r r rG rO rQ �exists)r Zdata_dirZ data_filer" r" r# � test_no_pycache_in_non_package� s
z2CompileallTestsBase.test_no_pycache_in_non_packagec C s� drdnd\}}t j| jd|d� tjj| j|d�}| �tj �
|�� tjj| j |d�}| �tj �
|�� tjj| j |d�}| �tj �
|�� d S )NF)r r )r � T)r= �optimize)� optimization)
rG rH r r r r r rI r r rP r r )r re �opt�cachedZcached2Zcached3r" r" r# �
test_optimize� s
�
�
�z!CompileallTestsBase.test_optimizec C sn | � tj�| j�� t�� �}t�t �
| j �� W 5 Q R X |� � �
� d }| �|d� | �tj�| j�� d S )Nr z$Listing ([^WindowsPath|PosixPath].*))rQ r r rP r r rT rG rH rU rV r rX �
splitlinesrW rI )r rY �liner" r" r# �test_compile_dir_pathlike� s
z-CompileallTestsBase.test_compile_dir_pathlikez&concurrent.futures.ProcessPoolExecutorc C s" t j| jddd� | �|j� d S �NT� �r= �workers�rG rH r rI �called�r � pool_mockr" r" r# �test_compile_pool_called� s z,CompileallTestsBase.test_compile_pool_calledc C s, | � td�� tj| jdd� W 5 Q R X d S )Nz%workers must be greater or equal to 0���)rp )ZassertRaisesRegex�
ValueErrorrG rH r r( r" r" r# �!test_compile_workers_non_positive� s �z5CompileallTestsBase.test_compile_workers_non_positivec C s, t j| jddd� | �|jd d d � d S )NTr ro r Z max_workers)rG rH r rD � call_argsrs r" r" r# � test_compile_workers_cpu_count� s z2CompileallTestsBase.test_compile_workers_cpu_countzcompileall.compile_filec C s, t j| jdd� | �|j� | �|j� d S )NTr] )rG rH r rQ rr rI )r �compile_file_mockrt r" r" r# �test_compile_one_worker� s z+CompileallTestsBase.test_compile_one_workerN��newc C s" t j| jddd� | �|j� d S rm rq )r r{ r" r" r# �$test_compile_missing_multiprocessing� s z8CompileallTestsBase.test_compile_missing_multiprocessing)�__name__�
__module__� __qualname__r$ r) r+ r8 rJ rK rL rS rZ r\ r` rc ri rl r �patchru rx rz r| r r" r" r" r# r
s2
r
c @ s e Zd ZdS )� CompileallTestsWithSourceEpochN�r� r� r� r" r" r" r# r� � s r� )� metaclassZsource_date_epochc @ s e Zd ZdS )�!CompileallTestsWithoutSourceEpochNr� r" r" r" r# r� � s r� c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) � EncodingTestzTIssue 6716: compileall should escape source code when printing errors
to stdout.c C sP t �� | _tj�| jd�| _t| jddd��}|�d� |�d� W 5 Q R X d S )Nr r zutf-8��encodingz# -*- coding: utf-8 -*-
u
print u"€"
) r
r r r r r r r r r r" r" r# r$ � s
zEncodingTest.setUpc C s t �| j� d S r% r& r( r" r" r# r) � s zEncodingTest.tearDownc C s8 z*t j}tjt�� dd�t _t�| j� W 5 |t _X d S )N�asciir� )�sysrY �io�
TextIOWrapper�BytesIOrG rH r )r Z orig_stdoutr" r" r# �
test_error� s
zEncodingTest.test_errorN)r� r� r� �__doc__r$ r) r� r" r" r" r# r� � s r� c @ s� e Zd ZdZedd� �Zdd� Zdd� Zdd � Zd
d � Z d d
� Z
dd� Z dd� Z dd� Z
edd� �Zdd� Zddg fddd gfd d d gffD ]&\ZZZeefd d!�Zee� d"e < q�d#d$� Zd%d&� Zed'd(� �Zd)d*� Zd+d,� Zd-d.� Zd/d0� Z d1d2� Z d3d4� Z d5d6� Z d7d8� Z d9d:� Z!d;d<� Z"d=d>� Z#d?d@� Z$dAdB� Z%dCdD� Z&dEdF� Z'e(e)dG�dHdI� �Z*e+�,dJ�dKdL� �Z-dMdN�dOdP�Z.dQdR� Z/dSdT� Z0dUdV� Z1dWdX� Z2dYS )Z�CommandLineTestsBasezTest compileall's CLI.c C s� t tjjtj�D ]�}d}t�|�d }|d }z`z8|� � sF|� � d}|�
d��}|�d� W 5 Q R X W n" tk
r� d}Y W � q�Y nX W 5 t�t |�� |r�|�
� X qd}|| _d S )NFra ztest.tryTr z# for test_compileall)�filterr r �isdirr� rU rV r rN �str�rmdir�is_dirr r r �OSError�_sys_path_writable)�clsr Zdirectory_createdr r! Zsys_path_writabler" r" r# �
setUpClass� s$ z CommandLineTestsBase.setUpClassc C s | j st�d��d S )Nz(not all entries on sys.path are writable)r� r@ rA r( r" r" r# � _skip_if_sys_path_not_writable s z3CommandLineTestsBase._skip_if_sys_path_not_writablec C s t �� d|�S )N�-S�-mrG )r� r� rG )r Z!optim_args_from_interpreter_flags)r �argsr" r" r# �
_get_run_args s ��z"CommandLineTestsBase._get_run_argsc O s( t j| �|�|�\}}}| �d|� |S )N� )r �assert_python_okr� rD �r r� Zenv_vars�rc�out�errr" r" r# � assertRunOK s �
z CommandLineTestsBase.assertRunOKc O s" t j| �|�|�\}}}|||fS r% )r �assert_python_failurer� r� r" r" r# �assertRunNotOK s
�
z#CommandLineTestsBase.assertRunNotOKc C s" t j�|�}| �tj�|�� d S r% )r r r rI r r rb �r rR r r" r" r# �assertCompiled s z#CommandLineTestsBase.assertCompiledc C s" t j�|�}| �tj�|�� d S r% )r r r rQ r r rb r� r" r" r# �assertNotCompiled s z&CommandLineTestsBase.assertNotCompiledc C sr t �� | _| �tj| j� tj�| jd�| _ t�
| j � tj�| j d�| _ t �
| j dd�| _t �
| j dd�| _d S )N�foora �__init__rd Zbar)r
r r Z
addCleanupr r' r r r �pkgdirr �pkgdir_cachedirr � make_script�initfn�barfnr( r" r" r# r$ ! s
zCommandLineTestsBase.setUpc C sL | � � t�| jdd�}| j| jd� | �|� | �| j� | �| j� d S )N�bazrd �Z
PYTHONPATH) r� r r� r r� r� r� r� r� )r �bazfnr" r" r# �test_no_args_compiles_path+ s
z/CommandLineTestsBase.test_no_args_compiles_pathc C s� | � � t�| jdd�}| j| jd� tj�|�}t� |t
�
� d fd � t� |�j }| j| jd� t� |�j }| �
||� | jd| jd� t� |�j }| �||� d S )Nr� rd r� �< rM �-f)r� r r� r r� r r r r �utime�timer1 r2 rD rF )r r� �pycpathr7 �mtime2r" r" r# � test_no_args_respects_force_flag4 s z5CommandLineTestsBase.test_no_args_respects_force_flagc C sR | � � t�| jdd� | j| jd�}| �d|� | jd| jd�}| �d|� d S )Nr� rd r� s Listing �-q)r� r r� r r� �assertInZ assertNotIn�r Znoisyr= r" r" r# � test_no_args_respects_quiet_flagF s z5CommandLineTestsBase.test_no_args_respects_quiet_flagZnormal�pycre z opt-1.pycz-OZdoubleoptimizez opt-2.pycz-OOc s~ t j|ddd| jg � | �tj�| j�� t� fdd�dD ��}| � tt�
| j��|� | � � fdd�t�
| j�D �� d S ) Nr� rG r� c 3 s | ]}|� tjj� �V qd S r% )�formatr� �implementation� cache_tag)�.0�base��extr" r# � <genexpr>Z s �z)CommandLineTestsBase.f.<locals>.<genexpr>)z__init__.{}.{}z bar.{}.{}c s g | ]}|� � �r|�qS r" )�endswith)r� rR r� r" r# �
<listcomp>^ s
�z*CommandLineTestsBase.f.<locals>.<listcomp>) r r� r� rI r r rb r� �sortedrD �listdirrQ )r r� �switch�expectedr" r� r# �fU s � �zCommandLineTestsBase.fZtest_pep3147_paths_c C sP | � dd| j� | �tj�| j�� tddddg�}| �tt� | j��|� d S )Nz-br� � __init__.pyz __init__.pyczbar.pyzbar.pyc)
r� r� rQ r r rb r� r� rD r� )r r� r" r" r# �test_legacy_pathsb s �z&CommandLineTestsBase.test_legacy_pathsc C s| | � d| j� | �tj�| j�� tj�| jd�}| �tj�|�� | � d| j� | �tj�| j�� | �tj�|�� d S )Nr� ra ) r� r� rI r r rb r� r rQ )r Z
cachecachedirr" r" r# �test_multiple_runsl s z'CommandLineTestsBase.test_multiple_runsc C s� | � d| j� tj�| j�}t�|t�� d fd � t� |�j
}| � d| j� t� |�j
}| � ||� | � dd| j� t� |�j
}| � ||� d S )Nr� r� rM r� )
r� r� r r r r� r r� r� r1 r2 rD rF )r r� r7 r� r" r" r# �
test_forcey s z CommandLineTestsBase.test_forcec C s� t j�| jd�}t �|� t�|dd�}t�|dd�}| �dd| j� | �|� | � t j�
t j�|d��� | �d| j� | � |� | � |� d S )N�spamr� rd �hamr� z-lra ) r r r r� r r r� r� r� rQ rb r� )r �
subpackage� subinitfn�hamfnr" r" r# �test_recursion_control� s
z+CommandLineTestsBase.test_recursion_controlc C sV t j�| jd�}t j�|d�}t j�|d�}|||fD ]}t�|� q6t j�|d�}t�|dd�}t�|dd�}t�|dd�}| �dd| j� | �|� | � t j�
t j�|d ��� | �dd
| j� | � |� | � |� | �|� | �dd | j� | � |� | � |� | � |� | �|� | �dd | j� | � |� | � |� | � |� | � |� d S )
Nr� r� Zeggsr� rd Zeggr� z-r 0ra z-r 1z-r 2z-r 5) r r r r� r Zmake_pkgr� r� r� rQ rb r� ) r r� Z subpackage2Z subpackage3Zpkgr� r� ZspamfnZeggfnr" r" r# �test_recursion_limit� s8
�
z)CommandLineTestsBase.test_recursion_limitc C s6 | � | j�}| � d| j�}| �d|� | �d|� d S )Nr� r� )r� r� rF rD r� r" r" r# �
test_quiet� s z CommandLineTestsBase.test_quietc C sT t �| jdd� | �d| j�\}}}| �d| j�\}}}| �d|� | �d|� d S )N� crunchyfrog�
bad(syntaxr� z-qqr� )r r� r� r� rF rD )r �_r= Zsilentr" r" r# � test_silent� s
z CommandLineTestsBase.test_silentc C s. | � ddd| j� | �| j� | �| j� d S )Nr� z-xz
ba[^\\/]*$)r� r� r� r� r� r� r( r" r" r# � test_regexp� s z CommandLineTestsBase.test_regexpc C sv t j�| jd�}t �|� t�|dd�}t�|dd�}| �d| j|� | � | j
� | � | j � | � |� | � |� d S )NZfoo2r� rd �bar2r� ) r r r r r r r� r� r� r� r� r� )r Zpkgdir2Zinit2fn�bar2fnr" r" r# �test_multiple_dirs� s
z'CommandLineTestsBase.test_multiple_dirsc C s8 t �| jdd� | �ddd| j�\}}}| �|d� d S )Nr� r� r� �-d�dinsdale� File "dinsdale)r r� r� r� rW �r r� r� r� r" r" r# �test_d_compile_error� s z)CommandLineTestsBase.test_d_compile_errorc C s� t �| jdd�}| �ddd| j� t �| jdd�}tj�|�}t�|tj �
| jd�� t� |� t j |d d
�\}}}| �
|d � d S ) Nr� zraise Exceptionr� r� r� �bingz
import bazzbaz.pycF)Z
__isolatedr� )r r� r� r� r r r r �renamer r �remover� rW )r r� rR r� r� r� r� r" r" r# �test_d_runtime_error� s
z)CommandLineTestsBase.test_d_runtime_errorc C sZ | � dtj�| jd�| j�\}}}| �|d� | �|d� | �tj� t
j � | j
��� d S )N�-i�
nosuchfiles rror.*nosuchfiles Traceback)r� r r r r r� rW ZassertNotRegexrQ rb r r r r� r� r" r" r# �test_include_bad_file� s �
�z*CommandLineTestsBase.test_include_bad_filec C s� t �| jdd�}t �| jdd�}t �| jdd�}t �| jdd�}ttj�| jd�d��>}|�tj�| jd�tj � |�tj�| jd �tj � W 5 Q R X | �
d
tj�| jd�|� | � |� | � |� | � |� | � |� d S ) N�f1rd �f2�f3�f4�l1r �f1.py�f2.pyr� )
r r� r� r r r r r r �linesepr� r� r� �r r� r� r� r� r� r" r" r# �test_include_file_with_arg� s &
z/CommandLineTestsBase.test_include_file_with_argc C s� t �| jdd�}t �| jdd�}t �| jdd�}t �| jdd�}ttj�| jd�d��"}|�tj�| jd�tj � W 5 Q R X | �
d tj�| jd�� | � |� | � |� | � |� | � |� d S )
Nr� rd r� r� r� r� r r� r� )
r r� r� r r r r r r r� r� r� r� r� r" r" r# �test_include_file_no_arg� s &
z-CommandLineTestsBase.test_include_file_no_argc C s� t �| jdd�}t �| jdd�}t �| jdd�}t �| jdd�}t j| �d�ddg � }|j�|tj � d �� t �
|� | � |� | � |� | � |� | � |� d S )
Nr� rd r� r� r� r" r� �-r� )
r r� r� Z spawn_pythonr� �stdinr r r� �encodeZ kill_pythonr� r� )r r� r� r� r� �pr" r" r# �test_include_on_stdin s
z*CommandLineTestsBase.test_include_on_stdinc C s\ t �| jdd�}| �d| j|| j�\}}}| �|d� | �|� | �| j� | �| j� d S )Nr� z syntax(errorr� s rror) r r� r� r� r� r� rW r� r� )r Zbingfnr� r� r� r" r" r# �!test_compiles_as_much_as_possible s
�
z6CommandLineTestsBase.test_compiles_as_much_as_possiblec C s | � d�}| �|d� d S )NZ badfilenames Can't list 'badfilename')r� rW )r r� r" r" r# �!test_invalid_arg_produces_message s
z6CommandLineTestsBase.test_invalid_arg_produces_messagec C s� t �| jdd� tj�tj�| jd��}| � d| j� t
|d��}|� � }W 5 Q R X | � t
�|dd� d�d � | � d
| j� t
|d��}|� � }W 5 Q R X | � t
�|dd� d�d � d S ) Nr� rd r� z --invalidation-mode=checked-hashr, � � �little� z"--invalidation-mode=unchecked-hashr )r r� r� r r r r r r r� r r/ rD r0 �
from_bytes)r r� �fpr6 r" r" r# �test_pyc_invalidation_mode s � z/CommandLineTestsBase.test_pyc_invalidation_modezrequires multiprocessingc C s� t �| jdd�}g }td�D ]F}tj�| jd�|��}t�|� t �|dd�}|� t �|dd�� q | �
| jdd� | � |� |D ]}| � |� q�d S )Nr� rd rn zfoo{}r� z-j�0) r r� r �ranger r r r� r �appendr� r� )r r� �files�suffixr� rR r! r" r" r# � test_workers- s
z!CommandLineTestsBase.test_workerszcompileall.compile_dirc C sR t jdtj| jdgd��0 t�� | �|j� | � |j
d d d� W 5 Q R X d S )Nzsys.argvz-j0r} rv rp r ) r r� r� �
executabler rG �mainrI rr rD ry )r rH r" r" r# � test_workers_available_cores< s � z1CommandLineTestsBase.test_workers_available_coresT)�parallelc C s ddg}| j }g }|D ]>}tj�||�}t�|� t�|dd� |�t�|dd�� qtj | j d||rjdnd d
� | �
|� |D ]�}| �
|� | j �|� t j
�|�}|t| j tj �d � } t�|�\}
}
} tj�|| �} tjj
�|�}
| �|
j| � | �d | � d �t�| �� q�d S )
z@Recursive compile_dir ddir must contain package paths; bpo39769.r^ r� r� rd �modzdef fn(): 1/0
fn()
TrM r )r= r[ rp N�")r r r r r r r� r rG rH rI �
startswithr r r rE �sepr� r^ r_ Z_get_code_from_pycrD � co_filenamer� �fsdecode)r r[ r �fullpathr ZmodsZsubdirr Zmodcode�modpathr� r� Z expected_inZ mod_code_objr" r" r# �_test_ddir_onlyD s4
�
�
z$CommandLineTestsBase._test_ddir_onlyc C s | j ddd�S )�=Recursive compile_dir ddir= contains package paths; bpo39769.�
<a prefix>F�r[ r �r r( r" r" r# �test_ddir_only_one_worker] s z.CommandLineTestsBase.test_ddir_only_one_workerc C s | j ddd�S )r r Tr! r" r( r" r" r# �test_ddir_multiple_workersa s z/CommandLineTestsBase.test_ddir_multiple_workersc C s | j ddd�S )�?Recursive compile_dir ddir='' contains package paths; bpo39769.rd Fr! r" r( r" r" r# � test_ddir_empty_only_one_workere s z4CommandLineTestsBase.test_ddir_empty_only_one_workerc C s | j ddd�S )r% rd Tr! r" r( r" r" r# � test_ddir_empty_multiple_workersi s z5CommandLineTestsBase.test_ddir_empty_multiple_workersN)3r� r� r� r� � classmethodr� r� r� r� r� r� r� r$ r� r r� r� �namer� r� r� �localsr� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r �_have_multiprocessingr r r� r r r# r$ r& r' r" r" r" r# r� � s`
�
"
r� c @ s e Zd ZdS )� CommmandLineTestsWithSourceEpochNr� r" r" r" r# r, n s r, c @ s e Zd ZdS )� CommmandLineTestsNoSourceEpochNr� r" r" r" r# r- u s r- �__main__)%r� rG �importlib.utilr Ztest.test_importlib.utilr^ r rU rB r r3 r
r� r@ r� r r Zconcurrent.futuresr r+ � ImportErrorr Z test.supportr Ztest_py_compiler r r
ZTestCaser� r� r� r� r, r- r� r r" r" r" r# �<module> sf
* � � � �