Your IP : 216.73.216.213
o
0�isD � @ sJ d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl m Z m
Z
mZmZ d dlmZ d dlmZ d dlmZ d dlmZ d dlmZmZmZm Z m Z m Z m Z d dl m!Z! d d l"m#Z#m$Z$ d
Z%d Z&d
Z'e(ed �oe(ed
�Z)dedede*fdd�Z+de,ee-f fdd�Z.de-dedej/fdd�Z0dede-de
fdd�Z1G dd � d �Z2G d d � d e �Z3e-Z4e,ed e3f e,ed e4f B Z5G d!d"� d"e6�Z7G d#d$� d$ej8�Z9d%e:e9 de:e9 fd&d'�Z;G d(d)� d)�Z<d*eddfd+d,�Z=G d-d.� d.ej>�Z?d/e@e-ef dee@e-ef B fd0d1�ZAdeBeCe fd2d3�ZDdS )4� N)�
NamedTuple�NoReturn�Literal�Any)�support)� os_helper)� Namespace)�Regrtest)�runtest� is_failed�
TestResult� Interrupted�Timeout�
ChildError�PROGRESS_MIN_TIME)� setup_tests)�format_duration�
print_warningg >@g �r@�setsid�killpg�result�ns�returnc C s& t | t�rdS |jrt| |�rdS dS )NTF)�
isinstancer
Zfailfastr )r r � r �B/opt/alt/python310/lib64/python3.10/test/libregrtest/runtest_mp.py� must_stop) s
r c C s$ t �| �\}}tdi |��}||fS )Nr )�json�loadsr )� worker_args�ns_dict� test_namer r r r �parse_worker_args1 s r" �testnamec C sx t |�}|| f}t�|�}tjgt�� �d�d�d�d�|�}i }tr'd|d< tj |ftj
tj
dt j dkt
jd�|��S ) Nz-uz-mz
test.regrtestz
--worker-argsTZstart_new_session�nt)�stdout�stderrZuniversal_newlinesZ close_fds�cwd)�varsr �dumps�sys�
executabler Zargs_from_interpreter_flags�USE_PROCESS_GROUP�
subprocess�Popen�PIPE�os�namer ZSAVEDCWD)r# r r r �cmd�kwr r r �run_test_in_subprocess7 s4
�������r4 r! c C s< t | � t| |�}t� ttj|td�dd� t�d� d S )N)�clsT��flushr )r r
�printr r) �EncodeTestResultr* �exit)r r! r r r r �run_tests_workerP s
r; c @ s. e Zd Z dd� Zdd� Zdd� Zdd� Zd S )
�MultiprocessIteratorc C s t �� | _|| _d S �N)� threadingZLock�lock�
tests_iter)�selfr@ r r r �__init__a s
z MultiprocessIterator.__init__c C s | S r= r �rA r r r �__iter__e s z MultiprocessIterator.__iter__c C sB | j � | jd u r t�t| j�W d � S 1 sw Y d S r= )r? r@ �
StopIteration�nextrC r r r �__next__h s
$�z MultiprocessIterator.__next__c C s2 | j � d | _W d � d S 1 sw Y d S r= )r? r@ rC r r r �stopn s "�zMultiprocessIterator.stopN)�__name__�
__module__� __qualname__rB rD rG rH r r r r r< ] s r< c @ s. e Zd ZU eed< eed< eed< eed< dS )�MultiprocessResultr r% r& � error_msgN)rI rJ rK r �__annotations__�strr r r r rL s s
rL FTc @ s e Zd ZdS )�
ExitThreadN)rI rJ rK r r r r rP ~ s rP c s� e Zd Zdeddddf� fdd� Zdefdd �Zd d
d �Zd d d
�Z d!de dedede
fdd�Z dede eeef fdd�Z
dede
fdd�Zd dd�Zd dd �Zd eddfd d �Z� ZS )"�TestWorkerProcess� worker_id�runner�MultiprocessTestRunnerr Nc sZ t � �� || _|j| _|j| _|j| _|j| _|j| _d | _ d | _
d | _ d| _ d| _
d S )NF)�superrB rR �pending�outputr �worker_timeout�timeout�regrtest�current_test_name�
start_time�_popen�_killed�_stopped)rA rR rS �� __class__r r rB � s
zTestWorkerProcess.__init__c C s� d| j � �g}| �� r|�d� n|�d� | j}|r#|�d|� �� | j}|d urBt�� | j }|�d| jj � �dt
|�� �f� dd� |� S ) NzTestWorkerProcess #�runningZstoppedztest=zpid=ztime=z<%s>� ) rR �is_alive�appendr[ r] �time� monotonicr\ �extend�pidr �join)rA �info�test�popen�dtr r r �__repr__� s
�zTestWorkerProcess.__repr__c
C s� | j }|d u r d S | jrd S d| _tr| � d�}n| � }td|� �tjdd� ztr5t�|jt j
� W d S |� � W d S t yE Y d S t
ya } ztd|� d|��� W Y d }~d S d }~ww )NTz process groupzKill ��filer7 zFailed to kill z: )r] r^ r, r8 r* r& r0 r ri �signal�SIGKILL�kill�ProcessLookupError�OSErrorr )rA rm Zwhat�excr r r �_kill� s( "��zTestWorkerProcess._killc C s d| _ | �� d S )NT)r_ rx rC r r r rH � s zTestWorkerProcess.stop� � test_resultr% r& c C s t �� | j |_t||||�S r= )rf rg r\ � duration_secrL )rA rz r% r& �err_msgr r r �mp_result_error� s z!TestWorkerProcess.mp_result_errorr! c C s t �� | _|| _zt|| j�}d| _|| _W n d | _� z_zV| jr)| � � t
�z|j | j d�\}}|j
}W n% tjyP | jrDt
�| � � d }d }}Y n ty\ | jr[t
�� w |�� }|�� }|||fW W | �� d | _d | _S | � � � | �� d | _d | _w )NF�rY ry )rf rg r\ r[ r4 r r^ r] r_ rx rP Z communicaterY �
returncoder- �TimeoutExpiredrv �strip�rstrip�_wait_completed)rA r! rm r% r& �retcoder r r � _run_process� sN
� �z TestWorkerProcess._run_processc
C s� | � |�\}}}|d u r| �t|�||�S d }|dkr d| }n1|�d�\}}}|�� }|s1d}n z tj|td�}W n tyP } z
d| }W Y d }~nd }~ww |d ur_| �t |�|||�S t
||||�S )Nr z Exit code %s�
z Failed to parse worker stdout)Z object_hookz Failed to parse worker JSON: %s) r� r} r �
rpartitionr� r r �decode_test_result� Exceptionr rL ) rA r! r� r% r& r| �_r rw r r r �_runtest s*
��
�zTestWorkerProcess._runtestc C s� | j sRz,zt| j�}W n ty Y W d S w | �|�}| j�d|f� t|j| j �r.W d S W n t
y9 Y d S t yL | j�dt �
� f� Y d S w | j rd S d S )NFT)r_ rF rV rE r� rW Zputr r r rP �
BaseException� traceback�
format_exc)rA r! � mp_resultr r r �run" s& �
� ��zTestWorkerProcess.runc
C sv | j }|j�� |j�� z|�t� W d S tjtfy: } zt d| � dt
t�� d|��� W Y d }~d S d }~ww )NzFailed to wait for z completion (timeout=z): ) r] r% �closer& �wait� JOIN_TIMEOUTr- r� rv r r )rA rm rw r r r r� 5 s
����z!TestWorkerProcess._wait_completedr\ c C sf | � d� | �� s d S t�� | }| j�d| � dt|�� �� |tkr2td| � dt|�� �� d S q)NTg �?z Waiting for z thread for zFailed to join z in ) rj rd rf rg rZ �logr r� r )rA r\ rn r r r � wait_stoppedD s
��z TestWorkerProcess.wait_stopped�r N)ry ry N)rI rJ rK �intrB rO ro rx rH r rL r} �tupler� r� r� r� �floatr� �
__classcell__r r r` r rQ � s,
����
�
;
rQ �workersc C sN g }| D ] }|j }|s qt�� |j }|tkr$d|t|�f }|�|� q|S )Nz%s (%s))r[ rf rg r\ r r re )r� rb �workerr[ rn �textr r r � get_running\ s
�r� c @ sr e Zd Zdeddfdd�Zddd�Zddd �ZdedB fd
d �Zd e ddfd
d�Z
dede fdd�Z ddd�Z
dS )rT rZ r Nc C sj || _ | j j| _|j| _t�� | _t| j j�| _| jj d ur-t
| jj d | jj d �| _ nd | _ d | _ d S )Ng �?i, )
rZ r� r �queueZQueuerW r< ZtestsrV rY �minrX r� )rA rZ r r r rB j s
�
z MultiprocessTestRunner.__init__c s| � fdd�t d� jjd �D �� _dt� j�� d�}� jjr-|dt� jj�t� j�f 7 }� �|� � jD ]}|� � q5d S )Nc s g | ]}t |� ��qS r )rQ )�.0�indexrC r r �
<listcomp>{ s �z8MultiprocessTestRunner.start_workers.<locals>.<listcomp>� z Run tests in parallel using z child processesz" (timeout: %s, worker timeout: %s))
�ranger Zuse_mpr� �lenrY r rX r� �start)rA �msgr� r rC r �
start_workersz s
�
��
�z$MultiprocessTestRunner.start_workersc C s6 t �� }| jD ]}|�� q| jD ]}|�|� qd S r= )rf rg r� rH r� )rA r\ r� r r r � stop_workers� s
�z#MultiprocessTestRunner.stop_workersc C s� | j jd u}t}tdd� | jD ��rM|rtjtdd� z| jj |d�W S t
j y- Y nw t | j�}|rC| j j
sC| �dd�|� � tdd� | jD ��sz| jj dd�W S t
j y` Y d S w ) Nc s s � | ]}|� � V qd S r= )rd )r� r� r r r � <genexpr>� s � z5MultiprocessTestRunner._get_result.<locals>.<genexpr>T)r: r~ z running: %s�, r )r rY �PROGRESS_UPDATE�anyr� � faulthandlerZdump_traceback_later�MAIN_PROCESS_TIMEOUTrW �getr� ZEmptyr� �pgor� rj )rA Zuse_faulthandlerrY rb r r r � _get_result� s* ��
��z"MultiprocessTestRunner._get_resultr� c C s� |j }t|�}|jd ur|d|j 7 }n|jtkr&| jjs&|dt|j� 7 }t| j �}|r:| jjs:|dd�
|� 7 }| j � | j
|� d S )Nz (%s)z -- running: %sr� )r rO rM r{ r r r� r r� r� rj rZ Zdisplay_progress�
test_index)rA r� r r� rb r r r �display_result� s
z%MultiprocessTestRunner.display_result�itemc C s� |d r|d }t d|� �� dS | jd7 _|d }| j�|j� | �|� |jr3t|jdd� |jrC| j j
sCt|jt jdd� t |j| j �rLdS dS )Nr r� z regrtest worker thread failed: Tr6 rp F)
r r� rZ Zaccumulate_resultr r� r% r8 r& r r� r* r )rA r� r� r� r r r �_process_result� s
z&MultiprocessTestRunner._process_resultc C s� | � � d| _z<z | �� }|d u rn | �|�}|rnq
W n ty- t� d| j_Y nw W | jj d ur9t
� � | j �
� | �� d S | jj d urNt
� � | j �
� | �� w )Nr T)r� r� r� r� �KeyboardInterruptr8 rZ Z interruptedr rY r� Zcancel_dump_traceback_laterrV rH r� )rA r� rH r r r � run_tests� s2
�� ��
�
z MultiprocessTestRunner.run_testsr� )rI rJ rK r rB r� r� � QueueOutputr� rL r� �boolr� r� r r r r rT i s
rT rZ c C s t | ��� d S r= )rT r� )rZ r r r �run_tests_multiprocess� s r� c s0 e Zd Z dedeeef f� fdd� Z� ZS )r9 �or c s. t |t�rt|�}|jj|d< |S t� �|�S )N�__test_result__)r r r( ra rI rU �default)rA r� r r` r r r� � s
zEncodeTestResult.default)rI rJ rK r �dictrO r� r� r r r` r r9 � s &r9 �dc C sD d| vr| S | � d�}t� D ]}|j|kr |di | �� S qd S )Nr� r )�pop�get_all_test_result_classesrI )r� �cls_namer5 r r r r� � s
��r� c C sT d} t h}t|�| kr(t|�} g }|D ] }|�|�� � q|�|� t|�| ks |S )Nr )r r� rh �__subclasses__�update)Z
prev_countZclassesZto_addr5 r r r r� s
�r� )E� collectionsr� r r0 r� rr r- r* r> rf r� �typingr r r r rl r Z test.supportr Ztest.libregrtest.cmdliner Ztest.libregrtest.mainr Ztest.libregrtest.runtestr
r r r
r r r Ztest.libregrtest.setupr Ztest.libregrtest.utilsr r r� r� r� �hasattrr, r� r r� rO r" r. r4 r; r< rL ZExcStrr� r� rP ZThreadrQ �listr� rT r� Z JSONEncoderr9 r� r� �set�typer� r r r r �<module> sP $
[
&