Your IP : 216.73.216.85
U
i�f�` � @ sf d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl m Z z d dl
Z
W n ek
rx dZ
Y nX ej�e�Zej�ed�Zej�ed�ZG dd� dejj�ZG dd� dej�ZG d d
� d
�ZG d d � d ejj �Z G d
d� dejj �Z G dd� de j �Z G dd� de j �Z!dd� Z"G dd� de j �Z#da$dd� Z%dd� Z&e'dk�rbe �(� dS ) � N)�supportz keycert.pemz keycert2.pemc @ s e Zd ZdZdd� Zdd� ZdS )�LoopbackHttpServerz^HTTP server w/ a few modifications that make it useful for
loopback testing purposes.
c C s" t jj�| ||� | j�d� d S )Ng�������?)�http�server�
HTTPServer�__init__�socket�
settimeout)�selfZserver_addressZRequestHandlerClass� r �?/opt/alt/python38/lib64/python3.8/test/test_urllib2_localnet.pyr s
�zLoopbackHttpServer.__init__c C s | j �� \}}|�d� ||fS )z HTTPServer method, overridden.g $@)r Zacceptr )r
�requestZclient_addressr r r � get_request) s
z LoopbackHttpServer.get_requestN)�__name__�
__module__� __qualname__�__doc__r r r r r r r s r c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �LoopbackHttpServerThreadz2Stoppable thread that runs a loopback http server.c C s< t j�| � d| _t �� | _d|_td|�| _| jj | _
d S )NFzHTTP/1.0)z 127.0.0.1r ) � threading�Threadr � _stop_serverZEvent�readyZprotocol_versionr �httpdZ server_port�port�r
�request_handlerr r r r 8 s
�z!LoopbackHttpServerThread.__init__c C s d| _ | �� | j�� dS )z.Stops the webserver if it's currently running.TN)r �joinr Z server_close�r
r r r �stopA s z LoopbackHttpServerThread.stopc C s | j �� | js | j�� q
d S �N)r �setr r �handle_requestr r r r �runI s
z LoopbackHttpServerThread.runN)r r r r r r r" r r r r r 5 s r c @ sX e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dd� Z dd� Z dS )�DigestAuthHandlerz-Handler for performing digest authentication.c C s" d| _ g | _i | _d| _d| _d S )Nr z
Test Realm�auth)� _request_num�_nonces�_users� _realm_name�_qopr r r r r S s
zDigestAuthHandler.__init__c C s
|| _ d S r )r) )r
Zqopr r r �set_qopZ s zDigestAuthHandler.set_qopc C s
|| _ d S r )r' )r
Zusersr r r � set_users] s zDigestAuthHandler.set_usersc C s
|| _ d S r )r( )r
Zrealmr r r � set_realma s zDigestAuthHandler.set_realmc C s8 | j d7 _ t�t| j ��d���� }| j�|� |S )N� �ascii)r% �hashlib�md5�str�encode� hexdigestr& �append)r
�noncer r r �_generate_nonced s z!DigestAuthHandler._generate_noncec C s� |� d�}||d d � }|�d�}i }|D ]P}|�d�\}}|�� }|d dkrl|d dkrl|dd� }n|�� }|||< q,|S )N� r- �,�=r �"���)�find�split�strip)r
Zauth_strZfirst_space_index�parts� auth_dict�part�name�valuer r r �_create_auth_dictj s
z#DigestAuthHandler._create_auth_dictc C s� i }|� |� ||d< ||d< ||d< d| }t�|�d���� }d| }t�|�d���� } ||d< | |d< d | }
t�|
�d���� } | |d
kS ) N�password�method�uriz#%(username)s:%(realm)s:%(password)sr. z%(method)s:%(uri)s�HA1�HA2z3%(HA1)s:%(nonce)s:%(nc)s:%(cnonce)s:%(qop)s:%(HA2)s�response)�updater/ r0 r2 r3 ) r
r@ rE rF rG Z
final_dictZHA1_strrH ZHA2_strrI Z response_strrJ r r r �_validate_auth{ s
�z DigestAuthHandler._validate_authc C sN |� dd� |�dd� |�dd| j| j| �� f � |�� |j�d� dS ) Ni� z Proxy Authentication Required� Content-Type� text/htmlzProxy-Authenticatez(Digest realm="%s", qop="%s",nonce="%s", s Proxy Authentication Required.F)�
send_response� send_headerr( r) r6 � end_headers�wfile�writer r r r �_return_auth_challenge� s �� z(DigestAuthHandler._return_auth_challengec C s� t | j�dkrdS d|jkr&| �|�S | �|jd �}|d | jkrT| j|d }n
| �|�S |�d�| jkrx| �|�S | j�|d � d}|j|j fD ]}| �
|||j |�r�d}q�|s�| �|�S dS dS )a Performs digest authentication on the given HTTP request
handler. Returns True if authentication was successful, False
otherwise.
If no users have been set, then digest auth is effectively
disabled and this method will always return True.
r TzProxy-AuthorizationZusernamer5 FN) �lenr' �headersrT rD �getr& �remove�path�
short_pathrL Zcommand)r
r r@ rE Zauth_validatedrY r r r r! � s0
�
�
z DigestAuthHandler.handle_requestN)
r r r r r r* r+ r, r6 rD rL rT r! r r r r r# P s r# c @ sf e Zd ZdZdZdZdZdeef Ze� e�
d��� d�Z dd� Z
d d
� Zd d � Zd
d� Zdd� ZdS )�BasicAuthHandlerz,Handler for performing basic authentication.�testUser�testPass�Testz%s:%sr. c O s t jjj| f|�|� d S r )r r �BaseHTTPRequestHandlerr )r
�args�kwargsr r r r � s zBasicAuthHandler.__init__c G s d S r r �r
�formatr` r r r � log_message� s z BasicAuthHandler.log_messagec C s" | � d� | �dd� | �� d S )N�� � Content-typerN )rO rP rQ r r r r �do_HEAD� s
zBasicAuthHandler.do_HEADc C s4 | � d� | �dd| j � | �dd� | �� d S )Ni� zWWW-AuthenticatezBasic realm="%s"rf rN )rO rP �REALMrQ r r r r � do_AUTHHEAD� s
z BasicAuthHandler.do_AUTHHEADc C sh | j �dd�s$| �� | j�d� n@| j �dd�d| j kr\| �d� | �� | j�d� n| �� d S )NZ
Authorization� s No Auth header receivedzBasic re s It works)rV rW ri rR rS � ENCODED_AUTHrO rQ r r r r �do_GET� s ��
zBasicAuthHandler.do_GETN)r r r r �USER�PASSWDrh Z USER_PASSWD�base64Z b64encoder2 �decoderk r rd rg ri rl r r r r r[ � s r[ c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �FakeProxyHandlerz�This is a 'fake proxy' that makes it look like the entire
internet has gone down due to a sudden zombie invasion. It main
utility is in providing us with authentication support for
testing.
c O s || _ tjjj| f|�|� d S r )�digest_auth_handlerr r r_ r )r
rr r` ra r r r r � s zFakeProxyHandler.__init__c G s d S r r rb r r r rd s z FakeProxyHandler.log_messagec C sv t j�| jd�\}}}}}}|| _| j�| �rr| �dd� | �dd� | � � | j
� t d| j d�� | j
� d� d S ) Nr re ZOKrM rN zYou've reached %s!<BR>r. sF Our apologies, but our server is down due to a sudden zombie invasion.)
�urllib�parseZurlparserY rZ rr r! rO rP rQ rR rS �bytes)r
ZscmZnetlocrY ZparamsZqueryZfragmentr r r rl s � �zFakeProxyHandler.do_GETN)r r r r r rd rl r r r r rq � s rq c sP e Zd ZdZdZdZdZ� fdd�Zdd� Z� fd d
�Z d d � Z
d
d� Z � Z S )�BasicAuthTestsr\ r] Z Incorrectr^ c sT t t| ��� dd� }t|�| _| �| j� d| jj | _| j� � | jj
� � d S )Nc _ s
t | |�S r )r[ �r` ra r r r �#http_server_with_basic_auth_handler s zABasicAuthTests.setUp.<locals>.http_server_with_basic_auth_handlerzhttp://127.0.0.1:%s) �superrv �setUpr r �
addCleanup� stop_serverr �
server_url�startr �wait)r
rx �� __class__r r rz s
zBasicAuthTests.setUpc C s | j �� d | _ d S r �r r r r r r r| ' s
zBasicAuthTests.stop_serverc s t t| ��� d S r )ry rv �tearDownr r� r r r� + s zBasicAuthTests.tearDownc C s| t j�� }|�| j| j| j| j� t j�t j� |�� z| �
t j� | j�� W n( t j j
k
rv | �d| j � Y nX d S )Nz!Basic auth failed for the url: %s)rs r
�HTTPBasicAuthHandler� add_passwordrh r} rm rn �install_opener� build_opener�
assertTrue�urlopen�error� HTTPError�fail�r
Zahr r r �test_basic_auth_success. s
z&BasicAuthTests.test_basic_auth_successc C sR t j�� }|�| j| j| j| j� t j�t j� |�� | �
t j j t jj
| j� d S r )rs r
r� r� rh r} rm �INCORRECT_PASSWDr� r� � assertRaisesr� r� r� r� r r r �test_basic_auth_httperror7 s
z(BasicAuthTests.test_basic_auth_httperror)
r r r rm rn r� rh rz r| r� r� r� �
__classcell__r r r� r rv s rv c s^ e Zd ZdZdZdZdZe�d�� fdd��Z dd � Z
d
d � Z d d
� Z dd� Z
dd� Z� ZS )�ProxyAuthTestszhttp://localhostZtesterZtest123Z TestRealmr0 c s� t t� ��� dd� }� �|tj�� � dtjd< dtjd< t� � _� j� � j
� j i� � j� � j
� � fdd�}t|�� _� �� j� � j�� � jj�� d� jj }tj�d |i�}tj�� � _tj�|� j�� _d S )
Nc S s t j�� t j�| � d S r ��os�environ�clearrK �Z old_environr r r �restore_environI s
z-ProxyAuthTests.setUp.<locals>.restore_environrj �NO_PROXY�no_proxyc s t � jf| �|�S r )rq rr rw r r r �create_fake_proxy_handlerT s z7ProxyAuthTests.setUp.<locals>.create_fake_proxy_handlerzhttp://127.0.0.1:%dr ) ry r� rz r{ r� r� �copyr# rr r+ rm rn r, rh r r r| r~ r r r rs r
Z ProxyHandlerZProxyDigestAuthHandler�proxy_digest_handlerr� �opener)r
r� r� Z proxy_url�handlerr� r r rz E s(
�zProxyAuthTests.setUpc C s | j �� d | _ d S r r� r r r r r| a s
zProxyAuthTests.stop_serverc C sF | j �| j| j| j| jd � | j�d� | �t j
j | j j
| j� d S )NZbadr$ )r� r� rh �URLrm rn rr r* r� rs r� r� r� �openr r r r �-test_proxy_with_bad_password_raises_httperrore s �
�z<ProxyAuthTests.test_proxy_with_bad_password_raises_httperrorc C s( | j �d� | �tjj| jj| j� d S �Nr$ ) rr r* r� rs r� r� r� r� r� r r r r �,test_proxy_with_no_password_raises_httperrorm s
�z;ProxyAuthTests.test_proxy_with_no_password_raises_httperrorc C sN | j �| j| j| j| j� | j�d� | j� | j��}|�
� r@q6W 5 Q R X d S r� ) r� r� rh r� rm rn rr r* r� r� �read�r
�resultr r r �test_proxy_qop_auth_workss s � z(ProxyAuthTests.test_proxy_qop_auth_worksc C sp | j �| j| j| j| j� | j�d� z| j� | j�}W n t
j j k
rP Y n X |� |�
� rbqXW 5 Q R X d S )Nzauth-int)r� r� rh r� rm rn rr r* r� r� rs r� �URLErrorr� r� r r r �0test_proxy_qop_auth_int_works_or_throws_urlerror{ s � z?ProxyAuthTests.test_proxy_qop_auth_int_works_or_throws_urlerror)r r r r� rm rn rh r Zrequires_hashdigestrz r| r� r� r� r� r� r r r� r r� > s r� c s G � �fdd�dt jj�� � S )Nc sB e Zd ZdZg Zg ZdZdd� Zdd� Z� �fdd�Z d d
� Z
d S ) z1GetRequestHandler.<locals>.FakeHTTPRequestHandlerz TestHTTP/�P c S s* | � � }|r&| j�|�}||d � }qd S r )� send_headrR rS )r
�bodyZdoner r r rl � s z8GetRequestHandler.<locals>.FakeHTTPRequestHandler.do_GETc S s2 | j d }| j�t|��}| �� | j�|� d S )NzContent-Length)rV Zrfiler� �intrl �requestsr4 )r
Zcontent_lengthZ post_datar r r �do_POST� s
z9GetRequestHandler.<locals>.FakeHTTPRequestHandler.do_POSTc s| | j � _| j�| j� ��d�\}}}| �|� |D ] \}}| �||d| ji � q4|rp| �dd� | � � |S | � � d S )Nr r rf z
text/plain)
rV �headers_receivedr� r4 rY �poprO rP r rQ )r
Z
response_coderV r� �headerrC ��FakeHTTPRequestHandler� responsesr r r� � s
z;GetRequestHandler.<locals>.FakeHTTPRequestHandler.send_headc W s d S r r )r
r` r r r rd � s z=GetRequestHandler.<locals>.FakeHTTPRequestHandler.log_messageN) r r r Zserver_versionr� r� r rl r� r� rd r r� r r r� � s r� )r r r_ )r� r r� r �GetRequestHandler� s &r� c s� e Zd ZdZ� fdd�Zd+dd�Zdd� Zd,d d
�Zd-d d �Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Z� ZS ).� TestUrlopenaN Tests urllib.request.urlopen using the network.
These tests are not exhaustive. Assuming that testing using files does a
good job overall of some of the basic interface features. There are no
tests exercising the optional 'data' and 'proxies' arguments. No tests
for transparent redirection have been written.
c s@ t t| ��� dd� }| �|tj�� � dtjd< dtjd< d S )Nc S s t j�� t j�| � d S r r� r� r r r r� � s
z*TestUrlopen.setUp.<locals>.restore_environ�*r� r� )ry r� rz r{ r� r� r� )r
r� r� r r rz � s
zTestUrlopen.setUpNc K sl g }t jj||f|�}z@|�|�d�� |�|�� � |�|�d�� |�|�� � W 5 |�� X d� |�S )Nre i � )
rs r
r� �close�extend� readlinesr4 �readliner� r )r
�url�datara �l�fr r r r� � s
zTestUrlopen.urlopenc C s | j �� d | _ d S r r� r r r r r| � s
zTestUrlopen.stop_serverc C sZ |d krdg dfg}t |�}t|�| _| �| j� | j�� | jj�� | jj}||_|S )Nre s
we don't care) r� r r r{ r| r~ r r r )r
r� r� r r r r � start_server� s
zTestUrlopen.start_serverc K s^ t tjd�s| �d� ddlm} |d kr6dg dfg}t|�}|| fd|i|��}|j|_|S )NZ HTTPSHandlerzssl support requiredr )�make_https_serverre �
we care a bitZ
handler_class)�hasattrrs r
�skipTestZtest.ssl_serversr� r� r )r
r� ra r� r� r r r r �start_https_server� s
z TestUrlopen.start_https_serverc C sV d}ddgdfdg |fg}| � |�}| �d|j �}| �||� | �|jddg� d S ) Ns We got here...i. )ZLocationz(http://localhost:%(port)s/somewhere_elserj re �http://localhost:%s/�/z/somewhere_else�r� r� r � assertEqualr� )r
�expected_responser� r� r� r r r �test_redirection� s ��
z TestUrlopen.test_redirectionc C s@ d}d}ddg|fg}| � |�}| �d|j �}| �||� d S )Ns hello worlds a
hello worl
1
d
0
re )zTransfer-EncodingZchunkedr� )r� r� r r� )r
r� Z
chunked_startrJ r� r� r r r � test_chunked s �
zTestUrlopen.test_chunkedc
C s� d}| � dg |fg�}z| �d|j � W n6 tjjk
r` } z|�� }|�� W 5 d }~X Y n X | �d� | � ||� | � |j
dg� d S )Ns Bad bad bad...i� zhttp://localhost:%s/weeblez404 should raise URLErrorz/weeble) r� r� r rs r� r� r� r� r� r� r� )r
r� r� r� r� r r r �test_404 s
zTestUrlopen.test_404c C sF d}| � dg |fg�}| �d|j �}| �||� | �|jdg� d S )N�
pycon 2008...re �http://localhost:%s/bizarre�/bizarrer� �r
r� r� r� r r r �test_200 s
zTestUrlopen.test_200c C sJ d}| � dg |fg�}| �d|j d�}| �||� | �|jddg� d S )Nr� re r� s get=with_feelingr� r� r� r r r �test_200_with_parameters% s � z$TestUrlopen.test_200_with_parametersc C s8 | � � }tjtd�}| jd|j |d�}| �|d� d S )N�Zcafile� https://localhost:%s/bizarre��contextr� )r� �ssl�create_default_context�CERT_localhostr� r r� )r
r� r� r� r r r �
test_https- s zTestUrlopen.test_httpsc
C s� | j td�}t�dtf��� | jd|j td�}| �|d� | �t j
j ��}| jd|j t d� W 5 Q R X | j t d�}| �t j
j ��}| jd|j t d� W 5 Q R X W 5 Q R X d S )N��certfilerj r� r� r� )
r� r� r �check_warnings�DeprecationWarningr� r r� r� rs r� r� �CERT_fakehostname)r
r� r� �cmr r r �test_https_with_cafile3 s � � �z"TestUrlopen.test_https_with_cafilec
C sX | j td�}t�dtf��4 | �tjj��}| j d|j
dd� W 5 Q R X W 5 Q R X d S )Nr� rj r� T)Z cadefault) r� r� r r� r� r� rs r� r� r� r )r
r� r� r r r �test_https_with_cadefaultD s �z%TestUrlopen.test_https_with_cadefaultc s� t d kr| �d� t js"| �d� d � � fdd�}t �t j�}|�|� | j|td�}t jtd�}| j d|j
|d� | � � d � d S )
Nzssl module requiredz SNI support required in OpenSSLc s |� d S r r )Zssl_sockZ server_nameZinitial_context�Zsni_namer r �cb_sniR s z*TestUrlopen.test_https_sni.<locals>.cb_sni)r� r� r� zhttps://localhost:%sr� Z localhost) r� r� ZHAS_SNIZ
SSLContextZPROTOCOL_TLS_SERVERZset_servername_callbackr� r� r� r� r r� )r
r� r� r� r r� r �test_https_sniL s
zTestUrlopen.test_https_snic C sP | � � }tjjd|j ddid�}tj�|�� W 5 Q R X | �|jd d� d S )Nr� ZRangez bytes=20-39)rV )r� rs r
ZRequestr r� r� r� )r
r� Zreqr r r �test_sending_headers\ s �
z TestUrlopen.test_sending_headersc C sZ | � � }tj�d|j ��6}dD ]}| �t||�d| � q | �|�� d� W 5 Q R X d S )N�http://localhost:%s)r� r� �info�geturlz3object returned from urlopen lacks the %s attributezcalling 'read' failed)r� rs r
r� r r� r� r� )r
r� �open_url�attrr r r �
test_basicd s �zTestUrlopen.test_basicc C sX | � � }tj�d|j �}|� |�� }W 5 Q R X | �|tjj d� | �
|� � d� d S )Nr� zEobject returned by 'info' is not an instance of email.message.MessageZplain) r� rs r
r� r r� ZassertIsInstance�email�messageZMessager� Zget_content_subtype)r
r� r� Zinfo_objr r r � test_infol s � �zTestUrlopen.test_infoc C sH | � � }tj�d|j �}|� |�� }W 5 Q R X | �|d|j � d S )Nr� )r� rs r
r� r r� r� )r
r� r� r� r r r � test_geturlw s
zTestUrlopen.test_geturlc C sB d}| � dg |fg�}tj�d|j �}|D ]}| �||� q,d S )Nr� re r� )r� rs r
r� r r� )r
r� r� r� �liner r r �test_iteration s
zTestUrlopen.test_iterationc
C s� ddddd d g}d� |�}| �dg |fg�}tj�d |j �}t|�D ]0\}}| �||| d
|t|| �t|�f � qJ| �|d t|�� d S ) Ns We
s got
s here
s verylong i �
r� re r� zQFetched line number %s doesn't match expected:
Expected length was %s, got %sr- ) r r� rs r
r� r � enumerater� rU )r
�linesr� r� r� �indexr� r r r �test_line_iteration� s
��z TestUrlopen.test_line_iteration)N)N)N)r r r r rz r� r| r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r� r r� � s*
r� c C s t �� ad S r )r Zthreading_setup� threads_keyr r r r � setUpModule� s r� c C s t rtjt � d S r )r� r Zthreading_cleanupr r r r �tearDownModule� s r� �__main__))ro r� r� Z urllib.parsers Zurllib.requestZ http.serverr r Zunittestr/ Ztestr r� � ImportErrorrY �dirname�__file__�herer r� r� r r r r r r# r_ r[ rq ZTestCaserv r� r� r� r� r� r� r �mainr r r r �<module> s>
y,!(N+ ]