Your IP : 216.73.216.52
3
� f�a �
@ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
m Z e j d�Z
y d dlZW n ek
rz dZY nX ejje�Zejjed�Zejjed�ZG dd� dejj�ZG dd � d e
j�ZG d
d � d �Z G d d
� d
ejj �Z G dd� dejj �Z ej e
d�G dd� dej!��Z"ej e
d�G dd� dej!��Z#dd� Z$ej e
d�G dd� dej!��Z%da&dd� Z'dd � Z(e)d k�r�ej*� dS ) � N)�support� threadingz keycert.pemz keycert2.pemc @ s e Zd ZdZdd� Zdd� ZdS )�LoopbackHttpServerz^HTTP server w/ a few modifications that make it useful for
loopback testing purposes.
c C s" t jjj| ||� | jjd� d S )Ng�������?)�http�server�
HTTPServer�__init__�socket�
settimeout)�selfZserver_addressZRequestHandlerClass� r �?/opt/alt/python36/lib64/python3.6/test/test_urllib2_localnet.pyr ! s
zLoopbackHttpServer.__init__c C s | j j� \}}|jd� ||fS )z HTTPServer method, overridden.g $@)r Zacceptr
)r �requestZclient_addressr r r
� get_request* s
z LoopbackHttpServer.get_requestN)�__name__�
__module__� __qualname__�__doc__r r r r r r
r s r c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �LoopbackHttpServerThreadz2Stoppable thread that runs a loopback http server.c C s< t jj| � d| _t j� | _d|_td|�| _| jj | _
d S )NFzHTTP/1.0� 127.0.0.1r )r r ) r �Threadr � _stop_serverZEvent�readyZprotocol_versionr �httpdZ server_port�port)r �request_handlerr r r
r 9 s
z!LoopbackHttpServerThread.__init__c C s d| _ | j� | jj� dS )z.Stops the webserver if it's currently running.TN)r �joinr Z server_close)r r r r
�stopB s z LoopbackHttpServerThread.stopc C s$ | j j� x| js | jj� q W d S )N)r �setr r �handle_request)r r r r
�runJ s
z LoopbackHttpServerThread.runN)r r r r r r r r r r r
r 6 s r c @ sX e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dd� Z dd� Z dS )�DigestAuthHandlerz-Handler for performing digest authentication.c C s" d| _ g | _i | _d| _d| _d S )Nr z
Test Realm�auth)� _request_num�_nonces�_users� _realm_name�_qop)r r r r
r T s
zDigestAuthHandler.__init__c C s
|| _ d S )N)r' )r Zqopr r r
�set_qop[ s zDigestAuthHandler.set_qopc C s t |t�st�|| _d S )N)�
isinstance�dict�AssertionErrorr% )r Zusersr r r
� set_users^ s zDigestAuthHandler.set_usersc C s
|| _ d S )N)r& )r Zrealmr r r
� set_realmb s zDigestAuthHandler.set_realmc C s8 | j d7 _ tjt| j �jd��j� }| jj|� |S )N� �ascii)r# �hashlib�md5�str�encode� hexdigestr$ �append)r �noncer r r
�_generate_noncee s z!DigestAuthHandler._generate_noncec C s� |j d�}||d d � }|jd�}i }xX|D ]P}|jd�\}}|j� }|d dkrn|d dkrn|dd� }n|j� }|||< q.W |S ) N� r. �,�=r �"���r< )�find�split�strip)r Zauth_strZfirst_space_index�parts� auth_dict�part�name�valuer r r
�_create_auth_dictk s
z#DigestAuthHandler._create_auth_dictc C s� i }|j |� ||d< ||d< ||d< d| }tj|jd��j� }d| }tj|jd��j� } ||d< | |d< d | }
tj|
jd��j� } | |d
kS ) N�password�method�uriz#%(username)s:%(realm)s:%(password)sr/ z%(method)s:%(uri)s�HA1�HA2z3%(HA1)s:%(nonce)s:%(nc)s:%(cnonce)s:%(qop)s:%(HA2)s�response)�updater0 r1 r3 r4 ) r rA rF rG rH Z
final_dictZHA1_strrI ZHA2_strrJ Z response_strrK r r r
�_validate_auth| s
z DigestAuthHandler._validate_authc C sN |j dd� |jdd� |jdd| j| j| j� f � |j� |jjd� dS ) Ni� z Proxy Authentication Requiredz Content-Typez text/htmlzProxy-Authenticatez(Digest realm="%s", qop="%s",nonce="%s", s Proxy Authentication Required.F)�
send_response� send_headerr& r' r7 � end_headers�wfile�write)r r r r r
�_return_auth_challenge� s z(DigestAuthHandler._return_auth_challengec C s� t | j�dkrdS d|jkr&| j|�S | j|jd �}|d | jkrT| j|d }n
| j|�S |jd�| jkrx| j|�S | jj|d � d}x*|j|j gD ]}| j
|||j |�r�d}q�W |s�| j|�S dS dS )a Performs digest authentication on the given HTTP request
handler. Returns True if authentication was successful, False
otherwise.
If no users have been set, then digest auth is effectively
disabled and this method will always return True.
r TzProxy-AuthorizationZusernamer6 FN) �lenr% �headersrS rE �getr$ �remove�path�
short_pathrM Zcommand)r r rA rF Zauth_validatedrX r r r
r � s,
z DigestAuthHandler.handle_requestN)
r r r r r r( r, r- r7 rE rM rS r r r r r
r! Q s r! c @ sf e Zd ZdZdZdZdZdeef Zej ej
d��j d�Z dd� Z
d d
� Zd d � Zd
d� Zdd� ZdS )�BasicAuthHandlerz,Handler for performing basic authentication.�testUser�testPass�Testz%s:%sr/ c O s t jjj| f|�|� d S )N)r r �BaseHTTPRequestHandlerr )r �args�kwargsr r r
r � s zBasicAuthHandler.__init__c G s d S )Nr )r �formatr_ r r r
� log_message� s z BasicAuthHandler.log_messagec C s" | j d� | jdd� | j� d S )N�� z Content-typez text/html)rN rO rP )r r r r
�do_HEAD� s
zBasicAuthHandler.do_HEADc C s4 | j d� | jdd| j � | jdd� | j� d S )Ni� zWWW-AuthenticatezBasic realm="%s"z Content-typez text/html)rN rO �REALMrP )r r r r
� do_AUTHHEAD� s
z BasicAuthHandler.do_AUTHHEADc C sh | j jdd�s$| j� | jjd� n@| j jdd�d| j kr\| jd� | j� | jjd� n| j� d S )NZ
Authorization� s No Auth header receivedzBasic rc s It works)rU rV rf rQ rR � ENCODED_AUTHrN rP )r r r r
�do_GET� s
zBasicAuthHandler.do_GETN)r r r r �USER�PASSWDre Z USER_PASSWD�base64Z b64encoder3 �decoderh r rb rd rf ri r r r r
rZ � s rZ c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �FakeProxyHandlerz�This is a 'fake proxy' that makes it look like the entire
internet has gone down due to a sudden zombie invasion. It main
utility is in providing us with authentication support for
testing.
c O s || _ tjjj| f|�|� d S )N)�digest_auth_handlerr r r^ r )r ro r_ r` r r r
r � s zFakeProxyHandler.__init__c G s d S )Nr )r ra r_ r r r
rb s z FakeProxyHandler.log_messagec C sv t jj| jd�\}}}}}}|| _| jj| �rr| jdd� | jdd� | j � | j
j t d| j d�� | j
j d� d S ) Nr rc ZOKz Content-Typez text/htmlzYou've reached %s!<BR>r/ sF Our apologies, but our server is down due to a sudden zombie invasion.)
�urllib�parseZurlparserX rY ro r rN rO rP rQ rR �bytes)r ZscmZnetlocrX ZparamsZqueryZfragmentr r r
ri s zFakeProxyHandler.do_GETN)r r r r r rb ri r r r r
rn � s rn z!Threading required for this test.c sP e Zd ZdZdZdZdZ� fdd�Zdd� Z� fd d
�Z d d � Z
d
d� Z � Z S )�BasicAuthTestsr[ r\ Z Incorrectr] c sT t t| �j� dd� }t|�| _| j| j� d| jj | _| jj � | jj
j � d S )Nc _ s
t | |�S )N)rZ )r_ r` r r r
�#http_server_with_basic_auth_handler! s zABasicAuthTests.setUp.<locals>.http_server_with_basic_auth_handlerzhttp://127.0.0.1:%s) �superrs �setUpr r �
addCleanup� stop_serverr �
server_url�startr �wait)r rt )� __class__r r
rv s
zBasicAuthTests.setUpc C s | j j� d | _ d S )N)r r )r r r r
rx ) s
zBasicAuthTests.stop_serverc s t t| �j� d S )N)ru rs �tearDown)r )r| r r
r} - s zBasicAuthTests.tearDownc C s| t jj� }|j| j| j| j| j� t jjt jj |�� y| j
t jj | j�� W n( t j j
k
rv | jd| j � Y nX d S )Nz!Basic auth failed for the url: %s)rp r �HTTPBasicAuthHandler� add_passwordre ry rj rk �install_opener� build_opener�
assertTrue�urlopen�error� HTTPError�fail)r �ahr r r
�test_basic_auth_success0 s
z&BasicAuthTests.test_basic_auth_successc C sR t jj� }|j| j| j| j| j� t jjt jj |�� | j
t j j t jj
| j� d S )N)rp r r~ r re ry rj �INCORRECT_PASSWDr� r� � assertRaisesr� r� r� )r r� r r r
�test_basic_auth_httperror9 s
z(BasicAuthTests.test_basic_auth_httperror)
r r r rj rk r� re rv rx r} r� r� �
__classcell__r r )r| r
rs s rs c sT e Zd ZdZdZdZdZ� fdd�Zdd� Zd d
� Z d d � Z
d
d� Z dd� Z � Z
S )�ProxyAuthTestszhttp://localhostZtesterZtest123Z TestRealmc s� t t� �j� dd� }� j|tjj� � dtjd< dtjd< t� � _� jj � j
� j i� � jj � j
� � fdd�}t|�� _� j� j� � jj� � jjj� d� jj }tjjd |i�}tjj� � _tjj|� j�� _d S )
Nc S s t jj� t jj| � d S )N)�os�environ�clearrL )� old_environr r r
�restore_environK s
z-ProxyAuthTests.setUp.<locals>.restore_environrg �NO_PROXY�no_proxyc s t � jf| �|�S )N)rn ro )r_ r` )r r r
�create_fake_proxy_handlerV s z7ProxyAuthTests.setUp.<locals>.create_fake_proxy_handlerzhttp://127.0.0.1:%dr ) ru r� rv rw r� r� �copyr! ro r, rj rk r- re r r rx rz r r{ r rp r Z ProxyHandlerZProxyDigestAuthHandler�proxy_digest_handlerr� �opener)r r� r� Z proxy_url�handler)r| )r r
rv H s$
zProxyAuthTests.setUpc C s | j j� d | _ d S )N)r r )r r r r
rx c s
zProxyAuthTests.stop_serverc C sF | j j| j| j| j| jd � | jjd� | jt j
j | j j
| j� d S )NZbadr" )r� r re �URLrj rk ro r( r� rp r� r� r� �open)r r r r
�-test_proxy_with_bad_password_raises_httperrorg s
z<ProxyAuthTests.test_proxy_with_bad_password_raises_httperrorc C s( | j jd� | jtjj| jj| j� d S )Nr" ) ro r( r� rp r� r� r� r� r� )r r r r
�,test_proxy_with_no_password_raises_httperroro s
z;ProxyAuthTests.test_proxy_with_no_password_raises_httperrorc C sN | j j| j| j| j| j� | jjd� | jj | j�}x |j
� r@q6W |j � d S )Nr" ) r� r re r� rj rk ro r( r� r� �read�close)r �resultr r r
�test_proxy_qop_auth_worksu s
z(ProxyAuthTests.test_proxy_qop_auth_worksc C st | j j| j| j| j| j� | jjd� y| jj | j�}W n t
j j k
rT d }Y nX |rpx |j
� rfq\W |j� d S )Nzauth-int)r� r re r� rj rk ro r( r� r� rp r� �URLErrorr� r� )r r� r r r
�0test_proxy_qop_auth_int_works_or_throws_urlerror~ s
z?ProxyAuthTests.test_proxy_qop_auth_int_works_or_throws_urlerror)r r r r� rj rk re rv rx r� r� r� r� r� r r )r| r
r� @ s r� c s G � �fdd�dt jj�� � S )Nc sB e Zd ZdZg Zg ZdZdd� Zdd� Z� �fdd�Z d d
� Z
d S ) z1GetRequestHandler.<locals>.FakeHTTPRequestHandlerz TestHTTP/�P c S s. | j � }x |r(| jj|�}||d � }q
W d S )N)� send_headrQ rR )r �body�doner r r
ri � s z8GetRequestHandler.<locals>.FakeHTTPRequestHandler.do_GETc S s2 | j d }| jjt|��}| j� | jj|� d S )NzContent-Length)rU Zrfiler� �intri �requestsr5 )r Zcontent_lengthZ post_datar r r
�do_POST� s
z9GetRequestHandler.<locals>.FakeHTTPRequestHandler.do_POSTc s� | j � _| jj| j� �jd�\}}}| j|� x&|D ] \}}| j||d| ji � q6W |rt| jdd� | j � |S | j � d S )Nr r z Content-typez
text/plain)
rU �headers_receivedr� r5 rX �poprN rO r rP )r Z
response_coderU r� �headerrD )�FakeHTTPRequestHandler� responsesr r
r� � s
z;GetRequestHandler.<locals>.FakeHTTPRequestHandler.send_headc W s d S )Nr )r r_ r r r
rb � s z=GetRequestHandler.<locals>.FakeHTTPRequestHandler.log_messageN) r r r Zserver_versionr� r� r ri r� r� rb r )r� r� r r
r� � s r� )r r r^ )r� r )r� r� r
�GetRequestHandler� s &r� c s� e Zd ZdZ� fdd�Zd+dd�Zdd� Zd,d d
�Zd-d d �Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Z� ZS ).� TestUrlopenaN Tests urllib.request.urlopen using the network.
These tests are not exhaustive. Assuming that testing using files does a
good job overall of some of the basic interface features. There are no
tests exercising the optional 'data' and 'proxies' arguments. No tests
for transparent redirection have been written.
c s@ t t| �j� dd� }| j|tjj� � dtjd< dtjd< d S )Nc S s t jj� t jj| � d S )N)r� r� r� rL )r� r r r
r� � s
z*TestUrlopen.setUp.<locals>.restore_environ�*r� r� )ru r� rv rw r� r� r� )r r� )r| r r
rv � s
zTestUrlopen.setUpNc
K sl g }t jj||f|�}z@|j|jd�� |j|j� � |j|jd�� |j|j� � W d |j� X dj |�S )Nrc i � )
rp r r� �extend� readlinesr5 �readliner� r� r )r �url�datar` �l�fr r r
r� � s
zTestUrlopen.urlopenc C s | j j� d | _ d S )N)r r )r r r r
rx � s
zTestUrlopen.stop_serverc C sZ |d krdg dfg}t |�}t|�| _| j| j� | jj� | jjj� | jj}||_|S )Nrc s
we don't care) r� r r rw rx rz r r{ r )r r� r� r r r r
� start_server� s
zTestUrlopen.start_serverc K s^ t tjd�s| jd� ddlm} |d kr6dg dfg}t|�}|| fd|i|��}|j|_|S )NZ HTTPSHandlerzssl support requiredr )�make_https_serverrc s
we care a bitZ
handler_class)�hasattrrp r �skipTestZtest.ssl_serversr� r� r )r r� r` r� r� r r r r
�start_https_server� s
z TestUrlopen.start_https_serverc C sV d}dd
gdfdg |fg}| j |�}| jd|j �}| j||� | j|jdd g� d S ) Ns We got here...i. �Location�(http://localhost:%(port)s/somewhere_elserg rc zhttp://localhost:%s/�/z/somewhere_else)r� r� )r� r� r � assertEqualr� )r �expected_responser� r� r� r r r
�test_redirection� s
z TestUrlopen.test_redirectionc C s@ d}d}ddg|fg}| j |�}| jd|j �}| j||� d S )Ns hello worlds a
hello worl
1
d
0
rc �Transfer-Encoding�chunkedzhttp://localhost:%s/)r� r� )r� r� r r� )r r� Z
chunked_startrK r� r� r r r
� test_chunked s
zTestUrlopen.test_chunkedc C s� d}| j dg |fg�}y| jd|j � W n6 tjjk
r` } z|j� }|j� W Y d d }~X n X | jd� | j ||� | j |j
dg� d S )Ns Bad bad bad...i� zhttp://localhost:%s/weeblez404 should raise URLErrorz/weeble) r� r� r rp r� r� r� r� r� r� r� )r r� r� r� r� r r r
�test_404 s
zTestUrlopen.test_404c C sF d}| j dg |fg�}| jd|j �}| j||� | j|jdg� d S )Ns
pycon 2008...rc zhttp://localhost:%s/bizarrez/bizarre)r� r� r r� r� )r r� r� r� r r r
�test_200" s
zTestUrlopen.test_200c C sJ d}| j dg |fg�}| jd|j d�}| j||� | j|jddg� d S )Ns
pycon 2008...rc zhttp://localhost:%s/bizarres get=with_feelingz/bizarre)r� r� r r� r� )r r� r� r� r r r
�test_200_with_parameters) s z$TestUrlopen.test_200_with_parametersc C s8 | j � }tjtd�}| jd|j |d�}| j|d� d S )N)�cafilez https://localhost:%s/bizarre)�contexts
we care a bit)r� �ssl�create_default_context�CERT_localhostr� r r� )r r� r� r� r r r
�
test_https1 s zTestUrlopen.test_httpsc C s� | j td�}tjdtf��� | jd|j td�}| j|d� | jt j
j ��}| jd|j t d� W d Q R X | j t d�}| jt
j��}| jd|j t d� W d Q R X W d Q R X d S )N)�certfilerg z https://localhost:%s/bizarre)r� s
we care a bit)r� r� r �check_warnings�DeprecationWarningr� r r� r� rp r� r� �CERT_fakehostnamer� ZCertificateError)r r� r� �cmr r r
�test_https_with_cafile7 s z"TestUrlopen.test_https_with_cafilec C sX | j td�}tjdtf��4 | jtjj��}| j d|j
dd� W d Q R X W d Q R X d S )N)r� rg z https://localhost:%s/bizarreT)Z cadefault) r� r� r r� r� r� rp r� r� r� r )r r� r� r r r
�test_https_with_cadefaultH s
z%TestUrlopen.test_https_with_cadefaultc s� t d kr| jd� t js"| jd� d � � fdd�}t jt j�}|j|� | j|td�}t jtd�}| j d|j
|d� | j � d � d S )
Nzssl module requiredz SNI support required in OpenSSLc s |� d S )Nr )Zssl_sockZ server_nameZinitial_context)�sni_namer r
�cb_sniV s z*TestUrlopen.test_https_sni.<locals>.cb_sni)r� r� )r� zhttps://localhost:%s)r� Z localhost) r� r� ZHAS_SNIZ
SSLContextZ PROTOCOL_TLSZset_servername_callbackr� r� r� r� r r� )r r� r� r� r )r� r
�test_https_sniP s
zTestUrlopen.test_https_snic
C sP | j � }tjjd|j ddid�}tjj|�� W d Q R X | j|jd d� d S )Nzhttp://localhost:%s/ZRangez bytes=20-39)rU )r� rp r ZRequestr r� r� r� )r r� Zreqr r r
�test_sending_headers` s
z TestUrlopen.test_sending_headersc
C sb | j � }tjjd|j �}x"dD ]}| jt||�d| � q W z| j|j� d� W d |j� X d S ) Nzhttp://localhost:%sr� r� �info�geturlz3object returned from urlopen lacks the %s attributezcalling 'read' failed)r� r� r� r� ) r� rp r r� r r� r� r� r� )r r� �open_url�attrr r r
�
test_basich s
zTestUrlopen.test_basicc C sX | j � }tjjd|j �}|� |j� }W d Q R X | j|tjj d� | j
|j � d� d S )Nzhttp://localhost:%szEobject returned by 'info' is not an instance of email.message.MessageZplain) r� rp r r� r r� ZassertIsInstance�email�messageZMessager� Zget_content_subtype)r r� r� Zinfo_objr r r
� test_infos s zTestUrlopen.test_infoc C sH | j � }tjjd|j �}|� |j� }W d Q R X | j|d|j � d S )Nzhttp://localhost:%s)r� rp r r� r r� r� )r r� r� r� r r r
� test_geturl~ s
zTestUrlopen.test_geturlc C sF d}| j dg |fg�}tjjd|j �}x|D ]}| j||� q.W d S )Ns
pycon 2008...rc zhttp://localhost:%s)r� rp r r� r r� )r r� r� r� �liner r r
�test_iteration� s
zTestUrlopen.test_iterationc C s� ddddd d g}dj |�}| jdg |fg�}tjjd |j �}x<t|�D ]0\}}| j||| d
|t|| �t|�f � qLW | j|d t|�� d S ) Ns We
s got
s here
s verylong i �
r� rc zhttp://localhost:%szQFetched line number %s doesn't match expected:
Expected length was %s, got %sr. ) r r� rp r r� r � enumerater� rT )r �linesr� r� r� �indexr� r r r
�test_line_iteration� s
z TestUrlopen.test_line_iteration)N)N)N)r r r r rv r� rx r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r )r| r
r� � s*
r� c C s t j� ad S )N)r Zthreading_setup� threads_keyr r r r
� setUpModule� s r� c C s t rtjt � d S )N)r� r Zthreading_cleanupr r r r
�tearDownModule� s r� �__main__)+rl r� r� Z urllib.parserp Zurllib.requestZ http.serverr Zunittestr0 Ztestr �
import_moduler r� � ImportErrorrX �dirname�__file__�herer r� r� r r r r r r! r^ rZ rn Z
skipUnlessZTestCasers r� r� r� r� r� r� r �mainr r r r
�<module> sD
y,!
(
N+
`