Your IP : 216.73.216.213
�
g f� � @ s� d Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l m Z d d l
m Z d d l Z d d l Z d d l Z d d l Z d d l m Z m Z d d l m Z d d l Z d d � Z d a d d d d
� Z d d � Z Gd
d � d e � Z Gd d � d e � Z Gd d � d e
j � Z! Gd d � d e
j � Z" Gd d � d e
j e e � Z# Gd d � d e
j � Z$ Gd d � d e
j � Z% Gd d � d e
j e � Z& Gd d � d e
j � Z' Gd d � d e
j � Z( Gd! d" � d" e
j � Z) Gd# d$ � d$ e
j � Z* Gd% d& � d& e
j � Z+ Gd' d( � d( e
j � Z, Gd) d* � d* e
j � Z- Gd+ d, � d, e
j � Z. Gd- d. � d. e
j � Z/ e0 d/ k r�e
j1 � n d S)0z Regresssion tests for urllib� N)�patch)�support)� url2pathname� pathname2url)� b64encodec C sI t t | � � d d � j � } t | � d k rA d | } n d | S)z!Escape char as RFC 2396 specifies� N� z0%s�%)�hex�ord�upper�len)�charZhex_repr� r �5/opt/alt/python34/lib64/python3.4/test/test_urllib.py� hexescape s "
r c C s� | d k r$ t j j d | � } n@ t s^ t j d t f � � t j j � } Wd QX| a n t } | d k r} | j | � S| j | | � Sd S)z.urlopen(url [, data]) -> open file-like objectN�proxiesz8FancyURLopener style of invoking requests is deprecated.)�urllib�requestZFancyURLopener�
_urlopenerr �check_warnings�DeprecationWarning�open)�url�datar Zopenerr r r �urlopen! s
r c sH G� f d d � d t j � � G� � f d d � d t j j � � � S)Nc s^ e Z d Z d Z � f d d � Z d d � Z d d d � Z d d d
� Z d d � Z d S)
z fakehttp.<locals>.FakeSocketr c s
| � _ d S)N)�buf)�selfr )�FakeHTTPConnectionr r �sendall8 s z$fakehttp.<locals>.FakeSocket.sendallc _ s | j d 7_ | S)Nr )�io_refs)r �args�kwdsr r r �makefile; s z%fakehttp.<locals>.FakeSocket.makefileNc S s | j r
d St j j | | � S)N� )�closed�io�BytesIO�read)r Zamtr r r r( ? s z!fakehttp.<locals>.FakeSocket.readc S s | j r
d St j j | | � S)Nr$ )r% r& r' �readline)r Zlengthr r r r) D s z%fakehttp.<locals>.FakeSocket.readlinec S s5 | j d 8_ | j d k r1 t j j | � n d S)Nr r )r r& r' �close)r r r r r* I s z"fakehttp.<locals>.FakeSocket.close) �__name__�
__module__� __qualname__r r r# r( r) r* r )r r r �
FakeSocket5 s r. c s. e Z d Z d Z � � � Z d d � Z d S)z$fakehttp.<locals>.FakeHTTPConnectionNc S s | j | _ d S)N)�fakesockZsock)r r r r �connectT s z,fakehttp.<locals>.FakeHTTPConnection.connect)r+ r, r- r r/ r0 r )r. �fakedatar r r N s r )r& r' �http�client�HTTPConnection)r1 r )r r. r1 r �fakehttp4 s % r5 c @ s( e Z d Z d d � Z d d � Z d S)�
FakeHTTPMixinc C s% t j j | _ t | � t j _ d S)N)r2 r3 r4 �_connection_classr5 )r r1 r r r r5 [ s zFakeHTTPMixin.fakehttpc C s | j t j _ d S)N)r7 r2 r3 r4 )r r r r �
unfakehttp_ s zFakeHTTPMixin.unfakehttpN)r+ r, r- r5 r8 r r r r r6 Z s r6 c @ s( e Z d Z d d � Z d d � Z d S)� FakeFTPMixinc C s5 Gd d � d t � } t j j | _ | t j _ d S)Nc @ s: e Z d Z d d d d � Z d d � Z d d � Z d S) z,FakeFTPMixin.fakeftp.<locals>.FakeFtpWrapperNTc S s d S)Nr )r �userZpasswd�hostZport�dirsZtimeoutZ
persistentr r r �__init__f s z5FakeFTPMixin.fakeftp.<locals>.FakeFtpWrapper.__init__c S s t j � d f S)Nr )r& r' )r �file�typer r r �retrfilej s z5FakeFTPMixin.fakeftp.<locals>.FakeFtpWrapper.retrfilec S s d S)Nr )r r r r r* m s z2FakeFTPMixin.fakeftp.<locals>.FakeFtpWrapper.close)r+ r, r- r= r@ r* r r r r �FakeFtpWrappere s rA )�objectr r �
ftpwrapper�_ftpwrapper_class)r rA r r r �fakeftpd s zFakeFTPMixin.fakeftpc C s | j t j _ d S)N)rD r r rC )r r r r � unfakeftps s zFakeFTPMixin.unfakeftpN)r+ r, r- rE rF r r r r r9 c s r9 c @ s� e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d d � Z d d � Z d S) �urlopen_FileTestsz�Test urlopen() opening a temporary file.
Try to test as much functionality as possible so as to cut down on reliance
on connecting to the Net for testing.
c C sv t d | j j d � | _ t t j d � } z | j | j � Wd | j � Xt j | _ t
d | j � | _ d S)Nztest_urllib: %s
�ascii�wbzfile:%s) �bytes� __class__r+ �textr r �TESTFN�writer* �pathnamer � returned_obj)r �fr r r �setUp s zurlopen_FileTests.setUpc C s! | j j � t j t j � d S)zShut down the open objectN)rP r* �os�remover rM )r r r r �tearDown� s
zurlopen_FileTests.tearDownc C s5 x. d D]& } | j t | j | � d
| � q Wd S) Nr( r) � readlines�filenor* �info�geturl�getcode�__iter__z/object returned by urlopen() lacks %s attribute) zreadzreadlinez readlineszfilenozclosezinfozgeturlzgetcodez__iter__)�
assertTrue�hasattrrP )r �attrr r r �test_interface� s
z urlopen_FileTests.test_interfacec C s | j | j | j j � � d S)N)� assertEqualrL rP r( )r r r r � test_read� s zurlopen_FileTests.test_readc C s< | j | j | j j � � | j d | j j � d � d S)Nr$ zKcalling readline() after exhausting the file did not return an empty string)r` rL rP r) )r r r r �
test_readline� s z urlopen_FileTests.test_readlinec C sF | j j � } | j t | � d d � | j | d | j d � d S)Nr z.readlines() returned the wrong number of linesr z"readlines() returned improper text)rP rV r` r
rL )r Z
lines_listr r r �test_readlines� s
z urlopen_FileTests.test_readlinesc C sQ | j j � } | j | t d � | j t j | t | j � � | j d � d S)Nz fileno() did not return an intzTReading on the file descriptor returned by fileno() did not return the expected text) rP rW �assertIsInstance�intr` rS r( r
rL )r Zfile_numr r r � test_fileno� s $z urlopen_FileTests.test_filenoc C s | j j � d S)N)rP r* )r r r r �
test_close� s z urlopen_FileTests.test_closec C s# | j | j j � t j j � d S)N)rd rP rX �email�message�Message)r r r r � test_info� s zurlopen_FileTests.test_infoc C s | j | j j � | j � d S)N)r` rP rY rO )r r r r � test_geturl� s z urlopen_FileTests.test_geturlc C s | j | j j � � d S)N)Z assertIsNonerP rZ )r r r r � test_getcode� s z urlopen_FileTests.test_getcodec C s+ x$ | j D] } | j | | j � q
Wd S)N)rP r` rL )r �liner r r � test_iter� s zurlopen_FileTests.test_iterc C s$ | j t t j j d | j � d S)Nz./)� assertRaises�
ValueErrorr r r rO )r r r r �test_relativelocalfile� s z(urlopen_FileTests.test_relativelocalfileN)r+ r, r- �__doc__rR rU r_ ra rb rc rf rg rk rl rm ro rr r r r r rG w s rG c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S)
�
ProxyTestsc C sR t j � | _ x< t t j � D]+ } d | j � k r | j j | � q q Wd S)N�proxy)r ZEnvironmentVarGuard�env�listrS �environ�lower�unset)r �kr r r rR � s zProxyTests.setUpc C s | j j � | ` d S)N)rv �__exit__)r r r r rU � s
zProxyTests.tearDownc C sf | j j d d � t j j � } | j d | d � | j j d d � | j t j j d � � d S)NZNO_PROXY� localhost�noz+localhost, anotherdomain.com, newdomain.comzanotherdomain.com)rv �setr r �getproxies_environmentr` r\ Zproxy_bypass_environment)r r r r r �+test_getproxies_environment_keep_no_proxies� s
z6ProxyTests.test_getproxies_environment_keep_no_proxiesc C s� zl | j j d d � t j j � } | j d | d � | j j d d � t j j � } | j d | � Wd | j j d � | j j d � Xd S)NZ
HTTP_PROXYzhttp://somewhere:3128r2 ZREQUEST_METHOD�GET)rv r r r r� r` Z assertNotInrz )r r r r r �test_proxy_cgi_ignore� s z ProxyTests.test_proxy_cgi_ignoreN)r+ r, r- rR rU r� r� r r r r rt � s rt c @ s e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d d � Z d d � Z e j e j d d � d d � � Z d d! � Z d" d# � Z d$ d% � Z d& d' � Z d( S))�urlopen_HttpTestsz.Test urlopen() opening a fake http connection.c
C s� | j d | d � zh t d � } | j | j � d � | j | j � d � | j | j � d � | j | j � d � Wd | j � Xd S)Ns HTTP/s 200 OK
Hello!zhttp://python.org/s Hello!r$ �� )r5 r r` r) rY rZ r8 )r Zver�fpr r r �
check_read� s z urlopen_HttpTests.check_readc
C sQ d } | j d � z, t j j | � } | j | j � | � Wd | j � Xd S)Nz-http://docs.python.org/library/urllib.html#OKs HTTP/1.1 200 OK
Hello!)r5 r r r r` rY r8 )r r r� r r r �test_url_fragment� s
z#urlopen_HttpTests.test_url_fragmentc
C sB | j d � z# t d � } | j | j j � Wd | j � Xd S)Ns HTTP/1.1 200 OK
Hello!zhttp://www.python.org)r5 r r\ r� Z
will_closer8 )r Zrespr r r �test_willclose s
z urlopen_HttpTests.test_willclosec C s | j d � d S)Ns 0.9)r� )r r r r �
test_read_0_9 s z urlopen_HttpTests.test_read_0_9c C s | j d � d S)Ns 1.0)r� )r r r r �
test_read_1_0 s z urlopen_HttpTests.test_read_1_0c C s | j d � d S)Ns 1.1)r� )r r r r �
test_read_1_1 s z urlopen_HttpTests.test_read_1_1c
C s6 | j d � z | j t t d � Wd | j � Xd S)Ns� HTTP/1.1 401 Authentication Required
Date: Wed, 02 Jan 2008 03:03:54 GMT
Server: Apache/1.3.33 (Debian GNU/Linux) mod_ssl/2.8.22 OpenSSL/0.9.7e
Connection: close
Content-Type: text/html; charset=iso-8859-1
zhttp://python.org/)r5 rp �OSErrorr r8 )r r r r �test_read_bogus s
z!urlopen_HttpTests.test_read_bogusc
C s< | j d � z | j t j j t d � Wd | j � Xd S)Ns� HTTP/1.1 302 Found
Date: Wed, 02 Jan 2008 03:03:54 GMT
Server: Apache/1.3.33 (Debian GNU/Linux) mod_ssl/2.8.22 OpenSSL/0.9.7e
Location: file://guidocomputer.athome.com:/python/license
Connection: close
Content-Type: text/html; charset=iso-8859-1
zhttp://python.org/)r5 rp r �errorZ HTTPErrorr r8 )r r r r �test_invalid_redirect& s z'urlopen_HttpTests.test_invalid_redirectc
C s6 | j d � z | j t t d � Wd | j � Xd S)Nr$ zhttp://something)r5 rp r� r r8 )r r r r �test_empty_socket5 s
z#urlopen_HttpTests.test_empty_socketc C sR | j t j j � � } t d � Wd QX| j | j j � | j | j j � d S)Nz/file://localhost/a/file/which/doesnot/exists.py) rp r r� �URLErrorr r\ � exception�filename�reason)r �er r r �test_missing_localfile> s z(urlopen_HttpTests.test_missing_localfilec C s� t j � \ } } d | j t j j d � } z? | j t j j | � � t | � � } | j | � Wd QXWd t j | � t j
| � X| j t j j | � � | j t
j j � � t | � Wd QXd S)Nzfile://localhost/�/)�tempfile�mkstemp�replacerS �path�sepr\ �existsr r* �unlink� assertFalserp r r� r� )r �fdZtmp_fileZ tmp_fileurlZfobjr r r �test_file_notexistsE s
z%urlopen_HttpTests.test_file_notexistsc C sX d } | j t j j � � } t | � Wd QX| j | j j � | j | j j � d S)Nz ftp:///path)
rp r r� r� r r� r� r� r\ r� )r Z test_ftp_urlr� r r r �test_ftp_nohostS s
z!urlopen_HttpTests.test_ftp_nohostc C sR | j t j j � � } t d � Wd QX| j | j j � | j | j j � d S)Nz.ftp://localhost/a/file/which/doesnot/exists.py)
rp r r� r� r r� r� r� r\ r� )r r� r r r �test_ftp_nonexistingZ s z&urlopen_HttpTests.test_ftp_nonexistingZ MAXFTPCACHEr c C sR | j � z6 t j j d d d d g � t j j d <t d � Wd | j � Xd S)Nr: �passr} � �testzftp://localhost)rE r r rC Zftpcacher rF )r r r r �test_ftp_cache_pruning` s
(z(urlopen_HttpTests.test_ftp_cache_pruningc
C s� | j d � zh t d � } | j | j � d � | j | j � d � | j | j � d � | j | j � d � Wd | j � Xd S)Ns HTTP/1.0 200 OK
Hello!z http://user:pass@python.org/s Hello!r$ r� )r5 r r` r) rY rZ r8 )r r� r r r �test_userpass_inurlj s
z%urlopen_HttpTests.test_userpass_inurlc
C s� | j d � z� d } d j | � } t j j } d t | j d � � j d � } t | � } | j | | j
j d � � | j | j � d � | j | j � d � | j
| j � | � | j | j � d � Wd | j � Xd S)
Ns HTTP/1.0 200 OK
Hello!za b:c dzhttp://{}@python.org/zAuthorization: Basic %s
�ASCIIzUTF-8s Hello!r$ r� )r5 �formatr2 r3 r4 r �encode�decoder �assertInr r` r) ZassertNotEqualrY rZ r8 )r Zuserpassr Zfakehttp_wrapperZ
authorizationr� r r r � test_userpass_inurl_w_spacesu s
z.urlopen_HttpTests.test_userpass_inurl_w_spacesc C s- t j d t f � � t j j � Wd QXd S)N� )r r r r r � URLopener)r r r r �test_URLopener_deprecation� s z,urlopen_HttpTests.test_URLopener_deprecationc
C sB t j � } | j t � �! t j j d d d d | �Wd QXd S)Nzhttps://localhostZcafilez/nonexistent/path�context)�sslZcreate_default_contextrp rq r r r )r r� r r r �test_cafile_and_context� s z)urlopen_HttpTests.test_cafile_and_contextN)r+ r, r- rs r� r� r� r� r� r� r� r� r� r� r� r� r� r rB r r r� r� r� r� r� r r r r r� � s&
$
r� c @ s� e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d S)�urlopen_DataTestsz"Test urlopen() opening a data URL.c C sy d | _ d | _ d | _ d | _ d | _ t j j | j � | _ t j j | j � | _ t j j | j � | _
d S)Nu test data URLs :;,%=& ö Ä sU �PNG
IHDR {@�� sRGB �� � IDAT�c```���? �
o/ IEND�B`�zZdata:text/plain;charset=UTF-8,test%20data%20URLs%20%3A%3B%2C%25%3D%26%20%C3%B6%20%C3%84%20zPdata:text/plain;charset=ISO-8859-1;base64,dGVzdCBkYXRhIFVSTHMgOjssJT0mIPYgxCA%3Dz�data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAIAAAABCAIAAAB7
QOjdAAAAAXNSR0IArs4c6QAAAA9JREFUCNdj%0AYGBg%2BP//PwAGAQL%2BCm8 vHgAAAABJRU5ErkJggg%3D%3D%0A%20) rL �image�text_url�text_url_base64� image_urlr r r �
text_url_resp�text_url_base64_resp�image_url_resp)r r r r rR � s zurlopen_DataTests.setUpc C s5 x. d
D]& } | j t | j | � d | � q Wd S) Nr( r) rV r* rX rY rZ r[ z/object returned by urlopen() lacks %s attribute)zreadzreadlinez readlineszclosezinfozgeturlzgetcodez__iter__)r\ r] r� )r r^ r r r r_ � s
z urlopen_DataTests.test_interfacec C s� | j | j j � t j j � | j | j j � j � d d g � | j | j j � d t
t | j � � � | j t
j j d � j � j � d
d g � d S) N�
text/plainr� �charset�
ISO-8859-1zcontent-lengthzdata:,�US-ASCII)r� r� )�charsetr� )r� r� )r� r� )rd r� rX rh ri rj r` r� �
get_paramsr� �strr
r� r r r )r r r r rk � s
!zurlopen_DataTests.test_infoc C sX | j | j j � | j � | j | j j � | j � | j | j j � | j � d S)N)r` r� rY r� r� r� r� r� )r r r r rl � s
z urlopen_DataTests.test_geturlc C sB | j | j j � j t | j j � j � � d � | j � d S)Nr� )r` r� r( r� �dictrX r� rL )r r r r �test_read_text� s z urlopen_DataTests.test_read_textc C sB | j | j j � j t | j j � j � � d � | j � d S)Nr� )r` r� r( r� r� rX r� rL )r r r r �test_read_text_base64� s z'urlopen_DataTests.test_read_text_base64c C s | j | j j � | j � d S)N)r` r� r( r� )r r r r �test_read_image� s z!urlopen_DataTests.test_read_imagec C s | j t t j j d � d S)Nzdata:text/plain)rp rq r r r )r r r r �test_missing_comma� s z$urlopen_DataTests.test_missing_commac C s | j t t j j d � d S)Nzdata:;base64,Cg=)rp rq r r r )r r r r �test_invalid_base64_data� s z*urlopen_DataTests.test_invalid_base64_dataN)
r+ r, r- rs rR r_ rk rl r� r� r� r� r� r r r r r� � s r� c @ s� e Z d Z d Z d d � Z d d � Z d d � Z d d d
� Z d d � Z d
d � Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d S)�urlretrieve_FileTestsz(Test urllib.urlretrieve() on local filesc C ss g | _ | j t j � d | _ z0 t t j d � } | j | j � | j � Wd y | j � Wn Yn XXd S)Ns testing urllib.urlretrieverI )� tempFiles�registerFileForCleanUpr rM rL r rN r* )r �FILEr r r rR � s zurlretrieve_FileTests.setUpc
C s4 x- | j D]" } y t j | � Wq
Yq
Xq
Wd S)N)r� rS rT )r Zeachr r r rU � s
z urlretrieve_FileTests.tearDownc C s[ t j j | � } y | j d � Wn! t k
rF t j d � � Yn Xd t j j | � S)Nzutf-8z!filePath is not encodable to utf8z file://%s)
rS r� �abspathr� �UnicodeEncodeError�unittestZSkipTestr r r )r ZfilePathr r r �constructLocalFileUrl� s
z+urlretrieve_FileTests.constructLocalFileUrlr$ c C sm t j � \ } } z: | j | � t j | d � } | j | � | j � Wd y | j � Wn Yn XX| S)z�Creates a new temporary file containing the specified data,
registers the file for deletion during the test fixture tear down, and
returns the absolute path of the file.rI N)r� r� r� rS �fdopenrN r* )r r ZnewFdZ newFilePathZnewFiler r r �createNewTempFile s
z'urlretrieve_FileTests.createNewTempFilec C s | j j | � d S)N)r� �append)r ZfileNamer r r r� s z,urlretrieve_FileTests.registerFileForCleanUpc C sQ t j j d t j � } | j | d t j � | j | d t j j d � d S)Nzfile:%sr r zFdid not get an email.message.Message instance as second returned value)
r r � urlretriever rM r` rd rh ri rj )r �resultr r r �
test_basic s z urlretrieve_FileTests.test_basicc C s� d t j } | j | � t j j | j t j � | � } | j | | d � | j t j
j | � d � t | d � } z | j
� } | j � Wd y | j � Wn Yn XX| j | j | � d S)Nz%s.2r z copy of the file was not made�rb)r rM r� r r r� r� r` r\ rS r� r� r r( r* rL )r � second_tempr� r� rL r r r � test_copy s
z urlretrieve_FileTests.test_copyc sX d g � f d d � } d t j } � j | � t j j � j t j � | | � d S)Nr c sZ � j | t � � j | t � � j | t � � j | | d � | d d | d <d S)Nr r )rd re r` )� block_count�block_read_size� file_sizeZ count_holder)r r r �
hooktester2 s
z9urlretrieve_FileTests.test_reporthook.<locals>.hooktesterz%s.2)r rM r� r r r� r� )r r� r� r )r r �test_reporthook0 s
z%urlretrieve_FileTests.test_reporthookc C su g } | d d � } | j � } t j j | j | � t j | � | j t | � d � | j | d d d � d S)Nc S s | j | | | f � d S)N)r� )r� r� r� �_reportr r r r� A s zAurlretrieve_FileTests.test_reporthook_0_bytes.<locals>.hooktesterr r r ) r� r r r� r� r rM r` r
)r �reportr� � srcFileNamer r r �test_reporthook_0_bytes> s
z-urlretrieve_FileTests.test_reporthook_0_bytesc C s� g } | d d � } | j d � } t j j | j | � t j | � | j t | � d � | j | d d d � | j | d d d � d S) Nc S s | j | | | f � d S)N)r� )r� r� r� r� r r r r� N s zAurlretrieve_FileTests.test_reporthook_5_bytes.<locals>.hooktester� x� r r r s xxxxx) r� r r r� r� r rM r` r
)r r� r� r� r r r �test_reporthook_5_bytesI s
z-urlretrieve_FileTests.test_reporthook_5_bytesc C s� g } | d d � } | j d d � } t j j | j | � t j | � | j t | � d � | j | d d d � | j | d d d � | j | d d d � | j | d d d � d S)
Nc S s | j | | | f � d S)N)r� )r� r� r� r� r r r r� \ s zDurlretrieve_FileTests.test_reporthook_8193_bytes.<locals>.hooktesterr� i � r r r i ) r� r r r� r� r rM r` r
)r r� r� r� r r r �test_reporthook_8193_bytesW s
z0urlretrieve_FileTests.test_reporthook_8193_bytesN)r+ r, r- rs rR rU r� r� r� r� r� r� r� r� r� r r r r r� � s r� c @ s. e Z d Z d Z d d � Z d d � Z d S)�urlretrieve_HttpTestsz5Test urllib.urlretrieve() using fake http connectionsc C sa | j d � d d � } | j t j j � �- z t j j d d | �Wd | j � XWd QXd S)Ns� HTTP/1.1 200 OK
Date: Wed, 02 Jan 2008 03:03:54 GMT
Server: Apache/1.3.33 (Debian GNU/Linux) mod_ssl/2.8.22 OpenSSL/0.9.7e
Connection: close
Content-Length: 100
Content-Type: text/html; charset=iso-8859-1
FF
c S s d S)Nr )Zpar1Zpar2Zpar3r r r � _reporthookv s zYurlretrieve_HttpTests.test_short_content_raises_ContentTooShortError.<locals>._reporthookzhttp://example.com/Z
reporthook)r5 rp r r� �ContentTooShortErrorr r� r8 )r r� r r r �.test_short_content_raises_ContentTooShortErrork s zDurlretrieve_HttpTests.test_short_content_raises_ContentTooShortErrorc C sO | j d � | j t j j � �' z t j j d � Wd | j � XWd QXd S)Ns� HTTP/1.1 200 OK
Date: Wed, 02 Jan 2008 03:03:54 GMT
Server: Apache/1.3.33 (Debian GNU/Linux) mod_ssl/2.8.22 OpenSSL/0.9.7e
Connection: close
Content-Length: 100
Content-Type: text/html; charset=iso-8859-1
FF
zhttp://example.com/)r5 rp r r� r� r r� r8 )r r r r �Atest_short_content_raises_ContentTooShortError_without_reporthook� s zWurlretrieve_HttpTests.test_short_content_raises_ContentTooShortError_without_reporthookN)r+ r, r- rs r� r� r r r r r� h s r� c @ s� e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d S)� QuotingTestsau Tests for urllib.quote() and urllib.quote_plus()
According to RFC 2396 (Uniform Resource Identifiers), to escape a
character you write it as '%' + <2 character US-ASCII hex value>.
The Python code of ``'%' + hex(ord(<character>))[2:]`` escapes a
character properly. Case does not matter on the hex letters.
The various character sets specified are:
Reserved characters : ";/?:@&=+$,"
Have special meaning in URIs and must be escaped if not being used for
their special meaning
Data characters : letters, digits, and "-_.!~*'()"
Unreserved and do not need to be escaped; can be, though, if desired
Control characters : 0x00 - 0x1F, 0x7F
Have no use in URIs so must be escaped
space : 0x20
Must be escaped
Delimiters : '<>#%"'
Must be escaped
Unwise : "{}|\^[]`"
Must be escaped
c C s} d j d d d d g � } t j j | � } | j | | d | | f � t j j | � } | j | | d | | f � d S)Nr� ZABCDEFGHIJKLMNOPQRSTUVWXYZZabcdefghijklmnopqrstuvwxyz�
0123456789z_.-zusing quote(): %r != %rz using quote_plus(): %r != %r)�joinr �parse�quoter` �
quote_plus)r Z do_not_quoter� r r r �test_never_quote� s z QuotingTests.test_never_quotec C s! | j t j j j d d � d S)Nr r� )r` r r� r� � __defaults__)r r r r �test_default_safe� s z QuotingTests.test_default_safec C s[ d } t j j | d | �} | j | | d | | f � t j j | d | �} | j | | d | | f � t j j | d d �} | j | | d | | f � t j j d d d d d �} t j j d d d d d
�} | j | | d | | f � t j j d d d d d �} t j j d d d d d
�} | j | | d | | f � d S) Nz<>�safezusing quote(): %r != %rz using quote_plus(): %r != %rs <>u aüb�encodingzlatin-1� ür� s �)r r� r� r` r� )r Zquote_by_defaultr� �expectr r r � test_safe� s, zQuotingTests.test_safec C sF d d � t d � D� } | j d � | j t d � � d j | � } x� | D]� } t j j | � } | j t | � | d | t | � | f � t j j | � } | j t | � | d | t | � | f � qO W~ d } d
} t j j | � } | j | | d | | f � t j j | � } | j | | d | | f � d S)
Nc S s g | ] } t | � � q Sr )�chr)�.0�numr r r �
<listcomp>� s z5QuotingTests.test_default_quoting.<locals>.<listcomp>� z
<>#%"{}|\^[]`� r� z1using quote(): %s should be escaped to %s, not %sz6using quote_plus(): %s should be escapes to %s, not %szab[]cdz
ab%5B%5Dcdzusing quote(): %r != %rz using quote_plus(): %r != %r)
�ranger� r� r� r r� r� r` r r� )r Z should_quoter r� Z
partial_quote�expectedr r r �test_default_quoting� s,
z!QuotingTests.test_default_quotingc C s� t j j d � } | j | t d � d | t d � f � t j j d � } | j | d d | � d } | j d t d � � } t j j | � } | j | | d | | f � | j d d � } t j j | � } | j | | d | | f � d S)N� zusing quote(): %r != %r�+zusing quote_plus(): %r != +z
a b cd e fz using quote_plus(): %r != %r)r r� r� r` r r� r� )r r� �givenr� r r r �test_quoting_space� s z QuotingTests.test_quoting_spacec C sz | j t j j d � d � | j t j j d d � d � | j t j j d � d � | j t j j d d � d � d S)Nzalpha+beta gammazalpha%2Bbeta+gammar zalpha+beta+gammas alpha+beta gamma� +)r` r r� r� )r r r r �test_quoting_plus s z QuotingTests.test_quoting_plusc C s� d } d } t j j | � } | j | | d | | f � | j t t j j | d d �t j j | � } | j | | d | | f � d S)Ns ��ab�z %A2%D8ab%FFzusing quote(): %r != %rr� zlatin-1z"using quote_from_bytes(): %r != %r)r r� r� r` rp � TypeErrorZquote_from_bytes)r r r� r� r r r �test_quote_bytes s z QuotingTests.test_quote_bytesc C s� d } d } t j j | � } | j | | d | | f � t j j | d d d d �} | j | | d | | f � d } d } t j j | d d �} | j | | d | | f � d } d } t j j | � } | j | | d | | f � d } | j t t j j | d d �d } d
} t j j | d d d d �} | j | | d | | f � d } d } t j j | d d d d
�} | j | | d | | f � d S)Nu ¢Øabÿz%C2%A2%C3%98ab%C3%BFzusing quote(): %r != %rr� �errorsz %A2%D8ab%FFzlatin-1u 漢字z%E6%BC%A2%E5%AD%97z%3F%3Fr� z %26%2328450%3B%26%2323383%3B�xmlcharrefreplace)r r� r� r` rp r� )r r r� r� r r r �test_quote_with_unicode$ sB z$QuotingTests.test_quote_with_unicodec C s� d } d } t j j | d d �} | j | | d | | f � d } d } t j j | d d d d �} | j | | d | | f � d S)
Nu ¢Ø ÿz
%A2%D8+%FFr� zlatin-1z using quote_plus(): %r != %ru ab漢字 cdz ab%3F%3F+cdr r� )r r� r� r` )r r r� r� r r r � test_quote_plus_with_unicodeN s z)QuotingTests.test_quote_plus_with_unicodeN)
r+ r, r- rs r� r� r� r r r r
r r r r r r r� � s
*r� c @ sj e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d S)�UnquotingTestszwTests for unquote() and unquote_plus()
See the doc string for quoting_Tests for details on quoting and such.
c C sm g } x� t d � D]� } t t | � � } t | � } t j j | � } | j | | d | | f � t j j | � } | j | | d | | f � | j | � q Wd j | � } ~ t j j | � } | j | j
d � d d | � | j t t
f t j j d � | j t t
f t j j f � t j d t f d d ��$ | j t t
f t j j d
� Wd QXd S) N� zusing unquote(): %r != %rz using unquote_plus(): %r != %rr� r r z/using unquote(): not all characters escaped: %s�quietTr$ )r r r� r r� �unquoter` � unquote_plusr� r� �countrp r �AttributeErrorr r � BytesWarning)r Z escape_listr� r r� r� Z
escape_stringr r r �test_unquotinge s, z UnquotingTests.test_unquotingc C s� d } | } t j j | � } | j | | d | | f � d } | } t j j | � } | j | | d | | f � d } | } t j j | � } | j | | d | | f � d } t | d � } t j j | � } | j | | d | | f � d } t | d � } t j j | � } | j | | d | | f � d } t | d � } t j j | � } | j | | d | | f � | j t t f t j j d � | j t t f t j j f � d S)Nz%xabzusing unquote(): %r != %rz%xr rH z"using unquote_to_bytes(): %r != %r) r r� r r` rJ �unquote_to_bytesrp r r )r r r� r� r r r �test_unquoting_badpercent~ s@ z(UnquotingTests.test_unquoting_badpercentc C s? d } d } t j j | � } | j | | d | | f � d S)Nz%Ab%eAs ��z"using unquote_to_bytes(): %r != %r)r r� r r` )r r r� r� r r r �test_unquoting_mixed_case� s z(UnquotingTests.test_unquoting_mixed_casec C sx d t d � } d } t j j | � } | j | | d | | f � t j j | � } | j | | d | | f � d S)Nzab%sd�cZabcdzusing quote(): %r != %rz using unquote_plus(): %r != %r)r r r� r r` r )r r r� r� r r r �test_unquoting_parts� s z#UnquotingTests.test_unquoting_partsc C s� d } | } t j j | � } | j | | d | | f � | j d d � } t j j | � } | j | | d | | f � d S)Nzare+there+spaces...zusing unquote(): %r != %rr r z using unquote_plus(): %r != %r)r r� r r` r� r )r r r� r� r r r �test_unquoting_plus� s z"UnquotingTests.test_unquoting_plusc C s� d } d } t j j | � } | j | | d | | f � t j j d � } d } | j | | d | | f � d } d } t j j | � } | j | | d | | f � d } d } t j j | � } | j | | d | | f � d S) Nz"br%C3%BCckner_sapporo_20050930.docs brückner_sapporo_20050930.docz"using unquote_to_bytes(): %r != %ru 漢%C3%BCs 漢üs %A2%D8ab%FFs ��ab�s %A2�ab%FF)r r� r r` )r r r� r� r r r �test_unquote_to_bytes� s. z$UnquotingTests.test_unquote_to_bytesc C s d } d } t j j | � } | j | | d | | f � t j j | d d d d �} | j | | d | | f � t j j d d d �} d } | j | | d | | f � d } d } t j j | � } | j | | d | | f � d
} d } t j j | � } | j | | d | | f � t j j | d d �} | j | | d | | f � d
} d
} t j j | d d �} | j | | d | | f � t j j d � } d } | j | | d | | f � t j j d d d �} d } | j | | d | | f � d S)Nz"br%C3%BCckner_sapporo_20050930.docu brückner_sapporo_20050930.doczusing unquote(): %r != %rr� r z br%FCckner_sapporo_20050930.doczlatin-1z%E6%BC%A2%E5%AD%97u 漢字z%F3%B1u �r� r� �ignoreu 漢%C3%BCu 漢üu 漢%FC)r r� r r` )r r r� r� r r r �test_unquote_with_unicode� sN z(UnquotingTests.test_unquote_with_unicodeN) r+ r, r- rs r r r r r r! r# r r r r r ^ s $ r c @ s� e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d d � Z d S)�urlencode_TestszTests for urlencode()c C s d d d g } t j j | � } x. | D]& } | j | | d | | | f � q( W| j | j d � d d | | j d � f � | j d � } | | d } | | d } | j | j � o� | j � d | | f � | j t | � d d | t | � d f � d
S)a Helper method for testing different input types.
'given' must lead to only the pairs:
* 1st, 1
* 2nd, 2
* 3rd, 3
Test cannot assume anything about order. Docs make no guarantee and
have possible dictionary input.
z1st=1z2nd=2z3rd=3z testing %s: %s not found in %s�&r z#testing %s: expected 2 '&'s; got %sr z1testing %s: '&' not located in proper place in %sr� r� z5testing %s: unexpected number of characters: %s != %sN� � r& r' )
r r� � urlencoder� r` r �indexr\ �isdigitr
) r r Z test_typeZexpect_somewherer� r Z amp_locationZ on_amp_leftZ on_amp_rightr r r �help_inputtype s$
z urlencode_Tests.help_inputtypec C s) | j i d d 6d d 6d d 6d � d S)N�1�1st�2�2nd�3�3rdzusing dict as input type)r+ )r r r r �test_using_mapping? s z"urlencode_Tests.test_using_mappingc C s | j d d d
g d � d S) Nr- r, r/ r. r1 r0 z*using sequence of two-item tuples as input)z1str, )z2ndr. )z3rdr0 )r+ )r r r r �test_using_sequenceD s z#urlencode_Tests.test_using_sequencec C s� i d d 6} d t d � t d � f } t j j | � } | j | | � i d d 6} d } t j j | � } | j | | � d S)N�=r% z%s=%szA bunch of pluseszkey namezkey+name=A+bunch+of+pluses)r r r� r( r` )r r r� r� r r r � test_quotingI s
z urlencode_Tests.test_quotingc C s� i d d d g d 6} d t j j t d d d g � � } t j j | � } | j | | � t j j | d � } x, | d D] } d | } | j | | � q} W| j | j d � d d | j d � � d S)
Nr, r. r0 Zsequencez sequence=%sTr% r zExpected 2 '&'s, got %s)r r� r� r� r( r` r� r )r r r� r� �valuer r r �
test_doseqT s %
zurlencode_Tests.test_doseqc C s< | j d t j j i � � | j d t j j g � � d S)Nr� )r` r r� r( )r r r r �test_empty_sequencea s z#urlencode_Tests.test_empty_sequencec C sJ | j d t j j i d d 6� � | j d t j j i d d 6� � d S)Nza=1r �aza=None)r` r r� r( )r r r r �test_nonstring_valuese s #z%urlencode_Tests.test_nonstring_valuesc C s� | j d t j j i d d g d 6d � � | j d t j j i d d g d 6d � � t j d d
g � } | j d t j j i | d 6d � � d S) Nza=1&a=2r r r9 Tz
a=None&a=a�bza=a&a=b)r9 r )r; r )r` r r� r( � collections� OrderedDict)r r r r r �test_nonstring_seq_valuesi s , # z)urlencode_Tests.test_nonstring_seq_valuesc C s� d } d } t j j | d d d d �} | j | | � d } d } t j j | � } | j | | � d } d } t j j | d d
�} | j | | � d S)N� � Áz%3F=%3Fr� r� r r� z
%C2%A0=%C3%81z%A0=%C1zlatin-1�r? r@ )rA �r? r@ )rB �r? r@ )rC )r r� r( r` )r r r� r� r r r �test_urlencode_encodingq s z'urlencode_Tests.test_urlencode_encodingc C sQ d } d } t j j | d d d d d d �} | j | | � d } d } t j j | d d d d d �} | j | | � d } d } t j j | d � } | j | | � d } d } t j j | d � } | j | | � d } d } t j j | d d d �} | j | | � d } d } t j j | d d d �} | j | | � d S)!Nr? r@ z%3F=%3F�doseqTr� r� r r� r z
%3F=1&%3F=%3Fz
%C2%A0=%C3%81�* z%C2%A0=42&%C2%A0=%C3%81z%A0=%C1zlatin-1z%A0=42&%A0=%C1�r? r@ )rG �r r@ �r? rH )rI �r? r@ )rJ �rF r@ �r? rK )rL �r? r@ )rM �rF r@ �r? rN )rO )r r� r( r` )r r r� r� r r r � test_urlencode_encoding_doseq� s4 z-urlencode_Tests.test_urlencode_encoding_doseqc C s� d } d } t j j | � } | j | | � t j j | d � } | j | | � d } d } t j j | d � } | j | | � d S) N� �$� �$z
%A0%24=%C1%24TrF z%A0%24=42&%A0%24=%C1%24�rQ rR )rS �rF rR �rQ rT )rU )r r� r( r` )r r r� r� r r r �test_urlencode_bytes� s z$urlencode_Tests.test_urlencode_bytesc C sP d } t j j | d d �} d } | j | | � d } t j j | d d d d �} d } | j | | � d } d
} t j j | d d d �} | j | | � d } t j j | d d d d �} d } | j | | � d } d } t j j | d d d d d d �} d } d
} t j j | d d d d d �} | j | | � d S)N� �$� �$r� z:$z %A0$=%C1$rE T�
rF z%A0$=%C1$&%A0$=13&%A0$=42r� zlatin-1�rW rX )rZ �rW rX )r[ �rX rY rF �rW r\ )r] �rW rX )r^ �rW rX )r_ �rX rY rF �rW r` )ra )r r� r( r` )r r r� r� r r r �&test_urlencode_encoding_safe_parameter� s4 z6urlencode_Tests.test_urlencode_encoding_safe_parameterN)r+ r, r- rs r+ r2 r3 r5 r7 r8 r: r> rD rP rV rb r r r r r$ s
% r$ c @ sU e Z d Z d Z d d � Z d d � Z e j e j d k d � d d � � Z
d
S) �Pathname_Testsz&Test pathname2url() and url2pathname()c C s� t j j d d d d � } d } t j j | � } | j | | d | | f � t j j | � } | j | | d | | f � d S)N�partsZofr9 r� zparts/of/a/pathz pathname2url() failed; %s != %sz url2pathame() failed; %s != %s)rS r� r� r r r r` r )r Z
expected_pathZ expected_urlr� r r r r� � s zPathname_Tests.test_basicc C s: t j j d d d � } d t j j d � } t j j | � } | j | | d | | f � | } t j j | � } | j | | d | | f � t j j d d � } d t j j d � } t j j | � } | j | | d | | f � d
} t j j d d � } t j j | � } | j | | d | | f � d S)
NZneedszquot=ing�herez
needs/%s/herez pathname2url() failed; %s != %sz url2pathname() failed; %s != %sz make sureZ using_quotez%s/using_quotezmake+sure/using_unquotez make+sureZ
using_unquote)
rS r� r� r r� r� r r r` r )r r r� r� r r r r5 � s. zPathname_Tests.test_quoting�win32z.test specific to the urllib.url2path function.c C s� d } d } x= | D]5 } t j j | � } | j | | d | | f � q Wd } d } t j j | � } | j | | d | | f � d S)
N�/C:/�///C:/�/C|//zC:\z/urllib.request..url2pathname() failed; %s != %sz
///C|/pathzC:\pathz.urllib.request.url2pathname() failed; %s != %s)rg rh ri )r r r r` )r r r� r r� r r r � test_ntpath
s
zPathname_Tests.test_ntpathN) r+ r, r- rs r� r5 r� Z
skipUnless�sys�platformrj r r r r rc � s
rc c @ s" e Z d Z d Z d d � Z d S)�
Utility_Testsz=Testcase to test the various utility functions in the urllib.c C s | j t j j � t � d S)zATest the urllib.request.thishost utility function returns a tupleN)rd r r Zthishost�tuple)r r r r �
test_thishost s zUtility_Tests.test_thishostN)r+ r, r- rs ro r r r r rm s rm c @ s" e Z d Z d Z d d � Z d S)�URLopener_Testsz4Testcase to test the open method of URLopener class.c
C st Gd d � d t j j � } t j d t f � �= | j | � j d � d � | j | � j d � d � Wd QXd S)Nc @ s e Z d Z d d � Z d S)z8URLopener_Tests.test_quoted_open.<locals>.DummyURLopenerc S s | S)Nr )r r r r r � open_spam( s zBURLopener_Tests.test_quoted_open.<locals>.DummyURLopener.open_spamN)r+ r, r- rq r r r r �DummyURLopener' s rr z8DummyURLopener style of invoking requests is deprecated.zspam://example/ /z//example/%20/z,spam://c:|windows%/:=&?~#+!$,;'@()*[]|/path/z'//c:|windows%/:=&?~#+!$,;'@()*[]|/path/)r r r� r r r r` r )r rr r r r �test_quoted_open& s
z URLopener_Tests.test_quoted_openN)r+ r, r- rs rs r r r r rp # s rp c @ s. e Z d Z d Z d d � Z d d � Z d S)� RequestTestsz&Unit tests for urllib.request.Request.c C sW t j j } | d � } | j | j � d � | d i � } | j | j � d � d S)Nzhttp://www.python.orgr� ZPOST)r r �Requestr` �
get_method)r ru r r r r �test_default_values� s
z RequestTests.test_default_valuesc C s� t j j } | d d d �} | j | j d � | j | j � d � | d i d d �} | j | j d � | j | j � d � | d d d �} | j | j � d � d | _ | j | j � d � d S)Nzhttp://www.python.org�methodZHEADr� )r r ru r` rx rv )r ru r r r r �test_with_method_arg� s z!RequestTests.test_with_method_argN)r+ r, r- rs rw ry r r r r rt � s rt c @ sL e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d S) �URL2PathNameTestsc C sF | j t d � d � | j t d � d � | j t d � d � d S)Nz///C|zC:z///C:z///C|/zC:\)r` r )r r r r � test_converting_drive_letter� s z.URL2PathNameTests.test_converting_drive_letterc C s0 | j t d � d � | j t d � d � d S)Nz
///C/test/z
\\\C\test\z ////C/test/z \\C\test\)r` r )r r r r �$test_converting_when_no_drive_letter� s z6URL2PathNameTests.test_converting_when_no_drive_letterc C s | j t d � d � d S)Nz///C|/foo/bar/spam.foozC:\foo\bar\spam.foo)r` r )r r r r �test_simple_compare� s z%URL2PathNameTests.test_simple_comparec C s | j t t d � d S)Nu ///è|/)rp �IOErrorr )r r r r �test_non_ascii_drive_letter� s z-URL2PathNameTests.test_non_ascii_drive_letterc C s@ d d d g } x* | D]" } | j t t | � � | � q Wd S)NzC:z \\\C\test\\zC:\foo\bar\spam.foo)r` r r )r �
list_of_pathsr� r r r �test_roundtrip_url2pathname� s
z-URL2PathNameTests.test_roundtrip_url2pathnameN)r+ r, r- r{ r| r} r r� r r r r rz � s
rz c @ sL e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d S) �PathName2URLTestsc C s0 | j t d � d � | j t d � d � d S)NzC:z///C:zC:\)r` r )r r r r r{ � s z.PathName2URLTests.test_converting_drive_letterc C sF | j t d � d � | j t d � d � | j t d � d � d S)Nz\\\folder\test\z/////folder/test/z\\folder\test\z////folder/test/z
\folder\test\z
/folder/test/)r` r )r r r r r| � s z6PathName2URLTests.test_converting_when_no_drive_letterc C s | j t d � d � d S)NzC:\foo\bar\spam.fooz///C:/foo/bar/spam.foo)r` r )r r r r r} � s z%PathName2URLTests.test_simple_comparec C s | j t t d � d S)NzXX:\)rp r~ r )r r r r �test_long_drive_letter� s z(PathName2URLTests.test_long_drive_letterc C s@ d d d g } x* | D]" } | j t t | � � | � q Wd S)Nz///C:z/////folder/test/z///C:/foo/bar/spam.foo)r` r r )r r� r� r r r �test_roundtrip_pathname2url� s
z-PathName2URLTests.test_roundtrip_pathname2urlN)r+ r, r- r{ r| r} r� r� r r r r r� � s
r� �__main__)2rs Z urllib.parser Zurllib.requestZ urllib.errorZ http.clientr2 Z
email.messagerh r& r� Z
unittest.mockr r� r rS r� rk r� Z
nturl2pathr r �base64r r< r r r r5 rB r6 r9 ZTestCaserG rt r� r� r� r� r� r r$ rc rm rp rt rz r� r+ �mainr r r r �<module> sN & R% �I� )���<a