Your IP : 216.73.216.85
��Yf,� � n @ s� d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z e j
d k r� e j � j d k Z
n d Z
y d d l Z Wn e k
r� d Z d Z Yn Xe j e j � Z d d � Z Gd d
� d
e � Z Gd d � d � Z Gd
d � d e � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z e j e j
d k d � Gd d � d e e j � � Z! Gd d! � d! e e j � Z" Gd" d# � d# e j � Z# Gd$ d% � d% e j � Z$ Gd& d' � d' e e j � Z% Gd( d) � d) e j � Z& Gd* d+ � d+ e j � Z' d, d- f d. d/ f d0 d1 f d2 d3 f d4 d5 f d6 d7 f d8 d9 f d: d; f d< d= f d> d? f d@ dA f dB dC f dD dE f dF dG f dH dI f dJ dK f dL dM f dN dO f dP dQ f g Z( x0 e( D]( Z) e* e) � dR k r�e+ e, e) � � q{WGdS dT � dT e j � Z- GdU dV � dV e j � Z. dW dX f dY dZ f d[ d\ f d] d^ f d_ d` f d d f da db f dc dd f de de f df df f dg dg f dh dh f di di f dj dj f dk dj f dl d f dm dj f dn do f dp dj f dq dq f dr d f ds d f dt do f du d f dv d f dw d f dx d f dy d f dz d f d{ d f d| d f d} d f d~ d f d� d f d� d f d� d f d� d f d� d f d� d f d� d� f d� d f d� d� f d d f d� d� f d� d� f g- Z/ Gd� d� � d� e j � Z0 Gd� d� � d� e j � Z1 Gd� d� � d� e j � Z2 Gd� d� � d� e j � Z3 Gd� d� � d� e j � Z4 d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� gf Z5 e6 e d� � rEe5 j7 d� � d� d� g Z8 Gd d� de j e � Z9 Gdd� de j � Z: Gdd� de j � Z; Gdd� de j � Z< Gdd � d e j � Z= Gd
d � d e j � Z> Gd d
� d
e j � Z? Gdd� de j � Z@ Gdd� de j � ZA ddddg ZB dddg ddg ddddg dd g d d g i ZC y d d lD ZD Wn e k
r�d ZD Yn XeB j7 d � d d!g eC d <y d d lE ZE Wn e k
r�Yn XeB j7 d"� d#g eC d"<Gd$d%� d%e j � ZF i ZG d&d'� ZH e jI eH � y d d(lJ mK ZK Wn e k
rv d)d*� ZK Yn XGd+d,� d,e j � ZL e j e j
d k d-� Gd.d/� d/e j � � ZM eN d0k r� e jO � d S(1 � N)�support�win32� F� c s � � f d d � } | S)Nc s& � j � | � | t | � f � d S)N)� assertEqual�len)�inputZexpect)�coder�self� �5/opt/alt/python35/lib64/python3.5/test/test_codecs.py�check s z coding_checker.<locals>.checkr )r
r r
r )r r
r �coding_checker s r c @ s= e Z d Z d Z d d � Z d d � Z d
d d � Z d S) �QueuezF
queue: write bytes at one end, read bytes from the other end
c C s
| | _ d S)N)�_buffer)r
�bufferr r r �__init__" s zQueue.__init__c C s | j | 7_ d S)N)r )r
�charsr r r �write% s z Queue.writer c C s` | d k r/ | j } | j d d � | _ | S| j d | � } | j | d � | _ | Sd S)Nr )r )r
�size�sr r r �read( s z
Queue.readN���)�__name__�
__module__� __qualname__�__doc__r r r r r r r r s r c @ s( e Z d Z d d � Z d d � Z d S)�MixInCheckStateHandlingc C s xt t | � d � D]� } t j | � � } | j | d | � � } | j � } | j | d t � | d s� | j | d d d � d f � | j | j | d � � | j
| | j � � t j | � � } | j | � | j | | d � d � } | j
| | | � q Wd S)Nr r T) �ranger �codecs�getincrementaldecoder�decode�getstate�assertIsInstance�int�setstate�
assertTruer ) r
�encoding�ur �i�d�part1�state�part2r r r �check_state_handling_decode3 s
!
z3MixInCheckStateHandling.check_state_handling_decodec C s� x� t t | � d � D]� } t j | � � } | j | d | � � } | j � } t j | � � } | j | � | j | | d � d � } | j | | | � q Wd S)Nr T)r r r �getincrementalencoder�encoder" r% r ) r
r' r( r r) r* r+ r, r- r r r �check_state_handling_encodeI s
z3MixInCheckStateHandling.check_state_handling_encodeN)r r r r. r1 r r r r r 2 s r c @ sv e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
d � Z d Z
d d � Z d S)�ReadTestc
C s9 t d � } t j | j � | � } d } x_ t | j | j � | � D]B \ } } | j t | g � � | | j � 7} | j | | � qF W| j | j � d � | j | j
d � t j | j � � } d } xU t | j | j � | � D]8 \ } } | | j t | g � � 7} | j | | � q� W| j | j d d � d � | j | j
d � | j � d } xU t | j | j � | � D]8 \ } } | | j t | g � � 7} | j | | � q�W| j | j d d � d � | j | j
d � | j | j � } | j | d j t j d d � | D� | j � � � d S)N� � Tc S s g | ] } t | g � � q Sr )�bytes)�.0�cr r r �
<listcomp>| s z*ReadTest.check_partial.<locals>.<listcomp>)r r � getreaderr' �zipr0 r r5 r r �
bytebufferr r! r �reset�join�
iterdecode)
r
r Zpartialresults�q�r�resultr7 Z
partialresultr* �encodedr r r �
check_partialT s6 ((
( zReadTest.check_partialc se � f d d � � d d � f d d � } d } d } d } � j | | d � | � � j | | d � | � � j | | d d
� | � � j | | d d
� | � d } g } g } xP t | � D]B \ } } | j | d d d | � | j | d d d � q� W� j | d j | � d � d j | � � � j | d j | � d � d j | � � x� t d � D]� }
x� | D]� } d
|
d | d } � | � } xT t d
� D]F } � j | j d d � |
d | � � j | j d d � d � q�W� | � } xP t d
� D]B } � j | j d d � |
d � � j | j d d � d � qWq{WqnWd S)Nc s1 t j | j � j � � } t j � j � | � S)N)�io�BytesIOr0 r' r r9 )r �stream)r
r r r9 � s z)ReadTest.test_readline.<locals>.getreaderTc sR � | � } g } x0 | j d | d | � } | s4 P| j | � q Wd j | � S)Nr �keepends�|)�readline�appendr= )r rG r �reader�lines�line)r9 r r � readalllines� s z,ReadTest.test_readline.<locals>.readalllinesu foo
bar
baz
spam
eggsu foo
|bar
|baz
|spam
|eggszfoo|bar|baz|spam|eggsF�
�
�
�
�
�� u あr4 rH �P �azxxx
rG �xxx)rP rQ rR rS )r � enumeraterJ r= r rI ) r
rN r Z sexpectedZsexpectednoendsZlineendsZvwZvwor) Zlineendr rK r )r9 r
r �
test_readline sH
++
zReadTest.test_readlinec s� d d d d g } d j | � � � � f d d � } | � } � j | j � | d � � j | j � d j | d d � � � � j | j � d � | � } � j | j � | d � � j | j � | d d � � � j | j � d � | � } � j | j d
d d d
� � d d
� � � j | j � � d
d � � � j | j � d � | � } � j | j d
d d d
� � d d
� � � j | j � | d d
d � g | d d � � � j | j � d � d S)Nz Humpty Dumpty sat on a wall,
z!Humpty Dumpty had a great fall.
z-All the king's horses and all the king's men
z#Couldn't put Humpty together again.r4 c s1 t j � j � j � � } t j � j � | � S)N)rD rE r0 r' r r9 )rF )�datar
r r r9 � s z8ReadTest.test_mixed_readline_and_read.<locals>.getreaderr r r �( r � )r= r rI r � readlines)r
rL r9 �fr )rZ r
r � test_mixed_readline_and_read� s, ) , ,5z%ReadTest.test_mixed_readline_and_readc = C s. d d d d d d d d d d
d d d
d d d d d d d d d d d d d d d d d d d d d d d d d d! d" d# d$ d% d& d' d( d) d* d d+ d, d- d. d/ d0 d1 d2 d3 d4 d5 d6 g= } t j d7 j | � j | j � � } t j | j � | � } x. t | � D] \ } } | j | | | � qWd S)8Nz:<%!--===================================================
z, BLOG index page: show recent articles,
z7 today's articles, or articles of a specific date.
z>========================================================--%>
z!<%@inputencoding="ISO-8859-1"%>
z <%@pagetemplate=TEMPLATE.y%>
z$<%@import=import frog.util, frog%>
z!<%@import=import frog.objects%>
z9<%@import=from frog.storageerrors import StorageError%>
z<%
z
zimport logging
z+log=logging.getLogger("Snakelets.logger")
zuser=self.SessionCtx.user
z-storageEngine=self.SessionCtx.storageEngine
z-def readArticlesFromDate(date, count=None):
z2 entryids=storageEngine.listBlogEntries(date)
z% entryids.reverse() # descending
z if count:
z# entryids=entryids[:count]
z
try:
z\ return [ frog.objects.BlogEntry.load(storageEngine, date, Id) for Id in entryids ]
z except StorageError,x:
z6 log.error("Error loading articles: "+str(x))
z, self.abort("cannot load articles")
zshowdate=None
zarg=self.Request.getArg()
zif arg=="today":
z, #-------------------- TODAY'S ARTICLES
z- self.write("<h2>Today's articles</h2>")
z( showdate = frog.util.isodatestr()
z. entries = readArticlesFromDate(showdate)
zelif arg=="active":
z4 #-------------------- ACTIVE ARTICLES redirect
z self.Yredirect("active.y")
zelif arg=="login":
z/ #-------------------- LOGIN PAGE redirect
z self.Yredirect("login.y")
zelif arg=="date":
z7 #-------------------- ARTICLES OF A SPECIFIC DATE
z2 showdate = self.Request.getParameter("date")
zV self.write("<h2>Articles written on %s</h2>"% frog.util.mediumdatestr(showdate))
zelse:
z+ #-------------------- RECENT ARTICLES
z, self.write("<h2>Recent articles</h2>")
z. dates=storageEngine.listBlogEntryDates()
z if dates:
z entries=[]
z SHOWAMOUNT=10
z for showdate in dates:
zW entries.extend( readArticlesFromDate(showdate, SHOWAMOUNT-len(entries)) )
z* if len(entries)>=SHOWAMOUNT:
z break
z
r4 ) rD rE r= r0 r' r r9 rX r )r
r rF rK r) rM r r r �test_bug1175396� s� $zReadTest.test_bug1175396c C s� t d � } t j | j � | � } t j | j � | � } | j d � | j | j d d � d � | j d � | j | j d d � d � | j | j d d � d � | j d � | j | j d d � d � | j | j d d � d � | j d � | j | j d d
� d � | j d � | j | j d d
� d � | j | j d d
� d � | j d � | j | j d d
� d � | j | j d d
� d � | j d
� | j | j d d
� d
� d S)Nr3 zfoo
rG F�fooz
bar
r4 ZbarZbazTrP zbar
zfoo
)r r � getwriterr' r9 r r rI )r
r? �writerrK r r r �test_readlinequeue! s*
zReadTest.test_readlinequeuec C s� d } d } d } | | | j | j � } t j | � } t j | j � | � } | j | j � | � | j | j � | � | j | j � | � | j | j � d � d S)NzAxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx yyyyyyyyyyyyyyyyyyyyyyyyyyyyyyy
z`offending line: ladfj askldfj klasdj fskla dfzaskdj fasklfj laskd fjasklfzzzzaa%whereisthis!!!
z next line.
r4 )r0 r' rD rE r r9 r rI )r
�s1�s2�s3r rF rK r r r �test_bug1098990_a< s zReadTest.test_bug1098990_ac C s� d } d } d } d } d } | | | | | j | j � } t j | � } t j | j � | � } | j | j � | � | j | j � | � | j | j � | � | j | j � | � | j | j � | � | j | j � d � d S)Nzaaaaaaaaaaaaaaaaaaaaaaaa
zbbbbbbbbbbbbbbbbbbbbbbbb
zstillokay:bbbbxx
zbroken!!!!badbad
z againokay.
r4 )r0 r' rD rE r r9 r rI ) r
re rf rg Zs4Zs5r rF rK r r r �test_bug1098990_bI s "zReadTest.test_bug1098990_bu �c C sw | j t d j | j � | j d j | j d � d j | j � � | j d j | j d � d j | j � � | j d j | j d � d j | j � � | j d j | j d � d j | j � � | j d j | j d
� d j | j � � d j | j � } xnd d d g D]]\ } } | j | j � t | � d � } | j | j � t | � d � } | d | } | | | j | } | j t | j | j � | j | j | j d � | � | j | j | j d � | � | j | j | j d � | | � | j | j | j d
� | | j | � d j
d d � | j D� � } | j | j | j d � | | | � qWd S)Nu �u [�]�backslashreplacez[\udc80]� namereplace�xmlcharrefreplacez
[�]�ignorez[]�replacez[?]r4 � �A�[�]u ��
surrogatepassc s s | ] } d | Vq d S)z\x%02xNr )r6 �br r r � <genexpr>} s z0ReadTest.test_lone_surrogates.<locals>.<genexpr>)ro rp )rq rr )rp ro ) � assertRaises�UnicodeEncodeErrorr0 r' r r �ill_formed_sequence�UnicodeDecodeErrorr! �ill_formed_sequence_replacer= ) r
ZbomZbefore�afterZbefore_sequenceZafter_sequenceZ test_stringZ
test_sequencerj r r r �test_lone_surrogates\ sD ""
z ReadTest.test_lone_surrogatesN) r r r rC rY r_ r` rd rh ri rz r| r r r r r2 S s + ; " E
r2 c @ s� e Z d Z d Z e j d k r* d Z n d Z d Z d Z d d � Z d d
� Z
d d � Z d
d � Z d d � Z
d d � Z d d � Z d S)� UTF32Testzutf-32�littles �� s ܀s$ �� s p a m s p a m s$ �� s p a m s p a mc C s� t j | j � \ } } } } t j � } | | � } | j d � | j d � | j � } | j | | j k p} | | j k � t j | � } | | � } | j
| j � d � d S)N�spam�spamspam) r �lookupr' rD rE r �getvaluer& �spamle�spamber r )r
�_rK rc r r^ r* r r r �test_only_one_bom� s
% zUTF32Test.test_only_one_bomc C sx t j d � } t j | j � | � } | j t | j � t j d � } t j | j � | � } | j t | j � d S)N� s �� s ����s ��������)rD rE r r9 r' rv � UnicodeErrorr )r
r r^ r r r � test_badbom� s zUTF32Test.test_badbomc C s\ | j d d d d d d d d d d d d d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 � u ÿu ÿĀu ÿĀ)rC )r
r r r � test_partial� s4 zUTF32Test.test_partialc C sB | j d t j d d d � � | j d t j d d d � � d S)
N� �r s rn Tr4 rm )r� r )r4 r )r r �
utf_32_decode)r
r r r �
test_handlers� s zUTF32Test.test_handlersc C s | j t t j d d d � d S)Ns ��strictT)rv ry r r� )r
r r r � test_errors� s zUTF32Test.test_errorsc C s6 | j | j d | j � | j | j d | j � d S)Nr� )r. r' r� r� )r
r r r �test_decoder_state� s
z UTF32Test.test_decoder_statec C sb d d d } | j d d t j | � d � d d d } | j d d t j | � d � d S)Ns �� s i u 𐀀r s ��s )r r r� )r
Z
encoded_leZ
encoded_ber r r �test_issue8941� s
zUTF32Test.test_issue8941N)r r r r' �sys� byteorderrx r� r� r� r� r� r� r� r� r� r r r r r} � s r} c @ sL e Z d Z d Z d Z d d � Z d d � Z d d � Z d d
� Z d S) � UTF32LETestz utf-32-les �� c C sP | j d d d d d d d d d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� � s, zUTF32LETest.test_partialc C s | j d j | j � d � d S)Nu s )r r0 r' )r
r r r � test_simple s zUTF32LETest.test_simplec C s | j t t j d d d � d S)Ns �r� T)rv ry r �utf_32_le_decode)r
r r r r� s zUTF32LETest.test_errorsc C s/ d d } | j d d t j | � d � d S)Ns i u 𐀀r )r r r� )r
rB r r r r� s
zUTF32LETest.test_issue8941N) r r r r' rx r� r� r� r� r r r r r� � s r� c @ sL e Z d Z d Z d Z d d � Z d d � Z d d � Z d d
� Z d S) � UTF32BETestz utf-32-bes ܀c C sP | j d d d d d d d d d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� s, zUTF32BETest.test_partialc C s | j d j | j � d � d S)Nu s )r r0 r' )r
r r r r� - s zUTF32BETest.test_simplec C s | j t t j d d d � d S)Ns �r� T)rv ry r �utf_32_be_decode)r
r r r r� 0 s zUTF32BETest.test_errorsc C s/ d d } | j d d t j | � d � d S)Ns i u 𐀀r )r r r� )r
rB r r r r� 4 s
zUTF32BETest.test_issue8941N) r r r r' rx r� r� r� r� r r r r r� s r� c @ s� e Z d Z d Z e j d k r* d Z n d Z d Z d Z d d � Z d d
� Z
d d � Z d
d � Z d d � Z
d d � Z d d � Z d S)� UTF16Testzutf-16r~ s ��s ܀s ��s p a m s p a m s �� s p a m s p a mc C s� t j | j � \ } } } } t j � } | | � } | j d � | j d � | j � } | j | | j k p} | | j k � t j | � } | | � } | j
| j � d � d S)Nr r� ) r r� r' rD rE r r� r& r� r� r r )r
r� rK rc r r^ r* r r r r� F s
% zUTF16Test.test_only_one_bomc C sx t j d � } t j | j � | � } | j t | j � t j d � } t j | j � | � } | j t | j � d S)Ns ��s ����)rD rE r r9 r' rv r� r )r
r r^ r r r r� U s zUTF16Test.test_badbomc C s> | j d d d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� ^ s zUTF16Test.test_partialc C sB | j d t j d d d � � | j d t j d d d � � d S)
N� �r s rn Tr4 rm )r� r )r4 r )r r �
utf_16_decode)r
r r r r� s s zUTF16Test.test_handlersc C s | j t t j d d d � d S)Ns �r� T)rv ry r r� )r
r r r r� y s zUTF16Test.test_errorsc C s6 | j | j d | j � | j | j d | j � d S)Nr� )r. r' r� r� )r
r r r r� } s
z UTF16Test.test_decoder_statec C s� d } | j | j � } | j t j t j � t t j d � � } | j | � Wd QRXt j d t f � �# t
j t j d d | j �} Wd QRX| � | j | j � | � Wd QRXd S)NzHello
world
�wbr4 �Ur' )
r0 r' �
addCleanupr �unlink�TESTFN�openr �check_warnings�DeprecationWarningr r r )r
re r �fprK r r r �test_bug691291� s %zUTF16Test.test_bug691291N)r r r r' r� r� rx r� r� r� r� r� r� r� r� r� r r r r r� < s r� c @ s@ e Z d Z d Z d Z d d � Z d d � Z d d � Z d S)
� UTF16LETestz utf-16-les ��c C s8 | j d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� � s zUTF16LETest.test_partialc C sn d d d d d d d g } xL | D]D \ } } | j t t j | d d
� | j | j d d � | � q" Wd S)N� �� �� A Z� A�� A B C D Z� ABCD�� �� �A� �A � �A� �A r� Tzutf-16lern )r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )rv ry r �utf_16_le_decoder r! )r
�tests�raw�expectedr r r r� � s
zUTF16LETest.test_errorsc C s< | j d j | j � d � | j d j | j � d � d S)Nu s ��)r r0 r' r! )r
r r r � test_nonbmp� s zUTF16LETest.test_nonbmpN)r r r r' rx r� r� r� r r r r r� � s
r� c @ s@ e Z d Z d Z d Z d d � Z d d � Z d d � Z d S)
� UTF16BETestz utf-16-bes ܀c C s8 | j d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� � s zUTF16BETest.test_partialc C sn d d d d d d d g } xL | D]D \ } } | j t t j | d d
� | j | j d d � | � q" Wd S)N� �� �� A�� A�� A B C DZ� ABCD�� � � � �� � A� �A� � Ar� Tzutf-16bern )r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )rv ry r �utf_16_be_decoder r! )r
r� r� r� r r r r� � s
zUTF16BETest.test_errorsc C s< | j d j | j � d � | j d j | j � d � d S)Nu s � �)r r0 r' r! )r
r r r r� � s zUTF16BETest.test_nonbmpN)r r r r' rx r� r� r� r r r r r� � s
r� c sX e Z d Z d Z d Z d
Z d d � Z d d � Z � f d d
� Z d d � Z � S)�UTF8Testzutf-8s �u �� c C sA | j d d d d d d d d d d d d d d d d g � d S)Nu ÿ߿ࠀ𐀀r� u ÿu ÿ߿u ÿ߿ࠀu ÿ߿ࠀ)rC )r
r r r r� � s" zUTF8Test.test_partialc C s, d } | j | j | | j | j � � d S)Nu ÿĀ߿ࠀ)r. r' r0 )r
r( r r r r� s zUTF8Test.test_decoder_statec s- t � j � | j d j d d � d � d S)Nu [�]zutf-8�surrogateescapes [�])�superr| r r0 )r
)� __class__r r r|
s
z UTF8Test.test_lone_surrogatesc C s� | j d j d d � d � | j d j d d � d � | j d j d d � d � | j d j d d � d � | j t j d � � | j t � � d j d d � Wd QRX| j t � � d j d d � Wd QRXd S) Nu abc�defzutf-8rs s abc�defu �s �s abc�s abc�z)r r0 r! r& r � lookup_errorrv ry )r
r r r �test_surrogatepass_handler s z#UTF8Test.test_surrogatepass_handleru ���)
r r r r' rx rz r� r� r| r� r r )r� r r� � s r� z cp65001 is a Windows-only codecc @ sj e Z d Z d Z d d � Z d d � Z e j e d � d d � � Z e j e d � d d
� � Z
d S) � CP65001Test�cp65001c C s� d d d g } t r% | j d � n
| j d � x� | D]� \ } } } | d k r� y | j d | � } Wn? t k
r� } z | j d | | | f � WYd d } ~ Xn X| j | | d | | | | f � q9 | j t | j d | � q9 Wd S) N�abcr� � abc� � � � � �rm r3 rn � ?rj � \udc80rk rs � �r� z1Unable to encode %a to cp65001 with errors=%r: %sz!%a.encode("cp65001", %r)=%a != %a)r� r� r� )r� r� r� )r� r� r� �r� r� N�r� rm r3 �r� rn r� �r� rj r� �r� rk r� �r� rs r� )r� r� r� r� r� r� )r� r� r� )�VISTA_OR_LATER�extendrJ r0 rw �failr rv )r
r� �text�errorsr� rB �errr r r � test_encode% s0
$ zCP65001Test.test_encodec C s d d d d d d d d d! g } t r7 | j d% � n
| j d' � x� | D]� \ } } } | d k r� y | j d | � } Wn? t k
r� } z | j d | | | f � WYd d } ~ Xn X| j | | d | | | | f � qK | j t | j d | � qK Wd S)(N� abcr� r� � é€� é€� � � �� �� [é]� [é]� [�]rm �[]rn � [�]r� � [�]� [�]� [���]� [�]r� z3Unable to decode %a from cp65001 with errors=%r: %sz!%a.decode("cp65001", %r)=%a != %a)r� r� r� )r� r� r� )r� r� r� )r� r� r� )r� r� r� )r� r� N)r� rm r� )r� rn r� )r� r� r� �r� r� N�r� rm r� �r� rn r� )r� r� r� �r� r� r� )r� )r� r� r! ry r� r rv )r
r� r� r� r� �decodedr� r r r � test_decodeD s8
$ zCP65001Test.test_decodez require Windows Vista or laterc C s� | j t d j d � | j t d j d � | j d j d d � d � | j d j d d � d � | j d j d d � d � | j d j d d
� d � | j d j d d � d
� | j d j d d � d � d S)Nu �r� s �u [�]rj s [\udc80]rk rl s
[�]r� s [�]rm s []rn s [?])rv rw r0 ry r! r )r
r r r r| i s z CP65001Test.test_lone_surrogatesc C s� | j d j d d � d � | j d j d d � d � | j d j d d � d � | j d j d d � d � | j t j d � � d S)Nu abc�defr� rs s abc�defu �s �)r r0 r! r& r r� )r
r r r r� z s z&CP65001Test.test_surrogatepass_handlerN) r r r r' r� r� �unittest�
skipUnlessr� r| r� r r r r r� s
% r� c @ sR e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d S)
�UTF7Testzutf-7c C s� d } | j | j | j � | j d � � | j | j d � j | j � | � d } | j | j | j � | j d � � | j | j d � j | j � | � | j d j | j � d � | j d j | j � d � d } | j | j | j � | j d � � | j | j d � j | j � | � d j t t t t d � � j � � t | | d | � � � } | j | j | j � d
� d S) NzGABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789'(),-./:?�asciiz !"#$%&*;<=>@[]^_`{|}za+bs a+-bz
r4 � �+sX +AAAAAQACAAMABAAFAAYABwAIAAsADAAOAA8AEAARABIAEwAUABUAFgAXABgAGQAaABsAHAAdAB4AHwBcAH4Afw-) r r0 r' r! r= �sorted�setr5 r )r
Zset_dZset_oZwsZ other_asciir r r �
test_ascii� s %%%% %%$ zUTF7Test.test_asciic " C st | j d d d d d d d d d d d d d d d d d d d d d d d
d d d d d d d d d d g � d S)
Nu a+-b cdĀe𐀀frV za+za+-za+-bza+-b za+-b cu a+-b cu a+-b cdu a+-b cdĀu a+-b cdĀeu a+-b cdĀe𐀀)rC )r
r r r r� � sD zUTF7Test.test_partialc C s� d& d' d( d) d* d+ d, d- d. d/ d0 d1 d2 d3 d4 d5 d6 d7 d8 d9 g } xf | D]^ \ } } | j d! | � �= | j t t j | d" d# � | j | j d$ d% � | � Wd QRXqI Wd S):N� �b� �b� a�b� a�b� a��b� a��b� a+IK� a�� a+IK-b� a+IK,b� a+IKx� a€�� a+IKx-b� a€�b� a+IKwgr� a+IKwgr-b� a+IKwgr,�
a+IKwgr,-b� a€�-b� a+IKwgrB�
a€€��
a+IKwgrB-b� a€€�b�
a+/,+IKw-b� a�€b� a+//,+IKw-b� a+///,+IKw-b� a�€b�
a+////,+IKw-b� a+IKw-b�� a€b�� a+IKw�br� r� Tzutf-7rn )r r )r r )r r
)r r )r
r )r r )r r )r r )r r )r r )r r )r r )r r )r r )r r )r r )r r )r! r )r" r# )r$ r )�subTestrv ry r � utf_7_decoder r! )r
r� r� r� r r r r� � s2
zUTF7Test.test_errorsc C s | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d
j | j � d � d S) Nu 𐒠s +2AHcoA-u ��s +2AHcoAu €𐒠s
+IKzYAdyg-s +IKzYAdygu
€€𐒠s
+IKwgrNgB3KA-s +IKwgrNgB3KA)r r0 r' r! )r
r r r r� � s zUTF7Test.test_nonbmpc C s~ d d d d d d d d d! d" d# d$ d% g
} xJ | D]B \ } } | j d | � �! | j | j d d � | � Wd QRXq4 Wd S)&N� a+2AE-b� a�b� a+2AE�b� a�b� a+2AE� a�� a+2AEA-b� a+2AH-b�
a+IKzYAQ-b� a€�b�
a+IKzYAQ�b� a€�b� a+IKzYAQA-b�
a+IKzYAd-b� a+IKwgrNgB-b� a€€�b� a+IKwgrNgB�b� a€€�b�
a+IKwgrNgB�
a€€��
a+IKwgrNgBA-br� zutf-7rn )r' r( )r) r* )r+ r, )r- r* )r. r* )r/ r0 )r1 r2 )r3 r2 )r4 r2 )r5 r6 )r7 r8 )r9 r: )r; r8 )r% r r! )r
r� r� r� r r r r| � s z UTF7Test.test_lone_surrogatesN) r r r r' r r� r� r� r| r r r r r� � s ' r� c @ s( e Z d Z d d � Z d d � Z d S)� UTF16ExTestc C s# | j t t j d d d d � d S)Ns �r� r T)rv ry r �utf_16_ex_decode)r
r r r r� s zUTF16ExTest.test_errorsc C s | j t t j � d S)N)rv � TypeErrorr r= )r
r r r �
test_bad_args s zUTF16ExTest.test_bad_argsN)r r r r� r? r r r r r< s r< c @ s4 e Z d Z d d � Z d d � Z d d � Z d S)�ReadBufferTestc C s5 d d l } | j t j | j d d � � d � d S)Nr rt � spamr� )rA r� )�arrayr r �readbuffer_encode)r
rB r r r �
test_array s zReadBufferTest.test_arrayc C s | j t j d � d � d S)Nr4 r3 r )r3 r )r r rC )r
r r r �
test_empty s zReadBufferTest.test_emptyc C s- | j t t j � | j t t j d � d S)N�* )rv r> r rC )r
r r r r? s z ReadBufferTest.test_bad_argsN)r r r rD rE r? r r r r r@ s r@ c @ sR e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d S)
� UTF8SigTestz utf-8-sigc C sS | j d d d d d d d d d d d d d d d d d d d d d d g � d S) Nu ÿ߿ࠀ𐀀r4 u u u ÿu ÿ߿u ÿ߿ࠀu ÿ߿ࠀ)rC )r
r r r r� ' s. zUTF8SigTest.test_partialc C s | j t d d � d � d S)Ns z utf-8-sigr4 )r �str)r
r r r �test_bug1601501C s zUTF8SigTest.test_bug1601501c C s> t j d � � } d } | j | j | j d � � | � d S)Nz utf-8-sigr )r r r r! r0 )r
r* r r r r �test_bomG s zUTF8SigTest.test_bomc C s� d } t j d } t j d � } x� d g t t d d � � d d d d d
g D]� } | t j | � � } t j � } xB | d k r� | j | � } n | j � } | s� P| j | � q| W| j
� } | j | | � qR Wd S) Nu ABC¡∀XYZs ABC¡∀XYZz utf-8-sigr � �@ r � i i ) r �BOM_UTF8r9 �listr rD rE �StringIOr r r� r ) r
� unistring�
bytestringrK �sizehint�istream�ostreamrZ �gotr r r �test_stream_bomL s
zUTF8SigTest.test_stream_bomc C s� d } d } t j d � } x� d g t t d d � � d d d d d
g D]� } | t j | � � } t j � } xB | d k r� | j | � } n | j � } | s� P| j | � qu W| j � } | j
| | � qK Wd S) Nu ABC¡∀XYZs ABC¡∀XYZz utf-8-sigr rK rL r rM i i ) r r9 rO r rD rE rP r r r� r ) r
rQ rR rK rS rT rU rZ rV r r r �test_stream_bareb s z UTF8SigTest.test_stream_bareN) r r r r' r� rI rJ rW rX r r r r rG $ s rG c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S)
�EscapeDecodeTestc C s9 | j t j d � d � | j t j t � � d � d S)Nr3 r )r3 r )r3 r )r r �
escape_decode� bytearray)r
r r r rE y s zEscapeDecodeTest.test_emptyc C sc t j } xS t d � D]E } t | g � } | d k r | j | | d � | d d f � q Wd S)NrM s \� 0� )r rZ r r5 r )r
r! rt r r r �test_raw} s
zEscapeDecodeTest.test_rawc C s� t j } t | | � } | d d � | d d � | d d � | d d � | d d
� | d d � | d
d � | d d � | d d � | d d � | d d � | d d
� | d d � | d d � | d d � | d d � | d d � | d! d" � | d# d � | d$ d � | d% d% � | d& d" � xD t d' � D]6 } | d( k rCt | g � } | d) | d) | � qCWd S)*Ns [\
]s []s [\"]s ["]s [\']s [']s [\\]s [\]s [\a]s []s [\b]s []s [\t]s [ ]s [\n]s [
]s [\v]s [ ]s [\f]s [ ]s [\r]s [
]s [\7]s [\8]s [\78]s [8]s [\41]s [!]s [\418]s [!8]s [\101]s [A]s [\1010]s [A0]s [\501]s [\x41]s [\X41]s [\x410]rM s
"'\abtnvfr01234567xs \)r rZ r r r5 )r
r! r
rt r r r � test_escape� s8
z EscapeDecodeTest.test_escapec C s� t j } | j t | d � | j t | d � | j | d d � d
� | j | d d � d � | j t | d � | j t | d
� | j | d d � d � | j | d d � d � d S)Ns \xs [\x]s [\x]\xrm � []r rn � [?]?s \x0s [\x0]s [\x0]\x0r� )r` r )ra r )r` r� )ra r� )r rZ rv �
ValueErrorr )r
r! r r r r� � s z EscapeDecodeTest.test_errorsN)r r r rE r^ r_ r� r r r r rY x s rY c @ s e Z d Z d d � Z d S)� RecodingTestc C sL t j � } t j | d d � } | j d � | j � | j | j � d S)N�unicode_internalzutf-8rV )rD rE r � EncodedFiler �closer& �closed)r
r^ �f2r r r �
test_recoding� s
zRecodingTest.test_recodingN)r r r ri r r r r rc � s rc u" ليهمابتكلموشعربي؟s egbpdaj6bu4bxfgehfvwxnu 他们为什么不说中文s ihqwcrb4cv8a8dqg056pqjyeu 他們爲什麽不說中文s ihqwctvzc91f659drss3x8bo0ybu Pročprostěnemluvíčeskys Proprostnemluvesky-uyb24dma41au, למההםפשוטלאמדבריםעבריתs 4dbcagdahymbxekheh6e0a7fei0buZ यहलोगहिन्दीक्योंनहींबोलसकतेहैंs, i1baa7eci9glrd9b2ae1bj0hfcgg6iyaf8o0a1dig0cdu6 なぜみんな日本語を話してくれないのかs& n8jok5ay5dzabd5bym9f0cm5685rrjetr6pdxauH 세계의모든사람들이한국어를이해한다면얼마나좋을까sE 989aomsvi5e83db1d2a355cv1e0vak1dwrv93d5xbh15a0dt30a5jpsd879ccm6fea98cu8 почемужеонинеговорятпорусскиs b1abfaaepdrnnbgefbaDotcwatmq2g4lu* PorquénopuedensimplementehablarenEspañols- PorqunopuedensimplementehablarenEspaol-fmd56au- TạisaohọkhôngthểchỉnóitiếngViệts, TisaohkhngthchnitingVit-kjcr8268qyxafd2f1b9gu 3年B組金八先生s 3B-ww4c5e180e575a65lsy2bu" 安室奈美恵-with-SUPER-MONKEYSs( -with-SUPER-MONKEYS-pc58ag80a8qai00g7n9nu' Hello-Another-Way-それぞれの場所s( Hello-Another-Way--fc4qua05auwb3674vfr0bu ひとつ屋根の下2s 2-u9tlzr9756bt3uc0vu MajiでKoiする5秒前s MajiKoi5-783gue6qz075azm5eu パフィーdeルンバs de-jg4avhby1noc0du そのスピードでs d9juau41awczczpz -> $1.00 <-s -> $1.00 <--r] c @ s( e Z d Z d d � Z d d � Z d S)� PunycodeTestc C sR xK t D]C \ } } | j t | j d � d � j � t | d � j � � q Wd S)N�punycoder� )�punycode_testcasesr rH r0 �lower)r
�uni�punyr r r r� % s zPunycodeTest.test_encodec C se x^ t D]V \ } } | j | | j d � � | j d � j d � } | j | | j d � � q Wd S)Nrk r� )rl r r! r0 )r
rn ro r r r r� 1 s zPunycodeTest.test_decodeN)r r r r� r� r r r r rj $ s rj c @ s� e Z d Z e j e d k d � d d � � Z e j e d k d � d d � � Z e j e d k d � d d � � Z d d
� Z d S) �UnicodeInternalTestr� zspecific to 32-bit wchar_tc C s� d d d g } d d d d
d g } xb | D]Z \ } } t j d k rX t t | � � } t j � � | j | | j d
� � Wd QRXq+ Wxb | D]Z } t j d k r� t t | � � } t j d t f � � | j t
| j d
� Wd QRXq� Wt j d k r d } d } n d } d } t j � � | j t
| j d
� Wd QRXt j � �! | j | j d
d � d � Wd QRXt j � �! | j | j d
d � | � Wd QRXd S)N� ��� � � ār3 r4 s ���s � s � s s r~ rd z*unicode_internal codec has been deprecateds z\x00\x00\x11\x00s z\x00\x11\x00\x00rn u �rj )rq rr )rs rt )r3 r4 ) r� r� r5 �reversedr r� r r! r� rv ry )r
�okZnot_okZinternalrn ZinvalidZinvalid_backslashreplacer r r �test_bug12513008 sD
$
z#UnicodeInternalTest.test_bug1251300c C s� y. t j d t f � � d j d � Wd QRXWnq t k
r� } zQ | j d | j � | j d | j � | j d | j � | j d | j � WYd d } ~ Xn X| j
� d S)Nz*unicode_internal codec has been deprecateds rd r� r� ) r r� r� r! ry r r' �object�start�endr� )r
Zexr r r � test_decode_error_attributesd s
&z0UnicodeInternalTest.test_decode_error_attributesc C s� t j d t j � t j d � } t j d t f � �P d j d � j � } | t d | d d � | d d � f d � d � } Wd QRX| j
d | � d S)
Nrp rd z*unicode_internal codec has been deprecated�abz%s""""%sr� r� � )r| r} ) r �register_error�
ignore_errors�
getdecoderr r� r� r0 r! r5 r )r
�decoderr| Zignoredr r r �test_decode_callbackr s
'z(UnicodeInternalTest.test_decode_callbackc
C s� t j d t f � �e t j d � } | j | d � d d � | j | d � d d � | j t j d � d d � Wd QRXd S) Nz*unicode_internal codec has been deprecatedrd rV r u éłr] s \x00r� )r r� r� r �
getencoderr �
escape_encode)r
�encoderr r r �test_encode_length~ s
z&UnicodeInternalTest.test_encode_lengthN)
r r r r� r� �SIZEOF_WCHAR_Trw r{ r� r� r r r r rp 7 s $,$$ rp s% foo͏᠆᠋barbaz︀︈️s foobarbazs CAFEs cafes ßs sss İs i̇s Ńͺs ń ιs ǰ ªs ǰ as ᾷs ᾶιs ǰs ΐs ΰs ẖs ὖ� s s s s r3 s s s
s s s s s s s s s �s �s ⿵s ́s ́s s s s s foo־bars fooﵐbars fooﹶbars foo َbars ا1s ا1بs Xßİ℡ǰ ªΰ s xssi̇telǰ aΰ s Xß㌖İ℡⒟㌀s* xssキロメートルi̇tel(d)アパートc @ s e Z d Z d d � Z d S)� NameprepTestc C s� d d l m } x� t t � D]� \ } \ } } | d k r> q t | d d � } | d k rr | j t | | � q t | d d � } y | j | | � | � Wq t k
r� } z( t j
d | d t | � f � � WYd d } ~ Xq Xq Wd S)Nr )�nameprepzutf-8rs z
Test 3.%d: %sr ) Zencodings.idnar� rX �nameprep_testsrH rv r� r � Exceptionr Z
TestFailed)r
r� �posZorigZprepped�er r r �
test_nameprep# s zNameprepTest.test_nameprepN)r r r r� r r r r r� " s r� c @ sX e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
S)�
IDNACodecTestc C sh | j t d d � d � | j t d d � d � | j t d d � d � | j t d d � d � d S)
Ns
python.org�idnaz
python.orgs python.org.z python.org.s xn--pythn-mua.orgu pythön.orgs xn--pythn-mua.org.u pythön.org.)r rH )r
r r r �test_builtin_decode6 s z!IDNACodecTest.test_builtin_decodec C sh | j d j d � d � | j d j d � d � | j d j d � d � | j d j d � d � d S)
Nz
python.orgr� s
python.orgz python.org.s python.org.u pythön.orgs xn--pythn-mua.orgu pythön.org.s xn--pythn-mua.org.)r r0 )r
r r r �test_builtin_encode< s z!IDNACodecTest.test_builtin_encodec C sE t j d � t j d � � } | j d � | j | j � d � d S)Nr� s abcr� r4 )r r9 rD rE r r )r
r@ r r r � test_streamB s
zIDNACodecTest.test_streamc C s� | j d j t j d d � d D� d � � d � | j d j t j d d � d D� d � � d � | j d j t j d
d � d D� d � � d � | j d j t j d
d � d D� d � � d � t j d � � } | j | j d � d � | j | j d � d � | j | j d � d � | j | j d d � d � | j � | j | j d � d � | j | j d � d � | j | j d � d � | j | j d d � d � d S)Nr4 c s s | ] } t | g � Vq d S)N)r5 )r6 r7 r r r ru I s z8IDNACodecTest.test_incremental_decode.<locals>.<genexpr>s
python.orgr� z
python.orgc s s | ] } t | g � Vq d S)N)r5 )r6 r7 r r r ru M s s python.org.z python.org.c s s | ] } t | g � Vq d S)N)r5 )r6 r7 r r r ru Q s s xn--pythn-mua.org.u pythön.org.c s s | ] } t | g � Vq d S)N)r5 )r6 r7 r r r ru U s s xn--xams ple-9ta.ou äxample.s rgr3 TZorgs rg.zorg.)r r= r r> r r! r< )r
r� r r r �test_incremental_decodeG s, %%%%
z%IDNACodecTest.test_incremental_decodec C sP | j d j t j d d � � d � | j d j t j d d � � d � | j d j t j d d � � d � | j d j t j d d � � d � t j d � � } | j | j d � d � | j | j d
� d � | j | j d d
� d � | j � | j | j d � d � | j | j d � d � | j | j d d
� d � d S)Nr3 z
python.orgr� s
python.orgz python.org.s python.org.u pythön.org.s xn--pythn-mua.org.u äxz ample.orgs xn--xample-9ta.r4 Ts orgz
ample.org.s xn--xample-9ta.org.)r r= r �
iterencoder/ r0 r< )r
r� r r r �test_incremental_encodee s(
z%IDNACodecTest.test_incremental_encodec C sg d j d d � d j d d � x@ d
D]8 } | j t d j d | � | j t d j d | � q' Wd S) z$Only supports "strict" error handlerz
python.orgr� r� s
python.orgrm rn rj r� N)rm rn rj r� )r0 r! rv r� )r
r� r r r r� � s
zIDNACodecTest.test_errorsN) r r r r� r� r� r� r� r� r r r r r� 5 s r� c @ s� e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
d � Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d S)�CodecsModuleTestc C s� | j t j d d � d � | j t t j � | j t j d � d � | j t t j d d � | j t j d d d d � d � | j t j d
d d d �d
� d S)Ns �zlatin-1u äöüs abcr� s �r� �objr' s [�]r� rm z[])r r r! rv r> ry )r
r r r r� � s z CodecsModuleTest.test_decodec C s� | j t j d d � d � | j t t j � | j t t j d d � | j t j d � d � | j t t j d d � | j t j d
d d d � d � | j t j d d d
d �d � d S)Nu äöüzlatin-1s �ra �__spam__r� s abcu ÿffr� r� r' u [ÿ]r� rm s [])r r r0 rv r> � LookupErrorrw )r
r r r r� � s z CodecsModuleTest.test_encodec C s- | j t t j � | j t t j d � d S)NrF )rv r> r �register)r
r r r �
test_register� s z CodecsModuleTest.test_registerc C sC | j t t j � | j t t j d � | j t t j d � d S)Nr� � )rv r> r r� r� )r
r r r � test_lookup� s z CodecsModuleTest.test_lookupc C s- | j t t j � | j t t j d � d S)Nr� )rv r> r r� r� )r
r r r �test_getencoder� s z CodecsModuleTest.test_getencoderc C s- | j t t j � | j t t j d � d S)Nr� )rv r> r r� r� )r
r r r �test_getdecoder� s z CodecsModuleTest.test_getdecoderc C s- | j t t j � | j t t j d � d S)Nr� )rv r> r r9 r� )r
r r r �test_getreader� s z CodecsModuleTest.test_getreaderc C s- | j t t j � | j t t j d � d S)Nr� )rv r> r rb r� )r
r r r �test_getwriter� s z CodecsModuleTest.test_getwriterc C s� t j t j � } | j t j t j | � y t j t j d � Wn" t j k
rf | j d � Yn Xt j d � } | j | j d � d S)NZtr_TRztest needs Turkish locale�ASCIIr� )
�locale� setlocale�LC_CTYPEr� �ErrorZskipTestr r� r �name)r
Z oldlocaler7 r r r �test_lookup_issue1813� s z&CodecsModuleTest.test_lookup_issue1813c , C s> d- } | j | t j � x t j D] } t t | � q# Wd S).Nr0 r! r� � CodecInfo�Codec�IncrementalEncoder�IncrementalDecoder� StreamReader� StreamWriterr� r� r� r/ r r9 rb r~ r� �
strict_errors�replace_errorsr �xmlcharrefreplace_errors�backslashreplace_errors�namereplace_errorsr� re r� r> �BOM�BOM_BE�BOM_LErN � BOM_UTF16� BOM_UTF16_BE� BOM_UTF16_LE� BOM_UTF32� BOM_UTF32_BE� BOM_UTF32_LE�BOM32_BE�BOM32_LE�BOM64_BE�BOM64_LE�StreamReaderWriter�
StreamRecoder),r0 r! r� r� r� r� r� r� r� r� r� r� r/ r r9 rb r~ r� r� r� r r� r� r� r� re r� r> r� r� r� rN r� r� r� r� r� r� r� r� r� r� r� r� )ZassertCountEqualr �__all__�getattr)r
Zapir r r �test_all� s& zCodecsModuleTest.test_allc C sw | j t j t j � xZ d D]R } | j | � �: t j t j | d � � } | j | t j � Wd QRXWd QRXq Wd S) N�wr@ �r+�w+rV �a+r� )r� r@ r� r� rV r� ) r� r r� r� r% r r� r# r� )r
�mode�filer r r � test_open� s
zCodecsModuleTest.test_openc C s� | j t t j d d � | j t t j d d � | j t t j d d � | j t t j d d � xF d
D]> } | j t t j d d | � | j t t j d d | � qk Wd S) Nr� Z undefineds abcr4 r3 r� rm rn rj )r� rm rn rj )rv r� r r0 r! )r
r� r r r �test_undefined� s
z CodecsModuleTest.test_undefinedN)r r r r� r� r� r� r� r� r� r� r� r� r� r� r r r r r� � s
r� c @ s( e Z d Z d d � Z d d � Z d S)�StreamReaderTestc C s( t j d � | _ t j d � | _ d S)Nzutf-8s 한
글)r r9 rK rD rE rF )r
r r r �setUp� s zStreamReaderTest.setUpc C s2 | j | j � } | j | j � d d g � d S)Nu 한
u 글)rK rF r r] )r
r^ r r r �test_readlines� s z StreamReaderTest.test_readlinesN)r r r r� r� r r r r r� � s r� c @ s e Z d Z d d � Z d S)�EncodedFileTestc C s� t j d � } t j | d d � } | j | j � d � t j � } t j | d d � } | j d � | j | j � d � d S)Ns 한
글z utf-16-lezutf-8s \�
�zlatin-1s üs �)rD rE r re r r r r� )r
r^ �efr r r �
test_basic s
zEncodedFileTest.test_basicN)r r r r� r r r r r� s r� r� �big5� big5hkscs�charmap�cp037Zcp1006�cp1026�cp1125�cp1140�cp1250�cp1251�cp1252�cp1253�cp1254�cp1255�cp1256�cp1257�cp1258�cp424�cp437�cp500Zcp720Zcp737�cp775�cp850�cp852�cp855Zcp856�cp857�cp858�cp860�cp861�cp862�cp863�cp864�cp865�cp866�cp869Zcp874Zcp875�cp932�cp949�cp950� euc_jis_2004� euc_jisx0213�euc_jp�euc_kr�gb18030�gb2312�gbk� hp_roman8�hzr� �
iso2022_jp� iso2022_jp_1� iso2022_jp_2�iso2022_jp_2004� iso2022_jp_3�iso2022_jp_ext�
iso2022_kr� iso8859_1�
iso8859_10�
iso8859_11�
iso8859_13�
iso8859_14�
iso8859_15�
iso8859_16� iso8859_2� iso8859_3� iso8859_4� iso8859_5� iso8859_6� iso8859_7� iso8859_8� iso8859_9�johab�koi8_rZkoi8_tZkoi8_u�kz1048�latin_1� mac_cyrillic� mac_greek� mac_iceland�
mac_latin2� mac_roman� mac_turkishZpalmos�ptcp154rk Zraw_unicode_escape� shift_jis�shift_jis_2004�shift_jisx0213�tis_620Zunicode_escaperd �utf_16� utf_16_be� utf_16_le�utf_7�utf_8Z mbcs_encode�mbcsc @ sm e Z d Z d d � Z e j d d � � Z d d � Z d d � Z d d
� Z d d � Z
d
d � Z d S)�BasicUnicodeTestc s d } x�t D]�} t j | � j } | j d � rA | d 7} n | d k rS d } | j | j d d � | j d d � � t j � �o t j | � | � \ } } | j | t
| � d | � t j | � | � \ } } | j | | d | � Wd QRX| t k r�t
d � } t j | � | � } d } xS | D]K }
| j |
� | j � } | j t | � t k t | � � | | 7} q3Wt
d � } t j | � | � } d }
x4 | D], }
| j t |
g � � |
| j � 7}
q�W| j |
| d | � | t k r
y t j | � � � Wn t k
r-Yn(Xd } x! | D] }
| � j |
� 7} q;W| � j d d � 7} t j | � � � d }
x* | D]" }
|
� j t |
g � � 7}
q�W|
� j d d � 7}
| j |
| d | � d j t j t j | | � | � � } | j | | d | � d j t j t j d | � | � � } | j | d � | d k r
y t j | � d � � Wn t k
r�Yq
Xd j � f d
d � | D� � } t j | � d � � d j � f d d � | D� � }
| j |
| d | � q
Wd S)N�abc123Z_codecr r� �-z encoding=%rr3 r4 Tr� r- rm c 3 s | ] } � j | � Vq d S)N)r0 )r6 r7 )r� r r ru � s z/BasicUnicodeTest.test_basics.<locals>.<genexpr>c 3 s' | ] } � j t | g � � Vq d S)N)r! r5 )r6 r7 )r� r r ru � s )r� r- ) �all_unicode_encodingsr r� r� �endswithr rn r r� r� r r� � broken_unicode_with_statefulr rb r r r& �typer5 r9 r/ r� r0 r r! r= r> r� )r
r r' r� rt r r r? rc �
encodedresultr7 �chunkrK �
decodedresultrA r )r� r� r � test_basics� s|
(
"
"
z BasicUnicodeTest.test_basicsc s� d d l m } m } d } x�t D]�} | t k r# y | | � � Wn t k
rY Yn� Xd } x! | D] } | � j | � 7} qg W| � j d d � 7} | | � � d } x* | D]" } | � j t | g � � 7} q� W| � j d d � 7} | j | | d | � | d k r# y | | d
� � Wn t k
r9Yq# Xd j
� f d d � | D� � } | | d
� � d j
� f d
d � | D� � } | j | | d | � q# Wd S)Nr )�codec_incrementalencoder�codec_incrementaldecoderr/ r3 r4 Tz encoding=%rr� r- rm c 3 s | ] } � j | � Vq d S)N)r0 )r6 r7 )�cencoderr r ru � s z4BasicUnicodeTest.test_basics_capi.<locals>.<genexpr>c 3 s' | ] } � j t | g � � Vq d S)N)r! r5 )r6 r7 )�cdecoderr r ru � s )r� r- ) Z _testcapir9 r: r1 r3 r� r0 r! r5 r r= )r
r9 r: r r' r5 r7 r7 r )r< r; r �test_basics_capi� s<
"
z!BasicUnicodeTest.test_basics_capic C s� d d d d d f } x� t D]� } | d k r4 q | t k rC q t j | � t j | j | � � � } x@ t d � D]2 } | j d d � | j � } | j
| | � qw Wq Wd S)Nz%s
%s
�d r/ Zdef456r� r\ r ) r1 r3 r r9 rD rE r0 r �seekr r )r
r r' rK �trZ r r r � test_seek� s
' zBasicUnicodeTest.test_seekc C sS xL t D]D } t j | � } | j t | � | d k r | j t | d � q Wd S)Nr� rk rF )r� rk )r1 r r� rv r> )r
r' r� r r r �test_bad_decode_args s
z%BasicUnicodeTest.test_bad_decode_argsc C sH xA t D]9 } t j | � } t j � � | j t | � Wd QRXq Wd S)N)r1 r r� r r� rv r> )r
r' r� r r r �test_bad_encode_args s
z%BasicUnicodeTest.test_bad_encode_argsc C s3 d d l m } t | j � } | j | | � d S)Nr )r� )� encodingsr� r4 Zencoding_tabler )r
r� Z
table_typer r r �"test_encoding_map_type_initialized s z3BasicUnicodeTest.test_encoding_map_type_initializedc C s_ d } xR t D]J } | t k r
| j | | | j | � � | j | | | j | � � q
Wd S)Nr/ )r1 r3 r. r0 r1 )r
r( r' r r r r� s
z#BasicUnicodeTest.test_decoder_stateN) r r r r8 r Z cpython_onlyr= rA rB rC rE r� r r r r r. � s O' r. c @ s4 e Z d Z d d � Z d d � Z d d � Z d S)� CharmapTestc C sq | j t j d d d � d � | j t j d d d � d � | j t t j d d d � | j t t j d d d � | j t j d d d � d � | j t j d d d � d � | j t j d d
d � d � | j t j d d
d � d � | j t j d d d � d � | j t j d d d � d � t t d
� � } | j t j | d d � d t | � f � d S)Ns r� r� r� � bcr| u abrn � ab�rj �ab\x02rm rM r4 )r� r� )rG r� )rH r� )rH r� )rI r� )rI r� )r| r� )r| r� )r r �charmap_decoderv ry r5 r r )r
�allbytesr r r �test_decode_with_string_map& s@ z'CharmapTest.test_decode_with_string_mapc C s0 | j t j d d d d d d d d i � d � | j t j d d d d d d d d
i � d � | j t j d d d d d d d d i � d � | j t j d d d d d d d d i � d � | j t t j d d d d d d i � | j t t j d d d d d d d d i � | j t t j d d d d d d d d i � | j t j d d d d d d i � d � | j t j d d d d d d d d i � d � | j t j d d d d d d d d i � d � | j t j d d d d d d i � d! � | j t j d d d d d d d d i � d" � | j t j d d d d d d d d i � d# � | j t j d d d d d d i � d$ � | j t j d d d d d d d d i � d% � | j t j d d d d d d d d i � d& � t t d � � } | j t j | d i � d t | � f � d S)'Ns r� r rV r rt r] r7 r� r� ZAaZBbZCc�AaBbCcu � bcr4 r| u rn � ab�rj �ab\x02rm rM )r� r� )rM r� )rN r� )r| r� )rO r� )rO r� )rO r� )rP r� )rP r� )rP r� )r| r� )r| r� )r| r� )r r rJ rv ry r5 r r )r
rK r r r � test_decode_with_int2str_map] s� z(CharmapTest.test_decode_with_int2str_mapc C sp t d � } t d � } t d � } | j t j d d d | d | d | i � d � | j t j d d d d d | d | i � d � | j t j d d d t j d | d | i � t t j � d
d
f � | j t t j d d d t j d d | d | i � | j t t j d d d | d | i � | j t t j d d d | d | d d i � | j t j d d d | d | i � d � | j t j d d d | d | d d i � d � | j t j d d d | d | i � d � | j t j d d d | d | d d i � d � | j t j d d d | d | i � d � | j t j d d d | d | d d i � d � d S) NrV rt r7 s r� r r r] r� r� i�� � bcZbci�� rn � ab�rj �ab\x02rm r| )r� r� )rR r� )rS r� )rS r� )rT r� )rT r� )r| r� )r| r� )
�ordr r rJ r� �
maxunicode�chrrv r> ry )r
rV rt r7 r r r � test_decode_with_int2int_map� s` z(CharmapTest.test_decode_with_int2int_mapN)r r r rL rQ rX r r r r rF % s 7 hrF c @ s( e Z d Z d d � Z d d � Z d S)� WithStmtTestc
C sX t j d � } t j | d d � � } | j | j � d � Wd QRX| j | j � d S)Ns üzlatin-1zutf-8s �)rD rE r re r r r& rg )r
r^ r� r r r �test_encodedfile s z WithStmtTest.test_encodedfilec
C s` t j d � } t j d � } t j | | j | j d � � } | j | j � d � Wd QRXd S)Ns üzutf-8r� � ü) rD rE r r� r� � streamreader� streamwriterr r )r
r^ �info�srwr r r �test_streamreaderwriter s
z$WithStmtTest.test_streamreaderwriterN)r r r rZ r` r r r r rY s rY c @ s( e Z d Z d d � Z d d � Z d S)� TypesTestc C s� t j t j t j t j t j t j t j t j t j t j
t j t j g } t
t d � rm | j t j � x! | D] } | j t | d � qt Wd S)N� mbcs_decoderW )r r& � utf_8_decoder� r� r= r� r� r� �utf_32_ex_decode�latin_1_decode� ascii_decoderJ �hasattrrJ rb rv r> )r
Zdecodersr� r r r �test_decode_unicode s
z TypesTest.test_decode_unicodec C s | j t j d � d � | j t j d � d
� | j t j d � d � | j t j d � d � | j t t j d � | j t j d d � d � | j t j d d
� d � | j t t j d � | j t j d d � d � | j t j d d
� d � d S)Nz\u1234� ሴr s \u1234s
\U00110000z
\U00110000rn � �rO rj �(\x5c\x55\x30\x30\x31\x31\x30\x30\x30\x30)ri r )ri r )ri r )ri r )rj rO )rk rO )rj rO )rk rO )r r �unicode_escape_decode�raw_unicode_escape_decoderv ry )r
r r r �test_unicode_escape5 s z TypesTest.test_unicode_escapeN)r r r rh rn r r r r ra s ra c @ sX e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
S)�UnicodeEscapeTestc C s6 | j t j d � d � | j t j d � d � d S)Nr4 r3 r )r3 r )r4 r )r r �unicode_escape_encoderl )r
r r r rE I s z UnicodeEscapeTest.test_emptyc C s^ t j } xN t d d � D]= } | d k r | j | t | � � t | g � d f � q Wd S)N� � s \r r �\ )r rp r r rW r5 )r
r0 rt r r r �test_raw_encodeM s z!UnicodeEscapeTest.test_raw_encodec C sc t j } xS t d � D]E } | d k r | j | t | g � d � t | � d d f � q Wd S)NrM s \r r\ �0r] rs )r rl r r r5 rW )r
r! rt r r r �test_raw_decodeS s z!UnicodeEscapeTest.test_raw_decodec C s� t j } t | | � } | d d � | d d � | d d � | d d � xC t d � D]5 } t | � d
k rY | t | � d | j � � qY Wx4 t d d
� D]# } | t | � d | j � � q� W| d d � | d d � d S)N� s \trP s \nrR s \r�\s \\rq z
z\x%02xrr rM u €s \u20acu 𝄠s
\U0001d120)r rp r r rW r0 )r
r0 r
rt r r r �test_escape_encodeY s
!!
z$UnicodeEscapeTest.test_escape_encodec C s� t j } t | | � } | d d � | d d � | d d � | d d � | d d
� | d d � | d
d � | d d � | d d � | d d � | d d � | d d
� | d d � | d d � | d d � | d d � | d d! � | d" d# � | d$ d! � | d% d# � | d& d' � | d( d) � xD t d* � D]6 } | d+ k rC| d, t | g � d- t | � � qCWd S).Ns [\
]z[]s [\"]z["]s [\']z[']s [\\]z[\]s [\a]z[]s [\b]z[]s [\t]z[ ]s [\n]z[
]s [\v]z[ ]s [\f]z[ ]s [\r]z[
]s [\7]s [\8]z[\8]s [\78]z[8]s [\41]z[!]s [\418]z[!8]s [\101]z[A]s [\1010]z[A0]s [\x41]s [\x410]s \u20acu €s
\U0001d120u 𝄠rM s
"'\abtnvfr01234567xuUNs \rx )r rl r r r5 rW )r
r! r
rt r r r �test_escape_decodeh s6
z$UnicodeEscapeTest.test_escape_decodec C s. t j } x� d D]� \ } } x� t | � D]� } | j t | d | d | � | j t | d | d | d � d | d | d
| d | } | j | | d � d t | � f � | j | | d
� d t | � f � q) Wq W| j t | d � | j | d d � d � | j | d d
� d � d S)N� xr] � ur� � Us \r\ s [\� ]s ]\rm z[]rn u [�]�s
\U00110000r4 rO � ��r{ r] �r| r� �r} r� )r� r� r� )r4 rO )r rO )r rl r rv ry r r )r
r! r7 r* r) rZ r r r �test_decode_errors� s "%z$UnicodeEscapeTest.test_decode_errorsN) r r r rE rt rv ry rz r� r r r r ro H s ro c @ sX e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
S)�RawUnicodeEscapeTestc C s6 | j t j d � d � | j t j d � d � d S)Nr4 r3 r )r3 r )r4 r )r r �raw_unicode_escape_encoderm )r
r r r rE � s z RawUnicodeEscapeTest.test_emptyc C sO t j } x? t d � D]1 } | j | t | � � t | g � d f � q Wd S)NrM r )r r� r r rW r5 )r
r0 rt r r r rt � s z$RawUnicodeEscapeTest.test_raw_encodec C sW t j } xG t d � D]9 } | j | t | g � d � t | � d d f � q Wd S)NrM r\ ru r] )r rm r r r5 rW )r
r! rt r r r rv � s z$RawUnicodeEscapeTest.test_raw_decodec C s} t j } t | | � } xD t d � D]6 } | d k r% | d t | � d t | g � � q% W| d d � | d d � d S) NrM s uUrx s \u €s \u20acu 𝄠s
\U0001d120)r r� r r rW r5 )r
r0 r
rt r r r ry � s (
z'RawUnicodeEscapeTest.test_escape_encodec C s} t j } t | | � } xD t d � D]6 } | d k r% | d t | g � d t | � � q% W| d d � | d d � d S) NrM s uUs \rx s \u20acu €s
\U0001d120u 𝄠)r rm r r r5 rW )r
r! r
rt r r r rz � s (
z'RawUnicodeEscapeTest.test_escape_decodec C s. t j } x� d D]� \ } } x� t | � D]� } | j t | d | d | � | j t | d | d | d � d | d | d | d | } | j | | d � d
t | � f � | j | | d � d t | � f � q) Wq W| j t | d
� | j | d
d � d � | j | d
d � d � d S)Nr| r� r} s \r\ s [\r~ s ]\rm z[]rn u [�]�s
\U00110000r4 rO � ��r| r� �r} r� )r� r� )r4 rO )r� rO )r rm r rv ry r r )r
r! r7 r* r) rZ r r r r� � s "%z'RawUnicodeEscapeTest.test_decode_errorsN) r r r rE rt rv ry rz r� r r r r r� � s r� c @ s e Z d Z d d � Z d S)�EscapeEncodeTestc C s� d d d d d d! d# d% g } xG | D]? \ } } | j d | � � | j t j | � | � Wd QRXq% W| j t t j d � | j t t j t d � � d S)&Nr3 r � foobarr � spam eggs� spam\x00eggs� � a'b� a\'br� � b\c� b\\c� c
d� c\nd� d
e� d\re� fg� f\x7fgrZ r s spam�r3 r )r3 r� �r� r )r� r� �r� r� )r� r� �r� r� )r� r� �r� r� )r� r� �r� r� )r� r� �r� r� )r� r� �r� r� )r� r� )r% r r r� rv r> r[ )r
r� rZ �outputr r r ry � s $z#EscapeEncodeTest.test_escape_encodeN)r r r ry r r r r r� � s r� c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S)
�SurrogateEscapeTestc C st | j d j d d � d � | j d j d d � d � | j d j d d � d � | j d j d d � d � d S)Ns foo�barzutf-8r� u foo�bars �u ���)r r! r0 )r
r r r � test_utf8� s z SurrogateEscapeTest.test_utf8c C s< | j d j d d � d � | j d j d d � d � d S)Ns foo�barr� r� u foo�bar)r r! r0 )r
r r r r � s z SurrogateEscapeTest.test_asciic C s< | j d j d d � d � | j d j d d � d � d S)Ns foo�barz
iso-8859-3r� u foo�bar)r r! r0 )r
r r r � test_charmap� s z SurrogateEscapeTest.test_charmapc C s | j d j d d � d � d S)Nu �����zlatin-1r� s ���)r r0 )r
r r r � test_latin1� s z SurrogateEscapeTest.test_latin1N)r r r r� r r� r� r r r r r� � s r� c @ s e Z d Z d d � Z d S)�BomTestc ( C s� d } d } | j t j t j � x�| D]�} t j t j d d | ��o } | j | � | j | � | j d
� | j | j � | d � | j d
� | j | j � | d � Wd QRXt j t j d d | ��k } | j | d
� | j
| j � d
� | j d
� | j | � | j d
� | j | j � | � Wd QRXt j t j d d | ��w } | j j | d
� | j
| j j � d
� | j j d
� | j j | � | j d
� | j | j � | � Wd QRXt j t j d d | ��[ } | j | � | j | j � � | j | � | j d
� | j | j � | d � Wd QRXt j t j d d | ��g } | j j | � | j j | j j � � | j j | � | j d
� | j | j � | d � Wd QRXq) Wd S)
NZ
1234567890�utf-16� utf-16-le� utf-16-be�utf-32� utf-32-le� utf-32-bezw+r' r r] )r� r� r� r� r� r� )
r� r r� r� r r� r r? r r ZassertNotEqual�tellrc )r
rZ r� r' r^ r r r �
test_seek0� sT
!
!
zBomTest.test_seek0N)r r r r� r r r r r� � s r� � base64_codec�uu_codec� quopri_codec� hex_codec�base64�base_64�uu�quopri�quoted_printable�quotedprintable�hex�rot_13�rot13�
zlib_codecr: �zlib� bz2_codec�bz2c @ s� e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
d � Z d d � Z
e j e
d � d d � � Z d d � Z d d � Z d d � Z d d � Z d S) �TransformCodecTestc C s� t t d � � } x� t D]� } | j d | � �w t j | � | � \ } } | j | t | � � t j | � | � \ } } | j | t | � � | j | | � Wd QRXq Wd S)NrM r' ) r5 r �bytes_transform_encodingsr% r r� r r r� )r
Zbinputr' �or r) r r r r8 W
s
z TransformCodecTest.test_basicsc C s{ xt t D]l } | j d | � �Q t j d | � } t j | � t j | � � } | j � } | j | d � Wd QRXq Wd S)Nr' s �) r� r% r r0 r9 rD rE r r )r
r' �sinrK �soutr r r � test_readb
s
z TransformCodecTest.test_readc C s{ xt t D]l } | j d | � �Q t j d | � } t j | � t j | � � } | j � } | j | d � Wd QRXq Wd S)Nr' s �) r� r% r r0 r9 rD rE rI r )r
r' r� rK r� r r r rY j
s
z TransformCodecTest.test_readlinec C s� d } x� t D]� } | j d | � �� | } t | � } t j | | � } t j | | � } | j | | � t | � } t j | | � } | j | | � t j | | � } | j | | � Wd QRXq
Wd S)Ns 12345�r' )r� r% �
memoryviewr r0 r r! )r
Zoriginalr' rZ ZviewZ view_encodedZ view_decodedr r r �test_buffer_api_usager
s
z(TransformCodecTest.test_buffer_api_usagec C s� d } xy t D]q } | j d | � �V d } | j | � } | j t | � � } | j | � Wd QRX| j | j j � Wd QRXq
Wd S)Nzbad input typer' zM{!r} is not a text encoding; use codecs.encode\(\) to handle arbitrary codecs) r� r% �format�assertRaisesRegexr� r0 � assertIsNone� exception� __cause__)r
� bad_inputr' �fmt�msg�failurer r r �0test_text_to_binary_blacklists_binary_transforms�
s
zCTransformCodecTest.test_text_to_binary_blacklists_binary_transformsc C s1 d } | j t | � � d j d � Wd QRXd S)NzR^'rot_13' is not a text encoding; use codecs.encode\(\) to handle arbitrary codecszjust an example messager� )r� r� r0 )r
r� r r r �.test_text_to_binary_blacklists_text_transforms�
s zATransformCodecTest.test_text_to_binary_blacklists_text_transformsc C s� d } x� t D]� } | j d | � �� t j | | � } d } | j | � } | j t | � � | j | � Wd QRX| j t | � � t | � j | � Wd QRXWd QRXq
Wd S)Ns6 encode first to ensure we meet any format restrictionsr' zM{!r} is not a text encoding; use codecs.decode\(\) to handle arbitrary codecs) r� r% r r0 r� r� r� r! r[ )r
rZ r' Z encoded_datar� r� r r r �0test_binary_to_text_blacklists_binary_transforms�
s
zCTransformCodecTest.test_binary_to_text_blacklists_binary_transformsc C s} xv d t d � f D]b } | j d | � �G d } | j t | � � } | j d � Wd QRX| j | j j � Wd QRXq Wd S)Ns immutables mutabler� zR^'rot_13' is not a text encoding; use codecs.decode\(\) to handle arbitrary codecsr� )r[ r% r� r� r! r� r� r� )r
r� r� r� r r r �.test_binary_to_text_blacklists_text_transforms�
s zATransformCodecTest.test_binary_to_text_blacklists_text_transformszRequires zlib supportc C sU d } | j t | � � } t j d d � Wd QRX| j | j j t | j � � d S)Nz(^decoding with 'zlib_codec' codec faileds hellor� )r� r� r r! r# r� r� r4 )r
r� r� r r r �!test_custom_zlib_error_is_wrapped�
s
z4TransformCodecTest.test_custom_zlib_error_is_wrappedc C sU d } | j t | � � } t j d d � Wd QRX| j | j j t | j � � d S)Nz'^decoding with 'hex_codec' codec faileds hellor� )r� r� r r! r# r� r� r4 )r
r� r� r r r � test_custom_hex_error_is_wrapped�
s
z3TransformCodecTest.test_custom_hex_error_is_wrappedc C s� xy t j � D]k \ } } t j | � j } xJ | D]B } | j d | � �' t j | � } | j | j | � Wd QRXq2 Wq
Wd S)N�alias)�transform_aliases�itemsr r� r� r% r )r
�
codec_name�aliasesZ
expected_namer� r^ r r r � test_aliases�
s
z TransformCodecTest.test_aliasesc C sH t j d d � } | j | d � d } | j t j | d � | � d S)Ns space tab eol
z quopri-codecs space=20tab=09eol=20
s space tab eol
)r r0 r r! )r
rB Z unescapedr r r �test_quopri_stateless�
s z(TransformCodecTest.test_quopri_statelessc C s | j t t j d d � d S)Nr3 zuu-codec)rv rb r r! )r
r r r �test_uu_invalid�
s z"TransformCodecTest.test_uu_invalidN)r r r r8 r� rY r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r� U
s
r� c C s
t j | � S)N)� _TEST_CODECS�get)r� r r r �_get_test_codec�
s r� )�
_forget_codecc C s d S)Nr )r� r r r r� �
s r� c @ s� e Z d Z d d � Z d d � Z d d � Z e j d d � � Z d d
� Z e
d d � Z d
d � Z d d � Z
d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d! d" � Z d# d$ � Z d% S)&�ExceptionChainingTestc C sA t | � t t | � � } t j | � j � | _ t | _ d S)N) �reprrH �idrD �normalize_encodingrm r� � RuntimeError� obj_to_raise)r
Z unique_idr r r r� �
s zExceptionChainingTest.setUpc C sS t j | j d � t j j | j d � y t | j � Wn t k
rN Yn Xd S)N)r� �popr� rD �_cacher� �KeyError)r
r r r �tearDown s
z ExceptionChainingTest.tearDownc C s, t j | | d | j �} | t | j <d S)Nr� )r r� r� r� )r
r0 r! Z
codec_infor r r � set_codec s z ExceptionChainingTest.set_codecc
c so d j | | j | j | � } | j | | � � } | VWd QRX| j | j j | � | j | j j j � d S)Nz${} with {!r} codec failed \({}: {}\)) r� r� r r� r# r� r� ZassertIsNotNone�
__traceback__)r
Z operation�exc_typer� Zfull_msgZcaughtr r r �
assertWrapped s z#ExceptionChainingTest.assertWrappedc O s
| j � d S)N)r� )r
�args�kwdsr r r � raise_obj s z ExceptionChainingTest.raise_objc C s� | | _ | j | j | j � | j d | | � � d j | j � Wd QRX| j d | | � � t j d | j � Wd QRX| j d | | � � d j | j � Wd QRX| j d | | � � t j d | j � Wd QRXd S)Nr' � str_inputZdecodings bytes input)r� r� r� r� r0 r� r r! )r
r� r� r� r r r �
check_wrapped" s z#ExceptionChainingTest.check_wrappedc C s | j t d � d S)Nr4 )r� r� )r
r r r �test_raise_by_type. s z(ExceptionChainingTest.test_raise_by_typec C s d } | j t | � | � d S)NzThis should be wrapped)r� r� )r
r� r r r �test_raise_by_value1 s z)ExceptionChainingTest.test_raise_by_valuec C s9 d } Gd d � d t � } | j | | � | | � d S)NzThis should be wrappedc @ s e Z d Z f Z d S)zWExceptionChainingTest.test_raise_grandchild_subclass_exact_size.<locals>.MyRuntimeErrorN)r r r � __slots__r r r r �MyRuntimeError7 s r� )r� r� )r
r� r� r r r �)test_raise_grandchild_subclass_exact_size5 s z?ExceptionChainingTest.test_raise_grandchild_subclass_exact_sizec C s9 d } Gd d � d t � } | j | | � | | � d S)NzThis should be wrappedc @ s e Z d Z d S)zVExceptionChainingTest.test_raise_subclass_with_weakref_support.<locals>.MyRuntimeErrorN)r r r r r r r r� = s r� )r� r� )r
r� r� r r r �(test_raise_subclass_with_weakref_support; s z>ExceptionChainingTest.test_raise_subclass_with_weakref_supportc s� � f d d � } | j | | � | j t | � � d j | j � Wd QRX| j t | � � t j d | j � Wd QRX| j t | � � d j | j � Wd QRX| j t | � � t j d | j � Wd QRXd S)Nc s
� � d S)Nr )r� r� )r� r r r� B s z:ExceptionChainingTest.check_not_wrapped.<locals>.raise_objz str inputs bytes input)r� r� r� r0 r� r r! )r
r� r� r� r )r� r �check_not_wrappedA s z'ExceptionChainingTest.check_not_wrappedc C s* Gd d � d t � } | j | d � d S)Nc @ s e Z d Z d d � Z d S)zKExceptionChainingTest.test_init_override_is_not_wrapped.<locals>.CustomInitc S s d S)Nr )r
r r r r P s zTExceptionChainingTest.test_init_override_is_not_wrapped.<locals>.CustomInit.__init__N)r r r r r r r r �
CustomInitO s r� r4 )r� r� )r
r� r r r �!test_init_override_is_not_wrappedN s z7ExceptionChainingTest.test_init_override_is_not_wrappedc C s* Gd d � d t � } | j | d � d S)Nc s" e Z d Z � f d d � Z � S)zIExceptionChainingTest.test_new_override_is_not_wrapped.<locals>.CustomNewc s t � j | � S)N)r� �__new__)�cls)r� r r r� V s zQExceptionChainingTest.test_new_override_is_not_wrapped.<locals>.CustomNew.__new__)r r r r� r r )r� r � CustomNewU s r r4 )r� r� )r
r r r r � test_new_override_is_not_wrappedT s z6ExceptionChainingTest.test_new_override_is_not_wrappedc C s8 d } t | � } d | _ | j | d j | � � d S)NzThis should NOT be wrappedr z^{}$)r� �attrr� r� )r
r� �excr r r �&test_instance_attribute_is_not_wrappedZ s z<ExceptionChainingTest.test_instance_attribute_is_not_wrappedc C s | j t d � d � d S)Nr �1)r� r� )r
r r r � test_non_str_arg_is_not_wrapped` s z5ExceptionChainingTest.test_non_str_arg_is_not_wrappedc C s& d } | j t d d d � | � d S)Nz^\('a', 'b', 'c'\)$rV rt r7 )r� r� )r
Zmsg_rer r r �!test_multiple_args_is_not_wrappedc s z7ExceptionChainingTest.test_multiple_args_is_not_wrappedc C s� d j | j � } | j t | � � d j | j � Wd QRX| j t | � � t j d | j � Wd QRX| j t | � � d j | j � Wd QRX| j t | � � t j d | j � Wd QRXd S)Nz^unknown encoding: {}$z str inputs bytes input)r� r� r� r� r0 r r! )r
r� r r r �%test_codec_lookup_failure_not_wrappedh s z;ExceptionChainingTest.test_codec_lookup_failure_not_wrappedc C s� d d � } d d � } | j | | � t j d | j � } | j | d � t j d | j � } | j | d � d } | j | j � } | j t | � � d j | j � Wd QRXd } | j | j � } | j t | � � d
j | j � Wd QRXd S) Nc _ s d S)N�
not bytes!r )r r r )r� r� r r r �
encode_to_strz s zSExceptionChainingTest.test_unflagged_non_text_codec_handling.<locals>.encode_to_strc _ s d S)N� not str!r )r r r )r� r� r r r �decode_to_bytes| s zUExceptionChainingTest.test_unflagged_non_text_codec_handling.<locals>.decode_to_bytesz
not bytes!s not str!zd^{!r} encoder returned 'str' instead of 'bytes'; use codecs.encode\(\) to encode to arbitrary types$r� zd^{!r} decoder returned 'bytes' instead of 'str'; use codecs.decode\(\) to decode to arbitrary types$s bytes input) r� r r0 r� r r! r� r� r> )r
r
r rB r� r� r� r r r �&test_unflagged_non_text_codec_handlingt s z<ExceptionChainingTest.test_unflagged_non_text_codec_handlingN)r r r r� r� r� �
contextlib�contextmanagerr� r� r� r� r� r� r� r� r� r� r r r r r r
r r r r r� �
s$
r� z"code pages are specific to Windowsc @ s� e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d S)� CodePageTesti� c C sh | j t t j d d � | j t t j d d � | j t t j d d � | j t t j d d � d S)Nr rV � a�{ r r )rv rb r �code_page_encode�code_page_decode�OSError)r
r r r �test_invalid_code_page� s z#CodePageTest.test_invalid_code_pagec C sg | j t d t j d d � | j t d t j d d d d � | j t d t j | j d d d � d S) Nr� i� � ÿs � r� T�CP_UTF8s �)r� rw r r ry r r )r
r r r �test_code_page_name� s z CodePageTest.test_code_page_namec C s x| D]� \ } } } | d k r� y t j | | | d � } WnB t k
r� } z" | j d | | | | f � WYd d } ~ Xn X| j | d | d | | | | d | f � | j | d d � | j | d t | � � q | j t t j | | | d � q Wd S)NTz2Unable to decode %a from "cp%s" with errors=%r: %sr z %a.decode("cp%s", %r)=%a != %ar ) r r ry r� r ZassertGreaterEqualZassertLessEqualr rv )r
�cpr� r� r� r� r� r� r r r � check_decode� s ' zCodePageTest.check_decodec C s� x� | D]� \ } } } | d k r� y t j | | | � } WnB t k
r } z" | j d | | | | f � WYd d } ~ Xn X| j | d | d | | | | d | f � | j | d t | � � q | j t t j | | | � q Wd S)Nz0Unable to encode %a to "cp%s" with errors=%r: %sr z %a.encode("cp%s", %r)=%a != %ar )r r rw r� r r rv )r
r r� r� r� r� rB r� r r r � check_encode� s ' zCodePageTest.check_encodec C s$ | j d d- � | j d d: � d S);Ni� r� r� � abc� ｄ騾� ���r � [ÿ]rm � []rn � [y]� [€]� [?]rj � [\xff]rk �) [\N{LATIN SMALL LETTER Y WITH DIAERESIS}]rl � [ÿ]� �� [�]r� � [�]rs �[]� [�]�[\xff]� � abc� abc� � abc�\x81 abc�r� r� r �r r� r �r r� N�r rm r! �r rn r" �r# rn r$ �r rj r% �r rk r& �r rl r' �r( r� N�r) r� r* �r) rs N) r2 r3 r4 r5 r6 r7 r8 r9 r: r; r< r= �r r� r� �r r� r �r* r� N�r* rm r+ �r* rn r, �r* rj r- �r* r� r) �r* rs N�r. r� N�r. rm r/ �r. rn r0 �r. rj r1 ) r> r? r@ rA rB rC rD rE rF rG rH rI )r r )r
r r r �
test_cp932� s6 zCodePageTest.test_cp932c C s$ | j d d � | j d d � d S) Ni� r� r� � abc� é€� �r � �� Łrm r3 rn � L� �r� � �rs �r� r� rK �rL r� rM �r r� rN �rO r� N�rO rm r3 �rO rn rP �rQ r� rR �rQ rs N)rS rT rU rV rW rX rY rZ �rK r� r� �rM r� rL �rN r� r )r[ r\ r] )r r )r
r r r � test_cp1252� s zCodePageTest.test_cp1252c C s* d } | j | d � | j | d � d S) Ni� r� r� � abc� é€� +AOkgrA-� � +2//f/w-� �� +3IA-� �� +//0-� [+/]�[]� [�]� [ÿ]�r� r� r_ �r` r� ra �rb r� rc �rd r� re �rf r� rg )rl rm rn ro rp �r_ r� r� �ra r� r` �rc r� rb �re r� rd �rg r� rf �rh r� ri �rj r� rk )rq rr rs rt ru rv rw )r r )r
r r r r � test_cp_utf7� s zCodePageTest.test_cp_utf7c C s@ | j d d � | j | j d � t r< | j | j d � d S)Ni� � ��rm � 騾rn � �騾� �� � �� [�]� []� [?]�ry rm rz �ry rn r{ )r� r� �r| rm r} �r| rn r~ )r� r� �r rm r� �r rn r� )r� r� )r r r� r )r
r r r �test_multibyte_encoding s z$CodePageTest.test_multibyte_encodingc C s� t j d d d d � } | j | d � t j d d d d � } | j | d � t j d d
d d � } | j | d � t j d d
d d � } | j | d � d S)Ni� s �r� Fr4 r s �� 騾r] s �� 騾騾r� s abcr� r� )r4 r )r� r] )r� r� )r� r� )r r r )r
r� r r r �test_incremental s z CodePageTest.test_incrementalN)
r r r r r r r r rJ r^ rx r� r� r r r r r � s ! r �__main__)Pr r rD r� r� r� �warningsrD Ztestr �platformZgetwindowsversion�majorr� Zctypes� ImportErrorr� ZsizeofZc_wcharr rx r r r2 ZTestCaser} r� r� r� r� r� r� r� r� r� r< r@ rG rY rc rl r) r �printr� rj rp r� r� r� r� r� r� r1 rg rJ r3 r. rF rY ra ro r� r� r� r� r� r� r� r� r� r� r� r� �_codecsr� r� r r �mainr r r r �<module> s�
!� 0 _ - . V , , 6e � T5
T Vl
��)N2":
�
��