Your IP : 216.73.216.213
�
f fq� � l @ s� d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z e j
d k r� e j � j d k Z
n d Z
y d d l Z Wn e k
r� d Z d Z Yn Xe j e j � Z d d � Z Gd d
� d
e � Z Gd d � d � Z Gd
d � d e � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z Gd d � d e e j � Z e j e j
d k d � Gd d � d e e j � � Z! Gd d! � d! e e j � Z" Gd" d# � d# e j � Z# Gd$ d% � d% e j � Z$ Gd& d' � d' e e j � Z% Gd( d) � d) e j � Z& Gd* d+ � d+ e j � Z' d, d- f d. d/ f d0 d1 f d2 d3 f d4 d5 f d6 d7 f d8 d9 f d: d; f d< d= f d> d? f d@ dA f dB dC f dD dE f dF dG f dH dI f dJ dK f dL dM f dN dO f dP dQ f g Z( x3 e( D]+ Z) e* e) � dR k r�e+ e, e) � � n q{WGdS dT � dT e j � Z- GdU dV � dV e j � Z. dW dX f dY dZ f d[ d\ f d] d^ f d_ d` f d d f da db f dc dd f de de f df df f dg dg f dh dh f di di f dj dj f dk dj f dl d f dm dj f dn do f dp dj f dq dq f dr d f ds d f dt do f du d f dv d f dw d f dx d f dy d f dz d f d{ d f d| d f d} d f d~ d f d� d f d� d f d� d f d� d f d� d f d� d f d� d� f d� d f d� d� f d d f d� d� f d� d� f g- Z/ Gd� d� � d� e j � Z0 Gd� d� � d� e j � Z1 Gd� d� � d� e j � Z2 Gd� d� � d� e j � Z3 Gd� d� � d� e j � Z4 d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� d� gd Z5 e6 e d� � rEe5 j7 d� � n d� d� g Z8 Gd� d� � d� e j e � Z9 Gd d� de j � Z: Gdd� de j � Z; Gdd� de j � Z< Gdd� de j � Z= Gdd � d e j � Z> Gd
d � d e j � Z? Gd d
� d
e j � Z@ ddddg ZA i ddg d6dg d6dddg d6dg d6dg d6ZB y d d lC ZC Wn e k
r�d ZC Yn XeA j7 d� d d g eB d<y d d lD ZD Wn e k
r�Yn XeA j7 d � d g eB d <Gd d!� d!e j � ZE i ZF d"d#� ZG e jH eG � y d d$lI mJ ZJ Wn e k
rb d%d&� ZJ Yn XGd'd(� d(e j � ZK e j e j
d k d)� Gd*d+� d+e j � � ZL eM d,k r� e jN � n d S(- � N)�support�win32� F� c s � � f d d � } | S)Nc s& � j � | � | t | � f � d S)N)� assertEqual�len)�inputZexpect)�coder�self� �5/opt/alt/python34/lib64/python3.4/test/test_codecs.py�check s z coding_checker.<locals>.checkr )r
r r
r )r r
r �coding_checker s r c @ s= e Z d Z d Z d d � Z d d � Z d
d d � Z d S) �QueuezF
queue: write bytes at one end, read bytes from the other end
c C s
| | _ d S)N)�_buffer)r
�bufferr r r �__init__" s zQueue.__init__c C s | j | 7_ d S)N)r )r
�charsr r r �write% s z Queue.writer c C s` | d k r/ | j } | j d d � | _ | S| j d | � } | j | d � | _ | Sd S)Nr )r )r
�size�sr r r �read( s z
Queue.readN���)�__name__�
__module__� __qualname__�__doc__r r r r r r r r s r c @ s( e Z d Z d d � Z d d � Z d S)�MixInCheckStateHandlingc C s xt t | � d � D]� } t j | � � } | j | d | � � } | j � } | j | d t � | d s� | j | d d d � d f � | j | j | d � � | j
| | j � � n t j | � � } | j | � | j | | d � d � } | j
| | | � q Wd S)Nr r T) �ranger �codecs�getincrementaldecoder�decode�getstate�assertIsInstance�int�setstate�
assertTruer ) r
�encoding�ur �i�d�part1�state�part2r r r �check_state_handling_decode3 s
!
z3MixInCheckStateHandling.check_state_handling_decodec C s� x� t t | � d � D]� } t j | � � } | j | d | � � } | j � } t j | � � } | j | � | j | | d � d � } | j | | | � q Wd S)Nr T)r r r �getincrementalencoder�encoder" r% r ) r
r' r( r r) r* r+ r, r- r r r �check_state_handling_encodeI s
z3MixInCheckStateHandling.check_state_handling_encodeN)r r r r. r1 r r r r r 2 s r c @ sv e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
d � Z d Z
d d � Z d S)�ReadTestc
C s9 t d � } t j | j � | � } d } x_ t | j | j � | � D]B \ } } | j t | g � � | | j � 7} | j | | � qF W| j | j � d � | j | j
d � t j | j � � } d } xU t | j | j � | � D]8 \ } } | | j t | g � � 7} | j | | � q� W| j | j d d � d � | j | j
d � | j � d } xU t | j | j � | � D]8 \ } } | | j t | g � � 7} | j | | � q�W| j | j d d � d � | j | j
d � | j | j � } | j | d j t j d d � | D� | j � � � d S)N� � Tc S s g | ] } t | g � � q Sr )�bytes)�.0�cr r r �
<listcomp>| s z*ReadTest.check_partial.<locals>.<listcomp>)r r � getreaderr' �zipr0 r r5 r r �
bytebufferr r! r �reset�join�
iterdecode)
r
r Zpartialresults�q�r�resultr7 Z
partialresultr* �encodedr r r �
check_partialT s6 ((
( zReadTest.check_partialc se � f d d � � d d � f d d � } d } d } d } � j | | d � | � � j | | d � | � � j | | d d
� | � � j | | d d
� | � d } g } g } xP t | � D]B \ } } | j | d d d | � | j | d d d � q� W� j | d j | � d � d j | � � � j | d j | � d � d j | � � x� t d � D]� }
x� | D]� } d
|
d | d } � | � } xT t d
� D]F } � j | j d d � |
d | � � j | j d d � d � q�W� | � } xP t d
� D]B } � j | j d d � |
d � � j | j d d � d � qWq{WqnWd S)Nc s1 t j | j � j � � } t j � j � | � S)N)�io�BytesIOr0 r' r r9 )r �stream)r
r r r9 � s z)ReadTest.test_readline.<locals>.getreaderTc sU � | � } g } x3 | j d | d | � } | s7 Pn | j | � q Wd j | � S)Nr �keepends�|)�readline�appendr= )r rG r �reader�lines�line)r9 r r � readalllines� s z,ReadTest.test_readline.<locals>.readalllinesu foo
bar
baz
spam
eggsu foo
|bar
|baz
|spam
|eggszfoo|bar|baz|spam|eggsF�
�
�
�
�
�� u あr4 rH �P �azxxx
rG �xxx)rP rQ rR rS )r � enumeraterJ r= r rI ) r
rN r Z sexpectedZsexpectednoendsZlineendsZvwZvwor) Zlineendr rK r )r9 r
r �
test_readline sH
++
zReadTest.test_readlinec s� d d d d g } d j | � � � � f d d � } | � } � j | j � | d � � j | j � d j | d d � � � � j | j � d � | � } � j | j � | d � � j | j � | d d � � � j | j � d � | � } � j | j d
d d d
� � d d
� � � j | j � � d
d � � � j | j � d � | � } � j | j d
d d d
� � d d
� � � j | j � | d d
d � g | d d � � � j | j � d � d S)Nz Humpty Dumpty sat on a wall,
z!Humpty Dumpty had a great fall.
z-All the king's horses and all the king's men
z#Couldn't put Humpty together again.r4 c s1 t j � j � j � � } t j � j � | � S)N)rD rE r0 r' r r9 )rF )�datar
r r r9 � s z8ReadTest.test_mixed_readline_and_read.<locals>.getreaderr r r �( r � )r= r rI r � readlines)r
rL r9 �fr )rZ r
r � test_mixed_readline_and_read� s, ) , ,5z%ReadTest.test_mixed_readline_and_readc = C s. d d d d d d d d d d
d d d
d d d d d d d d d d d d d d d d d d d d d d d d d d! d" d# d$ d% d& d' d( d) d* d d+ d, d- d. d/ d0 d1 d2 d3 d4 d5 d6 g= } t j d7 j | � j | j � � } t j | j � | � } x. t | � D] \ } } | j | | | � qWd S)8Nz:<%!--===================================================
z, BLOG index page: show recent articles,
z7 today's articles, or articles of a specific date.
z>========================================================--%>
z!<%@inputencoding="ISO-8859-1"%>
z <%@pagetemplate=TEMPLATE.y%>
z$<%@import=import frog.util, frog%>
z!<%@import=import frog.objects%>
z9<%@import=from frog.storageerrors import StorageError%>
z<%
z
zimport logging
z+log=logging.getLogger("Snakelets.logger")
zuser=self.SessionCtx.user
z-storageEngine=self.SessionCtx.storageEngine
z-def readArticlesFromDate(date, count=None):
z2 entryids=storageEngine.listBlogEntries(date)
z% entryids.reverse() # descending
z if count:
z# entryids=entryids[:count]
z
try:
z\ return [ frog.objects.BlogEntry.load(storageEngine, date, Id) for Id in entryids ]
z except StorageError,x:
z6 log.error("Error loading articles: "+str(x))
z, self.abort("cannot load articles")
zshowdate=None
zarg=self.Request.getArg()
zif arg=="today":
z, #-------------------- TODAY'S ARTICLES
z- self.write("<h2>Today's articles</h2>")
z( showdate = frog.util.isodatestr()
z. entries = readArticlesFromDate(showdate)
zelif arg=="active":
z4 #-------------------- ACTIVE ARTICLES redirect
z self.Yredirect("active.y")
zelif arg=="login":
z/ #-------------------- LOGIN PAGE redirect
z self.Yredirect("login.y")
zelif arg=="date":
z7 #-------------------- ARTICLES OF A SPECIFIC DATE
z2 showdate = self.Request.getParameter("date")
zV self.write("<h2>Articles written on %s</h2>"% frog.util.mediumdatestr(showdate))
zelse:
z+ #-------------------- RECENT ARTICLES
z, self.write("<h2>Recent articles</h2>")
z. dates=storageEngine.listBlogEntryDates()
z if dates:
z entries=[]
z SHOWAMOUNT=10
z for showdate in dates:
zW entries.extend( readArticlesFromDate(showdate, SHOWAMOUNT-len(entries)) )
z* if len(entries)>=SHOWAMOUNT:
z break
z
r4 ) rD rE r= r0 r' r r9 rX r )r
r rF rK r) rM r r r �test_bug1175396� s� $zReadTest.test_bug1175396c C s� t d � } t j | j � | � } t j | j � | � } | j d � | j | j d d � d � | j d � | j | j d d � d � | j | j d d � d � | j d � | j | j d d � d � | j | j d d � d � | j d � | j | j d d
� d � | j d � | j | j d d
� d � | j | j d d
� d � | j d � | j | j d d
� d � | j | j d d
� d � | j d
� | j | j d d
� d
� d S)Nr3 zfoo
rG F�fooz
bar
r4 ZbarZbazTrP zbar
zfoo
)r r � getwriterr' r9 r r rI )r
r? �writerrK r r r �test_readlinequeue! s*
zReadTest.test_readlinequeuec C s� d } d } d } | | | j | j � } t j | � } t j | j � | � } | j | j � | � | j | j � | � | j | j � | � | j | j � d � d S)NzAxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx yyyyyyyyyyyyyyyyyyyyyyyyyyyyyyy
z`offending line: ladfj askldfj klasdj fskla dfzaskdj fasklfj laskd fjasklfzzzzaa%whereisthis!!!
z next line.
r4 )r0 r' rD rE r r9 r rI )r
�s1�s2�s3r rF rK r r r �test_bug1098990_a< s zReadTest.test_bug1098990_ac C s� d } d } d } d } d } | | | | | j | j � } t j | � } t j | j � | � } | j | j � | � | j | j � | � | j | j � | � | j | j � | � | j | j � | � | j | j � d � d S)Nzaaaaaaaaaaaaaaaaaaaaaaaa
zbbbbbbbbbbbbbbbbbbbbbbbb
zstillokay:bbbbxx
zbroken!!!!badbad
z againokay.
r4 )r0 r' rD rE r r9 r rI ) r
re rf rg Zs4Zs5r rF rK r r r �test_bug1098990_bI s "zReadTest.test_bug1098990_bu �c C s | j t d j | j � | j d j | j d � d j | j � � | j d j | j d � d j | j � � | j d j | j d � d j | j � � | j d j | j d � d
j | j � � d j | j � } x(d d d g D]\ } } | j | j � t | � d � } | j | j � t | � d � } | d | } | | | j | } | j t | j | j � | j | j | j d � | � | j | j | j d � | � | j | j | j d � | | � | j | j | j d � | | j | � q� Wd S)Nu �u [�]�backslashreplacez[\udc80]�xmlcharrefreplacez
[�]�ignorez[]�replacez[?]r4 � �A�[�]u ��
surrogatepass)rn ro )rp rq )ro rn )
� assertRaises�UnicodeEncodeErrorr0 r' r r �ill_formed_sequence�UnicodeDecodeErrorr! �ill_formed_sequence_replace)r
ZbomZbefore�afterZbefore_sequenceZafter_sequenceZ test_stringZ
test_sequencer r r �test_lone_surrogates\ s8 ""
z ReadTest.test_lone_surrogatesN) r r r rC rY r_ r` rd rh ri rw ry r r r r r2 S s + ; " E
r2 c @ s� e Z d Z d Z e j d k r* d Z n d Z d Z d Z d d � Z d d
� Z
d d � Z d
d � Z d d � Z
d d � Z d d � Z d S)� UTF32Testzutf-32�littles �� s ܀s$ �� s p a m s p a m s$ �� s p a m s p a mc C s� t j | j � \ } } } } t j � } | | � } | j d � | j d � | j � } | j | | j k p} | | j k � t j | � } | | � } | j
| j � d � d S)N�spam�spamspam) r �lookupr' rD rE r �getvaluer& �spamle�spamber r )r
�_rK rc r r^ r* r r r �test_only_one_bom� s
% zUTF32Test.test_only_one_bomc C sx t j d � } t j | j � | � } | j t | j � t j d � } t j | j � | � } | j t | j � d S)N� s �� s ����s ��������)rD rE r r9 r' rs � UnicodeErrorr )r
r r^ r r r � test_badbom� s zUTF32Test.test_badbomc C s\ | j d d d d d d d d d d d d d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 � u ÿu ÿĀu ÿĀ)rC )r
r r r � test_partial� s4 zUTF32Test.test_partialc C sB | j d t j d d d � � | j d t j d d d � � d S)
N� �r s rm Tr4 rl )r� r )r4 r )r r �
utf_32_decode)r
r r r �
test_handlers� s zUTF32Test.test_handlersc C s | j t t j d d d � d S)Ns ��strictT)rs rv r r� )r
r r r � test_errors� s zUTF32Test.test_errorsc C s6 | j | j d | j � | j | j d | j � d S)Nr} )r. r' r� r� )r
r r r �test_decoder_state� s
z UTF32Test.test_decoder_statec C sb d d d } | j d d t j | � d � d d d } | j d d t j | � d � d S)Ns �� s i u 𐀀r s ��s )r r r� )r
Z
encoded_leZ
encoded_ber r r �test_issue8941� s
zUTF32Test.test_issue8941N)r r r r' �sys� byteorderru r� r� r� r� r� r� r� r� r� r r r r rz | s rz c @ sL e Z d Z d Z d Z d d � Z d d � Z d d � Z d d
� Z d S) � UTF32LETestz utf-32-les �� c C sP | j d d d d d d d d d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� � s, zUTF32LETest.test_partialc C s | j d j | j � d � d S)Nu s )r r0 r' )r
r r r � test_simple� s zUTF32LETest.test_simplec C s | j t t j d d d � d S)Ns �r� T)rs rv r �utf_32_le_decode)r
r r r r� � s zUTF32LETest.test_errorsc C s/ d d } | j d d t j | � d � d S)Ns i u 𐀀r )r r r� )r
rB r r r r� s
zUTF32LETest.test_issue8941N) r r r r' ru r� r� r� r� r r r r r� � s r� c @ sL e Z d Z d Z d Z d d � Z d d � Z d d � Z d d
� Z d S) � UTF32BETestz utf-32-bes ܀c C sP | j d d d d d d d d d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� s, zUTF32BETest.test_partialc C s | j d j | j � d � d S)Nu s )r r0 r' )r
r r r r� ' s zUTF32BETest.test_simplec C s | j t t j d d d � d S)Ns �r� T)rs rv r �utf_32_be_decode)r
r r r r� * s zUTF32BETest.test_errorsc C s/ d d } | j d d t j | � d � d S)Ns i u 𐀀r )r r r� )r
rB r r r r� . s
zUTF32BETest.test_issue8941N) r r r r' ru r� r� r� r� r r r r r� s r� c @ s� e Z d Z d Z e j d k r* d Z n d Z d Z d Z d d � Z d d
� Z
d d � Z d
d � Z d d � Z
d d � Z d d � Z d S)� UTF16Testzutf-16r{ s ��s ܀s ��s p a m s p a m s �� s p a m s p a mc C s� t j | j � \ } } } } t j � } | | � } | j d � | j d � | j � } | j | | j k p} | | j k � t j | � } | | � } | j
| j � d � d S)Nr| r} ) r r~ r' rD rE r r r& r� r� r r )r
r� rK rc r r^ r* r r r r� @ s
% zUTF16Test.test_only_one_bomc C sx t j d � } t j | j � | � } | j t | j � t j d � } t j | j � | � } | j t | j � d S)Ns ��s ����)rD rE r r9 r' rs r� r )r
r r^ r r r r� O s zUTF16Test.test_badbomc C s> | j d d d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� X s zUTF16Test.test_partialc C sB | j d t j d d d � � | j d t j d d d � � d S)
N� �r s rm Tr4 rl )r� r )r4 r )r r �
utf_16_decode)r
r r r r� m s zUTF16Test.test_handlersc C s | j t t j d d d � d S)Ns �r� T)rs rv r r� )r
r r r r� s s zUTF16Test.test_errorsc C s6 | j | j d | j � | j | j d | j � d S)Nr} )r. r' r� r� )r
r r r r� w s
z UTF16Test.test_decoder_statec C s� d } | j | j � } | j t j t j � t t j d � � } | j | � Wd QXt j d t f � �# t
j t j d d | j �} Wd QX| � | j | j � | � Wd QXd S)NzHello
world
�wbr4 �Ur' )
r0 r' �
addCleanupr �unlink�TESTFN�openr �check_warnings�DeprecationWarningr r r )r
re r �fprK r r r �test_bug691291} s $zUTF16Test.test_bug691291N)r r r r' r� r� ru r� r� r� r� r� r� r� r� r� r r r r r� 6 s r� c @ s@ e Z d Z d Z d Z d d � Z d d � Z d d � Z d S)
� UTF16LETestz utf-16-les ��c C s8 | j d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� � s zUTF16LETest.test_partialc C sn d d d d d d d g } xL | D]D \ } } | j t t j | d d
� | j | j d d � | � q" Wd S)N� �� �� A Z� A�� A B C D Z� ABCD�� �� �A� �A � �A� �A r� Tzutf-16lerm )r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )rs rv r �utf_16_le_decoder r! )r
�tests�raw�expectedr r r r� � s
zUTF16LETest.test_errorsc C s< | j d j | j � d � | j d j | j � d � d S)Nu s ��)r r0 r' r! )r
r r r � test_nonbmp� s zUTF16LETest.test_nonbmpN)r r r r' ru r� r� r� r r r r r� � s
r� c @ s@ e Z d Z d Z d Z d d � Z d d � Z d d � Z d S)
� UTF16BETestz utf-16-bes ܀c C s8 | j d d d d d d d d d d d d d g � d S)Nu ÿĀ𐀀r4 r� u ÿu ÿĀu ÿĀ)rC )r
r r r r� � s zUTF16BETest.test_partialc C sn d d d d d d d g } xL | D]D \ } } | j t t j | d d
� | j | j d d � | � q" Wd S)N� �� �� A�� A�� A B C DZ� ABCD�� � � � �� � A� �A� � Ar� Tzutf-16berm )r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )r� r� )rs rv r �utf_16_be_decoder r! )r
r� r� r� r r r r� � s
zUTF16BETest.test_errorsc C s< | j d j | j � d � | j d j | j � d � d S)Nu s � �)r r0 r' r! )r
r r r r� � s zUTF16BETest.test_nonbmpN)r r r r' ru r� r� r� r r r r r� � s
r� c sX e Z d Z d Z d Z d
Z d d � Z d d � Z � f d d
� Z d d � Z � S)�UTF8Testzutf-8s �u �� c C sA | j d d d d d d d d d d d d d d d d g � d S)Nu ÿ߿ࠀ𐀀r� u ÿu ÿ߿u ÿ߿ࠀu ÿ߿ࠀ)rC )r
r r r r� � s" zUTF8Test.test_partialc C s, d } | j | j | | j | j � � d S)Nu ÿĀ߿ࠀ)r. r' r0 )r
r( r r r r� � s zUTF8Test.test_decoder_statec s- t � j � | j d j d d � d � d S)Nu [�]zutf-8�surrogateescapes [�])�superry r r0 )r
)� __class__r r ry s
z UTF8Test.test_lone_surrogatesc C s� | j d j d d � d � | j d j d d � d � | j d j d d � d � | j d j d d � d � | j t j d � � | j t � � d j d d � Wd QX| j t � � d j d d � Wd QXd S) Nu abc�defzutf-8rr s abc�defu �s �s abc�s abc�z)r r0 r! r& r � lookup_errorrs rv )r
r r r �test_surrogatepass_handler s z#UTF8Test.test_surrogatepass_handleru ���)
r r r r' ru rw r� r� ry r� r r )r� r r� � s r� z cp65001 is a Windows-only codecc @ sv e Z d Z d Z d d � Z d d � Z e j e d � d d � � Z e j e d � d d
� � Z
d d � Z d
S)� CP65001Test�cp65001c C s� d d d g } t r% | j d � n
| j d � x� | D]� \ } } } | d k r� y | j d | � } Wn? t k
r� } z | j d | | | f � WYd d } ~ Xn X| j | | d | | | | f � q9 | j t | j d | � q9 Wd S) N�abcr� � abc� � � � � �rl r3 rm � ?rj � \udc80rr � �r� z1Unable to encode %a to cp65001 with errors=%r: %sz!%a.encode("cp65001", %r)=%a != %a)zabc�strictr� )r� r� r� )r� r� r� �r� r� N�r� zignorer3 �r� zreplacer� �r� zbackslashreplacer� �r� z
surrogatepassr� )r� r� r� r� r� )r� r� r� )�VISTA_OR_LATER�extendrJ r0 rt �failr rs )r
r� �text�errorsr� rB �errr r r � test_encode s.
$ zCP65001Test.test_encodec C s d d d d d d d d d! g } t r7 | j d% � n
| j d' � x� | D]� \ } } } | d k r� y | j d | � } Wn? t k
r� } z | j d | | | f � WYd d } ~ Xn X| j | | d | | | | f � qK | j t | j d | � qK Wd S)(N� abcr� r� � é€� é€� � � �� �� [é]� [é]� [�]rl �[]rm � [�]r� � [�]� [�]� [���]� [�]r� z3Unable to decode %a from cp65001 with errors=%r: %sz!%a.decode("cp65001", %r)=%a != %a)r� �strictzabc)r� r� r� )r� r� r� )r� r� r� )r� r� r� )r� r� N)r� �ignorer� )r� �replacer� )r� zsurrogateescaper� �r� r� N�r� r� r� �r� r� r� )r� r� r� �r� r� r� )r� )r� r� r! rv r� r rs )r
r� r� r� r� �decodedr� r r r � test_decode= s8
$ zCP65001Test.test_decodez require Windows Vista or laterc C s� | j t d j d � | j t d j d � | j d j d d � d � | j d j d d � d � | j d j d d � d
� | j d j d d � d � | j d j d d
� d � d S)Nu �r� s �u [�]rj s [\udc80]rk s
[�]r� s [�]rl s []rm s [?])rs rt r0 rv r! r )r
r r r ry b s z CP65001Test.test_lone_surrogatesc C s� | j d j d d � d � | j d j d d � d � | j d j d d � d � | j d j d d � d � | j t j d � � d S)Nu abc�defr� rr s abc�defu �s �)r r0 r! r& r r� )r
r r r r� q s z&CP65001Test.test_surrogatepass_handlerc C s | j d � d S)NzHissue #20571: code page 65001 codec does not support partial decoder yet)�skipTest)r
r r r rY } s zCP65001Test.test_readlineN) r r r r' r� r� �unittest�
skipUnlessr� ry r� rY r r r r r� s % r� c @ sR e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d S)
�UTF7Testzutf-7c C s� d } | j | j | j � | j d � � | j | j d � j | j � | � d } | j | j | j � | j d � � | j | j d � j | j � | � | j d j | j � d � | j d j | j � d � d } | j | j | j � | j d � � | j | j d � j | j � | � d j t t t t d � � j � � t | | d | � � � } | j | j | j � d
� d S) NzGABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789'(),-./:?�asciiz !"#$%&*;<=>@[]^_`{|}za+bs a+-bz
r4 � �+sX +AAAAAQACAAMABAAFAAYABwAIAAsADAAOAA8AEAARABIAEwAUABUAFgAXABgAGQAaABsAHAAdAB4AHwBcAH4Afw-) r r0 r' r! r= �sorted�setr5 r )r
Zset_dZset_oZwsZ other_asciir r r �
test_ascii� s %%%% %%$ zUTF7Test.test_asciic " C st | j d d d d d d d d d d d d d d d d d d d d d d d
d d d d d d d d d d g � d S)
Nu a+-b cdĀe𐀀frV za+za+-za+-bza+-b za+-b cu a+-b cu a+-b cdu a+-b cdĀu a+-b cdĀeu a+-b cdĀe𐀀)rC )r
r r r r� � sD zUTF7Test.test_partialc C s� d& d' d( d) d* d+ d, d- d. d/ d0 d1 d2 d3 d4 d5 d6 d7 d8 d9 g } xe | D]] \ } } | j d! | � �= | j t t j | d" d# � | j | j d$ d% � | � Wd QXqI Wd S):N� �b� �b� a�b� a�b� a��b� a��b� a+IK� a�� a+IK-b� a+IK,b� a+IKx� a€�� a+IKx-b� a€�b� a+IKwgr� a+IKwgr-b� a+IKwgr,�
a+IKwgr,-b� a€�-b� a+IKwgrB�
a€€��
a+IKwgrB-b� a€€�b�
a+/,+IKw-b� a�€b� a+//,+IKw-b� a+///,+IKw-b� a�€b�
a+////,+IKw-b� a+IKw-b�� a€b�� a+IKw�br� r� Tzutf-7rm )r r )r r )r
r )r r
)r r )r r )r r )r r )r r )r r )r r )r r )r r )r r )r r )r r )r r! )r" r! )r# r$ )r% r )�subTestrs rv r � utf_7_decoder r! )r
r� r� r� r r r r� � s2
zUTF7Test.test_errorsc C s | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d j | j � d � | j d
j | j � d � d S) Nu 𐒠s +2AHcoA-u ��s +2AHcoAu €𐒠s
+IKzYAdyg-s +IKzYAdygu
€€𐒠s
+IKwgrNgB3KA-s +IKwgrNgB3KA)r r0 r' r! )r
r r r r� � s zUTF7Test.test_nonbmpc C s} d d d d d d d d d! d" d# d$ d% g
} xI | D]A \ } } | j d | � �! | j | j d d � | � Wd QXq4 Wd S)&N� a+2AE-b� a�b� a+2AE�b� a�b� a+2AE� a�� a+2AEA-b� a+2AH-b�
a+IKzYAQ-b� a€�b�
a+IKzYAQ�b� a€�b� a+IKzYAQA-b�
a+IKzYAd-b� a+IKwgrNgB-b� a€€�b� a+IKwgrNgB�b� a€€�b�
a+IKwgrNgB�
a€€��
a+IKwgrNgBA-br� zutf-7rm )r( r) )r* r+ )r, r- )r. r+ )r/ r+ )r0 r1 )r2 r3 )r4 r3 )r5 r3 )r6 r7 )r8 r9 )r: r; )r< r9 )r& r r! )r
r� r� r� r r r ry � s z UTF7Test.test_lone_surrogatesN) r r r r' r r� r� r� ry r r r r r� � s ' r� c @ s( e Z d Z d d � Z d d � Z d S)� UTF16ExTestc C s# | j t t j d d d d � d S)Ns �r� r T)rs rv r �utf_16_ex_decode)r
r r r r� s zUTF16ExTest.test_errorsc C s | j t t j � d S)N)rs � TypeErrorr r> )r
r r r �
test_bad_args s zUTF16ExTest.test_bad_argsN)r r r r� r@ r r r r r= s r= c @ s4 e Z d Z d d � Z d d � Z d d � Z d S)�ReadBufferTestc C s5 d d l } | j t j | j d d � � d � d S)Nr �b� spamr� )rC r� )�arrayr r �readbuffer_encode)r
rD r r r �
test_array s zReadBufferTest.test_arrayc C s | j t j d � d � d S)Nr4 r3 r )r3 r )r r rE )r
r r r �
test_empty s zReadBufferTest.test_emptyc C s- | j t t j � | j t t j d � d S)N�* )rs r? r rE )r
r r r r@ s z ReadBufferTest.test_bad_argsN)r r r rF rG r@ r r r r rA s rA c @ sR e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d S)
� UTF8SigTestz utf-8-sigc C sS | j d d d d d d d d d d d d d d d d d d d d d d g � d S) Nu ÿ߿ࠀ𐀀r4 u u u ÿu ÿ߿u ÿ߿ࠀu ÿ߿ࠀ)rC )r
r r r r� " s. zUTF8SigTest.test_partialc C s | j t d d � d � d S)Ns z utf-8-sigr4 )r �str)r
r r r �test_bug1601501> s zUTF8SigTest.test_bug1601501c C s> t j d � � } d } | j | j | j d � � | � d S)Nz utf-8-sigr| )r r r r! r0 )r
r* r r r r �test_bomB s zUTF8SigTest.test_bomc C s� d } t j d } t j d � } x� d g t t d d � � d d d d d
g D]� } | t j | � � } t j � } xE | d k r� | j | � } n | j � } | s� Pn | j | � q| W| j
� } | j | | � qR Wd S) Nu ABC¡∀XYZs ABC¡∀XYZz utf-8-sigr � �@ r � i i ) r �BOM_UTF8r9 �listr rD rE �StringIOr r r r ) r
� unistring�
bytestringrK �sizehint�istream�ostreamrZ �gotr r r �test_stream_bomG s
zUTF8SigTest.test_stream_bomc C s� d } d } t j d � } x� d g t t d d � � d d d d d
g D]� } | t j | � � } t j � } xE | d k r� | j | � } n | j � } | s� Pn | j | � qu W| j � } | j
| | � qK Wd S) Nu ABC¡∀XYZs ABC¡∀XYZz utf-8-sigr rM rN r rO i i ) r r9 rQ r rD rE rR r r r r ) r
rS rT rK rU rV rW rZ rX r r r �test_stream_bare] s z UTF8SigTest.test_stream_bareN) r r r r' r� rK rL rY rZ r r r r rI s rI c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S)
�EscapeDecodeTestc C s | j t j d � d � d S)Nr3 r )r3 r )r r �
escape_decode)r
r r r rG t s zEscapeDecodeTest.test_emptyc C sf t j } xV t d � D]H } t | g � } | d k r | j | | d � | d d f � q q Wd S)NrO s \� 0� )r r\ r r5 r )r
r! rB r r r �test_raww s
zEscapeDecodeTest.test_rawc C s� t j } t | | � } | d d � | d d � | d d � | d d � | d d
� | d d � | d
d � | d d � | d d � | d d � | d d � | d d
� | d d � | d d � | d d � | d d � | d d � | d! d" � | d# d � | d$ d � | d% d% � | d& d" � xG t d' � D]9 } | d( k rCt | g � } | d) | d) | � qCqCWd S)*Ns [\
]s []s [\"]s ["]s [\']s [']s [\\]s [\]s [\a]s []s [\b]s []s [\t]s [ ]s [\n]s [
]s [\v]s [ ]s [\f]s [ ]s [\r]s [
]s [\7]s [\8]s [\78]s [8]s [\41]s [!]s [\418]s [!8]s [\101]s [A]s [\1010]s [A0]s [\501]s [\x41]s [\X41]s [\x410]rO s
"'\abtnvfr01234567xs \)r r\ r r r5 )r
r! r
rB r r r � test_escape~ s8
z EscapeDecodeTest.test_escapec C s� t j } | j t | d � | j t | d � | j | d d � d
� | j | d d � d � | j t | d � | j t | d
� | j | d d � d � | j | d d � d � d S)Ns \xs [\x]s [\x]\xrl � []r rm � [?]?s \x0s [\x0]s [\x0]\x0r� )ra r )rb r )ra r� )rb r� )r r\ rs �
ValueErrorr )r
r! r r r r� � s z EscapeDecodeTest.test_errorsN)r r r rG r_ r` r� r r r r r[ s s r[ c @ s e Z d Z d d � Z d S)� RecodingTestc C sL t j � } t j | d d � } | j d � | j � | j | j � d S)N�unicode_internalzutf-8rV )rD rE r � EncodedFiler �closer& �closed)r
r^ �f2r r r �
test_recoding� s
zRecodingTest.test_recodingN)r r r rj r r r r rd � s rd u" ليهمابتكلموشعربي؟s egbpdaj6bu4bxfgehfvwxnu 他们为什么不说中文s ihqwcrb4cv8a8dqg056pqjyeu 他們爲什麽不說中文s ihqwctvzc91f659drss3x8bo0ybu Pročprostěnemluvíčeskys Proprostnemluvesky-uyb24dma41au, למההםפשוטלאמדבריםעבריתs 4dbcagdahymbxekheh6e0a7fei0buZ यहलोगहिन्दीक्योंनहींबोलसकतेहैंs, i1baa7eci9glrd9b2ae1bj0hfcgg6iyaf8o0a1dig0cdu6 なぜみんな日本語を話してくれないのかs& n8jok5ay5dzabd5bym9f0cm5685rrjetr6pdxauH 세계의모든사람들이한국어를이해한다면얼마나좋을까sE 989aomsvi5e83db1d2a355cv1e0vak1dwrv93d5xbh15a0dt30a5jpsd879ccm6fea98cu8 почемужеонинеговорятпорусскиs b1abfaaepdrnnbgefbaDotcwatmq2g4lu* PorquénopuedensimplementehablarenEspañols- PorqunopuedensimplementehablarenEspaol-fmd56au- TạisaohọkhôngthểchỉnóitiếngViệts, TisaohkhngthchnitingVit-kjcr8268qyxafd2f1b9gu 3年B組金八先生s 3B-ww4c5e180e575a65lsy2bu" 安室奈美恵-with-SUPER-MONKEYSs( -with-SUPER-MONKEYS-pc58ag80a8qai00g7n9nu' Hello-Another-Way-それぞれの場所s( Hello-Another-Way--fc4qua05auwb3674vfr0bu ひとつ屋根の下2s 2-u9tlzr9756bt3uc0vu MajiでKoiする5秒前s MajiKoi5-783gue6qz075azm5eu パフィーdeルンバs de-jg4avhby1noc0du そのスピードでs d9juau41awczczpz -> $1.00 <-s -> $1.00 <--r^ c @ s( e Z d Z d d � Z d d � Z d S)� PunycodeTestc C sR xK t D]C \ } } | j t | j d � d � j � t | d � j � � q Wd S)N�punycoder )�punycode_testcasesr rJ r0 �lower)r
�uni�punyr r r r� s zPunycodeTest.test_encodec C se x^ t D]V \ } } | j | | j d � � | j d � j d � } | j | | j d � � q Wd S)Nrl r )rm r r! r0 )r
ro rp r r r r� + s zPunycodeTest.test_decodeN)r r r r� r� r r r r rk s rk c @ s� e Z d Z e j e d k d � d d � � Z e j e d k d � d d � � Z e j e d k d � d d � � Z d d
� Z d S) �UnicodeInternalTestr� zspecific to 32-bit wchar_tc C sl d d d g } d d d d
d g } xd | D]\ \ } } t j d k r[ t t | � � } n t j � � | j | | j d
� � Wd QXq+ Wxd | D]\ } t j d k r� t t | � � } n t j d t f � � | j t
| j d
� Wd QXq� Wt j d k r
d } n d } t j � � | j t
| j d
� Wd QXt j � �! | j | j d
d � d � Wd QXd S)N� ��� � � ār3 r4 s ���s � s � s s r{ re z*unicode_internal codec has been deprecateds s rm u �)rr rs )rt ru )r3 r4 ) r� r� r5 �reversedr r� r r! r� rs rv )r
�okZnot_okZinternalro Zinvalidr r r �test_bug12513002 s:
#
z#UnicodeInternalTest.test_bug1251300c C s� y- t j d t f � � d j d � Wd QXWnq t k
r� } zQ | j d | j � | j d | j � | j d | j � | j d | j � WYd d } ~ Xn X| j
� d S)Nz*unicode_internal codec has been deprecateds re r� r� ) r r� r� r! rv r r' �object�start�endr� )r
Zexr r r � test_decode_error_attributesY s
&z0UnicodeInternalTest.test_decode_error_attributesc C s� t j d t j � t j d � } t j d t f � �P d j d � j � } | t d | d d � | d d � f d � d � } Wd QX| j
d | � d S)
Nrq re z*unicode_internal codec has been deprecated�abz%s""""%sr� r � )zabr~ ) r �register_error�
ignore_errors�
getdecoderr r� r� r0 r! r5 r )r
�decoderr} Zignoredr r r �test_decode_callbackg s
'z(UnicodeInternalTest.test_decode_callbackc
C s� t j d t f � �e t j d � } | j | d � d d � | j | d � d d � | j t j d � d d � Wd QXd S) Nz*unicode_internal codec has been deprecatedre rV r u éłr^ s \x00r� )r r� r� r �
getencoderr �
escape_encode)r
�encoderr r r �test_encode_lengths s
z&UnicodeInternalTest.test_encode_lengthN)
r r r r� r� �SIZEOF_WCHAR_Trx r| r� r� r r r r rq 1 s $'$$ rq s% foo͏᠆᠋barbaz︀︈️s foobarbazs CAFEs cafes ßs sss İs i̇s Ńͺs ń ιs ǰ ªs ǰ as ᾷs ᾶιs ǰs ΐs ΰs ẖs ὖ� s s s s r3 s s s
s s s s s s s s s �s �s ⿵s ́s ́s s s s s foo־bars fooﵐbars fooﹶbars foo َbars ا1s ا1بs Xßİ℡ǰ ªΰ s xssi̇telǰ aΰ s Xß㌖İ℡⒟㌀s* xssキロメートルi̇tel(d)アパートc @ s e Z d Z d d � Z d S)� NameprepTestc C s� d d l m } x� t t � D]� \ } \ } } | d k rA q n t | d d � } | d k ru | j t | | � q t | d d � } y | j | | � | � Wq t k
r� } z( t j
d | d t | � f � � WYd d } ~ Xq Xq Wd S)Nr )�nameprepzutf-8rr z
Test 3.%d: %sr ) Zencodings.idnar� rX �nameprep_testsrJ rs r� r � Exceptionr Z
TestFailed)r
r� �posZorigZprepped�er r r �
test_nameprep s zNameprepTest.test_nameprepN)r r r r� r r r r r� s r� c @ sX e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
S)�
IDNACodecTestc C sh | j t d d � d � | j t d d � d � | j t d d � d � | j t d d � d � d S)
Ns
python.org�idnaz
python.orgs python.org.z python.org.s xn--pythn-mua.orgu pythön.orgs xn--pythn-mua.org.u pythön.org.)r rJ )r
r r r �test_builtin_decode+ s z!IDNACodecTest.test_builtin_decodec C sh | j d j d � d � | j d j d � d � | j d j d � d � | j d j d � d � d S)
Nz
python.orgr� s
python.orgz python.org.s python.org.u pythön.orgs xn--pythn-mua.orgu pythön.org.s xn--pythn-mua.org.)r r0 )r
r r r �test_builtin_encode1 s z!IDNACodecTest.test_builtin_encodec C sE t j d � t j d � � } | j d � | j | j � d � d S)Nr� s abcr� r4 )r r9 rD rE r r )r
r@ r r r � test_stream7 s
zIDNACodecTest.test_streamc C s� | j d j t j d d � d D� d � � d � | j d j t j d d � d D� d � � d � | j d j t j d
d � d D� d � � d � | j d j t j d
d � d D� d � � d � t j d � � } | j | j d � d � | j | j d � d � | j | j d � d � | j | j d d � d � | j � | j | j d � d � | j | j d � d � | j | j d � d � | j | j d d � d � d S)Nr4 c s s | ] } t | g � Vq d S)N)r5 )r6 r7 r r r � <genexpr>> s z8IDNACodecTest.test_incremental_decode.<locals>.<genexpr>s
python.orgr� z
python.orgc s s | ] } t | g � Vq d S)N)r5 )r6 r7 r r r r� B s s python.org.z python.org.c s s | ] } t | g � Vq d S)N)r5 )r6 r7 r r r r� F s s xn--pythn-mua.org.u pythön.org.c s s | ] } t | g � Vq d S)N)r5 )r6 r7 r r r r� J s s xn--xams ple-9ta.ou äxample.s rgr3 TZorgs rg.zorg.)r r= r r> r r! r< )r
r� r r r �test_incremental_decode< s, %%%%
z%IDNACodecTest.test_incremental_decodec C sP | j d j t j d d � � d � | j d j t j d d � � d � | j d j t j d d � � d � | j d j t j d d � � d � t j d � � } | j | j d � d � | j | j d
� d � | j | j d d
� d � | j � | j | j d � d � | j | j d � d � | j | j d d
� d � d S)Nr3 z
python.orgr� s
python.orgz python.org.s python.org.u pythön.org.s xn--pythn-mua.org.u äxz ample.orgs xn--xample-9ta.r4 Ts orgz
ample.org.s xn--xample-9ta.org.)r r= r �
iterencoder/ r0 r< )r
r� r r r �test_incremental_encodeZ s(
z%IDNACodecTest.test_incremental_encodec C sg d j d d � d j d d � x@ d
D]8 } | j t d j d | � | j t d j d | � q' Wd S) z$Only supports "strict" error handlerz
python.orgr� r� s
python.orgrl rm rj r� N)zignorezreplacezbackslashreplacezsurrogateescape)r0 r! rs r� )r
r� r r r r� v s
zIDNACodecTest.test_errorsN) r r r r� r� r� r� r� r� r r r r r� * s r� c @ s� e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
d � Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d S)�CodecsModuleTestc C se | j t j d d � d � | j t t j � | j t j d � d � | j t t j d d � d S)Ns �zlatin-1u äöüs abcr� s �r )r r r! rs r? rv )r
r r r r� � s
z CodecsModuleTest.test_decodec C s~ | j t j d d � d � | j t t j � | j t t j d d � | j t j d � d � | j t t j d d � d S)
Nu äöüzlatin-1s �ra �__spam__r� s abcu ÿffr )r r r0 rs r? � LookupErrorrt )r
r r r r� � s z CodecsModuleTest.test_encodec C s- | j t t j � | j t t j d � d S)NrH )rs r? r �register)r
r r r �
test_register� s z CodecsModuleTest.test_registerc C sC | j t t j � | j t t j d � | j t t j d � d S)Nr� � )rs r? r r~ r� )r
r r r � test_lookup� s z CodecsModuleTest.test_lookupc C s- | j t t j � | j t t j d � d S)Nr� )rs r? r r� r� )r
r r r �test_getencoder� s z CodecsModuleTest.test_getencoderc C s- | j t t j � | j t t j d � d S)Nr� )rs r? r r� r� )r
r r r �test_getdecoder� s z CodecsModuleTest.test_getdecoderc C s- | j t t j � | j t t j d � d S)Nr� )rs r? r r9 r� )r
r r r �test_getreader� s z CodecsModuleTest.test_getreaderc C s- | j t t j � | j t t j d � d S)Nr� )rs r? r rb r� )r
r r r �test_getwriter� s z CodecsModuleTest.test_getwriterc C s� t j t j � } | j t j t j | � y t j t j d � Wn" t j k
rf | j d � Yn Xt j d � } | j | j d � d S)NZtr_TRztest needs Turkish locale�ASCIIr )
�locale� setlocale�LC_CTYPEr� �Errorr� r r~ r �name)r
Z oldlocaler7 r r r �test_lookup_issue1813� s z&CodecsModuleTest.test_lookup_issue1813c + C s> d, } | j | t j � x t j D] } t t | � q# Wd S)-Nr0 r! r� � CodecInfo�Codec�IncrementalEncoder�IncrementalDecoder� StreamReader� StreamWriterr~ r� r� r/ r r9 rb r r� �
strict_errors�replace_errorsr� �xmlcharrefreplace_errors�backslashreplace_errorsr� rf r� r> �BOM�BOM_BE�BOM_LErP � BOM_UTF16� BOM_UTF16_BE� BOM_UTF16_LE� BOM_UTF32� BOM_UTF32_BE� BOM_UTF32_LE�BOM32_BE�BOM32_LE�BOM64_BE�BOM64_LE�StreamReaderWriter�
StreamRecoder)+zencodezdecodezregisterz CodecInfozCodeczIncrementalEncoderzIncrementalDecoderz StreamReaderz StreamWriterzlookupz
getencoderz
getdecoderzgetincrementalencoderzgetincrementaldecoderz getreaderz getwriterzregister_errorz lookup_errorz
strict_errorszreplace_errorsz
ignore_errorszxmlcharrefreplace_errorszbackslashreplace_errorszopenz EncodedFilez
iterencodez
iterdecodezBOMzBOM_BEzBOM_LEzBOM_UTF8z BOM_UTF16z BOM_UTF16_BEz BOM_UTF16_LEz BOM_UTF32z BOM_UTF32_BEz BOM_UTF32_LEzBOM32_BEzBOM32_LEzBOM64_BEzBOM64_LEzStreamReaderWriterz
StreamRecoder)ZassertCountEqualr �__all__�getattr)r
Zapir r r �test_all� s$ zCodecsModuleTest.test_allc C su | j t j t j � xX d D]P } | j | � �9 t j t j | d � � } | j | t j � Wd QXWd QXq Wd S) N�wr@ �r+�w+rV �a+r )r� r@ r� r� rV r� ) r� r r� r� r& r r� r# r� )r
�mode�filer r r � test_open� s
zCodecsModuleTest.test_openc C s� | j t t j d d � | j t t j d d � | j t t j d d � | j t t j d d � xF d
D]> } | j t t j d d | � | j t t j d d | � qk Wd S) Nr� Z undefineds abcr4 r3 r� rl rm rj )zstrictzignorezreplacezbackslashreplace)rs r� r r0 r! )r
r� r r r �test_undefined� s
z CodecsModuleTest.test_undefinedN)r r r r� r� r� r� r� r� r� r� r� r� r� r� r r r r r� � s
r� c @ s( e Z d Z d d � Z d d � Z d S)�StreamReaderTestc C s( t j d � | _ t j d � | _ d S)Nzutf-8s 한
글)r r9 rK rD rE rF )r
r r r �setUp� s zStreamReaderTest.setUpc C s2 | j | j � } | j | j � d d g � d S)Nu 한
u 글)rK rF r r] )r
r^ r r r �test_readlines� s z StreamReaderTest.test_readlinesN)r r r r� r� r r r r r� � s r� c @ s e Z d Z d d � Z d S)�EncodedFileTestc C s� t j d � } t j | d d � } | j | j � d � t j � } t j | d d � } | j d � | j | j � d � d S)Ns 한
글z utf-16-lezutf-8s \�
�zlatin-1s üs �)rD rE r rf r r r r )r
r^ �efr r r �
test_basic� s
zEncodedFileTest.test_basicN)r r r r� r r r r r� � s r� r �big5� big5hkscs�charmap�cp037Zcp1006�cp1026�cp1125�cp1140�cp1250�cp1251�cp1252�cp1253�cp1254�cp1255�cp1256�cp1257�cp1258�cp424�cp437�cp500Zcp720Zcp737�cp775�cp850�cp852�cp855Zcp856�cp857�cp858�cp860�cp861�cp862�cp863�cp864�cp865�cp866�cp869Zcp874Zcp875�cp932�cp949�cp950� euc_jis_2004� euc_jisx0213�euc_jp�euc_kr�gb18030�gb2312�gbk� hp_roman8�hzr� �
iso2022_jp� iso2022_jp_1� iso2022_jp_2�iso2022_jp_2004� iso2022_jp_3�iso2022_jp_ext�
iso2022_kr� iso8859_1�
iso8859_10�
iso8859_11�
iso8859_13�
iso8859_14�
iso8859_15�
iso8859_16� iso8859_2� iso8859_3� iso8859_4� iso8859_5� iso8859_6� iso8859_7� iso8859_8� iso8859_9�johab�koi8_rZkoi8_u�latin_1� mac_cyrillic� mac_greek� mac_iceland�
mac_latin2� mac_roman� mac_turkishZpalmos�ptcp154rl Zraw_unicode_escape� shift_jis�shift_jis_2004�shift_jisx0213�tis_620Zunicode_escapere �utf_16� utf_16_be� utf_16_le�utf_7�utf_8Z mbcs_encode�mbcsc @ sm e Z d Z d d � Z e j d d � � Z d d � Z d d � Z d d
� Z d d � Z
d
d � Z d S)�BasicUnicodeTestc s d } xt D]�} t j | � j } | j d � rA | d 7} n | d k rV d } n | j | j d d � | j d d � � t j � �o t j | � | � \ } } | j | t
| � d | � t j | � | � \ } } | j | | d | � Wd QX| t k r�t
d � } t j | � | � } d } xS | D]K }
| j |
� | j � } | j t | � t k t | � � | | 7} q5Wt
d � } t j | � | � } d }
x4 | D], }
| j t |
g � � |
| j � 7}
q�W| j |
| d | � n | t k r
y t j | � � � Wn t k
r2Yn(Xd } x! | D] }
| � j |
� 7} q@W| � j d d � 7} t j | � � � d }
x* | D]" }
|
� j t |
g � � 7}
q�W|
� j d d � 7}
| j |
| d | � d j t j t j | | � | � � } | j | | d | � d j t j t j d | � | � � } | j | d � | d k r
y t j | � d � � Wn t k
r�YqXd j � f d
d � | D� � } t j | � d � � d j � f d d � | D� � }
| j |
| d | � q
q
q
Wd S)N�abc123Z_codecr r� �-z encoding=%rr3 r4 Tr� r, rl c 3 s | ] } � j | � Vq d S)N)r0 )r6 r7 )r� r r r� � s z/BasicUnicodeTest.test_basics.<locals>.<genexpr>c 3 s' | ] } � j t | g � � Vq d S)N)r! r5 )r6 r7 )r� r r r� � s )zidnazmbcs) �all_unicode_encodingsr r~ r� �endswithr rm r r� r� r r� � broken_unicode_with_statefulr rb r r r& �typer5 r9 r/ r� r0 r r! r= r> r� )r
r r' r� rB r r r? rc �
encodedresultr7 �chunkrK �
decodedresultrA r )r� r� r � test_basicsj s|
(
"
"
z BasicUnicodeTest.test_basicsc s� d d l m } m } d } x�t D]�} | t k r# y | | � � Wn t k
rY Yn� Xd } x! | D] } | � j | � 7} qg W| � j d d � 7} | | � � d } x* | D]" } | � j t | g � � 7} q� W| � j d d � 7} | j | | d | � | d k r�y | | d
� � Wn t k
r9Yq�Xd j
� f d d � | D� � } | | d
� � d j
� f d
d � | D� � } | j | | d | � q�q# q# Wd S)Nr )�codec_incrementalencoder�codec_incrementaldecoderr. r3 r4 Tz encoding=%rr� r, rl c 3 s | ] } � j | � Vq d S)N)r0 )r6 r7 )�cencoderr r r� � s z4BasicUnicodeTest.test_basics_capi.<locals>.<genexpr>c 3 s' | ] } � j t | g � � Vq d S)N)r! r5 )r6 r7 )�cdecoderr r r� � s )zidnazmbcs) Z _testcapir8 r9 r0 r2 r� r0 r! r5 r r= )r
r8 r9 r r' r4 r7 r6 r )r; r: r �test_basics_capi� s<
"
z!BasicUnicodeTest.test_basics_capic C s� d d d d d f } x� t D]� } | d k r7 q n | t k rI q n t j | � t j | j | � � � } x@ t d � D]2 } | j d d � | j � } | j
| | � q} Wq Wd S)Nz%s
%s
�d r. Zdef456r� r\ r ) r0 r2 r r9 rD rE r0 r �seekr r )r
r r' rK �trZ r r r � test_seek� s
' zBasicUnicodeTest.test_seekc C sV xO t D]G } t j | � } | j t | � | d k r | j t | d � q q Wd S)Nr� rl rH )zidnazpunycode)r0 r r� rs r? )r
r' r� r r r �test_bad_decode_args� s
z%BasicUnicodeTest.test_bad_decode_argsc C sG x@ t D]8 } t j | � } t j � � | j t | � Wd QXq Wd S)N)r0 r r� r r� rs r? )r
r' r� r r r �test_bad_encode_args� s
z%BasicUnicodeTest.test_bad_encode_argsc C s3 d d l m } t | j � } | j | | � d S)Nr )r� )� encodingsr� r3 Zencoding_tabler )r
r� Z
table_typer r r �"test_encoding_map_type_initialized� s z3BasicUnicodeTest.test_encoding_map_type_initializedc C sb d } xU t D]M } | t k r
| j | | | j | � � | j | | | j | � � q
q
Wd S)Nr. )r0 r2 r. r0 r1 )r
r( r' r r r r� s
z#BasicUnicodeTest.test_decoder_stateN) r r r r7 r Z cpython_onlyr< r@ rA rB rD r� r r r r r- i s O' r- c @ s4 e Z d Z d d � Z d d � Z d d � Z d S)� CharmapTestc C s3 | j t j d d d � d
� | j t j d d d � d � | j t t j d d d � | j t t j d d d � | j t j d d d � d � | j t j d d d � d � | j t j d d
d � d � | j t j d d
d � d � t t d � � } | j t j | d
d � d t | � f � d S)Ns r� r� r� � bcr} u abrm � ab�rl rO r4 )zabcr� )rF r� )rG r� )rG r� )�abr� )rH r� )r r �charmap_decoders rv r5 r r )r
�allbytesr r r �test_decode_with_string_map s4 z'CharmapTest.test_decode_with_string_mapc C s� | j t j d d i d d 6d d 6d d 6� d � | j t j d d i d d 6d d 6d
d 6� d � | j t j d d i d d 6d d 6d d 6� d � | j t j d d i d d 6d d 6d d 6� d � | j t t j d d i d d 6d d 6� | j t t j d d i d d 6d d 6d d 6� | j t t j d d i d d 6d d 6d d 6� | j t j d d i d d 6d d 6� d � | j t j d d i d d 6d d 6d d 6� d � | j t j d d i d d 6d d 6d d 6� d � | j t j d d i d d 6d d 6� d � | j t j d d i d d 6d d 6d d 6� d � | j t j d d i d d 6d d 6d d 6� d! � t t d � � } | j t j | d i � d t | � f � d S)"Ns r� rV r rB r r7 r^ r� r� ZAaZBbZCc�AaBbCcu � bcr4 r} u rm � ab�rl rO )zabcr� )rL r� )rM r� )�abr� )rN r� )rN r� )rN r� )rO r� )rO r� )rO r� )r r rI rs rv r5 r r )r
rJ r r r � test_decode_with_int2str_map9 sj z(CharmapTest.test_decode_with_int2str_mapc C s/ t d � } t d � } t d � } | j t j d d i | d 6| d 6| d 6� d � | j t j d d i d d 6| d 6| d 6� d � | j t j d d i t j d 6| d 6| d 6� t t j � d
d
f � | j t t j d d i t j d d 6| d 6| d 6� | j t t j d d i | d 6| d 6� | j t t j d d i | d 6| d 6d d 6� | j t j d d i | d 6| d 6� d � | j t j d d i | d 6| d 6d d 6� d � | j t j d d i | d 6| d 6� d � | j t j d d i | d 6| d 6d d 6� d � d S)NrV rB r7 s r� r r r^ r� r� i�� � bcZbci�� rm � ab�rl r} )zabcr� )rQ r� )rR r� )rR r� )�abr� )rS r� )
�ordr r rI r� �
maxunicode�chrrs r? rv )r
rV rB r7 r r r � test_decode_with_int2int_map� sP # z(CharmapTest.test_decode_with_int2int_mapN)r r r rK rP rW r r r r rE s - UrE c @ s( e Z d Z d d � Z d d � Z d S)� WithStmtTestc
C sW t j d � } t j | d d � � } | j | j � d � Wd QX| j | j � d S)Ns üzlatin-1zutf-8s �)rD rE r rf r r r& rh )r
r^ r� r r r �test_encodedfile� s z WithStmtTest.test_encodedfilec
C s_ t j d � } t j d � } t j | | j | j d � � } | j | j � d � Wd QXd S)Ns üzutf-8r� � ü) rD rE r r~ r� � streamreader� streamwriterr r )r
r^ �info�srwr r r �test_streamreaderwriter� s
z$WithStmtTest.test_streamreaderwriterN)r r r rY r_ r r r r rX � s rX c @ s( e Z d Z d d � Z d d � Z d S)� TypesTestc C s� t j t j t j t j t j t j t j t j t j t j
t j t j g } t
t d � rp | j t j � n x! | D] } | j t | d � qw Wd S)N� mbcs_decoderW )r r' � utf_8_decoder� r� r> r� r� r� �utf_32_ex_decode�latin_1_decode� ascii_decoderI �hasattrrJ ra rs r? )r
Zdecodersr� r r r �test_decode_unicode� s
z TypesTest.test_decode_unicodec C s� | j t j d � d
� | j t j d � d � | j t j d � d � | j t j d � d
� | j t t j d � | j t j d d � d � | j t t j d � | j t j d d � d � d S)Nz\u1234� ሴr s \u1234s
\U00110000z
\U00110000rm � �rO )rh r )rh r )rh r )rh r )ri rO )ri rO )r r �unicode_escape_decode�raw_unicode_escape_decoders rv )r
r r r �test_unicode_escape� s z TypesTest.test_unicode_escapeN)r r r rg rl r r r r r` � s r` c @ sX e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
S)�UnicodeEscapeTestc C s6 | j t j d � d � | j t j d � d � d S)Nr4 r3 r )r3 r )r4 r )r r �unicode_escape_encoderj )r
r r r rG s z UnicodeEscapeTest.test_emptyc C sa t j } xQ t d d � D]@ } | d k r | j | t | � � t | g � d f � q q Wd S)N� � s \r r �\ )r rn r r rV r5 )r
r0 rB r r r �test_raw_encode s z!UnicodeEscapeTest.test_raw_encodec C sf t j } xV t d � D]H } | d k r | j | t | g � d � t | � d d f � q q Wd S)NrO s \r r] �0r^ rq )r rj r r r5 rV )r
r! rB r r r �test_raw_decode s z!UnicodeEscapeTest.test_raw_decodec C s� t j } t | | � } | d d � | d d � | d d � | d d � xF t d � D]8 } t | � d
k rY | t | � d | j � � qY qY Wx4 t d d
� D]# } | t | � d | j � � q� W| d d � | d d � d S)N� s \trP s \nrR s \r�\s \\ro z
z\x%02xrp rO u €s \u20acu 𝄠s
\U0001d120)r rn r r rV r0 )r
r0 r
rB r r r �test_escape_encode s
$!
z$UnicodeEscapeTest.test_escape_encodec C s� t j } t | | � } | d d � | d d � | d d � | d d � | d d
� | d d � | d
d � | d d � | d d � | d d � | d d � | d d
� | d d � | d d � | d d � | d d � | d d! � | d" d# � | d$ d! � | d% d# � | d& d' � | d( d) � xG t d* � D]9 } | d+ k rC| d, t | g � d- t | � � qCqCWd S).Ns [\
]z[]s [\"]z["]s [\']z[']s [\\]z[\]s [\a]z[]s [\b]z[]s [\t]z[ ]s [\n]z[
]s [\v]z[ ]s [\f]z[ ]s [\r]z[
]s [\7]s [\8]z[\8]s [\78]z[8]s [\41]z[!]s [\418]z[!8]s [\101]z[A]s [\1010]z[A0]s [\x41]s [\x410]s \u20acu €s
\U0001d120u 𝄠rO s
"'\abtnvfr01234567xuUNs \rv )r rj r r r5 rV )r
r! r
rB r r r �test_escape_decode! s6
z$UnicodeEscapeTest.test_escape_decodec C s. t j } x� d D]� \ } } x� t | � D]� } | j t | d | d | � | j t | d | d | d � d | d | d
| d | } | j | | d � d t | � f � | j | | d
� d t | � f � q) Wq W| j t | d � | j | d d � d � | j | d d
� d � d S)N� xr^ � ur� � Us \r] s [\� ]s ]\rl z[]rm u [�]�s
\U00110000r4 rO � ��ry r^ �rz r� �r{ r� )r~ r r� )r4 rO )r} rO )r rj r rs rv r r )r
r! r7 r* r) rZ r r r �test_decode_errors> s "%z$UnicodeEscapeTest.test_decode_errorsN) r r r rG rr rt rw rx r� r r r r rm s rm c @ sX e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
S)�RawUnicodeEscapeTestc C s6 | j t j d � d � | j t j d � d � d S)Nr4 r3 r )r3 r )r4 r )r r �raw_unicode_escape_encoderk )r
r r r rG P s z RawUnicodeEscapeTest.test_emptyc C sO t j } x? t d � D]1 } | j | t | � � t | g � d f � q Wd S)NrO r )r r� r r rV r5 )r
r0 rB r r r rr T s z$RawUnicodeEscapeTest.test_raw_encodec C sW t j } xG t d � D]9 } | j | t | g � d � t | � d d f � q Wd S)NrO r] rs r^ )r rk r r r5 rV )r
r! rB r r r rt Y s z$RawUnicodeEscapeTest.test_raw_decodec C s� t j } t | | � } xG t d � D]9 } | d k r% | d t | � d t | g � � q% q% W| d d � | d d � d S) NrO s uUrv s \u €s \u20acu 𝄠s
\U0001d120)r r� r r rV r5 )r
r0 r
rB r r r rw ^ s +
z'RawUnicodeEscapeTest.test_escape_encodec C s� t j } t | | � } xG t d � D]9 } | d k r% | d t | g � d t | � � q% q% W| d d � | d d � d S) NrO s uUs \rv s \u20acu €s
\U0001d120u 𝄠)r rk r r r5 rV )r
r! r
rB r r r rx g s +
z'RawUnicodeEscapeTest.test_escape_decodec C s. t j } x� d D]� \ } } x� t | � D]� } | j t | d | d | � | j t | d | d | d � d | d | d | d | } | j | | d � d
t | � f � | j | | d � d t | � f � q) Wq W| j t | d
� | j | d
d � d � | j | d
d � d � d S)Nrz r� r{ s \r] s [\r| s ]\rl z[]rm u [�]�s
\U00110000r4 rO � ��rz r� �r{ r� )r� r� )r4 rO )r� rO )r rk r rs rv r r )r
r! r7 r* r) rZ r r r r� p s "%z'RawUnicodeEscapeTest.test_decode_errorsN) r r r rG rr rt rw rx r� r r r r r� O s r� c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S)
�SurrogateEscapeTestc C st | j d j d d � d � | j d j d d � d � | j d j d d � d � | j d j d d � d � d S)Ns foo�barzutf-8r� u foo�bars �u ���)r r! r0 )r
r r r � test_utf8� s z SurrogateEscapeTest.test_utf8c C s< | j d j d d � d � | j d j d d � d � d S)Ns foo�barr r� u foo�bar)r r! r0 )r
r r r r � s z SurrogateEscapeTest.test_asciic C s< | j d j d d � d � | j d j d d � d � d S)Ns foo�barz
iso-8859-3r� u foo�bar)r r! r0 )r
r r r � test_charmap� s z SurrogateEscapeTest.test_charmapc C s | j d j d d � d � d S)Nu �����zlatin-1r� s ���)r r0 )r
r r r � test_latin1� s z SurrogateEscapeTest.test_latin1N)r r r r� r r� r� r r r r r� � s r� c @ s e Z d Z d d � Z d S)�BomTestc $ C s� d } d } | j t j t j � x�| D]�} t j t j d d | ��o } | j | � | j | � | j d
� | j | j � | d � | j d
� | j | j � | d � Wd QXt j t j d d | ��k } | j | d
� | j
| j � d
� | j d
� | j | � | j d
� | j | j � | � Wd QXt j t j d d | ��w } | j j | d
� | j
| j j � d
� | j j d
� | j j | � | j d
� | j | j � | � Wd QXt j t j d d | ��[ } | j | � | j | j � � | j | � | j d
� | j | j � | d � Wd QXt j t j d d | ��g } | j j | � | j j | j j � � | j j | � | j d
� | j | j � | d � Wd QXq) Wd S)
NZ
1234567890�utf-16� utf-16-le� utf-16-be�utf-32� utf-32-le� utf-32-bezw+r' r r^ )r� r� r� r� r� r� )
r� r r� r� r r� r r> r r ZassertNotEqual�tellrc )r
rZ r� r' r^ r r r �
test_seek0� sT
zBomTest.test_seek0N)r r r r� r r r r r� � s r� � base64_codec�uu_codec� quopri_codec� hex_codec�base64�base_64�uu�quopri�quoted_printable�quotedprintable�hex�rot13�rot_13�
zlib_codecr: �zlib� bz2_codec�bz2c @ s� e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
d � Z d d � Z
e j e
d � d d � � Z d d � Z d d � Z d d � Z d d � Z d S) �TransformCodecTestc C s� t t d � � } x� t D]� } | j d | � �w t j | � | � \ } } | j | t | � � t j | � | � \ } } | j | t | � � | j | | � Wd QXq Wd S)NrO r' ) r5 r �bytes_transform_encodingsr& r r� r r r� )r
Zbinputr' �or r) r r r r7 � s
z TransformCodecTest.test_basicsc C sz xs t D]k } | j d | � �Q t j d | � } t j | � t j | � � } | j � } | j | d � Wd QXq Wd S)Nr' s �) r� r& r r0 r9 rD rE r r )r
r' �sinrK �soutr r r � test_read
s
z TransformCodecTest.test_readc C sz xs t D]k } | j d | � �Q t j d | � } t j | � t j | � � } | j � } | j | d � Wd QXq Wd S)Nr' s �) r� r& r r0 r9 rD rE rI r )r
r' r� rK r� r r r rY
s
z TransformCodecTest.test_readlinec C s� d } x� t D]� } | j d | � �� | } t | � } t j | | � } t j | | � } | j | | � t | � } t j | | � } | j | | � t j | | � } | j | | � Wd QXq
Wd S)Ns 12345�r' )r� r& �
memoryviewr r0 r r! )r
Zoriginalr' rZ ZviewZ view_encodedZ view_decodedr r r �test_buffer_api_usage
s
z(TransformCodecTest.test_buffer_api_usagec C s� d } xw t D]o } | j d | � �U d } | j | � } | j t | � � } | j | � Wd QX| j | j j � Wd QXq
Wd S)Nzbad input typer' zM{!r} is not a text encoding; use codecs.encode\(\) to handle arbitrary codecs) r� r& �format�assertRaisesRegexr� r0 � assertIsNone� exception� __cause__)r
� bad_inputr' �fmt�msg�failurer r r �0test_text_to_binary_blacklists_binary_transforms)
s
zCTransformCodecTest.test_text_to_binary_blacklists_binary_transformsc C s0 d } | j t | � � d j d � Wd QXd S)NzR^'rot_13' is not a text encoding; use codecs.encode\(\) to handle arbitrary codecszjust an example messager� )r� r� r0 )r
r� r r r �.test_text_to_binary_blacklists_text_transforms5
s zATransformCodecTest.test_text_to_binary_blacklists_text_transformsc C s� d } x� t D]� } | j d | � �~ t j | | � } d } | j | � } | j t | � � | j | � Wd QX| j t | � � t | � j | � Wd QXWd QXq
Wd S)Ns6 encode first to ensure we meet any format restrictionsr' zM{!r} is not a text encoding; use codecs.decode\(\) to handle arbitrary codecs) r� r& r r0 r� r� r� r! � bytearray)r
rZ r' Z encoded_datar� r� r r r �0test_binary_to_text_blacklists_binary_transforms<
s
zCTransformCodecTest.test_binary_to_text_blacklists_binary_transformsc C s{ xt d t d � f D]` } | j d | � �F d } | j t | � � } | j d � Wd QX| j | j j � Wd QXq Wd S)Ns immutables mutabler� zR^'rot_13' is not a text encoding; use codecs.decode\(\) to handle arbitrary codecsr� )r� r& r� r� r! r� r� r� )r
r� r� r� r r r �.test_binary_to_text_blacklists_text_transformsK
s zATransformCodecTest.test_binary_to_text_blacklists_text_transformszRequires zlib supportc
C sT d } | j t | � � } t j d d � Wd QX| j | j j t | j � � d S)Nz(^decoding with 'zlib_codec' codec faileds hellor� )r� r� r r! r# r� r� r3 )r
r� r� r r r �!test_custom_zlib_error_is_wrappedU
s
z4TransformCodecTest.test_custom_zlib_error_is_wrappedc
C sT d } | j t | � � } t j d d � Wd QX| j | j j t | j � � d S)Nz'^decoding with 'hex_codec' codec faileds hellor� )r� r� r r! r# r� r� r3 )r
r� r� r r r � test_custom_hex_error_is_wrapped^
s
z3TransformCodecTest.test_custom_hex_error_is_wrappedc C s xx t j � D]j \ } } t j | � j } xI | D]A } | j d | � �' t j | � } | j | j | � Wd QXq2 Wq
Wd S)N�alias)�transform_aliases�itemsr r~ r� r& r )r
�
codec_name�aliasesZ
expected_namer� r] r r r � test_aliasesj
s
z TransformCodecTest.test_aliasesc C sH t j d d � } | j | d � d } | j t j | d � | � d S)Ns space tab eol
z quopri-codecs space=20tab=09eol=20
s space tab eol
)r r0 r r! )r
rB Z unescapedr r r �test_quopri_statelessr
s z(TransformCodecTest.test_quopri_statelessc C s | j t t j d d � d S)Nr3 zuu-codec)rs rc r r! )r
r r r �test_uu_invalidz
s z"TransformCodecTest.test_uu_invalidN)r r r r7 r� rY r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r� � s
r� c C s
t j | � S)N)� _TEST_CODECS�get)r� r r r �_get_test_codec�
s r� )�
_forget_codecc C s d S)Nr )r� r r r r� �
s r� c @ s� e Z d Z d d � Z d d � Z d d � Z e j d d � � Z d d
� Z e
d d � Z d
d � Z d d � Z
d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d! d" � Z d# d$ � Z d% S)&�ExceptionChainingTestc C sA t | � t t | � � } t j | � j � | _ t | _ d S)N) �reprrJ �idrC �normalize_encodingrn r� � RuntimeError� obj_to_raise)r
Z unique_idr r r r� �
s zExceptionChainingTest.setUpc C sS t j | j d � t j j | j d � y t | j � Wn t k
rN Yn Xd S)N)r� �popr� rC �_cacher� �KeyError)r
r r r �tearDown�
s
z ExceptionChainingTest.tearDownc C s, t j | | d | j �} | t | j <d S)Nr� )r r� r� r� )r
r0 r! Z
codec_infor r r � set_codec�
s z ExceptionChainingTest.set_codecc c sn d j | | j | j | � } | j | | � � } | VWd QX| j | j j | � | j | j j j � d S)Nz${} with {!r} codec failed \({}: {}\)) r� r� r r� r# r� r� ZassertIsNotNone�
__traceback__)r
Z operation�exc_typer� Zfull_msgZcaughtr r r �
assertWrapped�
s z#ExceptionChainingTest.assertWrappedc O s
| j � d S)N)r� )r
�args�kwdsr r r � raise_obj�
s z ExceptionChainingTest.raise_objc C s� | | _ | j | j | j � | j d | | � � d j | j � Wd QX| j d | | � � t j d | j � Wd QX| j d | | � � d j | j � Wd QX| j d | | � � t j d | j � Wd QXd S)Nr' � str_inputZdecodings bytes input)r� r� r� r� r0 r� r r! )r
r� r� r� r r r �
check_wrapped�
s z#ExceptionChainingTest.check_wrappedc C s | j t d � d S)Nr4 )r� r� )r
r r r �test_raise_by_type�
s z(ExceptionChainingTest.test_raise_by_typec C s d } | j t | � | � d S)NzThis should be wrapped)r� r� )r
r� r r r �test_raise_by_value�
s z)ExceptionChainingTest.test_raise_by_valuec C s9 d } Gd d � d t � } | j | | � | | � d S)NzThis should be wrappedc @ s e Z d Z f Z d S)zWExceptionChainingTest.test_raise_grandchild_subclass_exact_size.<locals>.MyRuntimeErrorN)r r r � __slots__r r r r �MyRuntimeError�
s r� )r� r� )r
r� r� r r r �)test_raise_grandchild_subclass_exact_size�
s z?ExceptionChainingTest.test_raise_grandchild_subclass_exact_sizec C s9 d } Gd d � d t � } | j | | � | | � d S)NzThis should be wrappedc @ s e Z d Z d S)zVExceptionChainingTest.test_raise_subclass_with_weakref_support.<locals>.MyRuntimeErrorN)r r r r r r r r� �
s r� )r� r� )r
r� r� r r r �(test_raise_subclass_with_weakref_support�
s z>ExceptionChainingTest.test_raise_subclass_with_weakref_supportc s� � f d d � } | j | | � | j t | � � d j | j � Wd QX| j t | � � t j d | j � Wd QX| j t | � � d j | j � Wd QX| j t | � � t j d | j � Wd QXd S)Nc s
� � d S)Nr )r� r� )r� r r r� �
s z:ExceptionChainingTest.check_not_wrapped.<locals>.raise_objz str inputs bytes input)r� r� r� r0 r� r r! )r
r� r� r� r )r� r �check_not_wrapped�
s z'ExceptionChainingTest.check_not_wrappedc C s* Gd d � d t � } | j | d � d S)Nc @ s e Z d Z d d � Z d S)zKExceptionChainingTest.test_init_override_is_not_wrapped.<locals>.CustomInitc S s d S)Nr )r
r r r r �
s zTExceptionChainingTest.test_init_override_is_not_wrapped.<locals>.CustomInit.__init__N)r r r r r r r r �
CustomInit�
s r� r4 )r� r� )r
r� r r r �!test_init_override_is_not_wrapped�
s z7ExceptionChainingTest.test_init_override_is_not_wrappedc C s* Gd d � d t � } | j | d � d S)Nc s" e Z d Z � f d d � Z � S)zIExceptionChainingTest.test_new_override_is_not_wrapped.<locals>.CustomNewc s t � j | � S)N)r� �__new__)�cls)r� r r r� �
s zQExceptionChainingTest.test_new_override_is_not_wrapped.<locals>.CustomNew.__new__)r r r r� r r )r� r � CustomNew�
s r� r4 )r� r� )r
r� r r r � test_new_override_is_not_wrapped�
s z6ExceptionChainingTest.test_new_override_is_not_wrappedc C s8 d } t | � } d | _ | j | d j | � � d S)NzThis should NOT be wrappedr z^{}$)r� �attrr� r� )r
r� �excr r r �&test_instance_attribute_is_not_wrapped�
s z<ExceptionChainingTest.test_instance_attribute_is_not_wrappedc C s | j t d � d � d S)Nr �1)r� r� )r
r r r � test_non_str_arg_is_not_wrapped s z5ExceptionChainingTest.test_non_str_arg_is_not_wrappedc C s& d } | j t d d d � | � d S)Nz^\('a', 'b', 'c'\)$rV rB r7 )r� r� )r
Zmsg_rer r r �!test_multiple_args_is_not_wrapped s z7ExceptionChainingTest.test_multiple_args_is_not_wrappedc C s� d j | j � } | j t | � � d j | j � Wd QX| j t | � � t j d | j � Wd QX| j t | � � d j | j � Wd QX| j t | � � t j d | j � Wd QXd S)Nz^unknown encoding: {}$z str inputs bytes input)r� r� r� r� r0 r r! )r
r� r r r �%test_codec_lookup_failure_not_wrapped
s z;ExceptionChainingTest.test_codec_lookup_failure_not_wrappedc C s� d d � } d d � } | j | | � t j d | j � } | j | d � t j d | j � } | j | d � d } | j | j � } | j t | � � d j | j � Wd QXd } | j | j � } | j t | � � d
j | j � Wd QXd S) Nc _ s d S)N�
not bytes!r )r� r r )r� r� r r r �
encode_to_str s zSExceptionChainingTest.test_unflagged_non_text_codec_handling.<locals>.encode_to_strc _ s d S)N� not str!r )r� r r )r� r� r r r �decode_to_bytes! s zUExceptionChainingTest.test_unflagged_non_text_codec_handling.<locals>.decode_to_bytesz
not bytes!s not str!zd^{!r} encoder returned 'str' instead of 'bytes'; use codecs.encode\(\) to encode to arbitrary types$r� zd^{!r} decoder returned 'bytes' instead of 'str'; use codecs.decode\(\) to decode to arbitrary types$s bytes input) r� r r0 r� r r! r� r� r? )r
r� r� rB r� r� r� r r r �&test_unflagged_non_text_codec_handling s z<ExceptionChainingTest.test_unflagged_non_text_codec_handlingN)r r r r� r� r� �
contextlib�contextmanagerr� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r� �
s$
r� z"code pages are specific to Windowsc @ s� e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d S)� CodePageTesti� c C sh | j t t j d d � | j t t j d d � | j t t j d d � | j t t j d d � d S)Nr rV � a�{ r r )rs rc r �code_page_encode�code_page_decode�OSError)r
r r r �test_invalid_code_page= s z#CodePageTest.test_invalid_code_pagec C s[ | j t d t j d d � | j t d t j d d � | j t d t j | j d � d S)Nr� i� � ÿs � �CP_UTF8s �)r� rt r r� rv r� r� )r
r r r �test_code_page_nameC s z CodePageTest.test_code_page_namec C s x� | D]� \ } } } | d k r� y t j | | | � } WnB t k
r } z" | j d | | | | f � WYd d } ~ Xn X| j | d | d | | | | d | f � | j | d d � | j | d t | � � q | j t t j | | | � q Wd S)Nz2Unable to decode %a from "cp%s" with errors=%r: %sr z %a.decode("cp%s", %r)=%a != %ar ) r r� rv r� r ZassertGreaterEqualZassertLessEqualr rs )r
�cpr� r� r� r� r� r� r r r � check_decodeK s ' zCodePageTest.check_decodec C s� x� | D]� \ } } } | d k r� y t j | | | � } WnB t k
r } z" | j d | | | | f � WYd d } ~ Xn X| j | d | d | | | | d | f � | j | d t | � � q | j t t j | | | � q Wd S)Nz0Unable to encode %a to "cp%s" with errors=%r: %sr z %a.encode("cp%s", %r)=%a != %ar )r r� rt r� r r rs )r
r r� r� r� r� rB r� r r r � check_encode] s ' zCodePageTest.check_encodec
C s$ | j d d# � | j d d- � d S).Ni� r� r� � abc� ｄ騾� ���r� � [ÿ]rl � []rm � [y]� [€]� [?]rj � [\xff]rk � [ÿ]� [�]�[]� [�]r� � [�]� � abc� abc� � abc��abc�strictr �r r r �r� r N�r �ignorer �r �replacer �r
r r �r zbackslashreplacer �r zxmlcharrefreplacer
)r r r r r r r r �r r r �r r r �r r N�r r r �r r r �r zsurrogateescaper �r r N�r r r �r r r ) r! r" r# r$ r% r& r' r( r) )r r )r
r r r �
test_cp932m s& zCodePageTest.test_cp932c
C s$ | j d d � | j d d � d S)Ni� r� r� � abc� é€� �r� � �� Łrl r3 rm � L��abc�strictr+ �r, r3 r- �r� r3 r. �r/ r3 N�r/ zignorer3 �r/ zreplacer0 )r1 r4 r5 r6 r7 r8 �r+ r3 r2 �r- r3 r, �r. r3 r� )r9 r: r; )r r )r
r r r � test_cp1252� s zCodePageTest.test_cp1252c C s* d } | j | d � | j | d � d S) Ni� r� r� � abc� é€� +AOkgrA-� � +2//f/w-� �� +3IA-� �� +//0-� [+/]�[]� [�]� [ÿ]��abc�strictr= �r> rL r? �r@ rL rA �rB rL rC �rD rL rE )rJ rM rN rO rP �r= rL rK �r? rL r> �rA rL r@ �rC rL rB �rE rL rD �rF rL rG �rH rL rI )rQ rR rS rT rU rV rW )r r )r
r r r r � test_cp_utf7� s zCodePageTest.test_cp_utf7c C sC | j d d � | j | j d � t r? | j | j d � n d S)Ni� � ��rl � 騾rm � �騾� �� � �� [�]� []� [?]�rY �ignorerZ �rY �replacer[ )rb rd �r\ rc r] �r\ re r^ )rf rg �r_ rc r` �r_ re ra )rh ri )r r� r� r )r
r r r �test_multibyte_encoding� s z$CodePageTest.test_multibyte_encodingc C s� t j d d d d � } | j | d � t j d d d d � } | j | d � t j d d
d d � } | j | d � t j d d
d d � } | j | d � d S)Ni� s �r� Fr4 r s �� 騾r^ s �� 騾騾r� s abcr� r� )r4 r )rk r^ )rl r� )zabcr� )r r� r )r
r� r r r �test_incremental� s z CodePageTest.test_incrementalN)
r r r r� r� r r r r* r< rX rj rm r r r r r� 7 s r� �__main__)Or r� rD r� r� r� �warningsrC Ztestr �platformZgetwindowsversion�majorr� Zctypes� ImportErrorr� �sizeofZc_wcharr ry r r r2 ZTestCaserz r� r� r� r� r� r� r� r� r� r= rA rI r[ rd rm r) r �printr� rk rq r� r� r� r� r� r� r0 rf rJ r2 r- rE rX r` rm r� r� r� r� r� r� r� r� r� r� r� �_codecsr� r� r� r �mainr r r r �<module> s�
!� * _ - . V , , 6f � T4
O V_
��%N2":
�
��