Your IP : 216.73.216.85
B
� f/� � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZG dd� d�ZG dd� de �Z
G dd� de �Z G dd � d e �Z
G d
d � d e �ZG d d
� d
e�ZG dd� de�ZG dd� de�ZG dd� dej�Zedkr�e�� dS )� Nc @ s e Zd Zdd� Zdd� ZdS )� PosReturnc C s
d| _ d S )Nr )�pos)�self� r �=/opt/alt/python37/lib64/python3.7/test/test_codeccallbacks.py�__init__ s zPosReturn.__init__c C s> | j }|}|dk r t|j�| }||jkr6t|j�| _ d|fS )Nr z<?>)r �len�object�start)r �excZoldposZrealposr r r �handle s
zPosReturn.handleN)�__name__�
__module__� __qualname__r r r r r r r s r c @ s e Zd Zdd� ZdS )�BadStartUnicodeEncodeErrorc C s t �| ddddd� g | _d S )N�ascii� r � �bad)�UnicodeEncodeErrorr r
)r r r r r s z#BadStartUnicodeEncodeError.__init__N)r
r r r r r r r r s r c @ s e Zd Zdd� ZdS )�BadObjectUnicodeEncodeErrorc C s t �| ddddd� g | _d S )Nr r r r r )r r r )r r r r r ! s z$BadObjectUnicodeEncodeError.__init__N)r
r r r r r r r r s r c @ s e Zd Zdd� ZdS )�NoEndUnicodeDecodeErrorc C s t �| dtd�ddd� | `d S )Nr � r r r )�UnicodeDecodeErrorr � bytearray�end)r r r r r ' s z NoEndUnicodeDecodeError.__init__N)r
r r r r r r r r & s r c @ s e Zd Zdd� ZdS )�BadObjectUnicodeDecodeErrorc C s" t �| dtd�ddd� g | _d S )Nr r r r r )r r r r )r r r r r - s z$BadObjectUnicodeDecodeError.__init__N)r
r r r r r r r r , s r c @ s e Zd Zdd� ZdS )� NoStartUnicodeTranslateErrorc C s t �| dddd� | `d S )Nr r r r )�UnicodeTranslateErrorr r
)r r r r r 3 s z%NoStartUnicodeTranslateError.__init__N)r
r r r r r r r r 2 s r c @ s e Zd Zdd� ZdS )�NoEndUnicodeTranslateErrorc C s t �| dddd� | `d S )Nr r r r )r r r )r r r r r 9 s z#NoEndUnicodeTranslateError.__init__N)r
r r r r r r r r 8 s r c @ s e Zd Zdd� ZdS )� NoObjectUnicodeTranslateErrorc C s t �| dddd� | `d S )Nr r r r )r r r )r r r r r ? s z&NoObjectUnicodeTranslateError.__init__N)r
r r r r r r r r > s r c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd3d4� Z d5d6� Z d7d8� Z d9d:� Z d;d<� Z d=d>� Z!d?d@� Z"dAdB� Z#dCdD� Z$dEdF� Z%dGdH� Z&dIS )J�CodecCallbackTestc C s0 d}| � |�dd�d� | � |�dd�d� d S )Nu スパモ änd eggsr �xmlcharrefreplaces& スパモ änd eggszlatin-1s! スパモ �nd eggs)� assertEqual�encode)r �sr r r �test_xmlcharrefreplaceE s
z(CodecCallbackTest.test_xmlcharrefreplacec C sd dd� }t �d|� d}d}| �|�dd�|� d}| �|�dd�|� d }| �|�d
d�|� d S ) Nc S s� t | t�std| ��g }x`| j| j| j� D ]J}y |�dtjj t
|� � W q. t k
rv |�dt
|� � Y q.X q.W d� |�| jfS )Nzdon't know how to handle %rz&%s;z&#%d;r )
�
isinstancer � TypeErrorr r
r �append�htmlZentitiesZcodepoint2name�ord�KeyError�join)r �l�cr r r �xmlcharnamereplaceW s
zECodecCallbackTest.test_xmlcharnamereplace.<locals>.xmlcharnamereplaceztest.xmlcharnamereplaceu «ℜ» = 〈ሴ€〉s0 «ℜ» = ⟨ሴ€⟩r s$ �ℜ� = ⟨ሴ€⟩zlatin-1s �ℜ� = ⟨ሴ�⟩z iso-8859-15)�codecs�register_errorr# r$ )r r0 �sin�soutr r r �test_xmlcharnamereplaceS s z)CodecCallbackTest.test_xmlcharnamereplacec C sd dd� }t �d|� d}d}| �|�dd�|� d}| �|�dd�|� d }| �|�d
d�|� d S ) Nc S sd t | t�std| ��g }x4| j| j| j� D ] }|�t�|dt |� �� q.W dd�
|� | jfS )Nzdon't know how to handle %rz0x%xz
[1m%s[0mz, ) r' r r( r r
r r) � unicodedata�namer+ r- )r r. r/ r r r �uninamereplacev s
z=CodecCallbackTest.test_uninamereplace.<locals>.uninamereplaceztest.uninamereplaceu ¬ሴ€耀sN [1mNOT SIGN, ETHIOPIC SYLLABLE SEE, EURO SIGN, CJK UNIFIED IDEOGRAPH-8000[0mr sE �[1mETHIOPIC SYLLABLE SEE, EURO SIGN, CJK UNIFIED IDEOGRAPH-8000[0mzlatin-1sA �[1mETHIOPIC SYLLABLE SEE[0m�[1mCJK UNIFIED IDEOGRAPH-8000[0mz iso-8859-15)r1 r2 r# r$ )r r8 r3 r4 r r r �test_uninamereplacem s z%CodecCallbackTest.test_uninamereplacec C sP d}d}| � |�dd�|� d}| � |�dd�|� d}| � |�dd�|� d S ) Nu a¬ሴ€耀s! a\xac\u1234\u20ac\u8000\U0010ffffr �backslashreplaces a�\u1234\u20ac\u8000\U0010ffffzlatin-1s a�\u1234�\u8000\U0010ffffz iso-8859-15)r# r$ )r r3 r4 r r r �test_backslashescape� s z&CodecCallbackTest.test_backslashescapec C sP d}d}| � |�dd�|� d}| � |�dd�|� d}| � |�dd�|� d S ) Nu a¬ሴ€耀s[ a\N{NOT SIGN}\N{ETHIOPIC SYLLABLE SEE}\N{EURO SIGN}\N{CJK UNIFIED IDEOGRAPH-8000}\U0010ffffr � namereplacesP a�\N{ETHIOPIC SYLLABLE SEE}\N{EURO SIGN}\N{CJK UNIFIED IDEOGRAPH-8000}\U0010ffffzlatin-1sD a�\N{ETHIOPIC SYLLABLE SEE}�\N{CJK UNIFIED IDEOGRAPH-8000}\U0010ffffz iso-8859-15)r# r$ )r r3 r4 r r r �test_nameescape� s z!CodecCallbackTest.test_nameescapec C sJ dd� }t �d|� d}d}| �|�dd�|� d}| �t|jdd� d S )Nc S sF t | t�std| ��| j| j| jd � dkr>d| jd fS | �d S )Nzdon't know how to handle %r� s ��� )r' r r( r r
)r r r r � relaxedutf8� s
z>CodecCallbackTest.test_decoding_callbacks.<locals>.relaxedutf8ztest.relaxedutf8s a b��cü����u a b cü zutf-8s ����)r1 r2 r# �decode� assertRaisesr )r r@ r3 r4 r r r �test_decoding_callbacks� s
z)CodecCallbackTest.test_decoding_callbacksc C s� t dd� dD ��}d}d}| �t�|d|�d |� d}| �ttj|d|� d |td
�< d }d }| �t�|d
|�d |� d|td
�< | �ttj|d
|� d S )Nc s s( | ] }t |�td |�� d�fV qdS )r> r N)r+ �bytes�upper)�.0r/ r r r � <genexpr>� s z7CodecCallbackTest.test_charmapencode.<locals>.<genexpr>Zabcdefgh�abcs AABBCC�strictr ZabcAs XYZ�?ZabcDEFs AABBCCXYZXYZXYZ�replaceZXYZ)�dictr# r1 �charmap_encoderB � UnicodeErrorr+ r( )r �charmapr3 r4 r r r �test_charmapencode� s z$CodecCallbackTest.test_charmapencodec C s� t j�dtf��� | �tdjd� td�d��dkr�dd� }| � d�dd�d� | � d�dd �d
� | � d�dd �d � t
� d
|� | � d�dd
�d� W d Q R X d S )Nz*unicode_internal codec has been deprecateds zunicode-internalr? � c S s t | t�std| ��dS )Nzdon't know how to handle %r)�r )r' r r( )r r r r �handler_unicodeinternal� s
zMCodecCallbackTest.test_decodeunicodeinternal.<locals>.handler_unicodeinternal�ignorerK u �r: z \x00ztest.huiz ) �test�support�check_warnings�DeprecationWarningrB r rA r r$ r# r1 r2 )r rS r r r �test_decodeunicodeinternal� s*
z,CodecCallbackTest.test_decodeunicodeinternalc C s� dd� }t �d|� dd� }t �d|� d}| �|�dd�d � | �|�dd�d
� | �d �d d�d
� | �d�d d�d� | �t �ddtd�di�d d� | �d�dd�d� | �d�dd�d� d S )Nc sj t � j� j�}t� t�r,� fdd�|D �}n*t� t�rJ� fdd�|D �}n td� ��dd�|� � jfS )Nc s g | ]}d t � j| � �qS )z<%d>)r+ r )rF r )r r r �
<listcomp>� s zFCodecCallbackTest.test_callbacks.<locals>.handler1.<locals>.<listcomp>c s g | ]}d � j | �qS )z<%d>)r )rF r )r r r rZ s zdon't know how to handle %rz[%s]r )�ranger
r r' r r r( r- )r �rr. r )r r �handler1� s
z2CodecCallbackTest.test_callbacks.<locals>.handler1z
test.handler1c sJ t � t�std� ��� fdd�t� j� j�D �}dd�|� � jd fS )Nzdon't know how to handle %rc s g | ]}d � j | �qS )z<%d>)r )rF r )r r r rZ
s zFCodecCallbackTest.test_callbacks.<locals>.handler2.<locals>.<listcomp>z[%s]r r )r' r r( r[ r
r r- )r r. r )r r �handler2 s
z2CodecCallbackTest.test_callbacks.<locals>.handler2z
test.handler2s ���r z [<129>][<128>][<255>]z [<129>][<128>]s \u3042\u3xxxzunicode-escapeu あ[<92><117><51>]xxxs \u3042\u3xxu あ[<92><117><51>]xxs abc�a�zr z
z[<98>][<99>]u güßrks g[<252><223>]rku güßs
g[<252><223>])r1 r2 r# rA �charmap_decoder+ r$ )r r] r^ r% r r r �test_callbacks� s4
z CodecCallbackTest.test_callbacksc s� ddddddg}x"|D ]}t �d| t �|�� qW d� |d d
� |D �7 }x\� fd d
�d D �D ]F}x@d
D ]8}x2|D ]*}y|�||� W qr tk
r� Y qrX qrW qhW q^W d S )NrI rT rK r" r: r< ztest.i� c S s g | ] }d | �qS )ztest.r )rF �errr r r rZ < s z6CodecCallbackTest.test_longstrings.<locals>.<listcomp>c s g | ] }|� �qS r r )rF r% )r. r r rZ = s )�xu あu aä)r zlatin-1z
iso-8859-1z iso-8859-15zutf-8zutf-7zutf-16zutf-32)r1 r2 � lookup_errorr$ rN )r �errorsrc Zuni�encr )r. r �test_longstrings3 s
z"CodecCallbackTest.test_longstringsc
C s� | j t|f|d d� �� | j t|f|dg �� dddddd g}x�tt|��D ]v}xp|D ]h}t|�t|| �krtqZg }x6tt|��D ]&}||kr�|�|� q�|�|| � q�W | j t|f|�� qZW qPW ||� } | �t| �|� d S )N���ztoo muchZspams eggss spam�* g �?)rB r( r[ r �typer) r# �str)
r �exctype�args�msgZ wrongargs�iZwrongargZcallargs�jr r r r �check_exceptionobjectargsF s
z+CodecCallbackTest.check_exceptionobjectargsc C s� | � tdddddgd� | � tdddddgd� | � tdd d
ddgd � | � tdd d
ddgd
� | � tddd
ddgd� | � tddd
ddgd� d S )Nr u gürkr r> �ouchz?'ascii' codec can't encode character '\xfc' in position 1: ouchrQ z;'ascii' codec can't encode characters in position 1-3: ouchu üxr z?'ascii' codec can't encode character '\xfc' in position 0: ouchu ĀxzA'ascii' codec can't encode character '\u0100' in position 0: ouchu xzA'ascii' codec can't encode character '\uffff' in position 0: ouchu 𐀀xzE'ascii' codec can't encode character '\U00010000' in position 0: ouch)rr r )r r r r �test_unicodeencodeerror_ s0 z)CodecCallbackTest.test_unicodeencodeerrorc C s< | � tdtd�dddgd� | � tdtd�dddgd� d S ) Nr s g�rkr r> rs z8'ascii' codec can't decode byte 0xfc in position 1: ouch� z6'ascii' codec can't decode bytes in position 1-2: ouch)rr r r )r r r r �test_unicodedecodeerror s z)CodecCallbackTest.test_unicodedecodeerrorc C sr | � tddddgd� | � tddddgd� | � tddddgd � | � td
dddgd � | � tddd dgd
� d S )Nu gürkr r> rs z4can't translate character '\xfc' in position 1: ouchu gĀrkz6can't translate character '\u0100' in position 1: ouchu grkz6can't translate character '\uffff' in position 1: ouchu g𐀀rkz:can't translate character '\U00010000' in position 1: ouchru z0can't translate characters in position 1-2: ouch)rr r )r r r r �test_unicodetranslateerror� s(
z,CodecCallbackTest.test_unicodetranslateerrorc
C s~ | � ttjd� | � ttjtd�� | � ttjtddddd�� | � ttjtdtd�ddd�� | � ttjtdddd�� d S )Nrj rs r u あr r � �) rB r( r1 �
strict_errors� Exceptionr r r r )r r r r � test_badandgoodstrictexceptions� s(
z1CodecCallbackTest.test_badandgoodstrictexceptionsc
C s� | � ttjd� | � ttjtd�� | �t�tddddd��d� | �t�tdtd�ddd��d� | �t�t dddd��d� d S ) Nrj rs r u aあbr r> )r r> s a�b)
rB r( r1 �
ignore_errorsrN r# r r r r )r r r r � test_badandgoodignoreexceptions� s(
z1CodecCallbackTest.test_badandgoodignoreexceptionsc
C s� | � ttjd� | � ttjtd�� | � ttjt� � | � ttjt� � | �t�tddddd��d� | �t�t dt
d�ddd��d � | �t�t dddd��d � d S )
Nrj rs r u aあbr r> )rJ r> s a�b)u �r> ) rB r( r1 �replace_errorsrN r r r# r r r r )r r r r � test_badandgoodreplaceexceptions� s8
z2CodecCallbackTest.test_badandgoodreplaceexceptionsc C s� | � ttjd� | � ttjtd�� | � ttjtdtd�ddd�� | � ttjtdddd�� d}|d 7 }d
�d d � |D ��}| � t�t
dd
| d ddt |� d��d
�dd � |D ��dt |� f� d S )Nrj rs r rx r r u あ)r r � �
�c �d i� i� i' i' i�� i�� i?B i@B )i � i�� r c s s | ]}t |�V qd S )N)�chr)rF r/ r r r rG ' s zOCodecCallbackTest.test_badandgoodxmlcharrefreplaceexceptions.<locals>.<genexpr>r_ �bc s s | ]}d | V qdS )z&#%d;Nr )rF r/ r r r rG - s ) rB r( r1 �xmlcharrefreplace_errorsrN r r r r- r# r r )r Zcsr% r r r �*test_badandgoodxmlcharrefreplaceexceptions s0
z<CodecCallbackTest.test_badandgoodxmlcharrefreplaceexceptionsc
C sD | � ttjd� | � ttjtd�� ddddddd d
d d d
dg }x�|D ]�\}}| j|d��x | �t�tdd| d ddt|� d��|dt|� f� | �t�t d| d ddt|� d��|dt|� f� W d Q R X qFW ddddg}xV|D ]N\}}| j|d��4 | �t�t
dt d| d �ddd��|df� W d Q R X q�W d S ) Nrj rs )u あz\u3042)�
z\x0a)r_ z\x61)r? z\x00)� ÿz\xff)u Āz\u0100)u z\uffff)u 𐀀z
\U00010000)u z
\U0010ffff)u �z\ud800)u �z\udfff)u ��z \ud800\udfff)rl r r_ r� r )� az\x61)�
z\x0a)� z\x00)rx z\xff)rD r� � br> ) rB r( r1 �backslashreplace_errorsrN �subTestr# r r r r r )r �testsr% r\ r� r r r �)test_badandgoodbackslashreplaceexceptions0 sV
z;CodecCallbackTest.test_badandgoodbackslashreplaceexceptionsc
C s� | � ttjd� | � ttjtd�� | � ttjtdtd�ddd�� | � ttjtdddd�� dd d
d d d
ddg}xb|D ]Z\}}| j|d��@ | � t�t
dd| d ddt |� d��|dt |� f� W d Q R X qxW d S )Nrj rs r rx r r u あ)u あz\N{HIRAGANA LETTER A})r? z\x00)u ﯹzW\N{ARABIC LIGATURE UIGHUR KIRGHIZ YEH WITH HAMZA ABOVE WITH ALEF MAKSURA ISOLATED FORM})u z\N{CANCEL TAG})u z
\U0010ffff)u �z\ud800)u �z\udfff)u ��z \ud800\udfff)rl r_ r� ) rB r( r1 �namereplace_errorsrN r r r r� r# r r )r r� r% r\ r r r �$test_badandgoodnamereplaceexceptionsj s>
z6CodecCallbackTest.test_badandgoodnamereplaceexceptionsc C s� t �d�}| �t|d� | �t|td�� | �t|tdddd�� x>dD ]6}| j|d�� | �t|td |ddd�� W d Q R X qHW | �|td d
dd d��d � | �t |t d t
d
�ddd�� | �|t d t
d�dd d��d� d S )N�surrogateescaperj rs u �r r )r_ u �u �)rl r u a�br> )� �r> r� s a�b)u �r> ) r1 re rB r( rN r r� r r# r r )r Zsurrogateescape_errorsr% r r r �(test_badandgoodsurrogateescapeexceptions� s>
z:CodecCallbackTest.test_badandgoodsurrogateescapeexceptionsc C s� t �d�}| �t|d� | �t|td�� | �t|tdddd�� x^dD ]V}| j|d��@ | �t|t|d ddd�� | �t|t|d � |�ddd�� W d Q R X qHW xBd
D ]:}| j|d ��$ | �t|td |dt
|�d�� W d Q R X q�W d
ddddddddddddddg}x�|D ]�\}}}}| j|||d ��� | � |t|d | d ddt
|� d��|dt
|� f� | � |t|t d |d |� d �dd| d��|d d� d| f� W d Q R X �qW d S ) N�
surrogatepassrj rs u �r r )zutf-8zutf-16lezutf-16bezutf-32lezutf-32be)�encodingr_ )u �u �u ��)rl r )zutf-8u �s �ru )zutf-16leu �s �r> )zutf-16beu �s � r> )zutf-32leu �s � rQ )zutf-32beu �s � rQ )zutf-8u �s �ru )zutf-16leu �s ��r> )zutf-16beu �s �r> )zutf-32leu �s �� rQ )zutf-32beu �s �rQ )zutf-8u ��s ��ru )zutf-16leu ��s ��r> )zutf-16beu ��s � �r> )zutf-32leu ��s � �� rQ )zutf-32beu ��s � �rQ )r� rl rD r� r� r� )
r1 re rB r( rN r r� r r r$ r r# r )r Zsurrogatepass_errorsrg r% r� r� �nr r r �&test_badandgoodsurrogatepassexceptions� sp
&
$z8CodecCallbackTest.test_badandgoodsurrogatepassexceptionsc s� d}d}xz|D ]r� t �d� fdd�� x |D ]}| �tdj|d� q,W x8dD ]0\}}tj�� � | �t|j|d� W d Q R X qLW qW d S )N) rj �foo)r r> ru )r� r ru )r� N)r� )r� r ru )r� N)r� )r zlatin-1z
iso-8859-1z iso-8859-15ztest.badhandlerc s � S )Nr )rd )�resr r �<lambda> r z:CodecCallbackTest.test_badhandlerresults.<locals>.<lambda>u あ))r rx )zutf-8rx )zutf-7s +x-)zunicode-internalr� ) r1 r2 rB r( r$ rU rV rW rA )r ZresultsZencsrg rD r )r� r �test_badhandlerresults s$
z(CodecCallbackTest.test_badhandlerresultsc C s| | � tjt�d�� | � tjt�d�� | � tjt�d�� | � tjt�d�� | � tjt�d�� | � tjt�d�� d S )NrI rT r" r: r< )r# r1 ry re r| r� r� r� )r r r r � test_lookup( s z CodecCallbackTest.test_lookupc C s8 dd� }t �d|� x dD ]}| �tdj|d� qW d S )Nc S s$ t | t�rd| jfS td| ��d S )Nu 䉂zdon't know how to handle %r)r' r r r( )r r r r � unencrepl: s
z@CodecCallbackTest.test_unencodablereplacement.<locals>.unencreplztest.unencreplhandler)r z
iso-8859-1z iso-8859-15u 䉂)r1 r2 rB r r$ )r r� rg r r r �test_unencodablereplacement9 s
z-CodecCallbackTest.test_unencodablereplacementc C s& | � ttjd� | � ttjdd� d S )Nrj z
test.dummy)rB r( r1 r2 )r r r r �test_badregistercallH s z&CodecCallbackTest.test_badregistercallc C s | � ttj� d S )N)rB r( r1 re )r r r r �test_badlookupcallO s z$CodecCallbackTest.test_badlookupcallc C s | � ttjd� d S )Nz test.unknown)rB � LookupErrorr1 re )r r r r �test_unknownhandlerT s z%CodecCallbackTest.test_unknownhandlerc C sR d}d� dd� |D ��}t�dtj� x&dD ] }xdD ]}|�||� q6W q,W d S )N)
r � r� �2 r� i� i� i� i' iP� i�� i � i@B r c S s g | ] }t |��qS r )r� )rF rd r r r rZ _ s z;CodecCallbackTest.test_xmlcharrefvalues.<locals>.<listcomp>ztest.xmlcharrefreplace)r z iso-8859-15)r" ztest.xmlcharrefreplace)r- r1 r2 r� r$ )r �vr% rg rc r r r �test_xmlcharrefvaluesY s
z'CodecCallbackTest.test_xmlcharrefvaluesc C s� | � tdjdd� dd� }t�d|� | � tdjdd� | � tdjdd� | � td jdd� | � td
jdd� | � td jdd� | � td jd
d� dd� }t�d|� | � tdjdd� t� }t�d|j� d|_| � d�dd�d� d|_| � d�dd�d� d|_| � t
djdd� d|_| � d�dd�d� d|_| � d�dd�d� d|_| � t
djdd� d |_| � d �d
d�d� G d d � d t �}| � t tj
dd d!d i� | � ttj
dd |� � | � ttj
dd d!tjd i� d S )"Nrx r z test.unknownc S s dS )Nrj r )r r r r �baddecodereturn1k s z=CodecCallbackTest.test_decodehelper.<locals>.baddecodereturn1ztest.baddecodereturn1� \zunicode-escapes \x0s \x0ys
\Uffffeeees \uyyyyzraw-unicode-escapec S s dS )N)rJ Nr )r r r r �baddecodereturn2u s z=CodecCallbackTest.test_decodehelper.<locals>.baddecodereturn2ztest.baddecodereturn2ztest.posreturnri s �0z<?>0���z<?><?>���r r> z<?>ru � s \uyyyy0c @ s e Zd Zdd� ZdS )z.CodecCallbackTest.test_decodehelper.<locals>.Dc S s t �d S )N)�
ValueError)r �keyr r r � __getitem__� s z:CodecCallbackTest.test_decodehelper.<locals>.D.__getitem__N)r
r r r� r r r r �D� s r� rI � )rB r� rA r1 r2 r( r r r r# �
IndexErrorrL rN ra r� �sys�
maxunicode)r r� r� �handlerr� r r r �test_decodehelpere s@ z#CodecCallbackTest.test_decodehelperc C sz | � tdjdd� dd� }t�d|� | � tdjdd� dd� }t�d |� | � tdjdd � t� }t�d
|j� d |_| � d �dd
�d
� d|_| � d �dd
�d� d|_| � t
d jdd
� d|_| � d �dd
�d
� d|_| � d �dd
�d� d|_| � t
d jdd
� d|_G dd� dt �}xTdD ]L}| � t tj
d|dd i� | � ttj
d||� � | � ttj
d|ddi� �q&W d S )Nr� r z test.unknownc S s dS )Nrj r )r r r r �badencodereturn1� s z=CodecCallbackTest.test_encodehelper.<locals>.badencodereturn1ztest.badencodereturn1c S s dS )N)rJ Nr )r r r r �badencodereturn2� s z=CodecCallbackTest.test_encodehelper.<locals>.badencodereturn2ztest.badencodereturn2ztest.posreturnri u ÿ0s <?>0r� s <?><?>r� r r> s <?>ru r c @ s e Zd Zdd� ZdS )z.CodecCallbackTest.test_encodehelper.<locals>.Dc S s t �d S )N)r� )r r� r r r r� � s z:CodecCallbackTest.test_encodehelper.<locals>.D.__getitem__N)r
r r r� r r r r r� � s r� )rI rK r" r: r< ztest.posreturnr� i, )rB r� r$ r1 r2 r( r r r r# r� rL rN rM r� )r r� r� r� r� rc r r r �test_encodehelper� s6
z#CodecCallbackTest.test_encodehelperc C sB G dd� dt �}| �tdjdtjd i� | �tdjddi� d S )Nc @ s e Zd Zdd� ZdS )z1CodecCallbackTest.test_translatehelper.<locals>.Dc S s t �d S )N)r� )r r� r r r r� � s z=CodecCallbackTest.test_translatehelper.<locals>.D.__getitem__N)r
r r r� r r r r r� � s r� r� r� r r )rL rB r� � translater� r� r( )r r� r r r �test_translatehelper� s z&CodecCallbackTest.test_translatehelperc C sH t d�dt d�dt d�dt d�di}x d D ]}d
| }|�|� q*W d S ) N�&z&�<z<�>z>�"z")r r� r� i� z abc<def>ghi)r+ r� )r rO r� �textr r r �test_bug828737� s
z CodecCallbackTest.test_bug828737c C s� ddddddddg}d d
� }t �d |� tj�� �: x2|D ]*\}}| �t�� |�|d � W d Q R X q:W W d Q R X d d
� }t �d|� tj�� �, x$|D ] \}}| �|�|d�d� q�W W d Q R X d S )N)r rx )zutf-7s ++)zutf-8rx )zutf-16rx )zutf-32rx )zunicode-escapes \u123g)zraw-unicode-escapes \u123g)zunicode-internalrx c S s$ t | t�rd| _dS td| ��d S )Nrj )u 䉂r zdon't know how to handle %r)r' r r r( )r r r r � replacing� s
z?CodecCallbackTest.test_mutatingdecodehandler.<locals>.replacingztest.replacingc S s$ t | t�rd| _dS td| ��d S )Nr )u 䉂r zdon't know how to handle %r)r' r r r( )r r r r �mutating s
z>CodecCallbackTest.test_mutatingdecodehandler.<locals>.mutatingz
test.mutatingu 䉂) r1 r2 rU rV rW rB r( rA r# )r Zbaddatar� r� �datar� r r r �test_mutatingdecodehandler� s& $ z,CodecCallbackTest.test_mutatingdecodehandlerc C s� dd� }t �d|� | �d�dd�d� | �d�dd�d� | �d �d
d�d � | �d �d
d�d � dd� }t �d|� | �d�dd�d� | �d�dd�d� d S )Nc S s( t | t�rd| jd fS td| ��d S )Nu �r zdon't know how to handle %r)r' r r
r( )r r r r �forward_shorter_than_end s
zPCodecCallbackTest.test_crashing_decode_handler.<locals>.forward_shorter_than_endz test.forward_shorter_than_ends ����� z utf-16-leu ����Ø s ���� � z utf-16-bes z utf-32-leu
���ᄑ s z utf-32-bec S s* t | t�rd| _d| jfS td| ��d S )Ns u �zdon't know how to handle %r)r' r r r
r( )r r r r �replace_with_long9 s
zICodecCallbackTest.test_crashing_decode_handler.<locals>.replace_with_longztest.replace_with_longr� zutf-16u � zutf-32u � )r1 r2 r# rA )r r� r� r r r � test_crashing_decode_handler s6
z.CodecCallbackTest.test_crashing_decode_handlerc s� t jt jt jt jt jt jt �d�t �d�g}x�tt t
fD ]�� G � fdd�dt �}x6|D ].}| j |� d�� | �
t||� � W d Q R X qVW G � fdd�dt�}xJ|D ]B}| j |� d��* | �
t|f�� ||� � W d Q R X W d Q R X q�W q8W d S )Nr� r� c s e Zd Z� ZdS )zACodecCallbackTest.test_fake_error_class.<locals>.FakeUnicodeErrorN)r
r r � __class__r )�clsr r �FakeUnicodeErrorW s r� )r� Z error_classc s e Zd Z� ZdS )zACodecCallbackTest.test_fake_error_class.<locals>.FakeUnicodeErrorN)r
r r r� r )r� r r r� \ s )r1 ry r| r~ r� r� r� re r r r rl r� rB r( rz )r Zhandlersr� r� r )r� r �test_fake_error_classK s$
z'CodecCallbackTest.test_fake_error_classN)'r
r r r& r5 r9 r; r= rC rP rY rb rh rr rt rv rw r{ r} r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r! C sH
$9 (%:.,H ;6
)3r! �__main__)r1 Z
html.entitiesr* r� Z test.supportrU r6 Zunittestr r r r r r r r r r r ZTestCaser! r
�mainr r r r �<module> s0 )