Your IP : 216.73.216.213
��Yf� � @ sC d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m Z d d l Z d d l Z d d l
Z
d d l m Z Gd d � d e j
� Z Gd d � d e j
� Z Gd d
� d
e j
� Z Gd d � d e � Z Gd
d � d e j � Z Gd d � d e � Z Gd d � d e � Z Gd d � d e j � Z Gd d � d e � Z Gd d � d e j
� Z Gd d � d e j
� Z Gd d � d e j
� Z Gd d � d e j
� Z Gd d � d � Z e j e e d! � d" � Gd# d$ � d$ e j
� � Z Gd% d& � d& e j
� Z e! d' k r?e j" � d S)(� N)�StringIO)�
TemporaryFile)�supportc @ s� e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d d � Z d d � Z d d � Z d d � Z d d! � Z d" d# � Z d$ d% � Z d& d' � Z d( d) � Z e j d* d+ � � Z d, d- � Z d. d/ � Z d0 d1 � Z d2 d3 � Z d4 d5 � Z d6 d7 � Z d8 d9 � Z! d: d; � Z" d< d= � Z# d> d? � Z$ d@ S)A�Test_Csvz�
Test the underlying C csv parser in ways that are not appropriate
from the high level interface. Further tests of this nature are done
in TestDialectRegistry.
c C se | j t | � | j t | d � | j t | | d d �| j t | | d d �| j t | | d d �| j t j | | d � | j t | | d d �| j t | | d d �| j t | | d d �| j t | | d d �| j t | | d d �| j t | | d d �| j t | | d t j d d
�| j t | | d t j d d �d S) N�bad_attrr � delimiterZXXZfoo� � quotechar�lineterminator�quoting� )� assertRaises� TypeError�csv�Error� QUOTE_ALL)�self�ctor�arg� r �2/opt/alt/python35/lib64/python3.5/test/test_csv.py�_test_arg_valid s zTest_Csv._test_arg_validc C s | j t j g � d S)N)r r �reader)r r r r �test_reader_arg_valid( s z Test_Csv.test_reader_arg_validc C s | j t j t � � d S)N)r r �writerr )r r r r �test_writer_arg_valid+ s z Test_Csv.test_writer_arg_validc G s- | | � } | j | j j d � | j | j j d � | j | j j d � | j | j j d � | j | j j d � | j | j j t j � | j | j j
d � | j | j j d � | j t
t | j d � | j t
t | j d d � | j t
t | j d � | j t
t | j d d � d S) N�,Tz
�"Fr �:r )� assertEqual�dialectr � doublequote�
escapecharr
r r r �
QUOTE_MINIMAL�skipinitialspace�strictr
�AttributeError�delattr�setattr)r r �args�objr r r �_test_default_attrs. s z Test_Csv._test_default_attrsc C s | j t j g � d S)N)r+ r r )r r r r �test_reader_attrs@ s zTest_Csv.test_reader_attrsc C s | j t j t � � d S)N)r+ r r r )r r r r �test_writer_attrsC s zTest_Csv.test_writer_attrsc G s t d d d d d d d d d d
d t j d d
d d
� } | | | � } | j | j j d � | j | j j d � | j | j j d � | j | j j d � | j | j j d
� | j | j j
t j � | j | j j d
� | j | j j d
� d S)Nr r r! Fr" �\r
�
r �*r r$ Tr% )
�dictr �
QUOTE_NONEr r r r! r" r
r r r$ r% )r r r) �kwargsr* r r r �_test_kw_attrsF s zTest_Csv._test_kw_attrsc C s | j t j g � d S)N)r4 r r )r r r r �test_reader_kw_attrsV s z Test_Csv.test_reader_kw_attrsc C s | j t j t � � d S)N)r4 r r r )r r r r �test_writer_kw_attrsY s z Test_Csv.test_writer_kw_attrsc G s� Gd d � d � } | | f } | | � } | j | j j d � | j | j j d � | j | j j d � | j | j j d � | j | j j d � | j | j j t j � | j | j j
d � | j | j j d � d S) Nc @ sC e Z d Z d Z d Z d Z d Z d Z e j Z
d Z d Z d S)z-Test_Csv._test_dialect_attrs.<locals>.dialect�-F�^�$�#TN)
�__name__�
__module__� __qualname__r r! r" r
r r r r r$ r% r r r r r ^ s r r7 Fr8 r9 r: T) r r r r! r" r
r r r r r$ r% )r r r) r r* r r r �_test_dialect_attrs\ s
z Test_Csv._test_dialect_attrsc C s | j t j g � d S)N)r> r r )r r r r �test_reader_dialect_attrsr s z"Test_Csv.test_reader_dialect_attrsc C s | j t j t � � d S)N)r> r r r )r r r r �test_writer_dialect_attrsu s z"Test_Csv.test_writer_dialect_attrsc K sl t d d d ��S } t j | | � } | j | � | j d � | j | j � | | j j � Wd QRXd S)Nzw+�newliner r ) r r r �writerow�seekr �readr r
)r �fields�expectr3 �fileobjr r r r � _write_testy s
zTest_Csv._write_testc K sy t d d d ��` } t j | | � } | j | � � | j | � Wd QRX| j d � | j | j � d � Wd QRXd S)Nzw+rA r r )r r r r
rB rC r rD )r �excrE r3 rG r r r r �_write_error_test� s
zTest_Csv._write_error_testc C s� | j t j d � | j f d � | j d g d � | j t j d g d t j �Gd d � d � } | j t | � � Gd d � d � } | j t | � g � d S)Nr z""r c @ s( e Z d Z d d � Z d d � Z d S)z.Test_Csv.test_write_arg_valid.<locals>.BadListc S s d S)N�
r )r r r r �__len__� s z6Test_Csv.test_write_arg_valid.<locals>.BadList.__len__c S s | d k r t � d S)N� )�OSError)r �ir r r � __getitem__� s z:Test_Csv.test_write_arg_valid.<locals>.BadList.__getitem__N)r; r< r= rL rP r r r r �BadList� s rQ c @ s e Z d Z d d � Z d S)z.Test_Csv.test_write_arg_valid.<locals>.BadItemc S s
t � d S)N)rN )r r r r �__str__� s z6Test_Csv.test_write_arg_valid.<locals>.BadItem.__str__N)r; r< r= rR r r r r �BadItem� s rS )rJ r r rH r2 rN )r rQ rS r r r �test_write_arg_valid� s z Test_Csv.test_write_arg_validc C s. d d } | j | | g d | | f � d S)N�XiP� z%s,%s)rH )r � bigstringr r r �test_write_bigfield� s
z Test_Csv.test_write_bigfieldc C s� | j d d d g d � | j t j d d d g d t j �| j d d d g d d t j �| j d d d g d d t j �| j d d d g d d t j �| j d d g d d t j �d S)
N�ar zp,qz a,1,"p,q"r z "a",1,"p,q"z
"a","1","p,q"za
bz "a
b","1")rH rJ r r r2 r# �QUOTE_NONNUMERICr )r r r r �test_write_quoting� s
zTest_Csv.test_write_quotingc C s | j d d d g d d d �| j t j d d d g d d d d �| j d d d g d
d d d d �| j d g d d d d
t j �| j d g d d d d
t j d d �| j d g d d d d
t j �| j d d d g d d d d
t j �d S)NrX r zp,qz a,1,"p,q"r" r. zp,"q"r! Fz
a,1,"p,\"q\""r z""""r z\"za,1,p\,q)rH rJ r r r# r2 )r r r r �test_write_escape� s
zTest_Csv.test_write_escapec C s� | j t d d d g � d � | j t d d d g � d � | j t g � d � | j t d g � d � | j t j t d g � d t j �| j t d d g � d � d S)
NrX r zp,qz a,1,"p,q"za,1,r z""r r )rH �iterrJ r r r2 )r r r r �test_write_iterable� s %z Test_Csv.test_write_iterablec C s� Gd d � d � } t j | � � } | j t | j d g g � t d d d ��n } t j | � } | j t | j d � | j d d g d d g g � | j d
� | j | j � d � Wd QRXd S) Nc @ s e Z d Z d d � Z d S)z+Test_Csv.test_writerows.<locals>.BrokenFilec S s
t � d S)N)rN )r Zbufr r r �write� s z1Test_Csv.test_writerows.<locals>.BrokenFile.writeN)r; r< r= r^ r r r r �
BrokenFile� s r_ rX zw+rA r �b�c�dr z
a,b
c,d
)
r r r
rN � writerowsr r rC r rD )r r_ r rG r r r �test_writerows� s
zTest_Csv.test_writerowsc
C s� d d l } | j d � } t d d d ��L } t j | � } | j | g g � | j d � | j | j � d � Wd QRXd S)Nr rX zw+rA r za
) � _testcapiZunicode_legacy_stringr r r rc rC r rD )r re ra rG r r r r � test_writerows_legacy_strings� s
z&Test_Csv.test_writerows_legacy_stringsc K s2 t j | | � } t | � } | j | | � d S)N)r r �listr )r �inputrF r3 r �resultr r r �
_read_test� s zTest_Csv._read_testc C s� | j g g � | j d g g g � | j t j | j d g d d d �| j t j | j d g d d d �| j d g d g g d d �| j t j | j d g d � d S)
Nr z"ab"cr% r zab c�abcr! r s ab c)rj r
r r )r r r r �test_read_oddinputs� s z Test_Csv.test_read_oddinputsc C s� | j d g d d g g � | j d g d d g g � | j d g d d g g � | j d g d d g g � | j t j | j d g g � | j t j | j d g g � | j t j | j d g g � d S)
Nza,brX r` za,b
za,b
za,b
za,b
c,dza,b
c,dza,b
c,d)rj r
r r )r r r r �
test_read_eol� s zTest_Csv.test_read_eolc C s� | j d g d d g g � | j d g d g g � | j d g d g g d d �| j t j | j d g g d d �| j t j | j d g g d d �| j t j | j d g g d d d d �d S)
Nza,"rX r z"ar8 �
r" r% T)rj r
r r )r r r r �
test_read_eof� s %%zTest_Csv.test_read_eofc C s� | j d g d d d g g d d �| j d g d d g g d d �| j d g d d g g d d �| j d
g d d g g d d �| j d g d d g g d d �| j d
g d d g g d d �d S)Nza,\b,crX r` ra r" r. za,b\,czb,cza,"b\,c"za,"b,\c"z a,"b,c\""zb,c"za,"b,c"\zb,c\)rj )r r r r �test_read_escape s %""""zTest_Csv.test_read_escapec C s� | j d g d d d g g � | j d g d d d d d g g d d d d �| j d g d d d d d g g d
t j d d �| j d g d d
d d d g g d
t j �| j d g d d g g � | j t | j d g g g d
t j �d S)Nz 1,",3,",5�1z,3,�5r �3r r" r. r z
,3,"5",7.3, 9r � g333333 @� z"a
b", 7za
bz 7zabc,3)rj r r2 rY r
�
ValueError)r r r r �test_read_quoting
s $
$$
zTest_Csv.test_read_quotingc C s� t j � } z� d } d | } d | | f } | j | g | | g g � t j | � | j | g | | g g � | j t j � | � t j | d � | j t j | j | g g � | j t t j d � | j t t j d d � Wd t j | � Xd S)NiP� rU z%s,%sr )r Zfield_size_limitrj r r
r r )r �limit�sizerV Zbigliner r r �test_read_bigfield s
zTest_Csv.test_read_bigfieldc C s� t j d d d g � } | j | j d � t | � | j | j d � t | � | j | j d � t | � | j | j d � | j t t | � | j | j d � d S)Nzline,1zline,2zline,3r r rM rt )r r r Zline_num�nextr
�
StopIteration)r �rr r r �test_read_linenum. s
zTest_Csv.test_read_linenumc C s� t d d d ��� } t j | � } | j t | j d � d d g d d g g } | j | � | j d � x7 t t j | � � D] \ } } | j | | | � q� WWd QRXd S) Nzw+rA r za
br` ra zx
dr )
r r r r
r rc rC � enumerater r )r rG r �rowsrO �rowr r r � test_roundtrip_quoteed_newlines: s
"z(Test_Csv.test_roundtrip_quoteed_newlinesc C s� t d d d ��� } t j | d t j d d �} d d g d d
g g } | j | � | j d � xF t t j | d t j d d �� D] \ } } | j | | | � q� WWd QRXd S) Nzw+rA r r r" r. za
br` ra zx
dr ) r r r r2 rc rC r r r )r rG r r� rO r� r r r �(test_roundtrip_escaped_unquoted_newlinesD s
1z1Test_Csv.test_roundtrip_escaped_unquoted_newlinesN)%r; r< r= �__doc__r r r r+ r, r- r4 r5 r6 r> r? r@ rH rJ rT rW rZ r[ r] rd r Z cpython_onlyrf rj rl rm ro rp rw rz r~ r� r� r r r r r s@
r c @ sp e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
d � Z d d � Z
d S)�TestDialectRegistryc C s= | j t t j d � | j t t j � | j t j t j d � | j t j t j d � | j t t j � | j t j t j d � | j t j t j d � | j t t j d � | j t t j d d � | j t t j d d d � | j t t j d d d �| j t t j d d d �| j t t j g � d S)NZnonesuchr Z badargumentr )r
r r �
list_dialects� get_dialectr �unregister_dialect�register_dialect)r r r r �test_registry_badargsN s z)TestDialectRegistry.test_registry_badargsc C s� Gd d � d t j � } d } t j � | g } | j � t j | | � | j t j | � | j t j | � j d � t
t j � � } | j | | � d S)Nc @ s e Z d Z d Z d S)z5TestDialectRegistry.test_registry.<locals>.myexceltsv� N)r; r< r= r r r r r �
myexceltsv` s r� r� ) r �excelr� �sortr� �
addCleanupr� r r� r �sorted)r r� �nameZexpected_dialectsZ got_dialectsr r r �
test_registry_ s
z!TestDialectRegistry.test_registryc C s} d } t j | d d �| j t j | � | j t j | � j d � | j d d d g g t t j d g | � � � d S)NZfedcbar �;rU �Y�ZzX;Y;Z) r r� r� r� r r� r rg r )r r� r r r �test_register_kwargsk s
z(TestDialectRegistry.test_register_kwargsc C s0 Gd d � d t j � } | j t j | � d S)Nc @ s e Z d Z d Z d S)z?TestDialectRegistry.test_incomplete_dialect.<locals>.myexceltsvr� N)r; r< r= r r r r r r� s s r� )r �Dialectr
r )r r� r r r �test_incomplete_dialectr s z+TestDialectRegistry.test_incomplete_dialectc C s� Gd d � d t j � } t d � �q } | j d � | j d � t j | d | � �} | j t | � d d g � | j t | � d d
g � Wd QRXd S) Nc @ s% e Z d Z d Z e j Z d Z d S)z5TestDialectRegistry.test_space_dialect.<locals>.space� r. N)r; r< r= r r r2 r r" r r r r �spacex s r� zw+zabc def
c1ccccc1 benzene
r r rk �defZc1ccccc1Zbenzene)r r� r r^ rC r r r{ )r r� rG r r r r �test_space_dialectw s
z&TestDialectRegistry.test_space_dialectc O st t d d d d d ��U } t j | | | � } | j d d d g � | j d � | j | j � | � Wd QRXd S)
Nzw+rA r �encodingzutf-8r rM rt r )r r r rB rC r rD )r �expectedZ writeargsZ kwwriteargsrG r r r r �compare_dialect_123� s
z'TestDialectRegistry.compare_dialect_123c C s� Gd d � d t j � } Gd d � d t j � } Gd d � d t j � } Gd d � d t j � } t j d | � zv | j d � | j d
| � | j d d | � �| j d
d d �| j d d | d d �| j d d | �Wd t j d � Xd S)Nc @ s e Z d Z d Z d S)z5TestDialectRegistry.test_dialect_apply.<locals>.testAr� N)r; r< r= r r r r r �testA� s r� c @ s e Z d Z d Z d S)z5TestDialectRegistry.test_dialect_apply.<locals>.testBr N)r; r< r= r r r r r �testB� s r� c @ s e Z d Z d Z d S)z5TestDialectRegistry.test_dialect_apply.<locals>.testC�|N)r; r< r= r r r r r �testC� s r� c @ s e Z d Z d Z d S)z7TestDialectRegistry.test_dialect_apply.<locals>.testUniu ΛN)r; r< r= r r r r r �testUni� s r� z1,2,3
z1 2 3
z1:2:3
r z1|2|3
z1;2;3
r r� u 1Λ2Λ3
)r r� r� r� r� )r r� r� r� r� r r r �test_dialect_apply� s
z&TestDialectRegistry.test_dialect_applyc C st | j t t j g d d �| j t t j g d d �| j t t j g d d �| j t t j g d d �d S)Nr r r r r �d ���)r
r r r )r r r r �test_bad_dialect� s z$TestDialectRegistry.test_bad_dialectN) r; r< r= r� r� r� r� r� r� r� r� r r r r r� M s
r� c @ s( e Z d Z d d � Z d d � Z d S)� TestCsvBasec C sn t d d d ��U } | j | � | j d � t j | d | j �} t | � } | j | | � Wd QRXd S)Nzw+rA r r r )r r^ rC r r r rg r )r rh �expected_resultrG r rE r r r �readerAssertEqual� s
z TestCsvBase.readerAssertEqualc C sh t d d d ��O } t j | d | j �} | j | � | j d � | j | j � | � Wd QRXd S)Nzw+rA r r r )r r r r rc rC r rD )r rh r� rG r r r r �writerAssertEqual� s
z TestCsvBase.writerAssertEqualN)r; r< r= r� r� r r r r r� � s r� c @ sB e Z d Z d Z d d � Z d d � Z d d � Z d d � Z d
d � Z d d
� Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d d � Z d d � Z d d � Z d d � Z d d! � Z d" d# � Z d$ d% � Z d& d' � Z d( d) � Z d* d+ � Z d, d- � Z d. d/ � Z d0 d1 � Z d2 d3 � Z d4 S)5�TestDialectExcelr� c C s | j d d g g � d S)Nrk )r� )r r r r � test_single� s z TestDialectExcel.test_singlec C s& | j d d d d d d g g � d S)Nz 1,2,3,4,5rq �2rs �4rr )r� )r r r r � test_simple� s z TestDialectExcel.test_simplec C s | j d g � d S)Nr )r� )r r r r �test_blankline� s z TestDialectExcel.test_blanklinec C s | j d d d g g � d S)Nr r )r� )r r r r �test_empty_fields� s z"TestDialectExcel.test_empty_fieldsc C s | j d d g g � d S)Nz""r )r� )r r r r �test_singlequoted� s z"TestDialectExcel.test_singlequotedc C s | j d d d g g � d S)Nz"",r )r� )r r r r � test_singlequoted_left_empty� s z-TestDialectExcel.test_singlequoted_left_emptyc C s | j d d d g g � d S)Nz,""r )r� )r r r r � test_singlequoted_right_empty� s z.TestDialectExcel.test_singlequoted_right_emptyc C s | j d d g g � d S)Nz""""r )r� )r r r r �test_single_quoted_quote� s z)TestDialectExcel.test_single_quoted_quotec C s | j d d g g � d S)Nz""""""z"")r� )r r r r �test_quoted_quotes� s z#TestDialectExcel.test_quoted_quotesc C s | j d d g g � d S)Nza""b)r� )r r r r �test_inline_quote� s z"TestDialectExcel.test_inline_quotec C s | j d d g g � d S)Nza"b"c)r� )r r r r �test_inline_quotes� s z#TestDialectExcel.test_inline_quotesc C s | j d d g g � d S)Nz"a"bZab)r� )r r r r �test_quotes_and_more� s z%TestDialectExcel.test_quotes_and_morec C s | j d d g g � d S)Nza"b)r� )r r r r �test_lone_quote� s z TestDialectExcel.test_lone_quotec C s | j d d g g � d S)Nz"a" "b"za "b")r� )r r r r �test_quote_and_quote� s z%TestDialectExcel.test_quote_and_quotec C s | j d d g g � d S)Nz "a")r� )r r r r �test_space_and_quote� s z%TestDialectExcel.test_space_and_quotec C s) | j d d d d d d d g g � d S)Nz#1,2,3,"I think, therefore I am",5,6rq r� rs zI think, therefore I amrr �6)r� )r r r r � test_quoted� s z TestDialectExcel.test_quotedc C s& | j d d d d d d g g � d S)NzJ1,2,3,"""I see,"" said the blind man","as he picked up his hammer and saw"rq r� rs z"I see," said the blind manz"as he picked up his hammer and saw)r� )r r r r �test_quoted_quote s z"TestDialectExcel.test_quoted_quotec C s; d } | j | d d d d d g d d d d
g g � d S) NzR1,2,3,"""I see,""
said the blind man","as he picked up his
hammer and saw"
9,8,7,6rq r� rs z"I see,"
said the blind manz"as he picked up his
hammer and saw�9�8�7r� )r� )r rh r r r �test_quoted_nl s z TestDialectExcel.test_quoted_nlc C s# | j d d d d d g g � d S)Nz 12,12,1",Z12z1"r )r� )r r r r �test_dubious_quote s z#TestDialectExcel.test_dubious_quotec C s | j g d � d S)Nr )r� )r r r r � test_null s zTestDialectExcel.test_nullc C s | j d g g d � d S)Nrk zabc
)r� )r r r r �test_single_writer s z#TestDialectExcel.test_single_writerc C s& | j d d d d d g g d � d S)Nr rM rk rt � z
1,2,abc,3,4
)r� )r r r r �test_simple_writer s z#TestDialectExcel.test_simple_writerc C s& | j d d d d d g g d � d S)Nr rM za"bc"rt r� z1,2,"a""bc""",3,4
)r� )r r r r � test_quotes! s z TestDialectExcel.test_quotesc C s | j d g g d � d S)Nzabc,defz "abc,def"
)r� )r r r r �test_quote_fieldsep$ s z$TestDialectExcel.test_quote_fieldsepc C s& | j d d d d d g g d � d S)Nr rM za
bcrt r� z1,2,"a
bc",3,4
)r� )r r r r �
test_newlines' s z TestDialectExcel.test_newlinesN) r; r< r= r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r� � s4 r� c @ s e Z d Z e j Z d Z d S)� EscapedExcelr. N)r; r< r= r r2 r r" r r r r r� * s r� c @ s1 e Z d Z e � Z d d � Z d d � Z d S)�TestEscapedExcelc C s | j d g g d � d S)Nzabc,defz
abc\,def
)r� )r r r r �test_escape_fieldsep1 s z%TestEscapedExcel.test_escape_fieldsepc C s | j d d g g � d S)Nz
abc\,def
zabc,def)r� )r r r r �test_read_escape_fieldsep4 s z*TestEscapedExcel.test_read_escape_fieldsepN)r; r< r= r� r r� r� r r r r r� . s r� c @ s. e Z d Z d Z d d � Z d d � Z d S)�TestDialectUnixZunixc C s | j d d d g g d � d S)Nr zabc defrk z"1","abc def","abc"
)r� )r r r r r� : s z"TestDialectUnix.test_simple_writerc C s | j d d d d g g � d S)Nz"1","abc def","abc"
rq zabc defrk )r� )r r r r �test_simple_reader= s z"TestDialectUnix.test_simple_readerN)r; r< r= r r� r� r r r r r� 7 s r� c @ s e Z d Z e j Z d Z d S)�QuotedEscapedExcelr. N)r; r< r= r rY r r" r r r r r� @ s r� c @ s1 e Z d Z e � Z d d � Z d d � Z d S)�TestQuotedEscapedExcelc C s | j d g g d � d S)Nzabc,defz "abc,def"
)r� )r r r r �test_write_escape_fieldsepG s z1TestQuotedEscapedExcel.test_write_escape_fieldsepc C s | j d d g g � d S)Nz "abc\,def"
zabc,def)r� )r r r r r� J s z0TestQuotedEscapedExcel.test_read_escape_fieldsepN)r; r< r= r� r r� r� r r r r r� D s r� c @ s� e Z d Z d d � Z d d � Z d d � Z d d � Z d d
� Z d d � Z d
d � Z d d � Z
d d � Z d d � Z d d � Z
d d � Z d d � Z d d � Z d d � Z d S) �TestDictFieldsc
C s� t d d d ��� } t j | d d d d g �} | j � | j d � | j | j � d � | j d d
d d i � | j d � | j � | j | j � d � Wd QRXd S)
Nzw+rA r �
fieldnames�f1�f2�f3r z
f1,f2,f3
rK rk z 10,,abc
) r r �
DictWriter� writeheaderrC r �readlinerB rD )r rG r r r r �test_write_simple_dictP s
z%TestDictFields.test_write_simple_dictc C s� t � } t j | d d d d g �} | j � | j | j � d � | j d d d d d d i d d d d
d d i g � | j | j � d � d S)
Nr� r� r� r� z
f1,f2,f3
r rk �frM � Zxyzz f1,f2,f3
1,abc,f
2,5,xyz
)r r r� r� r �getvaluerc )r rG r r r r � test_write_multiple_dict_rows[ s
z,TestDictFields.test_write_multiple_dict_rowsc C s# t � } | j t t j | � d S)N)r r
r r r� )r rG r r r �test_write_no_fieldse s z#TestDictFields.test_write_no_fieldsc C s� t d d d ��� } t j | d d d d g �} | j t � �& } | j d d d d
d d i � Wd QRXt | j � } | j d | � | j d
| � | j d | � | j d | � Wd QRXd S)Nzw+rA r r� r� r� r� Zf4rK Zspamr rk z'f4'z'f2'rq )
r r r� r
rv rB �str� exception�assertInZ assertNotIn)r rG r Zcxr� r r r �#test_write_fields_not_in_fieldnamesi s &z2TestDictFields.test_write_fields_not_in_fieldnamesc C sz t d � �g } | j d � | j d � t j | d d d d g �} | j t | � d d d d d d
i � Wd QRXd S) Nzw+z 1,2,abc
r r� r� r� r� rq r� rk )r r^ rC r �
DictReaderr r{ )r rG r r r r �test_read_dict_fieldsu s
z$TestDictFields.test_read_dict_fieldsc C s� t d � �t } | j d � | j d � t j | � } | j t | � d d d d d d i � | j | j d d d g � Wd QRXd S)
Nzw+zf1,f2,f3
1,2,abc
r r� rq r� r� r� rk )r r^ rC r r� r r{ r� )r rG r r r r � test_read_dict_no_fieldnames} s
(z+TestDictFields.test_read_dict_no_fieldnamesc C s� t d � �� } | j d � | j d � t j | d t t j | � � �} | j | j d d d g � | j t | � d d d d d d
i � Wd QRXd S) Nzw+zf1,f2,f3
1,2,abc
r r� r� r� r� rq r� rk ) r r^ rC r r� r{ r r r� )r rG r r r r �#test_read_dict_fieldnames_from_file� s
z2TestDictFields.test_read_dict_fieldnames_from_filec C s� d d l } t d � �� } | j d � | j d � t j | � } t | � } x[ | j | g | � D]D } | j | j d d d g � | j | d d d d d d i � qf WWd QRXd S)
Nr zw+zf1,f2,f3
1,2,abc
r� r� r� rq r� rk )
� itertoolsr r^ rC r r� r{ �chainr r� )r r� rG r �firstr� r r r � test_read_dict_fieldnames_chain� s
z.TestDictFields.test_read_dict_fieldnames_chainc C s� t d � �p } | j d � | j d � t j | d d d g �} | j t | � d d d d d d d
d d g i � Wd QRXd S)
Nzw+z1,2,abc,4,5,6
r r� r� r� rq r� rk r� rr r� )r r^ rC r r� r r{ )r rG r r r r �test_read_long� s
z TestDictFields.test_read_longc C s� t d � �v } | j d � | j d � t j | d d d g d d �} | j t | � d d d d
d d d d
d g i � Wd QRXd S)Nzw+z1,2,abc,4,5,6
r r� r� r� �restkey�_restrq r� rk r� rr r� )r r^ rC r r� r r{ )r rG r r r r �test_read_long_with_rest� s
z'TestDictFields.test_read_long_with_restc C s� t d � �� } | j d � | j d � t j | d d �} | j | j d d g � | j t | � d d d d d d
d d d
g i � Wd QRXd S)Nzw+zf1,f2
1,2,abc,4,5,6
r r� r� r� r� rq r� rk r� rr r� )r r^ rC r r� r r� r{ )r rG r r r r �&test_read_long_with_rest_no_fieldnames� s
z5TestDictFields.test_read_long_with_rest_no_fieldnamesc C s� t d � �� } | j d � | j d � t j | d d j � d d �} | j t | � d d d d d
d d d d
d
d d i � | j t | � d d d d d
d d d d
d d d i � Wd QRXd S)Nzw+z1,2,abc,4,5,6
1,2,abc
r r� z 1 2 3 4 5 6ZrestvalZDEFAULTrq r� rs rk r� rr r� )r r^ rC r r� �splitr r{ )r rG r r r r �test_read_short� s
!! z TestDictFields.test_read_shortc C sb d d d g } t j | d d j � �} | j t | � d d d d d
d d d
d d i � d S)Nz 2147483648,43.0e12,17,abc,def
z 147483648,43.0e2,17,abc,def
z47483648,43.0,170,abc,def
r� zi1 float i2 s1 s2Zi1Z
2147483648�floatz43.0e12Zi2Z17�s1rk �s2r� )r r� r� r r{ )r Zsampler r r r �test_read_multi� s z TestDictFields.test_read_multic C s� t j d d d g d d j � �} | j t | � d d d d d d d d d
d
d d i � | j t | � d d d d d d d d d
d
d d i � d S) Nz1,2,abc,4,5,6
z
r� z 1 2 3 4 5 6rq r� rs rk r� rr r� )r r� r� r r{ )r r r r r �test_read_with_blanks� s !!z$TestDictFields.test_read_with_blanksc C sb t j d g d d j � d d �} | j t | � d d d d d d d
d
d d d d i � d S)
Nz1;2;abc;4;5;6
r� z 1 2 3 4 5 6r r� rq r� rs rk r� rr r� )r r� r� r r{ )r r r r r �test_read_semi_sep� s
!z!TestDictFields.test_read_semi_sepN)r; r< r= r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r� M s
r� c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S)
�TestArrayWritesc C s� d d l } d d � t d � D� } | j d | � } t d d d ��l } t j | d d
�} | j | � d j d d � | D� � d
} | j d � | j | j � | � Wd QRXd S)Nr c S s g | ] } d | � q S)� r )�.0rO r r r �
<listcomp>� s z2TestArrayWrites.test_int_write.<locals>.<listcomp>r� rO zw+rA r r r� r c S s g | ] } t | � � q Sr )r� )r rO r r r r � s z
)
�array�ranger r r rB �joinrC r rD )r r �contentsrX rG r r� r r r �test_int_write� s
z TestArrayWrites.test_int_writec C s� d d l } d d � t d � D� } | j d | � } t d d d ��l } t j | d d
�} | j | � d j d d � | D� � d
} | j d � | j | j � | � Wd QRXd S)Nr c S s g | ] } d | d � q S)r� g�������?r )r rO r r r r � s z5TestArrayWrites.test_double_write.<locals>.<listcomp>r� rb zw+rA r r r� r c S s g | ] } t | � � q Sr )r� )r rO r r r r � s z
)
r r r r r rB r rC r rD )r r r rX rG r r� r r r �test_double_write� s
z!TestArrayWrites.test_double_writec C s� d d l } d d � t d � D� } | j d | � } t d d d ��l } t j | d d
�} | j | � d j d d � | D� � d
} | j d � | j | j � | � Wd QRXd S)Nr c S s g | ] } d | d � q S)r� g�������?r )r rO r r r r � s z4TestArrayWrites.test_float_write.<locals>.<listcomp>r� r� zw+rA r r r� r c S s g | ] } t | � � q Sr )r� )r rO r r r r s z
)
r r r r r rB r rC r rD )r r r rX rG r r� r r r �test_float_write� s
z TestArrayWrites.test_float_writec C s� d d l } d d l } | j d | j � } t d d d ��_ } t j | d d �} | j | � d j | � d } | j d � | j | j
� | � Wd QRXd S)
Nr �uzw+rA r r r� r z
) r �stringZ
ascii_lettersr r r rB r rC r rD )r r r
rX rG r r� r r r �test_char_write s
z TestArrayWrites.test_char_writeN)r; r< r= r r r r r r r r r� � s r� c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S)
�TestDialectValidityc C sB Gd d � d t j � } | � } | j | j t j � d | _ | j t j | � d | _ t j | _ d | _ | � } | j | j t j � | j | j d � | j
| j � d | _ | j t j � � } | � Wd QRX| j t | j � d � d | _ | j t j � � } | � Wd QRX| j t | j � d � d S) Nc @ s7 e Z d Z d Z d Z d Z d Z d Z e j Z
d S)z3TestDialectValidity.test_quoting.<locals>.mydialectr� r. FTz
N) r; r< r= r r" r! r$ r
r r2 r r r r r � mydialect s r
Tr z''z("quotechar" must be a 1-character stringr� z#"quotechar" must be string, not int)
r r� r r r2 r
r r! r r �
assertTruer� r� )r r
rb �cmr r r � test_quoting s, z TestDialectValidity.test_quotingc C sM Gd d � d t j � } | � } | j | j d � d | _ | j t j � � } | � Wd QRX| j t | j � d � d | _ | j t j � � } | � Wd QRX| j t | j � d � d | _ | j t j � � } | � Wd QRX| j t | j � d � d | _ | j t j � � } | � Wd QRX| j t | j � d
� d S) Nc @ s7 e Z d Z d Z d Z d Z d Z d Z e j Z
d S)z5TestDialectValidity.test_delimiter.<locals>.mydialectr� r. FTz
N) r; r< r= r r" r! r$ r
r r2 r r r r r r
4 s r
r� z:::z("delimiter" must be a 1-character stringr � ,z%"delimiter" must be string, not bytesr� z#"delimiter" must be string, not int)r r� r r r
r r� r� )r r
rb r r r r �test_delimiter3 s. z"TestDialectValidity.test_delimiterc
C s� Gd d � d t j � } | � } | j | j d � d | _ | � } | j | j d � d | _ | j t j � � } | � Wd QRX| j t | j � d � d S)Nc @ s7 e Z d Z d Z d Z d Z d Z d Z e j Z
d S)z:TestDialectValidity.test_lineterminator.<locals>.mydialectr� r. FTz
N) r; r< r= r r" r! r$ r
r r2 r r r r r r
W s r
z
z:::r� z!"lineterminator" must be a string)r r� r r
r
r r� r� )r r
rb r r r r �test_lineterminatorV s z'TestDialectValidity.test_lineterminatorc
C s� d d � } x� d D]� } | j d | � �i | j t j | | d � | j t j | | d � | j t j | | d � | j t j | | d
� Wd QRXq Wd S) Nc S s6 Gd d � d t j � } t | | | � | � } d S)Nc @ s e Z d Z d S)zQTestDialectValidity.test_invalid_chars.<locals>.create_invalid.<locals>.mydialectN)r; r< r= r r r r r
m s r
)r r� r( )�
field_name�valuer
rb r r r �create_invalidl s z>TestDialectValidity.test_invalid_chars.<locals>.create_invalidr r" r r r rk � xr� )r r" r )ZsubTestr
r r )r r r r r r �test_invalid_charsk s
z&TestDialectValidity.test_invalid_charsN)r; r< r= r r r r r r r r r s " # r c @ s� e Z d Z d Z d Z d Z d Z d Z d Z d Z d Z
d Z d
Z d Z
d d
� Z d d � Z d d � Z d d � Z d d � Z d S)� TestSnifferz�Harry's, Arlington Heights, IL, 2/1/03, Kimi Hayes
Shark City, Glendale Heights, IL, 12/28/02, Prezence
Tommy's Place, Blue Island, IL, 12/28/02, Blue Sunday/White Crow
Stonecutters Seafood and Chop House, Lemont, IL, 12/19/02, Week Back
a 'Harry''s':'Arlington Heights':'IL':'2/1/03':'Kimi Hayes'
'Shark City':'Glendale Heights':'IL':'12/28/02':'Prezence'
'Tommy''s Place':'Blue Island':'IL':'12/28/02':'Blue Sunday/White Crow'
'Stonecutters ''Seafood'' and Chop House':'Lemont':'IL':'12/19/02':'Week Back'
z+"venue","city","state","date","performers"
z�05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
zT2147483648;43.0e12;17;abc;def
147483648;43.0e2;17;abc;def
47483648;43.0;170;abc;def
zaaa bbb
AAA
BBB
za|b|c
d|e|f
z'a'|'b'|'c'
'd'|e|f
z+"venue"+"city"+"state"+"date"+"performers"
z�Harry's+ Arlington Heights+ IL+ 2/1/03+ Kimi Hayes
Shark City+ Glendale Heights+ IL+ 12/28/02+ Prezence
Tommy's Place+ Blue Island+ IL+ 12/28/02+ Blue Sunday/White Crow
Stonecutters Seafood and Chop House+ Lemont+ IL+ 12/19/02+ Week Back
a 'Harry''s'+ Arlington Heights'+ 'IL'+ '2/1/03'+ 'Kimi Hayes'
'Shark City'+ Glendale Heights'+' IL'+ '12/28/02'+ 'Prezence'
'Tommy''s Place'+ Blue Island'+ 'IL'+ '12/28/02'+ 'Blue Sunday/White Crow'
'Stonecutters ''Seafood'' and Chop House'+ 'Lemont'+ 'IL'+ '12/19/02'+ 'Week Back'
c C sO t j � } | j | j | j � d � | j | j | j | j � d � d S)NFT)r �Snifferr �
has_header�sample1�header1)r �snifferr r r �test_has_header� s zTestSniffer.test_has_headerc C sO t j � } | j | j | j � d � | j | j | j | j � d � d S)NFT)r r r r �sample8�header2)r r r r r �'test_has_header_regex_special_delimiter� s z3TestSniffer.test_has_header_regex_special_delimiterc C s� t j � } | j | j � } | j | j d � | j | j d � | j | j d � | j | j � } | j | j d � | j | j d � | j | j d � d S)Nr r Tr �'F) r r �sniffr r r r r$ �sample2)r r r r r r �
test_sniff� s zTestSniffer.test_sniffc C s� t j � } | j | j � } | j | j | j � | j | j d d �} | j | j d � | j | j d d �} | j | j d � | j | j � } | j | j d � | j | j � } | j | j d � | j | j � } | j | j d � | j | j
� } | j | j d � | j | j d � | j | j � } | j | j d
� | j | j
� } | j | j d
� | j | j d � d S) NZ
delimitersz?,�?z/,�/r� r� r� r# �+)r r r$ �sample3r� r r �sample4�sample5�sample6�sample7r r �sample9)r r r r r r �test_delimiters� s* zTestSniffer.test_delimitersc C s� t j � } | j | j � } | j | j � | j | j � } | j | j � | j | j � } | j | j � | j | j � } | j | j � | j | j
� } | j | j � d S)N) r r r$ r Z assertFalser! r! r% r r r/ )r r r r r r �test_doublequote� s z TestSniffer.test_doublequoteN)r; r< r= r r% r r* r+ r, r- r. r! r r/ r r" r& r0 r1 r r r r r z s r c @ s" e Z d Z d d � Z e Z d S)�NULc G s d S)Nr )�sr) r r r r^ � s z NUL.writeN)r; r< r= r^ �
writelinesr r r r r2 � s r2 �gettotalrefcountz requires sys.gettotalrefcount()c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S)
� TestLeaksc C s� d } t j � } x} t d � D]o } t j � | j t j g � t j � } t j d g � t j d g � t j d g � | | } | } q W| j | d k d � d S)Nr r� za,b,c
rt T) �sysr5 r �gc�collectr �garbager r )r �delta�lastrcrO �rcr r r �test_create_read� s
zTestLeaks.test_create_readc C s� d } t j � } t � } xt t d � D]f } t j � | j t j g � t j � } t j | � t j | � t j | � | | } | } q( W| j | d k d � d S)Nr r� rt T)
r7 r5 r2 r r8 r9 r r: r r )r r; r< r3 rO r= r r r �test_create_write s
zTestLeaks.test_create_writec C s� d } d g d } t j � } xm t d � D]_ } t j � | j t j g � t j � } t j | � } x | D] } qq W| | } | } q, W| j | d k d � d S)Nr za,b,c
r� r� T) r7 r5 r r8 r9 r r: r r )r r; r� r< rO r= Zrdrr� r r r � test_read s
zTestLeaks.test_readc C s� d } d d d g g d } t � } t j � } xz t d � D]l } t j � | j t j g � t j � } t j | � } x | D] } | j
| � q� W| | } | } q> W| j | d k d � d S)Nr r rM rt r� r� T) r2 r7 r5 r r8 r9 r r: r r rB ) r r; r� r3 r< rO r= r r� r r r �
test_write" s
zTestLeaks.test_writeN)r; r< r= r> r? r@ rA r r r r r6 � s r6 c @ s: e Z d Z d d d d g Z d d � Z d d � Z d S)
� TestUnicodeu Martin von Löwisu Marc André LemburgzGuido van Rossumu François Pinardc
C s� d d l } t d d d d d ��\ } | j d j | j � d � | j d � t j | � } | j t | � | j g � Wd QRXd S) Nr zw+rA r r� zutf-8r z
)
�ior r^ r �namesrC r r r rg )r rC rG r r r r �test_unicode_read: s
z TestUnicode.test_unicode_readc
C s� d d l } t d d d d d ��_ } t j | � } | j | j � d j | j � d } | j d � | j | j � | � Wd QRXd S) Nr zw+rA r r� zutf-8r z
)
rC r r r rB rD r rC r rD )r rC rG r r� r r r �test_unicode_writeC s
z TestUnicode.test_unicode_writeN)r; r< r= rD rE rF r r r r rB 3 s rB �__main__)#�copyrC r7 �osZunittestr Ztempfiler r r8 �pickleZtestr ZTestCaser r� r� r� r� r� r� r� r� r� r� r� r r r2 Z
skipUnless�hasattrr6 rB r; �mainr r r r �<module> s> � >la �.jqA