1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
| U
| ý°d ã @ s> d Z ddlZddlZddlmZ ddlZddlmZ ddlZddl Z
| ddl Z ddl m Z ddlmZmZ ddlmZ ddlmZ e j d¡Zd d
| Zd d Zd d Ze j ddddg¡dd Z dd Z e j dddddddg¡dd Z dd Z d d Z!d d Z"d!d" Z#d#d$ Z$d%d& Z%d'd( Z&d)d* Z'd+d, Z(d-d. Z)dS )/zy
| Tests that work on both the Python and C engines but do not have a
| specific classification into the other test modules.
| é N)ÚStringIO)ÚPath)ÚPY311)ÚEmptyDataErrorÚ ParserError)Ú DataFrameZ pyarrow_skipc C s< d}d}| }t jt|d |jt|dd W 5 Q R X d S )NzA|B|C
| 1|2,334|5
| 10|13|10.
| z'Only length-1 decimal markers supported©ÚmatchÚ )Údecimal©ÚpytestÚraisesÚ
| ValueErrorÚread_csvr )Ú all_parsersÚdataÚmsgÚparser© r úed:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/io/parser/common/test_read_errors.pyÚtest_empty_decimal_marker s
| r c C s t j |d¡}t d¡}t d¡}| }d}t|dP}t ||j|j|j |j
| ¡*}t j t |d | |¡ W 5 Q R X W 5 Q R X W 5 Q R X d S )Nzsauron.SHIFT_JIS.csvzutf-8z 'utf-8' codec can't decode byteÚrbr )ÚosÚpathÚjoinÚcodecsÚlookupÚopenÚ StreamRecoderÚencodeÚdecodeÚ streamreaderÚ streamwriterr r ÚUnicodeDecodeErrorr ) r Z csv_dir_pathr ÚcodecÚutf8r r ÚhandleÚstreamr r r Útest_bad_stream_exception( s
|
| ÿr) c C s> | }d}d}t jt|d |jt|ddd W 5 Q R X d S )Nz-ignore
| A,B,C
| 1,2,3 # comment
| 1,2,3,4,5
| 2,3,4
| z"Expected 3 fields in line 4, saw 5r é ú#)ÚheaderÚcomment©r r r r r ©r r r r r r r Útest_malformed< s
| r0 Únrowsé é c
| C s\ d}| }d}|j t|dddddgd*}tjt|d | |¡ W 5 Q R X W 5 Q R X d S ) Nz9ignore
| A,B,C
| skip
| 1,2,3
| 3,5,10 # comment
| 1,2,3,4,5
| 2,3,4
| z"Expected 3 fields in line 6, saw 5r* r+ Té )r, r- ÚiteratorÚ chunksizeZskiprowsr )r r r r r Úread)r r1 r r r Úreaderr r r Útest_malformed_chunksJ s ÿr9 c C sT d}| }|j dkrdnd}tjt|d" |jt|ddddd gd
| W 5 Q R X d S ) Nz1,2,3
| 4,,6
| 7,8,9
| 10,11,12
| Úcz2Too many columns specified: expected 4 and found 3zHNumber of passed names did not match number of header fields in the filer r ÚaÚbÚd)r, Únames)Úenginer r r r r ©r r r r r r r Útest_catch_too_many_names] s ÿýrA r* r4 é c C s< | }d| }d}t jt|d | t|¡ W 5 Q R X d S )NÚ
| z No columns to parse from filer )r r r r r )r r1 r r r r r r Útest_raise_on_no_columnsp s
| rD c C sh | }d}t jt| d¡d |jddd W 5 Q R X t jt| d¡d |jddd W 5 Q R X d S ) Nz/{}\(\) got an unexpected keyword argument 'foo'r r zfoo.csvr* )ÚfooÚ
| read_tablezfoo.tsv)r r Ú TypeErrorÚformatr rF )r r r r r r Ú+test_unexpected_keyword_parameter_exceptionz s rI c C sP | }d}t dddgi}|jt|dd}t ||¡ | ¡ }|jdksLtd S )Núa
| 1
| 1,2,3
| 4
| 5,6,7r; r* rB Úskip©Ú on_bad_linesr
| ©r r r ÚtmÚassert_frame_equalÚ
| readouterrÚerrÚAssertionError©r Úcapsysr r ÚexpectedÚresultÚcapturedr r r Útest_suppress_error_output
s rY c C s< | }d}d}t jt|d |jt|dd W 5 Q R X d S )NrJ z"Expected 1 fields in line 3, saw 3r ÚerrorrL r. r/ r r r Útest_error_bad_lines s
| r[ c C s^ | }d}t dddgi}|jt|dd}t ||¡ | ¡ }d|jksLtd|jksZtd S ) NrJ r; r* rB ÚwarnrL zSkipping line 3zSkipping line 5rN rT r r r Útest_warn_bad_lines s r] c C s8 d}| }d}t jt|d | t|¡ W 5 Q R X d S )Nz;A,B,C,D,E,F
| 1,2,3,4,5,6
| 6,7,8,9,10,11,12
| 11,12,13,14,15,16
| z"Expected 6 fields in line 3, saw 7r r. r@ r r r Ú test_read_csv_wrong_num_columnsª s
| r^ c C s´ d}ddg}|}|j dks(|j dkrtr|j dkrLtrL| j tjjdd¡ ttj dgg|d }|j
| t ||d
| }t ||¡ n0d }tjt|d |j
| t ||d
| W 5 Q R X d S ) Nz ,foor; r< r: Úpythonz;In Python 3.11, this is read as an empty character not null©ÚreasonrE )Úcolumns)r> zNULL byte detectedr )r? r ÚnodeÚ
| add_markerr ÚmarkÚxfailr ÚnpÚnanr r rO rP r r )Úrequestr r r> r rV Úoutr r r r Útest_null_byte_char¸ s ÿÿrk c C s |}|j dkr,| j tjj|j dd¡ t ¡ }t|}| d¡ t
| j ddZ}t
| j dt d tjtjd d
| |j|d d d W 5 Q R X t|d ksªt|d jW 5 Q R X W 5 Q R X d S )Nr: z= engine does not support sep=None with delim_whitespace=Falser` s ä
| a
| 1T)ÚrecordÚalways)Úcategoryz Could not determine delimiterr Úreplace)ÚsepZencoding_errorsr )r? rc rd r re rf rO Z ensure_cleanr Ú write_bytesÚwarningsÚcatch_warningsÚ simplefilterÚResourceWarningr ÚcsvÚErrorr ÚlenrS Úmessage)ri r r r Úfilerl r r r Útest_open_fileÎ s
|
| ÿÿ
|
| r{ c C s8 | }d}t jtdd |jt|dd W 5 Q R X d S )NrJ z(Argument abc is invalid for on_bad_linesr ÚabcrL r )r r r r r r Útest_invalid_on_bad_lineå s r} c C sL | }d}d}|j dkrd}tjt|d |jt|ddd W 5 Q R X d S ) Nz,+++123456789...
| col1,col2,col3,col4
| 1,2,3,4
| z"Expected 2 fields in line 2, saw 4r: zUCould not construct index. Requested to use 1 number of columns, but 3 left to parse.r r rZ )Z index_colrM )r? r r r r r r/ r r r Ú test_bad_header_uniform_errorì s
| ÿr~ c C sh | }d}t ddgd d}|jt|dd}t ||¡ | ¡ }|jdkrRd }nd
| }|j|ksdtd S ) Nz1,2
| a,b
| a,b,c
| a,b,d
| a,b
| r; r< r4 )Ú1Ú2r\ rL r: zUSkipping line 3: expected 2 fields, saw 3
| Skipping line 4: expected 2 fields, saw 3
|
| zhSkipping line 3: Expected 2 fields in line 3, saw 3
| Skipping line 4: Expected 2 fields in line 4, saw 3
| ) r r r rO rP rQ r? rR rS )r rU r r rV rW rX r\ r r r Ú)test_on_bad_lines_warn_correct_formattingú s
| r )*Ú__doc__r rv Úior r Úpathlibr rr Únumpyrg r Z pandas.compatr Z pandas.errorsr r Zpandasr Zpandas._testingZ_testingrO re Z usefixturesZ
| pytestmarkr r) r0 Z parametrizer9 rA rD rI rY r[ r] r^ rk r{ r} r~ r r r r r Ú<module> s>
|
|
|
|
|
