1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
| U
| ý°dµH ã @ s d Z ddlmZ ddlmZ ddlZddlZddlm Z ddl
| m Z m Z m Z ddlmZ ej d¡Zedd Zd
| d Zej d d ddgddgg¡dd Zej d ddg¡dd Zedd Zdd Zedd Zej d d d d gid!fdd"gd d gd#d$fdd"gd d gd%d&fg¡d'd( Z ed)d*d+gZ eej d,d dd"gid-d.d/d0d1d2d3gd4d-e d5d6e d5d7e d5d8e d9d:e d;d<e d;d=gd4g¡d>d? Z eej d,d dd"gidd.d/d0d1d2d3gd4de d5d6e d5d7e d5d8e d9d:e d;d<e d;d=gd4g¡d@dA Z eej d,d dd"gidd.d/d0d1d2d3gd4de d5d6e d5d7e d5d8e d9d:e d;d<e d;d=gd4g¡dBdC Z edDdE Z!edFdG Z"edHdI Z#edJdK Z$eej dLdMdNg¡dOdP Z%eej d,i d dig¡dQdR Z&ej dSi dd"dd-dgfdTd d dUdVdWgid d dUdVdWgfg¡dXdY Z'ej d d5d9gdZg¡d[d\ Z(ed]d^ Z)eej d_d`e ddadbdcgge *dddedfdgg¡dhfdie ddadbdcgge *dddedjdgg¡dhfdke ddadbdcdcgge *dddedjdgdlg¡dhfg¡dmdn Z+eej d ddgg¡ej doddpdqgdqdpgdqdrgg¡dsdt Z,edudv Z-edwdx Z.edydz Z/ed{d| Z0ed}d~ Z1edd Z2edd Z3dS )zx
| Tests that the file header is properly handled or inferred
| during parsing for all of the parsers defined in parsers.py
| é )Ú
| namedtuple)ÚStringION)Ú ParserError)Ú DataFrameÚIndexÚ
| MultiIndexZ pyarrow_skipc C s> | }d}t jt|d td}|j|dgd W 5 Q R X d S )Nzbut only \d+ lines in file©Úmatchz,,é
| ©Úheader)ÚpytestÚraisesÚ
| ValueErrorr Úread_csv)Ú all_parsersÚparserÚmsgÚs© r úYd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/io/parser/test_header.pyÚtest_read_with_bad_header s
| r c C s8 | }d}t jtdd |jt|dd W 5 Q R X d S )Nú$1,2,3,4,5
| 6,7,8,9,10
| 11,12,13,14,15
| zUPassing negative integer to header is invalid. For no header, use header=None insteadr éÿÿÿÿr ©r r r r r ©r r Údatar r r Útest_negative_header# s þr r r é é éûÿÿÿc C s8 | }d}t jtdd |jt||d W 5 Q R X d S )Nz<1,2,3,4,5
| 6,7,8,9,10
| 11,12,13,14,15
| z8cannot specify multi-index header with negative integersr r r )r r r r r r r Ú test_negative_multi_index_header2 s ÿr! TFc C s< | }d}d}t jt|d |jt||d W 5 Q R X d S )NzMyColumn
| a
| b
| a
| bz#Passing a bool to header is invalidr r )r r Ú TypeErrorr r )r r r r r r r r Útest_bool_header_arg@ s
| r# c C sf | }d}dddg}|j t||d}tdddgd d
| d gd d dggdddgdddgd}t ||¡ d S )Nz foo,1,2,3
| bar,4,5,6
| baz,7,8,9
| ÚAÚBÚC©Únamesé r é r é é é é é ÚfooÚbarÚbaz©ÚindexÚcolumns©r r r ÚtmÚassert_frame_equal)r r r r( ÚresultÚexpectedr r r Útest_header_with_index_colO s
| ýr; c C sD | }d}d}|j t|ddd}|j t|ddd}t ||¡ d S )Nzggot,to,ignore,this,line
| got,to,ignore,this,line
| index,A,B,C,D
| foo,2,3,4,5
| bar,7,8,9,10
| baz,12,13,14,15
| z7index,A,B,C,D
| foo,2,3,4,5
| bar,7,8,9,10
| baz,12,13,14,15
| r r ©r Ú index_col©r r r7 r8 )r r r Zdata2r9 r: r r r Útest_header_not_first_linea s r? c C sJ | }t jddddd}d}|jt|ddddgddgd }t ||¡ d S )
| Nr+ r* r r )Z r_idx_nlevelsZ c_idx_nlevelsá C0,,C_l0_g0,C_l0_g1,C_l0_g2
|
| C1,,C_l1_g0,C_l1_g1,C_l1_g2
| C2,,C_l2_g0,C_l2_g1,C_l2_g2
| C3,,C_l3_g0,C_l3_g1,C_l3_g2
| R0,R1,,,
| R_l0_g0,R_l1_g0,R0C0,R0C1,R0C2
| R_l0_g1,R_l1_g1,R1C0,R1C1,R1C2
| R_l0_g2,R_l1_g2,R2C0,R2C1,R2C2
| R_l0_g3,R_l1_g3,R3C0,R3C1,R3C2
| R_l0_g4,R_l1_g4,R4C0,R4C1,R4C2
| r r) r< )r7 ZmakeCustomDataframer r r8 ©r r r: r r9 r r r Útest_header_multi_indexu s
| rB z
| kwargs,msgr= r0 r1 zLindex_col must only contain row numbers when specifying a multi-index headerr) )r= r( z9cannot specify names when specifying a multi-index header)r= Zusecolsz;cannot specify usecols when specifying a multi-index headerc C sH d}| }t jt|d( |jt|fdddddgi| W 5 Q R X d S )Nr@ r r r r) r r* r )r Úkwargsr r r r r r Ú test_header_multi_index_invalid s rD Ú
| _TestTupleÚfirstÚsecondrC r* ©ÚaÚq©rI Úr©rI r ©ÚbÚt©ÚcÚu©rR Úv)Zskiprowsr( rI rJ rL r rO rP rR rS rU c C sr | }t ddddddgddd d
| d d ggd dgt ddddddg¡d}d}|jt|fddi|}t ||¡ d S )Nr) r r* r r+ r, r- r. r/ r
| é é ÚoneÚtworH rK rM rN rQ rT r3 zC,a,a,a,b,c,c
| ,q,r,s,t,u,v
| ,,,,,,
| one,1,2,3,4,5,6
| two,7,8,9,10,11,12r= r ©r r Ú from_tuplesr r r7 r8 ©r rC r r: r r9 r r r Ú&test_header_multi_index_common_format1· s ÿýr] c C sr | }t ddddddgddd d
| d d ggd dgt ddddddg¡d}d}|jt|fddi|}t ||¡ d S )Nr) r r* r r+ r, r- r. r/ r
| rV rW rX rY rH rK rM rN rQ rT r3 z<,a,a,a,b,c,c
| ,q,r,s,t,u,v
| one,1,2,3,4,5,6
| two,7,8,9,10,11,12r= r rZ r\ r r r Ú&test_header_multi_index_common_format2ç s ÿýr^ c C s~ | }t ddddddgddd d
| d d ggd dgt ddddddg¡d}|jdd}d}|jt|fdd i|}t ||¡ d S )Nr) r r* r r+ r, r- r. r/ r
| rV rW rX rY rH rK rM rN rQ rT r3 T)Zdropú2a,a,a,b,c,c
| q,r,s,t,u,v
| 1,2,3,4,5,6
| 7,8,9,10,11,12r= )r r r[ Z reset_indexr r r7 r8 r\ r r r Ú&test_header_multi_index_common_format3 s ÿý r` c C s¢ | }t tjdddddgdddd d
| ggd d td dgtdddgdddddggddd ddgdd dddggddgdd}d}|jt|dd gdd }t ||¡ d S ) Nr r* r r+ r, r. r/ r
| rV rW Úint64©Zdtyper) r- rI rO rR rL r rP rS rU r rJ ©ÚlevelsÚcodesr( r3 r_ r< © r ÚnpÚarrayr r r r r7 r8 rA r r r Ú0test_header_multi_index_common_format_malformed1F s $
| ýý ri c C s¢ | }t tjdddddgdddd d
| ggd d td dgtdddgdddddggddd ddgdd dddggd dgdd}d}|jt|dd gdd }t ||¡ d S ) Nr r* r r+ r, r. r/ r
| rV rW ra rb r) r- rI rO rR rL r rP rS rU r rJ rc r3 ú1,a,a,b,c,c
| q,r,s,t,u,v
| 1,2,3,4,5,6
| 7,8,9,10,11,12r< rf rA r r r Ú0test_header_multi_index_common_format_malformed2[ s $
| ýý
| rk c
| C s´ | }t tjddddgddddggd d
| td d gd dggdd gdd ggdtdddgddddggdd d d gdd d dggd dgdd}d}|jt|dd gdd gd }t ||¡ d S ) Nr* r r+ r, r/ r
| rV rW ra rb r) r- r r. r )rd re rI rO rR r rP rS rU rJ rc r3 rj r< )r rg rh r r r r7 r8 rA r r r Ú0test_header_multi_index_common_format_malformed3q s "ýý rl c C s^ | }d d gddgddgg}t ddg¡}t||d}d}|jt|d dgd
| }t ||¡ d S ) Nr) r r* r )rI r$ )rO r% ©r5 za,b
| A,B
| ,
| 1,2
| 3,4r r )r r[ r r r r7 r8 )r r r r5 r: r9 r r r Ú"test_header_multi_index_blank_line s rn z data,header)ú 1,2,3
| 4,5,6N)zfoo,bar,baz
| 1,2,3
| 4,5,6r c C sF | }|j tddddgd}|j t|dddg|d}t ||¡ d S )Nro rI rO rR r' ©r( r r> )r r r r r: r9 r r r Ú!test_header_names_backward_compat s rq c C s6 | }t dddgd}|jtdf|}t ||¡ d S )NrI rO rR rm za,b,c©r r r r7 r8 )r rC r r: r9 r r r Ú test_read_only_header_no_rows s rs z kwargs,namesr( r2 ZquuxZpandac C sb | }d}t dddddgddd d
| d gd d dddgg|d}|jt|fdd i|}t ||¡ d S )Nr r) r r* r r+ r, r- r. r/ r
| rV rW é é é rm r rr )r rC r( r r r: r9 r r r Útest_no_headerª s & ÿrw Z string_headerc C s< d}d}| }t jt|d |jt||d W 5 Q R X d S )Nz*header must be integer or list of integersz1,2
| 3,4r r r )r r r r r r r r Útest_non_int_headerÁ s
| rx c C sH d}| }t ddgddgddgd}|jt|dgd}t ||¡ d S )Nza,b,c
| 0,1,2
| 1,2,3r r) r r* )rI rO rR r rr )r r r r: r9 r r r Útest_singleton_headerÌ s
| ry z data,expectedz#A,A,A,B
| one,one,one,two
| 0,40,34,0.1é( é" g¹?)r$ rX )r$ zone.1)r$ zone.2)r% rY rm z%A,A,A,B
| one,one,one.1,two
| 0,40,34,0.1)r$ zone.1.1z/A,A,A,B,B
| one,one,one.1,two,two
| 0,40,34,0.1,0.1)r% ztwo.1c C s* | }|j t|ddgd}t ||¡ d S )Nr r) r r> )r r r: r r9 r r r Útest_mangles_multi_index× s )r| r5 Ú ZUnnamedZ
| NotUnnamedc C sê | }ddg}|d kr,d |p"ddg¡d }n d dg|p>ddg ¡d }|jt|||d}g }|d krrdddg}t|D ]2\}} | s¢d|d kr|n|d d } | | ¡ qzt t|d
| d g¡}td d gddgg|d}
| t
| ||
| ¡ d S )Nr r) ú,r} z
| 0,1
| 2,3
| 4,5
| z
| ,0,1
| 0,2,3
| 1,4,5
| r< z Unnamed: Z_level_0Ú0Ú1r r* r r+ rm ) Újoinr r Ú enumerateÚappendr r[ Úzipr r7 r8 ) r r= r5 r r r r9 Z exp_columnsÚiÚcolr: r r r Útest_multi_index_unnamed s
| r c C sN | }d}|j t|ddddgd}tddgd d
| gd d gd }t ||¡ d S )Nza, b
| 1,2,3
| 5,6,4
| r r$ r% r& )r r( r) r+ r r, r* r )r$ r% r& r6 ©r r r r9 r: r r r Ú6test_names_longer_than_header_but_equal_with_data_rows- s
| r c C s | }d}d}t dddddg¡}tdd d
| d d gdd d
| d d gg|d}|jt|ddgd}t ||jd d
¡ |jt|ddgd}t ||¡ d S )NzFMale, Male, Male, Female, Female
| R, R, L, R, R
| .86, .67, .88, .78, .81z^Male, Male, Male, Female, Female
| R, R, L, R, R
| .86, .67, .88, .78, .81
| .86, .67, .88, .78, .82)ZMaleÚR)ú Maleú R)r z L)ú Femaler )r z R.1g
ëQ¸
ë?gq=
| ×£på?g)\Âõ(ì?gö(\Âõè?gìQ¸
ëé?g=
| ×£p=ê?rm r r) r )r r[ r r r r7 r8 Ziloc)r r Ús1Ús2Úmir: Zdf1Zdf2r r r Ú test_read_csv_multiindex_columns: s( ÿûÿ ÿr c C s< | }d}t jtdd |jt|ddgd W 5 Q R X d S )Nz1row11,row12,row13
| row21,row22, row23
| row31,row32
| z1Header rows must have an equal number of columns.r r r r ©r r r r r )r r Zcaser r r Ú'test_read_csv_multi_header_length_checkZ s ÿr c C sX | }d}|j t|ddgd d}tdddgdtjtjgd d
| d d gd }t ||¡ d S )Nzx,1,5
| y,2
| z,3
| rI rO rp r) r r* r+ ©rI rO ÚxÚyÚz)r4 )r r r rg Únanr7 r8 r r r r Ú#test_header_none_and_implicit_indexj s ÿr c C s> | }d}t jtdd |jt|ddgd d W 5 Q R X d S )Núx,1
| y,2,5
| z,3
| z"Expected 2 fields in line 2, saw 3r rI rO rp r r r r r Ú1test_header_none_and_implicit_index_in_second_rowv s r c C sH | }d}|j t|ddgd dd}tddgdd gd
| }t ||¡ d S ) Nr rI rO Úskip)r( r Z on_bad_linesr r r) r* r r6 r r r r Ú&test_header_none_and_on_bad_lines_skip s ÿr c C sB | }d}d}t jt|d |jt|dddgd W 5 Q R X d S )Nza,b
| 1,2
| z;Passed header=\[0,1,2\], len of 3, but only 2 lines in filer r r) r r r )r r r r r r r Útest_header_missing_rows s
| r )4Ú__doc__Ú collectionsr Úior Únumpyrg r Z pandas.errorsr Zpandasr r r Zpandas._testingZ_testingr7 ÚmarkZ usefixturesZ skip_pyarrowr r Z parametrizer! r# r; r? rB rD rE r] r^ r` ri rk rl rn rq rs rw rx ry r[ r| r r r r r r r r r r r r Ú<module> s
|
|
|
|
|
| ý þþóþ
|
| úþ úþóþ
| úþ úþóþ
| úþ úþóþ
|
|
|
| ÿ þþþ
|
|
|
|
|
|
| ÿþþ
|
| ÿþþ
| ûÿþþíþ& ÿ"
|
|
|
|
|
|
|
|
