1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
| U
| ý°dÅ ã @ s d Z ddlmZ ddlmZ ddlZddlZddlmZ ddl m
| Z
| m Z ddl m Z ej d¡Zej deed d g¡d
| d Zd d Zdd Zej ddddgie
| dddgdddggdddgdfdd dgd e
| d d d ggd!d"d#gdfd$d ddgd e
| d%d&ggd'd(gdfg¡d)d* Zd+d, Zej d-d.dd/dgdd0dggfd1dd2dgdd3dggfd4dd5dgdd6dggfg¡d7d8 Zej d9d:d;d<g¡d=d> Zd?d@ Z ej dAi e
| dBddCgifddDgdEe
| dDddCgifg¡dFdG Z dHdI Z dJdK Z dLdM Z dNdO Z!dS )Pzj
| Tests that skipped rows are properly handled during
| parsing for all of the parsers defined in parsers.py
| é )Údatetime)ÚStringION)ÚEmptyDataError)Ú DataFrameÚIndexZ pyarrow_skipÚskiprowsé c C s| | }d}|j t||d ddd}ttdddtdddtdddgdd }tt d
| d ¡ d ¡dddg|d }t ||¡ d S )Nzr#foo,a,b,c
| #foo,a,b,c
| #foo,a,b,c
| #foo,a,b,c
| #foo,a,b,c
| #foo,a,b,c
| 1/1/2000,1.,2.,3.
| 1/2/2000,4,5,6
| 1/3/2000,7,8,9
| r T©r ÚheaderZ index_colZ parse_dateséÐ é é é ©Únameç ð?ç $@©r r ©ÚcolumnsÚindex©
| Úread_csvr r r r ÚnpZarangeZreshapeÚtmÚassert_frame_equal)Ú all_parsersr ÚparserÚtextÚresultr Úexpected© r! ú[d:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/io/parser/test_skiprows.pyÚtest_skip_rows_bug s&
| ÿ ÿ ÿr# c C sl | }dd dd tdD ¡ }dd dd dD ¡ }|jt|dd gd
| }| t|¡}t ||¡ d S ) Nza,b,c
| Ú
| c S s0 g | ](}d t|t|d t|d g¡qS ©ú,r r ©ÚjoinÚstr©Ú.0Úir! r! r" Ú
| <listcomp>7 s z'test_deep_skip_rows.<locals>.<listcomp>é
| c S s0 g | ](}d t|t|d t|d g¡qS r% r' r* r! r! r" r- : s )r r r r é r é é r r0 ©r )r( Úranger r r r )r r ÚdataZcondensed_datar Zcondensed_resultr! r! r" Útest_deep_skip_rows3 s ÿ ÿr5 c C s| | }d}|j t|dd ddd}ttdddtdddtddd gdd
| }tt d d ¡ d ¡ddd g|d}t ||¡ d S )Nz^#foo,a,b,c
| #foo,a,b,c
|
| #foo,a,b,c
| #foo,a,b,c
|
| 1/1/2000,1.,2.,3.
| 1/2/2000,4,5,6
| 1/3/2000,7,8,9
| r r Tr r r r r r r r r r r )r r r r4 r r r! r! r" Útest_skip_rows_blankB s&
| ÿ ÿ ÿr6 zdata,kwargs,expectedzKid,text,num_lines
| 1,"line 11
| line 12",2
| 2,"line 21
| line 22",2
| 3,"line 31",1r r zline 21
| line 22r zline 31Úidr Ú num_lines©r z+a,b,c
| ~a
| b~,~e
| d~,~f
| f~
| 1,2,~12
| 13
| 14~ú~)Ú quotecharr za
| bze
| dzf
| fÚaÚbÚczdText,url
| ~example
| sentence
| one~,url1
| ~example
| sentence
| two~,url2
| ~example
| sentence
| three~,url3zexample
| sentence
| twoÚurl2ÚTextÚurlc C s& | }|j t|f|}t ||¡ d S )N©r r r r )r r4 Úkwargsr r r r! r! r" Útest_skip_row_with_newline\ s #rD c C sR | }d}dddgdddgg}t |ddd gd
| }|jt|dgd }t ||¡ d S ) NzYid,text,num_lines
| 1,"line '11' line 12",2
| 2,"line '21' line 22",2
| 3,"line '31' line 32",1r zline '21' line 22r zline '31' line 32r r7 r r8 r9 r2 ©r r r r r )r r r4 Úexp_datar r r! r! r" Útest_skip_row_with_quote s rG z data,exp_dataz\id,text,num_lines
| 1,"line
| '11' line 12",2
| 2,"line
| '21' line 22",2
| 3,"line
| '31' line 32",1zline
| '21' line 22zline
| '31' line 32z\id,text,num_lines
| 1,"line '11
| ' line 12",2
| 2,"line '21
| ' line 22",2
| 3,"line '31
| ' line 32",1zline '21
| ' line 22zline '31
| ' line 32zbid,text,num_lines
| 1,"line '11
| ' line 12",2
| 2,"line '21
| ' line 22",2
| 3,"line '31
| ' line 32",1zline '21
| ' line 22zline '31
| ' line 32c C s: | }|j t|dgd}t|dddgd}t ||¡ d S )Nr r2 r7 r r8 r9 ©r r r r r )r r4 rF r r r r! r! r" Ú$test_skip_row_with_newline_and_quote s rI Úlineterminatorr$ z
| ú c C s¸ | }d ddddg¡}tdddd d
| gdd d d
| d gddddd
| ggdddddgd}|jdkr||dkr|tjjdd}|j |¡ | d|¡}|j t
| |dd dddddgd }t ||¡ d S ) Nr$ zSMOSMANIA ThetaProbe-ML2X z 2007/01/01 01:00 0.2140 U M z 2007/01/01 02:00 0.2141 M O z 2007/01/01 04:00 0.2142 D M z
| 2007/01/01z01:00g1¬ ZdË?ÚUÚMz02:00gºk ù gË?ÚOz04:00gBÏfÕçjË?ÚDÚdateÚtimeÚvarÚflagZoflagr9 ÚpythonrK z+'CR' not respect with the Python parser yet)Úreasonr T)r Zdelim_whitespaceÚnames) r( r ZengineÚpytestÚmarkZxfailÚnodeZ
| add_markerÚreplacer r r r )r rJ Úrequestr r4 r rX r r! r! r" Ú test_skiprows_lineterminator¶ s4 üÿ ý ú ür\ c C s8 | }d}t ddgi}|jt|dd}t ||¡ d S )Nz a"
| b"
| a
| 1r< r r r2 rE ©r r r4 r r r! r! r" Útest_skiprows_infield_quoteÛ s
| r^ zkwargs,expectedÚ1é Zfoo)r
| rV c C s6 | }d}|j t|fddd i|}t ||¡ d S )Nú a
| 1
| 2
| 3
| 4
| 5r c S s | d dkS )Nr r r! ©Úxr! r! r" Ú<lambda>ð ó z)test_skip_rows_callable.<locals>.<lambda>rB )r rC r r r4 r r! r! r" Útest_skip_rows_callableå s rf c C sD | }d}t ddgddgg}|jt|d dd d}t ||¡ d S ) Nz0,a
| 1,b
| 2,c
| 3,d
| 4,er r= r Údc S s | dkS )N)r r r! rb r! r! r" rd ú re z0test_skip_rows_callable_not_in.<locals>.<lambda>)r
| r rE r] r! r! r" Ú test_skip_rows_callable_not_inô s ÿrh c C s@ | }d}d}t jt|d |jt|dd d W 5 Q R X d S )Nra z No columns to parse from file©Úmatchc S s dS )NTr! rb r! r! r" rd re z)test_skip_rows_skip_all.<locals>.<lambda>r2 )rW Úraisesr r r )r r r4 Úmsgr! r! r" Útest_skip_rows_skip_allÿ s
| rm c C s@ d}| }d}t jt|d |jt|dd d W 5 Q R X d S )Nzby zerora ri c S s dd S )Nr r r! rb r! r! r" rd re z-test_skip_rows_bad_callable.<locals>.<lambda>r2 )rW rk ÚZeroDivisionErrorr r )r rl r r4 r! r! r" Útest_skip_rows_bad_callable s
| ro c C sT d}| }|j t|ddddgd}tdddd d
| gd d d ddgd}t ||¡ d S )Nz$a,b
| 1,a
| 2,b
| 3,c
| 4,d
| 5,e
| 6,f
| 7,g
| 8,h
| r` r r/ r )Znrowsr r r é r0 r< r> ÚeÚgÚh)r< r= rH )r r4 r r r r! r! r" Útest_skip_rows_and_n_rows s
|
| "rt )"Ú__doc__r Úior Únumpyr rW Z pandas.errorsr Zpandasr r Zpandas._testingZ_testingr rX Z usefixturesZ
| pytestmarkZ parametrizeÚlistr3 r# r5 r6 rD rG rI r\ r^ rf rh rm ro rt r! r! r! r" Ú<module> s
| þø
| ý øíþ!
| ûûûñþ
| ÿ
| "
| þþ
|
|
|
