U
|
®ý°dùg ã @ s¦ d dl m Z d dlZd dlZd dlZd dlmZmZmZm Z m
|
Z dd Z dd Z dd Zd
|
d Zd d Zdd Zdd Zdd Zdd Zdd Zdd Zdd Zd d Zej d dd g¡d d! Zd"d# Z d$d% Z d&d' Z d(d) Z ej d*d+d,d-gfd.d d-gfg¡d/d0 Z d1d2 Z!d3d4 Z"ej d5g d6fg d7fg d8fg d9fd:d;d<gd6fd:d;d<gd9fd:d;d<gd8fd:d;d<gd9fg¡d=d> Z#d?d@ Z$dAdB Z%dCdD Z&dEdF Z'dGdH Z(dS )Ié )ÚdatetimeN)Ú DataFrameÚIndexÚ
|
MultiIndexÚSeriesÚ_testingc C sB t dtjdg| d}tjtdd |jjdd d W 5 Q R X d S )NÚfooBAD__barBADÚfoo©Údtypez expand must be True or False©Úmatchú.*(BAD[_]+).*(BAD)©Úexpand)r ÚnpÚnanÚpytestÚraisesÚ
|
ValueErrorÚstrÚextract)Úany_string_dtypeÚvalues© r úXd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/strings/test_extract.pyÚ+test_extract_expand_kwarg_wrong_type_raises s r c C s¤ t dtjdg| d}tdtjtjg| d}|j d¡}t ||¡ |jjddd}t ||¡ tddgtjtjgtjtjgg| d}|jjd d
|
d}t ||¡ d S ) Nr r r
|
ÚBAD__z .*(BAD[_]+).*Tr ÚBADr F)r r r r r r ÚtmÚassert_frame_equal)r ÚsÚexpectedÚresultr r r Útest_extract_expand_kwarg s ÿr$ c
|
C s² t dtjddt ¡ dd ddg } | jjddd }tjtjg}td
|
d g|d
|
d g||||||g }t ||¡ | jjd dd }t d
|
tjd
|
tjtjtjtjtjtjg }t
|
||¡ d S ) NÚaBAD_BADÚ BAD_b_BADTr é ç @r Fr ÚBAD_r z.*(BAD[_]+).*BAD) r r r r Útodayr r r r r Úassert_series_equal)Úserr# Úerr" r r r Ú&test_extract_expand_False_mixed_object( s ÿ " "ÿr. c C sD t dddddg} d}tjt|d | jjdd d
|
W 5 Q R X d S ) NÚA1ÚA2ÚA3ZA4ZB5z,only one regex group is supported with Indexr ú ([AB])([123])Fr )r r r r r r )ÚidxÚmsgr r r Ú test_extract_expand_index_raises; s r5 c C sn | dddg|d}d}t jt|d |jjddd W 5 Q R X t jt|d |jjd
|
dd W 5 Q R X d S ) Nr/ ÚB2ÚC3r
|
ú"pattern contains no capture groupsr ú
|
[ABC][123]Fr ú
|
(?:[AB]).*©r r r r r ©Úindex_or_seriesr Ús_or_idxr4 r r r Ú,test_extract_expand_no_capture_groups_raisesE s r? c C sX | ddg|d}|j jddd}| ddgd|d }| tkrHt ||¡ n t ||¡ d S )
|
Nr/ r0 r
|
ú (?P<uno>A)\dFr ÚAÚuno©Únamer )r r r r r+ Zassert_index_equal©r= r r> r# r" r r r Ú(test_extract_expand_single_capture_groupR s rF c C sà t dddg| d}|jjddd}t tjtjtjg| d}t ||¡ |jjddd}ttjtjgtjtjgtjtjgg| d}t ||¡ |jjd dd}t d
|
d tjg| d}t ||¡ |jjd dd}td
|
d gd dgtjtjgg| d}t ||¡ |jjddd}t d
|
d tjgd| d}t ||¡ |jjddd}td
|
d gd dgtjtjggddg| d}t ||¡ |jjddd}td
|
d gd dgtjtjggddg| d}t ||¡ |jjddd}t d
|
d tjg| d}t ||¡ t dddg| d}|jjddd}td
|
d gd dgtjtjgg| d}t ||¡ t ddd g| d}|jjd dd}td
|
d gd dgtjd ggddg| d}t ||¡ t ddd g| d}|jjd dd}td
|
d gd dgd tjggddg| d}t ||¡ d S ) Nr/ r6 r7 r
|
ú(_)Fr ú(_)(_)ú ([AB])[123]rA ÚBr2 Ú1Ú2ú(?P<letter>[AB])ÚletterrC ú!(?P<letter>[AB])(?P<number>[123])Únumber©Úcolumnsr ú([AB])(?P<number>[123])r ú([AB])(?:[123])ÚA11ÚB22ÚC33ú([AB])([123])(?:[123])Ú3ú"(?P<letter>[AB])?(?P<number>[123])ÚCú#(?P<letter>[ABC])(?P<number>[123])?) r r r r r r r+ r r ©r r! r# r" r r r Ú"test_extract_expand_capture_groups^ s| ÿ ÿ ý ý ÿ ý ýr^ c C sÔ dddg}t | dkr t d¡ t | t |k r<| d¡} q | d t |
} t|| |d}|jjdd d
|
}td d tjg| |d}t
|
||¡ |jjd d d
|
}t dd gdd gdtjggddg| |d}t ||¡ d S )Nr/ r6 r[ r z Test requires len(index) > 0é ©Úindexr ú(\d)Fr rK rL ú (?P<letter>\D)(?P<number>\d)?rA rJ rN rP ©rR ra r ) Úlenr ÚskipÚrepeatr r r r r r r+ r r )ra r Údatar, r# r" r r r Ú(test_extract_expand_capture_groups_index± s$
|
|
üri c C sH t dddgd| d}|jjddd}t d d
|
d gd | d}t ||¡ d S ) NÚa3Úb3Úc2ZbobrC z(?P<sue>[a-z])Fr ÚaÚbÚcZsue)r r r r r+ r] r r r Ú,test_extract_single_series_name_is_preservedÌ s rp c C sZ t dtjdg| d}|jjddd}tddgtjtjgtjtjgg| d}t ||¡ d S ) Nr r r
|
r Tr r r )r r r r r r r r r] r r r Útest_extract_expand_TrueÓ s ÿrq c
|
C sn t jt jg} tdt jddt ¡ dd ddg }|jjddd}td d
|
g| d d
|
g| | | | | | g }t ||¡ d S ) Nr% r& Tr r' r( r r r) r )
|
r r r r r* r r r r r )r- Úmixedr# r" r r r Ú%test_extract_expand_True_mixed_objectÞ s ÷ÿ"rs c C sn | dddg|d}d}t jt|d |jjddd W 5 Q R X t jt|d |jjd
|
dd W 5 Q R X d S ) Nr/ r6 r7 r
|
r8 r r9 Tr r: r; r< r r r Ú4test_extract_expand_True_single_capture_group_raisesó s rt c C sD | ddg|d}|j jddd}tdddgi|d}t ||¡ d S ) Nr/ r0 r
|
r@ Tr rB rA )r r r r r rE r r r Ú-test_extract_expand_True_single_capture_group s ru rD Ú series_namec C sì t dddg| |d}|jjddd}ttjtjtjg|d}t ||¡ |jjd dd}ttjtjgtjtjgtjtjgg|d}t ||¡ |jjd
|
dd}td d tjg|d}t ||¡ |jjd dd}td dgd dgtjtjgg|d}t ||¡ |jjddd}tdd d tjgi|d}t ||¡ |jjddd}td dgd dgtjtjggddg|d}t ||¡ |jjddd}td dgd dgtjtjggddg|d}t ||¡ |jjddd}td d tjg|d}t ||¡ d S )Nr/ r6 r7 rC rG Tr r
|
rH rI rA rJ r2 rK rL rM rN rO rP rQ rS r rT ©r r r r r r r r )rD r r! r# r" r r r Útest_extract_series
|
sN ÿ ÿ ý ý rx c C sü t dddg| d}|jjddd}tdd gd
|
d gtjtjgg| d}t ||¡ t d d dg| d}|jjddd}tdd gd
|
d gtjdggddg| d}t ||¡ t d d dg| d}|jjddd}tdd gd
|
d gdtjggddg| d}t ||¡ d S )NrU rV rW r
|
rX Tr rA rK rJ rL r/ r6 rY rZ rN rP rQ r[ r\ rw r] r r r Ú test_extract_optional_groupsD s. ÿ ý ýry c C s¼ dddg}t | t |k r$t d¡ | d t |
} t|| |d}|jjddd}td d
|
tjg| |d}t
|
||¡ |jjd dd}td d gd d
|
gdtjggddg| |d}t
|
||¡ d S )Nr/ r6 r[ zIndex too shortr` rb Tr rK rL rc rA rJ rN rP rd ) re r rf r r r r r r r r )ra r rh r! r# r" r r r Ú+test_extract_dataframe_capture_groups_indexb s
|
|
ürz c C sJ t dddgd| d}|jjddd}td d
|
d d gi| d }t ||¡ d S )Nrj rk rl rv rC ú(?P<letter>[a-z])Tr rN rm rn ro r
|
)r r r r r r r] r r r Ú'test_extract_single_group_returns_frame| s r| c
|
C sN dddddt jdg}ddd d
|
d d d dg}d}dddg}t|| d}tjddddddddgd d }t|||| d}|jj|tj d }t
|
||¡ t d d d!d"d#d$d%g¡} t|| | d&}tjd'd(d)d*d+d,d-d.gd/d }t|||| d}|jj|tj d }t
|
||¡ t|| | d&}d0|j _ d1|_ t|||| d}|jj|tj d }t
|
||¡ d S )2Nzdave@google.comztdhock5@gmail.comzmaudelaperriere@gmail.comz'rob@gmail.com some text steve@gmail.comz%a@b.com some text c@d.com and e@f.comÚ )ZdaveZgoogleÚcom)Ztdhock5Úgmailr~ )Zmaudelaperrierer r~ )Zrobr r~ )Zstever r~ )rm rn r~ )ro Údr~ )ÚeÚfr~ zY
|
(?P<user>[a-z0-9]+)
|
@
|
(?P<domain>[a-z]+)
|
\.
|
(?P<tld>[a-z]{2,4})
|
ÚuserÚdomainÚtldr
|
©r r ©r' r ©r_ r )é r )r r' )é r )r r' )r r_ ©Nr ©Únames)Úflags)ÚsingleÚDave)r ÚToby)r ÚMaude)ÚmultipleÚ robAndSteve)r Úabcdef)ÚnoneÚmissing)r Úemptyr` )r r r )r r r )r r r )r r r )r r r' )r r r )r r r' )r r r_ )NNr )ÚmatchesÚ description)r r r )r r r r Ú from_tuplesr r Ú
|
extractallÚreÚVERBOSEr r ra r )
|
r rh Zexpected_tuplesÚpatZexpected_columnsr! Úexpected_indexr" r# Úmir r r Útest_extractall s ù
|
ø
|
|
þ ÿ ùÿ ø
|
õ ÿ ÿr¢ zpat,expected_namesrZ rN rP z([AB])?(?P<number>[123])c C s` t dddg|d}|j | ¡}tdtjdftjdfgtjdd d
|
gd d ||d }t ||¡ d S )Nr} r/ Ú32r
|
)rA rK rY rL r r ©r_ r' r r )ra rR r )
|
r r r r r r r r r r )r Zexpected_namesr r! r# r" r r r Ú test_extractall_column_namesÛ s
|
ür¥ c C s t dddgd| d}tjdddd gd
|
d }|j d ¡}td ddddgi|| d}t ||¡ |j d¡}tddddg|| d}t ||¡ d S )Nrj rk Úd4c2rv rC r r r r¤ r r r{ rN rm rn r ro r` ú([a-z]))r r r r r r r r )r r! r r# r" r r r Ú test_extractall_single_groupñ s&
|
ÿ ÿ
|
ÿr¨ c C sX t dddgd| d}|j d¡}tddd d
|
gtjd d d dgdd| d}t ||¡ d S )NZab3Zabc3Zd4cd2rv rC z([a-z]+)ÚabÚabcr Zcdr r r r¤ r r r` )r r r r r r r r r] r r r Ú,test_extractall_single_group_with_quantifier s
|
|
ÿûr« z data, names)N)Úi1)NÚi2)r¬ r rj rk r¦ c sB t | t |dkr*tt |d d}n$ fddt D }tj||d}t| d||d}tjg |d d}|j d
|
¡}tdg||d }t
|
||¡ |j d ¡}tddg||d }t
|
||¡ |j d ¡}tdg||d }t
|
||¡ |j d¡}tddg||d }t
|
||¡ |j d¡}tddg||d }t
|
||¡ d S )Nr' r ©rD c 3 s | ]}t |g d V qdS )r' N)Útuple)Ú.0Úi©Únr r Ú <genexpr>) s z-test_extractall_no_matches.<locals>.<genexpr>r rv ©rD ra r r z(z)rd z(z)(z)z (?P<first>z)Úfirstz(?P<first>z)(?P<second>z)Úsecondz(z)(?P<second>z)) re r Úranger r r r r r r r ) rh r r ra Ztuplesr! r r# r" r r² r Útest_extractall_no_matches sD ÿ ÿ ÿr¹ c C s
|
t dddgd| d}|j d¡}tddd dgitjd
|
d d gd d gd| d}t ||¡ | dkrtdddgtdddgddfD ] }|j d¡}t ||¡ qt dddgdtdddgdd| d}|j d¡}tddd dgitjdddgdd gd| d}t ||¡ d S )NZa1a2Zb1Zc1ZxxxrC z[ab](?P<digit>\d)ÚdigitrK rL r )r r' r r r r` Úobjectr® Zs_nameÚXXÚyyÚzzZidx_namerµ )r¼ r )r¼ r' )r½ r ) r r r r r r r r r )r r! r# r" r3 r r r Útest_extractall_stringindexN s< ý þ ü ÿûr¿ c C s> t dddgd| d}tjtdd |j d¡ W 5 Q R X d S ) Nrj rk r¦ rv rC zno capture groupsr z[a-z])r r r r r r )r r! r r r Ú(test_extractall_no_capture_groups_raisess s rÀ c C s t dddgdddgdd} | jjjd d
|
d }td d dg}t ||¡ | jjjdd
|
d }dddg}t|ddgd}t ||¡ d S )Nrj rk r¦ r1 ZB3ZD4rv )ra rD z([A-Z])Tr rA rJ ÚDz!(?P<letter>[A-Z])(?P<digit>[0-9]))rA rY )rJ rY )rÁ Ú4rN rº )rR )r ra r r r r r )r! Úrr Ze_listr r r Ú!test_extract_index_one_two_groups{ s
|
rÄ c C s t dddgd| d}d}|jj|dd}|j |¡}|jd d
|
d }t ||¡ d }|jj|dd}|j |¡}|jd d
|
d }t ||¡ d }|jj|dd} |j |¡}|jd d
|
d }t | |¡ d}
|
|jj|
|
dd} |j |
|
¡}|jd d
|
d }t | |¡ d S )Nrj rk rl rv rC ú([a-z])([0-9])Tr r r ©Úlevelú!(?P<letter>[a-z])(?P<digit>[0-9])ú(?P<group_name>[a-z])r§ )r r r r Úxsr r ) r r! Úpattern_two_nonameÚextract_two_nonameZhas_multi_indexZno_multi_indexÚpattern_two_namedÚextract_two_namedÚpattern_one_namedÚextract_one_namedÚpattern_one_nonameÚextract_one_nonamer r r Ú test_extractall_same_as_extract s* rÓ c C s t jdddgdd}tdddg|d | d
|
}d }|jj|d d }|j |¡}|jddd}t ||¡ d}|jj|d d }|j |¡}|jddd}t ||¡ d} |jj| d d }
|
|j | ¡}|jddd}t |
|
|¡ d} |jj| d d } |j | ¡}|jddd}t | |¡ d S )N)rA r¶ )rJ r· )r[ Úthird)ZcapitalZordinalr rj rk rl rv )ra rD r rÅ Tr r r rÆ rÈ rÉ r§ ) r r r r r r rÊ r r ) r r¡ r! rË rÌ Zhas_match_indexZno_match_indexrÍ rÎ rÏ rÐ rÑ rÒ r r r Ú-test_extractall_same_as_extract_subject_index¦ s2 þ rÕ ))r r Únumpyr r Zpandasr r r r r r r r$ r. r5 r? rF r^ ri rp rq rs rt ru ÚmarkZ parametrizerx ry rz r| r¢ r¥ r¨ r« r¹ r¿ rÀ rÄ rÓ rÕ r r r r Ú<module> sd
|
S
|
9
|
U
|
|
üþ
|
øþ
|
+%
|
