U
|
®ý°dÕw ã @ sÐ d dl Zd dlZd dlZd dlmZmZmZmZm Z m
|
Z
|
d dl m Z d dlmZ d dlmZ ejdd Zejdd Zejd d
|
Zejd d Zejd d Zejdd ZG dd dZG dd dZdS )é N)Ú DataFrameÚIndexÚ
|
MultiIndexÚ
|
RangeIndexÚSeriesÚ Timestamp)Úconcat)Úmergec
|
C sP ddddddddddg
|
} ddddddddddg
|
}t j t| ¡}t| ||d S )
|
z=left dataframe (not multi-indexed) for multi-index join testsÚbarÚfooZbazZquxZsnapZtwoZoneZthree©Úkey1Úkey2Údata)ÚnpÚrandomÚrandnÚlenr r © r ú\d:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/reshape/merge/test_multi.pyÚleft s r c C s | }ddg|j _dddg|_|S )z:right dataframe (multi-indexed) for multi-index join testsr r Zj_oneZj_twoZj_three)ÚindexÚnamesÚcolumns)Z multiindex_dataframe_random_dataÚdfr r r Úright s r c
|
C sb t dddddgdddddgdddddgddd ddgd
|
d d d dgddddddgd ddddg¡S )NÚAÚBÚCÚAMÚIPÚOPZhbwZnhbZhboià i? i¦ iÈ i\ )ÚOriginÚ DestinationÚPeriodÚTripPurpÚTripsr" r# r$ r% r& ©r ©r Ú set_indexr r r r Ú
|
left_multi' s û ø
|
÷r* c C sv t dddddddgdddddddgdddddddgd d
|
d d
|
d d
|
d gd d dd dddgddddddgd ddddg¡S )Nr r r ÚEÚFr r r! ÚaÚbÚcéd éP éZ éK é# é7 )r" r# r$ ÚLinkTypeÚDistancer" r# r$ r6 r7 r' r( r r r r Ú right_multi5 s û ø
|
÷r8 c C s
|
dddgS )Nr" r# r$ r r r r r Ú on_cols_multiC s r9 c C s dddddgS )Nr" r# r$ r% r6 r r r r r Úidx_cols_multiH s r: c @ s e Zd Zdd Zej dddg¡dd Zej dddg¡dd Zd
|
d Z d d Z
|
dd Z dd Z dd Z dd Zdd Zej ddejeeg¡dd Zej d d d g¡d d Zejd!d" Zejd#d$ Zejd%d& Zd'd( Zd)d* Zd+d, Z d-d. Z d/d0 Z dS )1ÚTestMergeMultic C s ddg}|j |||djdd}t|| ¡ ||d}t ||¡ |j |||ddjdd}t|| ¡ ||dd}t ||¡ d S )Nr r ©ÚonÚhowT)Údrop©r= r> Úsort)ÚjoinÚ reset_indexr ÚtmÚassert_frame_equal)Úselfr r Ú join_typeÚon_colsÚresultÚexpectedr r r Útest_merge_on_multikeyN s ÿ ÿz%TestMergeMulti.test_merge_on_multikeyrA FTc
|
sn dddgdd fdd}t ttt tdtd d
|
¡}ttj |d ¡ddgd }| d
|
dtj
|
d dt |¡ d¡¡ tj t |¡}|j| ¡ } ||d< | |d< |jdd |||| tj|jd
|
d d
df< tj|jdd d
df< tj|jdd d
df< ||d< tj t |¡}|j|d d
f } | |d< |jdd |||| d S )NÚ1stÚ2ndÚ3rdc sB dd fdd}|| d || d d | d d¡d S )
|
Nc S s | | kr dS t | S )Nr )Úord)r- r r r Ú<lambda>e ó zNTestMergeMulti.test_left_join_multi_index.<locals>.bind_cols.<locals>.<lambda>c s | ¡td S )Nr- )ÚmaprO )Úts©Ziordr r rP f rQ rL rN g Y@rM r g Ã@)Úfillna)r Úfr rT r Ú bind_colsd s z<TestMergeMulti.test_left_join_multi_index.<locals>.bind_colsc sö | j |d|d}t| t|d k s*t|d ¡ ¡ r>t|d ¡ ¡ rRttj|d |d dd |jd d
d d
f }tj|d |dd |jd ks¨t|rÂt ||j
|
d d
|
¡ t | | ¡ |dd }t t||_t ||¡ d S ) Nr r@ é Ú4thÚ5thF)Z check_nameséþÿÿÿÚ mergesort©Úkind)r= rA r> )rB r ÚAssertionErrorZisnaÚanyrD Zassert_series_equalÚilocÚnamerE Ú sort_valuesr rC r r )r r rA ÚresrI Úout©rW Zicolsr r Ú run_assertsi s z>TestMergeMulti.test_left_join_multi_index.<locals>.run_assertsr- ÚzrX )i é r' r iè ÚfloatrY rZ T)Úinplaceé ri é% é é+ éÿÿÿÿ)ÚlistrR Úchrr ÚarangerO r r ÚchoiceÚinsertÚrandintr ZastypeZ permutationra Úcopyr) ÚnanÚloc)rF rA rg Úlcr Úir r rf r Útest_left_join_multi_index` s*
|
"$ z)TestMergeMulti.test_left_join_multi_indexc C sJ ddg}|j ||dd|d}|j ||dd|d}||j }t ||¡ d S )Nr r Tr )Zleft_onZ right_indexr> rA r )Zright_onZ
|
left_indexr> rA )r r rD rE )rF r r rA rH Zmerged_left_rightZmerge_right_leftr r r Útest_merge_right_vs_left s" ÿ ÿ
|
z'TestMergeMulti.test_merge_right_vs_leftc C s t tdtjddgdddggddgd d
|
d }ttd ddddddgd d}t|| ¡ ddgd}ttd ddddddgd gd tdd}t ||¡ d S )Né r r rX ri rn Úlev1Úlev2©r ÚAmount)rb ZAAABBBr )r r Úcol©r= )r r r r )
|
r Úranger Ú from_productr rq r rC rD rE )rF Úsr rI rJ r r r Ú.test_merge_multiple_cols_with_mixed_cols_index© s ý üÿz=TestMergeMulti.test_merge_multiple_cols_with_mixed_cols_indexc C s| t dd¡}t |d¡}|d d d
}t||tj d¡d}t|d d d
|d d d
tj d¡d}t||dd d S )
|
Né
|
i' ri rp i N )r r Zvalue1)r r Zvalue2Úouter©r> )rD Z rands_arrayr Ztiler r r r )rF r r r Zdf2r r r Ú test_compress_group_combinations¼ s &ÿz/TestMergeMulti.test_compress_group_combinationsc C sö ddg}t dddgd ddgd tjt d
|
¡tjd d }t d dg¡}t dddgi|d}|j||d}| ¡ }tj |d< d|j
|
|j dk|j dk@ df< d|j
|
|j dk|j dk@ df< t ||¡ |j|ddd |j||dd}t ||¡ t dddgd ddgd tjdddgd tjd tjt d
|
¡tjd d}t d dg¡}t dddgi|d}|j||d}| ¡ }tj |d< d|j
|
|j dk|j dk@ df< d|j
|
|j dk|j dk@ df< t ||¡ |j|dd}|j||dd}t ||¡ d S )NÚk1Úk2r rX ri é r r
|
é é ©Zdtype)r r Úv)ri r
|
)rX r Úv2é é ©r r r\ T)r^ rk )r= rA )r r Zk3r r] )r r Úarrayrs Úint64r Ú from_tuplesrB rw rx ry r r rD rE rc Úfloat32Úint32)rF rH r r r rI rJ r r r Ú#test_left_join_index_preserve_orderË sH
|
ýÿ
|
|
üÿ
|
z2TestMergeMulti.test_left_join_index_preserve_orderc C sx t ddddgddddgddd d
|
gdd d d gddd dgddd dgddddgdd ddgddddgddddgg
|
ddddgdddd d d d d d!d"g
|
d#}t dd ddgddddgdddd"gddd d gddd d gdddd gdddd gdddd!gdddd$gdd dd%gdddd gdd d dgdd d d&gddd d'ggd(d)d*d+gd, d(d)d*g¡}|j|dddgd-d.}t ddddd gddddd!gddddtjgddd d
|
d'gdd d d dgdd d d d&gddd dtjgddd dd gddd dd gdddddgddddd"gdd dddgddddd gddddd ggddddd+gddddd d d d d d d d d!d"gd#}t ||¡ |j|dddgd-d/d0}|jdddgd1d2}t ||¡ d S )3NÚXÚYr r- ÚWÚeÚVÚQr ÚhÚRÚDr{ r. r/ r rV ÚgÚjÚdZcolaZcolbZcolcÚtagrn ri r rX r r~ é r é r ©r r iúÿÿÿi÷ÿÿÿrp éýÿÿÿZcol1Zcol2Zcol3Úvalr' r r< Tr@ r\ r] )r r) rB r rx rD rE rc )rF r r rI rJ r r r Ú+test_left_join_index_multi_match_multiindex sv
|
|
|
|
|
|
|
|
|
|
ö
|
ò
|
|
|
|
|
|
|
|
|
|
|
|
|
|
ò
|
ïî ò î z:TestMergeMulti.test_left_join_index_multi_match_multiindexc C sZ t ddgddgddgddggdd gddddgd
|
}t dd gdd gdd gddgddgddgddgddggddgd d¡}|j|ddd}t ddd gddd gdddgdddgddtjgddd gdddgddtjggdd dgddddddddgd
|
}t ||¡ |j|dddd}|jddd }t ||¡ t|| ¡ ddd }t
|
t ||_ t ||¡ d S ) Nr/ r r. rX r- ri rn rª r¯ r r ÚwÚxr© Úyrh Úrr¡ Úqr Úcharr' r r< Tr@ r\ r] ©r> r= ) r r) rB r rx rD rE rc r rC r r r )rF r r rI rJ Z expected2r r r Ú test_left_join_index_multi_matchF sP
|
ýø
|
õ ô
|
|
ø
|
ô z/TestMergeMulti.test_left_join_index_multi_matchc C sª t tdtj d¡tj d¡tdtj d¡ddddddgd }t d
|
d tjtjtjgd d tjtjtjgd}t||ddd}|jdgdd}| |¡}t
|
||¡ d S )NZabcder )ÚidÚv1r ÚdummyÚv3r¹ rº r r» r¼ r' r- r. gX9´Èv¾ó?gÀÊ¡E¶@)r¹ Zsv3r r< rX )Úaxis) r rq r r r rx r r? rB rD rE )rF r r rI ÚrdfrJ r r r Útest_left_merge_na_bugletx s$
|
|
|
û ø
|
þÿ
|
z(TestMergeMulti.test_left_merge_na_bugletc C sú dddgdddgdddgddt jgdddgdd dgdd t jgd
|
d d gdd dgg }t|d d dgd}ddt jgddt jgddt jgd
|
dt jgd
|
dt jgdd t jgg}t|d d dgd}|j|dd}| d¡j| d¡dd}| dt j¡}t ||¡ d S )Ni r ç ø?r i£ i¨ i² g @r i g @ÚyearÚpanelr r' r r iüÿÿ)r rx r r rU ÚreplacerD rE )rF r ÚframeZ
|
other_dataÚotherrI rJ r r r Útest_merge_na_keys s.
|
|
÷
|
|
|
|
|
|
úz!TestMergeMulti.test_merge_na_keysÚklassNc C sÎ t dddgdddgdgd}t |j¡|_|jj}|d k rB||}tjd d
|
d gtjd }t dddg|d }|j|d|gdd}t
|
||¡ t |dddgdddgd}|j||jjgdd}t
|
||¡ d S ©NrX ri rn z
|
2016-01-01z
|
2017-01-01z
|
2018-01-01r- r' ià iá iâ r )r- Zkey_1Úinnerr< )Zkey_0Za_xZa_y© r ÚpdÚ to_datetimer rÁ r r r r rD rE )rF rÇ r Ú on_vectorÚ exp_yearsrJ rI r r r Útest_merge_datetime_index° s ÿ z(TestMergeMulti.test_merge_datetime_indexÚ
|
merge_typer r c C s t dddgitjtddgtddggddgd d
|
}t tjg ddgd d gd }tjtddgtddggddgd }|d kr¾t ddgd d gd|d
|
}|j|d ddgd}|j|d d}n<t d d gddgd|d
|
}|j|dddgd}|j|dd}t ||¡ t ||¡ d S )Nr rÀ z
|
1950-01-01r z
|
1950-01-02r Údater r )r r Ústate)r r r )r rÒ r· r )rÒ r r )r r r r r rB rD rE )rF rÐ r r Zexpected_indexrJ Z results_mergeZ results_joinr r r Ú(test_merge_datetime_multi_index_empty_dfÇ sH ÿþü
|
ÿþþûþû z7TestMergeMulti.test_merge_datetime_multi_index_empty_dfc C s6 t dddgdddgdddgdd d
|
d gd d ¡}|S ) NrX ri rn r çffffºïAçÍÌÌÌúPAi^ )Ú household_idÚmaleÚwealthrÖ r× rØ r' r( )rF Ú householdr r r rÙ ö s ýúùzTestMergeMulti.householdc C sh t dddddddgdddddd tjgd
|
d d d d dtjgdddddddgdddddgd ddg¡}|S )NrX ri rn r« Ú nl0000301109Ú nl0000289783Ú gb00b03mlx29Ú lu0197800237Ú nl0000289965úABN AmroÚRobecoúRoyal Dutch Shellú AAB Eastern Europe Equity FundúPostbank BioTech Fondsç ð?çÙ?ç333333ã?ç333333Ã?ç Ð?)rÖ Úasset_idrb ÚsharerÖ ré rb rê r' )r r rx r) )rF Ú portfolior r r rë s2 ù
|
ù ì
|
éèzTestMergeMulti.portfolioc C s| t ddddddgddddddgddddd d
|
gd d d dd dgddddddgddddddgd ddg¡jddd d gd }|S ) Nr rX rÔ rÕ g xýArß rà rá râ rã rä rå ræ rç rè ri rn rÚ rÛ rÜ rÝ rÞ )r× rØ rb rê rÖ ré rÖ ré r× rØ rb rê r' )r r) Úreindex)rF rJ r r r rJ sB ú úúìÿ á
|
àÿ#zTestMergeMulti.expectedc C s. | ¡ }| ¡ }|j|dd}t ||¡ d S )NrÉ r )rw rB rD rE ©rF rë rÙ rJ rI r r r Útest_join_multi_levelsF s z%TestMergeMulti.test_join_multi_levelsc C sD | ¡ }| ¡ }t| ¡ | ¡ dgdd ddg¡}t ||¡ d S )NrÖ rÉ r< ré )rw r rC r) rD rE rí r r r Ú(test_join_multi_levels_merge_equivalenceO s üûz7TestMergeMulti.test_join_multi_levels_merge_equivalencec C sn | ¡ }| ¡ }|j|dd}t|tddgitjdtjfgddgdd gd
|
d d j|j d }t
|
||¡ d S )Nr r rê rä r« rÖ ré r r r T)r½ rA r' ) rw rB r r r r r rx rì r rD rE rí r r r Ú test_join_multi_levels_outer\ s&
|
ÿþý óòz+TestMergeMulti.test_join_multi_levels_outerc C s | ¡ }| ¡ }d|j_tjtdd |j|dd W 5 Q R X | ¡ }|j ddg¡ tjtdd |j|dd W 5 Q R X d S )Nr z+cannot join with no overlapping index names)ÚmatchrÉ r rÖ z'columns overlap but no suffix specified)rw r rb ÚpytestZraisesÚ
|
ValueErrorrB Z set_names)rF rë rÙ Z
|
portfolio2r r r Ú test_join_multi_levels_invalidr s ÿz-TestMergeMulti.test_join_multi_levels_invalidc C s t dddddddgddddddtjgd d
|
d d d d d gddddgd ddg¡}t dddddgdddddgddddd gd dd g¡}t ddddddddgddddddddgddddddddgd d d d d d d d gdddddddd gd ddd g¡jdd gd}t| ¡ | ¡ dgd!d" ddd g¡}t ||¡ t ddddddddddddg dddddddddddd g d d ddddddddd d g d d
|
d d d d d d d d d d g d d dddddddd d d g d ddd g¡jdd gd}t| ¡ | ¡ dgd#d" ddd g¡}t ||¡ d S )$NrX ri rn r« rÚ rÜ rÝ rÞ rä rå ræ rç rè )rÖ ré rê rÖ ré rê r' éé éê éë é´ éµ g¢Sãç·¸?g×D¡³°¿g ×>²ó¢?g
|
û?gH¨REñ¢?)ré ÚtÚ
|
log_returnrú )rÖ ré rú rê rû rû rÉ r< r ) r r rx r) rì r rC rD rE )rF rÙ rû rJ rI r r r Útest_join_multi_levels2 s ù õ òñû û÷ÿîø
|
øòÿå äÿ!üû ôôôôÔÿ=Ã>ÂÿBüûz&TestMergeMulti.test_join_multi_levels2) Ú__name__Ú
|
__module__Ú __qualname__rK rò ÚmarkÚ parametrizer| r} r r r r° r¸ r¿ rÆ r Úasarrayr r rÏ rÓ ÚfixturerÙ rë rJ rî rï rð rô rü r r r r r; M s6
|
7
|
6E2
|
|
.
|
|
|
& r; c @ sL e Zd Zdd Zdd Zej ddej e
|
e g¡dd Z d d
|
Z d d ZdS ) ÚTestJoinMultiMultic C sD t | ¡ | ¡ ||d |¡ ¡ }|j||d ¡ }t ||¡ d S )Nr· r )r rC r) Ú
|
sort_indexrB rD rE ©rF r* r8 rG r9 r: rJ rI r r r Útest_join_multi_multi" s üúÿ z(TestJoinMultiMulti.test_join_multi_multic C s` |j |jd}|j |jd}t| ¡ | ¡ ||d |¡ ¡ }|j||d ¡ }t ||¡ d S )Nr' r· r ) r? r r rC r) r rB rD rE r r r r Ú test_join_multi_empty_frames4 s üúÿ z/TestJoinMultiMulti.test_join_multi_empty_framesÚboxNc C sÎ t dddgdddgdgd}t |j¡|_|jj}|d k rB||}tjd d
|
d gtjd }t dddg|d }|j|d|gdd}t
|
||¡ t |dddgdddgd}|j||jjgdd}t
|
||¡ d S rÈ rÊ )rF r r rÍ rÎ rJ rI r r r rÏ H s ÿ z,TestJoinMultiMulti.test_merge_datetime_indexc C s² t jdddgddgd}tddd gd
|
d d gd |d}t jddddgddgd}tddddgddddgd |d}| |¡}t| ¡ | ¡ dgd d dddg¡}t ||¡ d S ) N)ÚK0ZX0)r
|
ZX1)ÚK1ZX2Úkeyr r ZA0ÚA1ÚA2ZB0ZB1ZB2)r r r )r
|
ZY0)r ZY1)ÚK2ZY2)r ZY3r ZC0ZC1ZC2ZC3ZD0ZD1ZD2ZD3)r r¦ rÉ r< ) r r r rB r rC r) rD rE )rF Z
|
index_leftr Z index_rightr rI rJ r r r Útest_single_common_level_ s4 ÿ ÿ
|
ÿþ
|
ÿþz+TestJoinMultiMulti.test_single_common_levelc C s¢ t jddgddggddgd}t jdd d
|
gddgd}t|d d d ddgid}t|ddddgid}| |¡}t|d d ddgdddtjgdd}t ||¡ d S )NrX ri rn r« r- r. r )r« rX )rn ri )rn rX r² r é é é( )r r r³ r r
|
Zfing)r² r³ ) r r r r rB r rx rD rE )rF Zmidx1Zmidx3r r rI rJ r r r Útest_join_multi_wrong_orderx s
|
þz.TestJoinMultiMulti.test_join_multi_wrong_order)rý rþ rÿ r r rò r r r r r r rÏ r r r r r r r ! s
|
r )Únumpyr rò ZpandasrË r r r r r r Zpandas._testingZ_testingrD Zpandas.core.reshape.concatr Zpandas.core.reshape.merger r r r r* r8 r9 r: r; r r r r r Ú<module> s2
|
|
|
|
|
|
|
Y
|
