U
|
ý°dh[ ã @ sÎ d dl Zd dlZd dlmZ d dlmZ d dlZd dl m
|
Z d dl m Z ej ddddgddggd d
|
gd d gd d gd fdddgdejgddggd dd
|
gd dd gd dd gd fg¡dd Zej ddddgddggdd
|
gdd gdd gd fdddgdejgddgejdggddd
|
d gddd d gdd d d gd fg¡dd Zej ddddgd
|
d gd d gd d gdfdddejgd
|
d dgd d dgd d dgdfg¡dd Zej d dd d d ejgejd d gd d gd fdd d d ejgejd d d gd d ejgd fg¡d!d" Zej d#dejd$d%gd d gd&d'fdejd$d%d(gd d ejgd&d'fg¡d)d* Zej d+d,¡d-d. Zej d/e d d0¡ed1ejjd2d3gd4d5gd6g¡d7d8 Z ej ddddgddggd d
|
gdd gd d gd fdddgdejgddggd dd
|
gddd gd dd gd fg¡d9d: Z ejj ej d;e d<¡e d=¡fe d>¡e d?¡fe !d<¡e !d=¡fg¡ej d@ddAd gfddAd dBgfg¡dCdD Z"ej dEej#dd d d ejgdFdFdGdHgdIdJd dKd d gid d ejgdLdMej#dd d d ejgdFdFdGdHgdIdJd dKd giddNdMej#dd d d dOgdFdFdGdHgdIdJd dKd d giddPdMej#dd d d dOgdFdFdGdHgdIdJd dKd d giddQdMg¡dRdS Z$ej dTdd gd d gg¡ej dUd gd d gg¡ej dVddg¡dWdX Z%dYdZ Z&d[d\ Z'ej d]e(d^¡ej d_dd`dadbdcdddedfdgdhdgdidjdkej#dlejj)edmdndodpdqdrg¡ej dsddg¡dtdu Z*ej dsddg¡ej d_e+dg¡dvdw Z,ej dxdydzd{g¡d|d} Z-d~d Z.ej dddg¡dd Z/d
d Z0dd Z1dS )é N)Úpa_version_under7p0)Úna_value_for_dtype)Úget_groupby_method_argszdropna, tuples, outputsTÚAÚBg *@ç
ëQ¸Î^@g À^@ç ð?©ÚcÚdÚeFç(@ç m@g (@c C s® dddddgd|dddgdddddgddddd gg}t j|d
|
d d d dgd}|jd
|
d g| d ¡ }t jj|tdd}| s|jddtj gd d}t j||d}t
|
||¡ d S )Nr r é r r r é{ é r ÚaÚbr
|
r r ©Úcolumns©ÚdropnaÚab©Únames©Úlevel©Úindex© ÚpdÚ DataFrameÚgroupbyÚsumÚ
|
MultiIndexÚ from_tuplesÚlistÚ
|
set_levelsÚnpÚnanÚtmÚassert_frame_equal) r ÚtuplesÚoutputsÚ nulls_fixtureÚdf_listÚdfÚgroupedÚmiÚexpected© r4 ú_d:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/groupby/test_groupby_dropna.pyÚ:test_groupby_dropna_multi_index_dataframe_nan_in_one_group s ür6 g*@g @m@c
|
C s dddddgd|dddgdddddg|dddd gd|ddd gg}t j|d
|
d d d dgd}|jd
|
d g| d ¡ }t jj|tdd}| s¤| ddtj gddtj gg¡}t j||d} t
|
|| ¡ d S )Nr r r r r r r r r r r r
|
r r r r r r r r )
|
r r, r- r. Únulls_fixture2r/ r0 r1 r2 r3 r4 r4 r5 Ú;test_groupby_dropna_multi_index_dataframe_nan_in_two_groups8 s û r8 zdropna, idx, outputs)r r
|
r c C s~ ddddgd dddgddddgdddd gg}t j|d
|
d d d gd}|jd
|
| d ¡ }t j|t j|dd
|
dd}t ||¡ d S )Nr r r r r r r r r r r r
|
r r r Úobject©ÚdtypeÚnamer )r r! r" r# ÚIndexr* r+ )r Úidxr- r/ r0 r1 r3 r4 r4 r5 Ú*test_groupby_dropna_normal_index_dataframed s
|
|
|
|
ür? zdropna, idx, expectedr r é r c C s8 t jddddg|d}|jd| d ¡ }t ||¡ d S )Nr é r@ r r )r r )r ÚSeriesr" r# r* Úassert_series_equal)r r> r3 ÚserÚresultr4 r4 r5 Ú test_groupby_dropna_series_level s rF zdropna, expectedg @j@ç àu@ú Max Speed©r r< ç 4@c C sL t jddddgddddgdd}|jd d
|
d tjg| d ¡ }t ||¡ d S ) Ng `x@rG g >@rJ ZFalconZParrotrH rI r r r )r rB r" r( r) Zmeanr* rC )r r3 rD rE r4 r4 r5 Ú test_groupby_dropna_series_by s
|
|
ý rK r )FTc C sB t dddd gdddd gd¡}|jd| d}|jj| ks>td S )Nr r rA r@ ©r r r r )r r! r" Zgrouperr ÚAssertionError)r r0 Úgbr4 r4 r5 Ú test_grouper_dropna_propagationª s rO r é Zabcd)r rA )ÚRr ÚnumÚcolr c C sÌ dddd| rt jndgi}tjdddd gdddd gd|d}|jd| d }| t¡}tj||d}t ||¡ |dg t¡}tj||d}t ||¡ |d t¡}tj |d |dd
|
}t
|
||¡ d S ) Nr rA r r r@ rL r r r rI ) r( r) r r! r" Ú transformÚlenr* r+ rB rC )r r Z expected_datar0 rN rE r3 r4 r4 r5 Ú+test_groupby_dataframe_slice_then_transform² s
|
$
|
rV c C s¼ dddddgdd dddgdddddgddddd gg}t j|d
|
d d d dgd}ttdd}|jd
|
d g| d |¡}t jj|tdd}| s|j ddt
|
j gd d}t j||d}t ||¡ d S )Nr r r r r r r r r r r r
|
r r r Úminr r r r r r )r r! r# Úmaxr" Úaggr$ r% r& r' r( r) r* r+ ) r r, r- r/ r0 Zagg_dictr1 r2 r3 r4 r4 r5 Ú-test_groupby_dropna_multi_index_dataframe_aggÎ s ü rZ zdatetime1, datetime2z
|
2020-01-01z
|
2020-02-01z-2 daysz-1 dayszdropna, valuesr é c
|
C s t ddddddg||||||gd¡}| r6||g}n ||tjg}|jd| d d
|
ti¡}t jd
|
|it j|dd d } t || ¡ d S ) Nr rA r@ rP é r[ )ÚvaluesÚdtr^ r r] ©r< r )
|
r r! r( r) r" rY r# r= r* r+ )
|
r r] Z datetime1Z datetime2Zunique_nulls_fixtureZunique_nulls_fixture2r0 Zindexesr1 r3 r4 r4 r5 Ú&test_groupby_dropna_datetime_like_dataø s" úþÿ
|
r` z#dropna, data, selected_data, levelsé
|
é é )Úgroupsr] r] r Zdropna_false_has_nan)ÚidZdropna_true_has_nanr
|
Zdropna_false_no_nanZdropna_true_no_nanc
|
C s t |¡}|jd| d}| dd ¡}tt|d |d }t jj|dd gd}| sf|rf|j|dd}t j||d} t
|
|| ¡ d S ) Nrd r c S s t dtt| i¡S )Nr] )r r! ÚrangerU )Úgrpr4 r4 r5 Ú<lambda>G ó z@test_groupby_apply_with_dropna_for_multi_index.<locals>.<lambda>r] r r r ) r r! r" ÚapplyÚtupleÚzipr$ r% r' r* r+ )
|
r ÚdataZ selected_dataÚlevelsr0 rN rE Z mi_tuplesr2 r3 r4 r4 r5 Ú.test_groupby_apply_with_dropna_for_multi_index s &
|
ro Ú input_indexÚkeysÚseriesc C s t dtjgddgddgd¡}| |¡}|r8|d }n | ddgkrX|dgkrX|dg }| d k rj| | ¡}|j|dd }|r|d }| ¡ }t ||¡ d S )
|
Nr rA r@ )r r r
|
r
|
r r Fr ) r r! r( r) Ú set_indexr" r# r* Ú assert_equal)rp rq rr Úobjr3 rN rE r4 r4 r5 Ú)test_groupby_dropna_with_multiindex_inputT s$ ýÿ
|
|
|
|
rv c C sæ dt jddt jgdddddgd} t | ¡}|jd d
|
d }|j}t j}dt jddg|d dt jdg|d t jt jddg|d i}t| ¡ | ¡ D ]\}}t
|
||¡ qt t | ¡ d ¡sÂtt | ¡ dd
ddgksâtd S ) NZg1Zg2r r rA r@ rP )Úgroupr rw Fr ©r; )r( r) r r! r" ÚindicesZintpÚarrayrl r] r* Zassert_numpy_array_equalÚisnanr& rq rM )rm r0 r1 rE r; r3 Z result_valuesZexpected_valuesr4 r4 r5 Útest_groupby_nan_includedr s "
|
ýr| c C sV t jtjddggdddgd} | ddg¡} | jddgdd ¡ }| }t ||¡ d S ) Nr r r r r
|
r Fr ) r r! r( r) rs r" Úfirstr* r+ )r0 rE r3 r4 r4 r5 Ú&test_groupby_drop_nan_with_multi_index s
|
r~ Úsequence_indexéQ r; ZUInt8ZInt8ZUInt16ZInt16ZUInt32ZInt32ZUInt64ZInt64ZFloat32ZFloat64ÚcategoryÚstringústring[pyarrow]zpyarrow is not installed©Úreason)Zmarksúdatetime64[ns]ú period[d]z Sparse[float]Ú test_seriesc sÔ d fddtdD ¡}|dkr4ddtjdn&|d krLd
|
d tjdnd d tjdt tjfdd|D |ddd d dgd¡}|jddd|d}|r¨|d }| ¡ }i }t
|
|D ] \} }
|
| |
|
d¡| ||
|
< q¼|dkr tj fdd|D |d j jdd} n^t|trL| d¡rLtjtjfdd|D |ddd} n tjfd d|D |dd } tj| ¡ | dd d } |s| ¡ } |sÄ| ¡ } |d k rÄ| d¡rÄ| d |¡| d< t || ¡ d S ) NÚ c s( g | ] }d ddd d| d qS )ÚxÚyÚz)r r rA r@ r4 )Ú.0Úk)r r4 r5 Ú
|
<listcomp>² s z(test_no_sort_keep_na.<locals>.<listcomp>rP )r r r r )r r r )r r z
|
2016-01-01z
|
2017-01-01r rA c s g | ] } | qS r4 r4 ©r Úlabel©Úuniquesr4 r5 r ¿ s rx r r@ )Úkeyr r F)r ÚsortÚas_indexr r c s g | ] } | qS r4 r4 ©r r r r4 r5 r Ï s r_ ZSparsec s g | ] } | qS r4 r4 r r r4 r5 r Õ s c s g | ] } | qS r4 r4 r r r4 r5 r Ø s r: )r r< r; )Újoinrf r ZNAr( r) r! rB r" r# Ú enumerateÚgetZCategoricalIndexÚcatÚ
|
categoriesÚ
|
isinstanceÚstrÚ
|
startswithr= rz r] Zto_frameÚ reset_indexÚastyper* rt ) r r; r r Úsequencer0 rN rE Zsummedr> r r r3 r4 )r r r5 Útest_no_sort_keep_na sP #ÿ
|
þÿ
|
|
ý ÿ r£ c C s t dddgi¡}t j||g|d}|r0|d n|}|j|d| d}| ¡ } t t|jg¡}
|
t jddgi|
|
d} |rt | | d ¡ n t
|
| | ¡ d S ) Nr r rA rx F)r r r@ r ) r r! rB r" r# r= r r; r* rC r+ ) r r; r. r7 r r0 rd ru rN rE r r3 r4 r4 r5 Útest_null_is_null_for_dtypeä s r¤ Ú
|
index_kindrf ÚsingleÚmultic C s¾ |dkr.|s.|dkr.d}| j tjj|d¡ t tjjddd gddd ¡}t
|
t j |ddd gd
|
t d d ¡}| ¡ } t j |ddd d gd
|
d ¡| d< |dkr¨dg}
|
n`|dkrÌdg}
|
| d¡}| d¡} n<ddg}
|
|d |d< | ddg¡}| d | d< | ddg¡} t||} t|| } |dkrT|dkrT| d j|
|
df} | d j|
|
df} | j|
|
||dd} t| || ¡ }|d d d ¡|d< |dkrª|d d d ¡|d< |rÖ|dkrÊ| ddg¡}n
|
| d¡}n6|dkr |dkr |jdd}|dkr |jdd}|dkr^|dkr^|d j ¡ }|dkrHdd |D }nd d |D }||d< |dkr|jddid}|r|d d ¡}|j|
|
d |||d }t||| }t ||¡ d S ) N)ÚidxminÚidxmaxr§ z@GH#10694 - idxmin/max broken for categorical with observed=Falser r rA é ©Úsizer@ ©r rb ©r r rP r rf r¦ Zx2Zcorrwithr r T)Úobservedr r r¬ )r© r¨ r c S s g | ]}|d krt jn|qS )rP ©r( r) r r4 r4 r5 r 5 s z-test_categorical_reducers.<locals>.<listcomp>c S s$ g | ] }|d kr t jt jfn|qS ))rP rP r° r r4 r4 r5 r 7 s F©r r¯ r r )ÚnodeÚ
|
add_markerÚpytestÚmarkÚxfailr( ÚappendÚrandomÚchoicer r! Ú Categoricalrf ÚcopyÚfillnars r Zdropr" Úgetattrr Úreplacer] ÚtolistÚrenamer* rt )ÚrequestZreduction_funcr¯ r r r¥ Úmsgr] r0 Z df_filledrq ÚargsZ args_filledZ gb_filledr3 Ú gb_keepnarE r4 r4 r5 Útest_categorical_reducers÷ s| ÿþý ÿ
|
|
|
|
|
|
|
|
ÿrÅ c C s |dkr$d}| j tjj|dd¡ t tjjddd gddd ¡}t
|
t j |ddd gd
|
t d d ¡}t ||}||d ¡ d } |dkrtt t| }
|
nx|dkr|rÜ|rÆ|d jddd } qø|d jddd } n |jd | jd
d ¡ } t| | g }
|
nt| || }
|
t
|
d|
|
i¡} |jd d|||d} |jd d||d}t| || }t||| }t||d ¡ j ¡ | jD ]0\}}|jdkr¤||j|< n||j|df< q|dkrâ||d ¡ | | ¡@ d7 < |dkrö| d¡}t ||¡ d S )Nr¼ zBGH#49651 fillna may incorrectly reorders results when dropna=FalseF)r
Ústrictr rA rª r« r@ r rb r® r r ZcumcountZngroupr r r± T)r r¯ r )ZrankZdiffZ
|
pct_changeÚshiftÚint64) r² r³ r´ rµ r¶ r( r· r¸ r¹ r r! rº rf r Zisnullr& rU ZnuniqueÚilocr r½ r" rl r¿ r] ÚndimZnotnullÚger¡ r* rt )rÁ Ztransformation_funcr¯ r r r r] r0 rà Znull_group_valuesZnull_group_dataZna_groupZnull_group_resultrÄ Z gb_dropnarE r3 rÉ Úvaluer4 r4 r5 Ú test_categorical_transformersH sT ÿ
|
|
ÿ ÿ
|
"
|
|
rÍ ÚmethodÚheadÚtailc
|
C sè t j ddd gd¡}t tj|dddgdtt|d¡}|jdd|||d }t || }| d
|
krr|d d d
}|dk|dk
|
¡ d k@ |dk|dk
|
¡ d k@ B |d k|d k
|
¡ d k@ B }| d
|
krÐ|d d d
}|| } t || ¡ d S ) Nr rA rc r@ r r® r Fr± rÐ éÿÿÿÿr\ ) r( r¸ r¹ r r! rº rf rU r" r½ Zcumsumr* r+ )
|
rÎ r¯ r r r] r0 rN rE Úmaskr3 r4 r4 r5 Útest_categorical_head_tail} s$ ÿ ÿýÿrÓ c C sp t j ddd gd¡} t tj| dddgdtt| d¡}|jddd }| d
|
d ¡}|
|
¡ }t ||¡ d S ) Nr rA rc r@ r r® r Fr c S s | ¡ S ©N©r# ©r r4 r4 r5 rh ri z&test_categorical_agg.<locals>.<lambda>) r( r¸ r¹ r r! rº rf rU r" rY r# r* r+ ©r] r0 rN rE r3 r4 r4 r5 Útest_categorical_agg s ÿrØ c C sr t j ddd gd¡} t tj| dddgdtt| d¡}|jddd }| d
|
d ¡}| d ¡}t
|
||¡ d S ) Nr rA rc r@ r r® r Fr c S s | ¡ S rÔ rÕ rÖ r4 r4 r5 rh ª ri z,test_categorical_transform.<locals>.<lambda>r# ) r( r¸ r¹ r r! rº rf rU r" rT r* r+ r× r4 r4 r5 Útest_categorical_transform£ s ÿ
|
rÙ )2Únumpyr( r´ Zpandas.compat.pyarrowr Zpandas.core.dtypes.missingr Zpandasr Zpandas._testingZ_testingr* Zpandas.tests.groupbyr rµ Z parametrizer) r6 r8 r? rB rF rK rO Z
|
RangeIndexr& r$ Z from_productrV rZ Zarm_slowÚ TimestampZ TimedeltaZPeriodr` Úparamro rv r| r~ rf Zskipifr£ r9 r¤ rÅ rÍ rÓ rØ rÙ r4 r4 r4 r5 Ú<module> st ýýýúþ
|
ý
|
|
|
ýýúþ
|
|
ýýþþ
|
$ ýþþ
|
þþþ
|
|
|
|
ýþ
|
ýýýúþ
|
ýþ"
|
û ûúúéþ#
|
|
ÿþéþ 8
|
P5
|
|
