U
|
ý°d0 ã @ sø d Z ddlmZ ddlZddlZddlmZmZm Z m
|
Z
|
m Z m Z m Z mZmZ ddlmZ dd Zdd Zg Zg Zd D ]Zed
|
d D ]\ZZeeeeZde de d ed ¡ d d¡fZ ddddgfZ ee e D ]6\Z Z e !ee e eef¡ e !e de de ¡ qÒqqtej"j#ej"j$deedej" $dddg¡ej" $dddg¡ej" $dddg¡ej" $d ddg¡ej" $d ddg¡d d Z%ej" $d ddg¡d!d" Z&ej" $d#d$d%gd$d%d&gg¡d'd( Z'ej" $d#d$d%gd$d%d&gg¡d)d* Z(d+d, Z)d-d. Z*ej+d/d0 Z,d1d2 Z-d3d4 Z.d5d6 Z/d7d8 Z0ej" $d9d:d;d<g¡ej" $dddg¡ej" $d=d>d?d g¡ej" $d@ddg¡ej" $dAddg¡dBdC Z1ej" $dDddg¡ej" $dEddddddFdGgdddddgddFddFdgfdddGdFdddgdddddgddFdFddgfdddGddFddgdddddgddFdFddgfg¡dHdI Z2ej+dJdK Z3ej" $dLddddMdddgdNdOdPgfddddMdddgdNdQdPgfddddMdddgdNdRdSgfddddTdUdVdVgdNdRdSgfg¡dWdX Z4ej+dYdZ Z5ej" $d[dddddFd d\d]d^ddGg dUdUd_dVdVdVdVd_d_g fdddddFd ddGgdUdUd_d_d_d_gfddddd d\d]d^gdUdUdVdVdVdVgfddddd gdUdUd_gfg¡d`da Z6ej+dbdc Z7ej" $dddddge j8dedfdggdhdidjgdkfdddddge e dge dldmdnge dodpej9ggddddgddddgddddggdhdidjgdqfg¡ej" $dddg¡drds Z:ej" $d@ddg¡ej" $dtddg¡ej" $duddMej;ddddddddddddg ej<dvfddTe ;dUdVdVdwdwdwdUdUdwdwdwdwg ¡fg¡dxdy Z=dzd{ Z>ej" $d@ddg¡ej" $duddMej;ddddddddddddg ej<dvfddTe ;dUdVdVdwdwdwdUdUdwdwdwdwg ¡fg¡d|d} Z?ej" $d@ddg¡ej" $duddMej;ddddddddddddddddddgej<dvfddTe ;dUdVdVdwdwdwdUdUdwdwdwdwdwdwdwdwdwdwg¡fg¡d~d Z@ej" $d@ddg¡ej" $ddddddd
dddddddg fdddd
ddgfg¡ej" $duddMej;ddddddddddddg ej<dvfddTe ;d_dwd_dwd_dwd_dwd_dwdwdwg ¡fg¡dd ZAej" $d@ddg¡ej" $dtddg¡ej" $duddMej;ddddddddddddg ej<dvfddTe ;dUdVdVdwdwdwdUdUdwdwdwdwg ¡fg¡dd ZBej" $dddMdddgfddTdUdUd_gfg¡dd ZCej" $ddeDdddddddgfdeDddg ddddddgfg¡ej" $d@ddg¡dd ZEej" $d¡ddg¡d¢d£ ZFd¤d¥ ZGd¦d§ ZHd¨d© ZIdªd« ZJd¬d ZKej" $d ddg¡d®d¯ ZLdS )°z
|
these are systematically testing all of the args to value_counts
|
with different size combinations. This is to ensure stability of the sorting
|
and proper parameter handling
|
é )ÚproductN) Ú CategoricalÚCategoricalIndexÚ DataFrameÚGrouperÚIndexÚ
|
MultiIndexÚSeriesÚ
|
date_rangeÚ to_datetimec C s t dgdgd} | d d¡| d< | d¡d ¡ }t ddggddgd}|d d¡|d< t |¡}tdg|d d
|
}t ||¡ d S ) NÚfemaleÚUS)ÚgenderÚcountryr Úcategoryr ©Úcolumnsé Úcount©ÚindexÚname) r ÚastypeÚgroupbyÚ value_countsr Ú
|
from_framer ÚtmÚassert_series_equal)ÚdfÚresultZdf_mi_expectedZ mi_expectedÚexpected© r! ú]d:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/groupby/test_value_counts.pyÚ.tests_value_counts_index_names_category_column s þÿ
|
r# c C sØ t j d¡ tddd}tt j td|¡t j ||¡t j d|d |¡d}| rÔ|d d ¡|d< t j |j
|
dd d
|
d f< t j |j
|
d d d
df< t j |j
|
dd d
df< t j |j
|
dd d
df< t j |j
|
dd d
df< |S )NiÒ z
|
2015-08-24é
|
)ZperiodsÚabcdr )Ú1stÚ2ndÚ3rdr( Úfloaté r& é é r' é é é é ) ÚnpÚrandomÚseedr
|
r ÚchoiceÚlistÚrandintr ÚnanÚloc)Ú seed_nansÚnÚmÚdaysÚframer! r! r" Úseed_df/ s ýÿr> )TF)éd iè )é é r@ r( r é r& r' ú-zdf, keys, bins, n, m)ÚidsÚisortTFznormalize, name)TÚ
|
proportion)Fr ÚsortÚ ascendingÚdropnac C s¦ dd } ||| |
|
|d} | j ||d} | d jf | }| j ||d} | d jtjf| }|jjd d
dg |j_| |¡}t| ||f\}}t |
|
¡ |
|
¡ ¡ d S )Nc S s2 t t| jjt| jj}tj|| jjd| _| S )N©Únames) r5 Úmapr Zget_level_valuesÚrangeZnlevelsr Ú from_arraysrK )r Zarrr! r! r" Ú rebuild_index^ s z7test_series_groupby_value_counts.<locals>.rebuild_index)Ú normalizerG rH rI Úbins©rG r( éÿÿÿÿ) r r Úapplyr r rK ÚrenamerL r r Ú
|
sort_index)r ÚkeysrQ r: r; rE rP r rG rH rI rO ÚkwargsZgrÚleftÚrightr! r! r" Ú test_series_groupby_value_countsT s
|
û
|
r[ Úutcc C s¤ t dddddddgddd d d
|
d
|
d gd d g¡}t|d | dd|d< | tddd¡}|d ¡ ¡ }|d tj¡ ¡ }|j j
|
|j _
|
| d¡}t ||¡ d S )Né©GI]é)J]éJ]é©êK]é)<M]éU=M]é©N]ÚappleÚbananaÚorangeÚpear©Ú TimestampÚFoodr+ ri Ús©r\ ÚunitÚDatetimeÚ1D©ÚfreqÚkeyrj r )r Údropr r r r rV rT r r rK rU r r )r\ r Údfgr r r! r! r" Ú-test_series_groupby_value_counts_with_groupery s* ù öÿ ó
|
ru r ÚAÚBÚCc C sf t | d}| | d d
¡}|| d ¡ }tg |jdd}tjg gt| | d|_t
|
||¡ d S )Nr rS r )Údtyper rJ ) r r r r ry r rN Úlenr r r ©r r rt r r r! r! r" Ú&test_series_groupby_value_counts_empty s
|
r| c C sP t tt| g| d}| | d d
¡}|| d ¡ }| ¡ }t ||¡ d S )N)Údatar rS )r rM rz r r r r r{ r! r! r" Ú(test_series_groupby_value_counts_one_row¥ s
|
r~ c C sp t tdgddgd} | dg¡ ¡ }t ddgt t ddg¡tddgddgdddg¡d d
|
}t
|
||¡ d S ) NÚaÚb)Ú
|
categoriesr r Fr )r Zorderedry r ©r} r r ) r r r r r rN r1 Úarrayr r r )rk r r r! r! r" Ú/test_series_groupby_value_counts_on_categorical± s" ÿþÿör c C sÊ t ddddddgddddddgddddddgd} | jd d
|
gd d d }|jd d }tddgddgdddggdddddgdddddgdddddggd d
|
d gd}tdddddg|dd}t ||¡ d S )NÚmaler ÚlowÚmediumÚhighr ÚFR©r Ú educationr r r FrR r r r rB ©ÚlevelsÚcodesrK r r )r r r r r r r )r Úgbr r r r! r! r" Ú(test_series_groupby_value_counts_no_sortÌ s ýÿ &ýr c C s4 t ddddddgddddddgddddddgdS ) Nr
r r r r r r r ©r r! r! r! r" Ú education_dfà s ýÿr c C s4 | j ddd}tjtdd | ¡ W 5 Q R X d S )Nr r ©Úaxisr ©Úmatch)r ÚpytestÚraisesÚNotImplementedErrorr ©r Úgpr! r! r" Ú test_axisë s r c C s6 | d¡}tjtdd |jdgd W 5 Q R X d S )Nr Úsubsetr ©r )r r r Ú
|
ValueErrorr r r! r! r" Útest_bad_subsetñ s
|
r c C s\ | d¡ddg jdd}tdddddgtjdd d
|
d d gdddgd dd}t ||¡ d S )Nr r r T©rP ç à?ç Ð?©r r
r ©r r r ©r r
r ©r r r ©r r
r rJ rF r )r r r r Ú from_tuplesr r )r r r r! r! r" Ú
|
test_basic÷ s" ÿ ûø
|
ôrª c C s | | j |||dS )N©rP rG rH )r )r rW rP rG rH r! r! r" Ú_frame_value_counts s r¬ r Úcolumnr Úfunctionzsort, ascending)FN)TTÚas_indexr= c s d d j fddd| } j||d} | ddg j|||d}
|
|r| tddg|||¡} |rrt |
|
| ¡ n|rzd nd
|
}| ¡ jd |id d } |dkrÆ| jddid d } t
|
| d dd¡| d< n0|dkrà| d d k| d< nt
|
| d dd¡| d< t |
|
| ¡ n d d d d< | d j|||d} || _ |r¶| j jdd} | d j d¡j d ¡| d< | d j d¡j d ¡| d< | d= | jd d id d } t | ¡| _ t |
|
| ¡ nV| d d| d j d¡j d ¡¡ | dd| d j d¡j d ¡¡ | d= t |
|
| ¡ d S )Nr c s d | dkS )Nr r r! )Úx©r r! r" Ú<lambda>+ ó z6test_against_frame_and_seriesgroupby.<locals>.<lambda>)r r r® )Úbyr¯ r r r« rF r r r r r Úlevel_0r r r® rC ZbothF©r rB )Úvaluesr r rT r¬ r r Ú reset_indexrU r1 ÚwhereÚassert_frame_equalr r Zto_frameÚstrÚsplitÚgetr r Úinsert) r r rP r rG rH r¯ r= r´ r r r Z index_framer! r± r" Ú$test_against_frame_and_seriesgroupby sd
|
ýü ÿ ÿ ÿ ""r¿ rP zCsort, ascending, expected_rows, expected_count, expected_group_sizer+ é c
|
s j ddgddd}|d j|||d}t } dD ] fdd |D | < q2|rn|| d
|
< | d
|
| < n|| d < t || ¡ d S ) Nr r F)r¯ rG r r« )r r r c s g | ]} | qS r! r! ©Ú.0Úrow©r r r! r" Ú
|
<listcomp>t s z!test_compound.<locals>.<listcomp>rF r )r r r r rº )
|
r rP rG rH Ú expected_rowsZexpected_countZexpected_group_sizer r r r! rÄ r" Ú test_compound[ s ÿrÇ c C s4 t ddddgddddgddddgdddd d
|
gd S ) Nr rB rÀ é r )rr Únum_legsÚ num_wingsZfalconZdogÚcatZantr¶ r r! r! r! r" Ú
|
animals_df} s "
|
þrÌ z?sort, ascending, normalize, name, expected_data, expected_indexr )r r r )rB rÀ rÈ )rB r r )rB rÈ rÀ )rÀ rB rÈ )r rB r rF r¢ r£ c
|
C s` | j |||d}t|tj|dddgd|d}t ||¡ | d¡j |||d} t | |¡ d S )N)rG rH rP rr rÉ rÊ rJ r )r r r rN r r r )
|
rÌ rG rH rP r Ú expected_dataÚexpected_indexÚ result_framer Úresult_frame_groupbyr! r! r" Ú test_data_frame_value_counts
s( ÿ ÿû
|
ÿrÑ c C s` t j} tdd| d| ddddg ddd| | ddddg dddddd| d| g ddddddd| | g d S )
|
Nr rÀ rÈ r+ rB r@ r/ r- )rv rw rx ÚD)r1 r7 r )r: r! r! r" Únulls_df s üÿrÓ z:group_dropna, count_dropna, expected_rows, expected_valuesr- rÈ r/ g ð?c
|
st j ddg|d}|jdd|d}t }jD ] fdd|D | < q.t |¡}t||dd } t || ¡ d S )
|
Nrv rw )rI T)rP rG rI c s g | ]} | qS r! r! rÁ ©r rÓ r! r" rÅ Ï s z,test_dropna_combinations.<locals>.<listcomp>rF r ) r r r r r r r r r )
|
rÓ Z group_dropnaZ count_dropnarÆ Úexpected_valuesr r r r r r! rÔ r" Útest_dropna_combinationsº s
|
|
rÖ c C s( t ddddgddddgd| | dgdS )Nr ÚJohnÚAnneÚBethÚSmithÚLouise)rr Ú
|
first_nameÚ middle_namer )Z nulls_fixturer! r! r" Únames_with_nulls_dfÕ s
|
|
|
ýÿrÞ z%dropna, expected_data, expected_index©r r )rÙ r× )rÛ rÚ rr rÜ rÝ rJ rØ rÙ r× rÛ rÚ r c C s` | j ||d}t|||d}|r0|tt| }t ||¡ | d¡j ||d}t ||¡ d S )N)rI rP r rr )r r r) rz r r r ) rÞ rI rP r rÍ rÎ rÏ r rÐ r! r! r" Ú#test_data_frame_value_counts_dropnaà s !ý
|
ÿrà Úobservedz normalize, name, expected_data©ry ç c C s¾ | d¡jd||d}|j|d}tjddddd d
|
d d d dddg dddgd}t|||d} tdD ]"}
|
| jjt | jj
|
|
|
|
|
d| _qd|rt || ¡ n | j |r¦dndd} t || ¡ d S )Nr r ©r¯ rá r¡ r¤ r¥ r¦ ©r r r ©r r r ©r r
r r§ r¨ ©r r r ©r r r ©r r
r ©r r
r r r rJ r r+ ©ÚlevelrF r ©r )r r r r r© r rM r Ú
|
set_levelsr r r r r¸ rº © r r¯ rá rP r rÍ r r rÎ Úexpected_seriesÚir r! r! r" Ú=test_categorical_single_grouper_with_only_observed_categories sL
|
ÿ ôñý ÿ
|
|
ÿró c C sÖ | ¡ d¡} | d j dg¡| d< | jd||d}|j|d}t|tj|dddgd|d } t d
|
D ]@}
|
t
|
| j j |
|
} |
|
d kr| | d jj¡} | j j| |
|
d | _ qf|rºt || ¡ n| j|d } t || ¡ d S )Nr r ÚASIArä r¡ r r rJ r r+ r rì rî )Úcopyr rË Zadd_categoriesr r r r r© rM r r r Zset_categoriesr rï r r r¸ rº ) r r¯ rá rÎ rP r rÍ r r rñ rò Z index_levelr r! r! r" Ú!assert_categorical_single_grouperT s. þú
|
ÿ rö c C s6 ddddddddd d
|
d d g }t | |d ||||d d S )Nr¤ r¥ r¦ rå ræ rç r§ r¨ rè ré rê rë T©r r¯ rá rÎ rP r rÍ ©rö ©r r¯ rP r rÍ rÎ r! r! r" Ú-test_categorical_single_grouper_observed_truew s, ôùrú c C sB ddddddddd d
|
d d d dddddg}t | |d||||d d S )Nr¤ r¥ r¦ rå rç ræ r§ r¨ rë rê ré rè )rô r
r )rô r
r )rô r r )rô r r )rô r r )rô r
r Fr÷ rø rù r! r! r" Ú.test_categorical_single_grouper_observed_false¦ s8 -îùrû zobserved, expected_index)r r r )r r r
)r r r
)r r r )r r r
)r r r )r r r )r r r
)r r r
)r r r )r r r )r r r
c C sÜ | ¡ } | d d¡| d< | d d¡| d< | jddg||d}|j|d}t|r^||dk n|tj|dddgd|d } td
|
D ]"}
|
| jj t
|
| jj |
|
|
|
d | _q|r¸t || ¡ n | j|rÄd nd d} t || ¡ d S )Nr r r rä r¡ rã r rJ r rB rì rF r rî ©rõ r r r r r r© rM r rï r r r r r¸ rº ) r r¯ rá rÎ rP r rÍ r r rñ rò r r! r! r" Ú"test_categorical_multiple_groupersò s8 7 ÿ þú ÿ
|
|
ÿrý c C sæ | ¡ } | d d¡| d< | d d¡| d< | jd||d}|j|d}ddd d
|
d d d dddddg }t|tj|dddgd|d} tddD ]"}
|
| jj t
|
| jj |
|
|
|
d| _q|rÂt || ¡ n | j|rÎdndd} t || ¡ d S )Nr r r r rä r¡ r¤ r¥ r¦ rå ræ rç r§ r¨ rè ré rê rë rJ r r r+ rì rF r rî rü rð r! r! r" Ú test_categorical_non_groupersH sJ ôþú ÿ
|
|
ÿrþ z*normalize, expected_label, expected_valuesc C s t dddgdddgd}|jdddgddd gd
|
d }|jd | d }t dtjdddgtjdddddgddddgddddg||i}t ||¡ d S )Nr rB r+ )rv rw rÀ r@ rv c S s | dkr dS dS )Nr r- r/ r! )rò r! r! r" r² r³ z&test_mixed_groupings.<locals>.<lambda>F©r¯ T)rG rP rµ râ Zlevel_2r/ r- rw )r r r r1 r Úint_r rº )rP Úexpected_labelrÕ r r r r r! r! r" Útest_mixed_groupings s" ûÿ r z test, columns, expected_namesÚrepeatZabbder Údr Úerí r% Úlevel_1Úcc
|
C sÆ t dddddgdddd d
|
gg|d }d d g}dtjddgtjddg}|j||d ¡ }|rtdtj||ddd}t
|
||¡ n@dd |D }t |} d| d< | d¡ t || d }t ||¡ d S )Nr r+ r@ r- r0 rB rÀ rÈ r/ r$ r )r r r- r+ r@ r0 )rB r r/ rÀ rÈ r$ r r râ r rÿ rß rJ r r c S s g | ]}t |d g qS )r )r5 rÁ r! r! r" rÅ ¼ s z0test_column_label_duplicates.<locals>.<listcomp>r )r r1 r Úint64r r r r r© r r r5 Úappendrº )
|
Útestr Zexpected_namesr¯ r rÍ rW r r Zexpected_columnsr! r! r" Ú test_column_label_duplicates¢ s( $þú
|
r znormalize, expected_labelc C sZ t dddggdd|gdjddd}d | d
|
}tjt|d |j| d W 5 Q R X d S ) Nr rB r+ r r r Frÿ zColumn label 'z ' is duplicate of result columnr r¡ )r r r r r r )rP r r Úmsgr! r! r" Ú test_result_label_duplicatesÄ s ÿ r c C sf t dddgi} | tjddgtjd¡}| ¡ }tdgtjddggd dgddd}t
|
||¡ d S )Nr r râ rB rJ r r ) r r r1 r r r r r r© r r )r r r r r! r! r" Útest_ambiguous_groupingÕ s ÿr c C sZ t dddgdddgddddgd } d
|
}tjt|d | d ¡jd gd W 5 Q R X d S )Nr r r r° Úy©Úc1Úc2r r r¶ z;Keys {'c1'} in subset cannot be in the groupby column keys.r r r ©r r r r r r ©r r r! r! r" Ú"test_subset_overlaps_gb_key_raisesà s $r c C sZ t dddgdddgddddgd } d
|
}tjt|d | d ¡jd gd W 5 Q R X d S )Nr r r r° r r r r r¶ z4Keys {'c3'} in subset do not exist in the DataFrame.r r Úc3r r r r! r! r" Ú!test_subset_doesnt_exist_in_frameè s $r c C sv t dddgdddgddddgd } | jdd
|
jd gd }tdd gtjddgddggd d gddd}t ||¡ d S )Nr r r r° r r r r r¶ rì r r rB rJ r r ©r r r r r rN r r ©r r r r! r! r" Ú test_subsetð s $ ýr c C s t dddgdddgdddggdddgdddgd } | jdd
|
jdgd }tdd gtjddgddgddggd ddgd dd}t ||¡ d S )Nr r° r r r r r r )r r rì r rB rJ r r r r r! r! r" Ú test_subset_duplicate_columnsü s ý ÿûr c
|
C sä t dddddddgddd d d
|
d
|
d gd d g¡}t|d | dd|d< | tddd¡}| ¡ }tddddg| d}|d ¡ }t||dd d
|
d ggdddddd gtd dddddd ggddd gd }t d|d d }t
|
||¡ d S )!Nr] r^ r_ r` ra rb rc rd re rf rg rh r+ ri rk rl rn ro rp z
|
2019-08-06z
|
2019-08-07z
|
2019-08-09z
|
2019-08-10)r\ r r rB rÈ rj r r r ) r rs r r r r Úuniquer rM r r r )r\ r r r ÚdatesZ
|
timestampsr r r! r! r" Ú test_value_counts_time_grouper s: ù öÿ ó
|
ÿ $ýr )MÚ__doc__Ú itertoolsr Únumpyr1 r Zpandasr r r r r r r r
|
r Zpandas._testingZ_testingr r# r> ZbinnedrD r9 r: r; r ZarangeÚmaxrQ rW Úkr r ÚmarkZslowZ parametrizer[ ru r| r~ r r Zfixturer r r rª r¬ r¿ rÇ rÌ rÑ rÓ rÖ rÞ rN r7 rà r r ró rö rú rû rý rþ r r5 r r r r r r r r r! r! r! r" Ú<module> s , $
|
|
|
|
|
ýþ>***ýþ
|
úüþ
|
|
ü""÷þ
|
|
|
þý
|
ý ùý÷þ &ý ýúþ0#&ý ýúþ & ÿýîÿýøþ& %ôþûþîþ &ý üúþ%&ý üúþ0þþ
|
þþ þþ
|
|
|
