U
|
ý°d¢ ã @ sL d dl Z d dl mZ d dlZd dlmZ d dlZd dlZd dlm Z d dl
|
m m Z d dlZd dlmZmZmZmZmZmZ d dlmZmZ ejjZ dd Z d d
|
Z d d Z d d Z dd Z!dd Z"dd Z#dd Z$dd Z%dd Z&dd Z'ej (d d d d g¡d!d" Z)d#d$ Z*e j+d%d& Z,d'd( Z-d)d* Z.d+d, Z/d-d. Z0d/d0 Z1dS )1é N)Ú timedelta)Úcatch_warnings)Ú Timestamp)Ú DataFrameÚSeriesÚ_testingÚconcatÚ
|
date_rangeÚread_hdf)Ú _maybe_removeÚensure_clean_storec C sx t | d}tddL t ¡ }t|d | d|d d
¡ | d|dd
¡ t |d |¡ t|d |jd|d d
dd | d|dd
¡ t |d |¡ t|d | d |d d
¡ | d |dd
¡ t |d |¡ t|d
|
| d
|
|d d
¡ | d
|
|dd
¡ t |d |¡ td d gdd gd d gddggd}d|d< t j
|
|j d< t|d | d|¡ t |d |¡ tt t j jddddt jdt t j jddddt jdt t j jddddt jdt ddd d d gt jdd t d¡d }t|d! | d!|¡ tj|d! |dd" t|d! |jd!|d#d$d%gd& tj|d! |dd" W 5 Q R X W 5 Q R X d S )'NT©ÚrecordÚdf1é
|
Údf2Útable©ÚformatÚdf3z/df3z/df3 foozdf3 fooé é r )ÚdataZtestingÚ mixed_column)r r Údféÿ é )ÚhighÚsize©Údtypeiÿÿ i @l l @l l l )Úu08Úu16Úu32Zu64©ÚindexZuints©Zcheck_index_typer! r" r# ©Ú data_columns)r r ÚtmÚmakeTimeDataFramer ÚappendÚassert_frame_equalÚputr ÚnpÚnanÚlocr ÚrandomÚrandintZuint8Zuint16Zuint32Zuint64Úarange)Ú
|
setup_pathÚstorer Z uint_data© r6 ú[d:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/io/pytables/test_append.pyÚ test_append sf
|
|
|
|
"
|
ÿ ÿ ÿ þöð
|
|
r8 c C s¬ t | }t ¡ }t ¡ }tt d¡}| d|¡ |d }t ||¡ |j d ksXt
|
| d|¡ |d }t ||¡ |j d kst
|
d|_ | d|¡ |d }t ||¡ |j |j ks¼t
|
||dk }| dd¡}t ||¡ ||dk|j d k @ }| dd
|
¡}tj||d d t tj d d¡dgd}t t|¡|d< d|d< d|jdd
df< |jddgd d | ¡ }|j d¡|_ | d|¡ tj|d |d d W 5 Q R X d S )Néd ÚssÚtsÚfooÚnsé< zfoo>60éF éZ zfoo>70 and index<90Tr& r r ÚA©ÚcolumnsÚBÚCÚbaré ©Zinplacer Úmi)r r) ZmakeStringSeriesZmakeTimeSeriesr r. r3 r+ Úassert_series_equalÚnameÚAssertionErrorÚselectr% r r1 ÚrandnÚlenr0 Ú set_indexÚstackZ droplevel) r4 r5 r: r; r= ÚresultÚexpectedrI Úsr6 r6 r7 Útest_append_series_ s@ rU c C sÚ t | Æ}tttj d¡ d¡tj d¡tj d¡ddtdt dddd d ¡d
|
t d¡d }t
|
|d tj |j d d
ddddgf< | d |d d
¡ | d |dd
¡ tj|d |dd | ¡ }tj |d< t
|
|d | d |d d
¡ | d |dd
¡ tj|d |dd | ¡ }tj |d< t
|
|d | d|d d
¡ | d|dd
¡ tj|d |dd | ¡ }tj |d< t
|
|d | d|d d
¡ | d|dd
¡ tj|d |dd W 5 Q R X d S )Né Úint32r< rF Ú20010101éÑ r r r )rA ÚA1ÚA2rD rE ÚDÚEr$ r é rZ rD r\ r] r Tr& r[ r r )r r r r. r1 rN Úastyper Údatetimer3 r r/ r0 r+ r) r, Úcopy)r4 r5 r r r r r6 r6 r7 Útest_append_some_nans sF
|
|
ù ö
|
|
|
|
|
|
|
rb c C s t | ~}ttj d¡tj d¡dt d¡d}tj|jdd
d d
f< t|d |j d|d d
dd |j d|dd
dd t
|
j |d |d
|
d
dd t|d |j d |d d
d d |j d |dd
d d t
|
j |d |dd t dd ¡H t|d | d|d d
¡ | d|dd
¡ t
|
|d |¡ W 5 Q R X t dd¡& t|d | d|d d
¡ | d|dd
¡ t
|
|d |d
|
d
¡ ttj d¡tj d¡dddt d¡d}tj|jdd
d d
f< t|d |j d|d d
dd |j d|dd
dd t
|
j |d |dd t|d |j d |d d
d d |j d |dd
d d t
|
j |d |dd ttj d¡tj d¡ddtdt ddddd¡dt d¡d}tj|jdd
d d
f< t|d |j d|d d
dd |j d|dd
dd t
|
j |d |dd t|d |j d |d d
d d |j d |dd
d d t
|
j |d |dd W 5 Q R X W 5 Q R X d S )NrV )rZ r[ r$ r r^ r r T)Údropnaéüÿÿÿr& r Fúio.hdf.dropna_tabler Zdf4r< rF )rZ r[ rD rE rX rY r r )rZ r[ rD rE r\ r] )r r r. r1 rN r3 r/ r0 r r+ r) r, ÚpdÚoption_contextr r` ©r4 r5 r r6 r6 r7 Útest_append_all_nansº sx þ
|
|
|
|
|
|
üù
|
|
|
|
|
ú÷
|
|
ri c
|
C s t | }t ¡ }|j d ¡|_t|d |jd|jd d
d d
f dgd | d|jd d
dd
f ¡ t |d |¡ | dd¡}|j
|
dgd}t ||¡ | dd¡}|j
|
dg|jd d
|
d }t ||¡ t d ¡}t jt|d | dd¡ W 5 Q R X W 5 Q R X d S )Nr r rC )Zaxesú columns=ArA rB )rj zindex=df.index[0:4]r é )rC r% zOpassing a filterable condition to a non-table indexer [Filter: Not Initialized]©Úmatchz columns=A and index>df.index[4])r r) r* r% Z
|
_with_freqr r+ Úilocr, rM ÚreindexÚreÚescapeÚpytestÚraisesÚ TypeError)r4 r5 r rR rS Úmsgr6 r6 r7 Ú!test_append_frame_column_oriented s$
|
$ ÿrv c
|
C sü t | æ}tdD ]Ö}ttj dd¡tdd}td|d< |d |d 7 < tdgt| dd|d< tdgt| d d|d < |d d
|
kr°|d= tdgt| dd|d< |d d
|
krÎ| d ¡}||d < |j
|
dd d | d|¡ qW 5 Q R X t | ö}ttj dd¡tddd}tdgt| dd|d< tdgt| d d|d < | d|¡ tdgt| d d|d< t d¡}tjt|d | d|¡ W 5 Q R X tdgt| dd|d< t d¡}tjt|d | d|¡ W 5 Q R X W 5 Q R X d S )Nr r ZABrB r% r Úint64r Úint16r rG rA TrH r Úfloat64)rC r Zint16_2zCcannot match existing table structure for [int16] on appending datarl ç ð?Zfloat_3zAcannot match existing table structure for [A,B] on appending data)r Úranger r. r1 rN Úlistr rO ÚpoprP r+ rp rq rr rs Ú
|
ValueError)r4 r5 Úir Úaru r6 r6 r7 Ú)test_append_with_different_block_ordering* s@
|
|
|
ÿÿr c s® t | ê tddÒ fdd}tddgddgg} d |¡ t d ¡|¡ |d d
|
d td d gddgg} d |¡ t||g}t d ¡|¡ |d d
|
d tddgddgg} jd|ddid t d¡|¡ |dd
|
d d|¡ td dgddgg}d}tj t
|
|d d|¡ W 5 Q R X t ¡ d¡} jd|d d d id t d¡|d ¡ jd |d dd d id t d ¡|d ¡ jd |d!d d"id# | ¡ ¡ jd$d% d¡} d |¡ t d ¡t||g¡ jd&|d d!d d"id# d&|d ¡ t d&¡t|d |d g¡ t d' t ¡ }d(|d)< tj|j|jd*d
d)f< d+|d,< tj|j|jd d-
d,f< d.|d/< tj|j|jd*d
d/f< d'|¡ d'¡}t ||¡ W 5 Q R X W 5 Q R X t | td(d+d0td1d2}t d' jd'|d3d4id |d'd3d4 d'¡jd3gks^tt d' jd'|dgd3d4id |d'd3d4 d'¡jdd3gks¦tt d' jd'|dgdd4id |d'dd4 |d'd5d4 d'¡jdgksøtt d' jd'|d d6
d4d jd'|d6d
d4d t d' |¡ td(d(d(d7d7d7gd3gd8}t d' t d9¡}tj t
|
|d jd'|d:d:d;d W 5 Q R X W 5 Q R X d S )<NTr c s" t | ¡jj|j|ks td S ©N©ÚgetattrÚ
|
get_storerr Ú descriptionÚitemsizerL ©ÚkeyrK r ©r5 r6 r7 Ú check_col\ s ÿÿz+test_append_with_strings.<locals>.check_colé{ Z asdqwertyiY ZdggnhebbsdfbdfbZdf_bigÚvalues_block_1r^ é| ZasdqyiZ Z dggnhefbdfbZdf_big2Úvaluesé2 ©Ú min_itemsizeÚdf_newZ
|
abcdefqhijZabcdefghijklmnopqrtsuvwxyzz¯Trying to store a string with len \[26\] in \[values_block_1\] column but\nthis column has a limit of \[15\]!\nConsider using min_itemsize to preset the sizes on these columnsrl rE r: rD r% rk Zss2©r( r Zss3r é )r r Zlonger)rE Zss4r r< Ústringr rF Ústring2é ZbahZstring3©rA rD r r$ rA éÈ Zvalues_block_0r ZbarhrB zBmin_itemsize has the key [foo] which is not an axis or data_columnrV )r< Zfoobar) r r r r+ r) r, rM r rr rs r~ ZmakeMixedDataFramerP rJ r- ra Z reset_indexZassignr r* r. r/ r0 r% r{ r
r( rL rp rq )r4 r r r rS r ru rR r6 r r7 Útest_append_with_stringsX s ÿÿ "
|
|
|
|
|
|
|
ÿr c
|
C s| t | j}tddddddddgi}|jd |d d
|
dd id |jd |d
|
d
dd id t | d ¡|¡ W 5 Q R X d S ) NÚxr ÚbÚcÚdÚeÚfÚ r éÿÿÿÿr r )r r r+ r) r, rM rh r6 r6 r7 Ú test_append_with_empty_stringÌ s
|
|
r¤ c sN t | t ¡ }d|jd|j d¡f< t d jd|d d
dgd d|dd
¡ t d |¡ j j
|
j j j jjdkst j j
|
j j j jjdks¦t dd¡}||jdk }t ||¡ dd ¡}|j|jd
|
d
d }||jdk }t ||¡ | ¡ }d |d < tj|j|jdd
|
d f< d|j|jdd
d f< t d jd|d gd dd¡}||jd k }t ||¡ fdd}W 5 Q R X t | t d jd|d gd did |dd d t d jd|d gdd |dd d t d jd|d gddid |dd d W 5 Q R X t | j d|d< d|d< d |d < t d jd|d dgdd d d d |dd d |ddd |dd!d W 5 Q R X t | H | ¡ }d|jd|j d"¡f< d#|jd|j d¡f< d |d < |j d ¡}tj|jdd
|
|f< d|jdd
|f< d |d< |j d¡}tj|jdd
|f< d|jd$d%
|f< t d jd|d"dd dgd dd&¡}||jd k|jd k@ |jdk@ |jdk @ }tj||d'd( dd)¡}||jd k|jd*k@ }t ||¡ W 5 Q R X t |
|
| ¡ }d |d < tj|j|jd
|
d
d f< d|j|jd$d+
d f< d*|d< td,|d-< tj|j|jd.d
d"dd-gf< t d/ jd/|dd0d dd-gd d/d¡}||jdk }t ||¡ d/d1d2d3g¡}||jdk|j dk@ |jd k@ }tj||d'd( W 5 Q R X t | tj d4¡ t d5d%d6}t tj !d%d.¡|d"dd0gd7}d |d < tj|j|jd
|
d
d f< d|j|jd$d+
d f< |dd0g "¡ |dd0g< d*|d< jd/|dd0d dgd d/d¡}||jdk }t ||¡ d/d1d2d8g¡}||jdk|j dk@ |jd k@ }t ||¡ W 5 Q R X d S )9Nrz r rD r r r' TúB>0zB>0 and index>df.index[3]rk r$ r< r r rF r r z string='foo'c s" t | ¡jj|j|ks td S r r r r r6 r7 r ù s ÿz0test_append_with_data_columns.<locals>.check_colé r r Z foobarbahr Z
|
foobarbah1Z string_block1Z
|
foobarbah2Z string_block2é( r )r r r r rA g ð¿é r z.string='foo' and string2='foo' and A>0 and B<0F)Z
|
check_freqz string='foo' and string2='cool'Zcoolé Z20010102r` rG Údf_dcrE zB > 0zC > 0z string == fooiÒ z1/1/2000)Zperiods)r% rC zstring == "foo")#r r) r* rn rC Zget_locr r+ r, Ú_handleÚrootr r Úcolsr% Z
|
is_indexedrL rD rM ro ra r. r/ r0 r r rA r rE r1 Úseedr r rN Úabs) r4 r rR rS r r Úslrª r% r6 r r7 Ú test_append_with_data_columnsÕ sä
|
|
|
|
|
|
|
|
|
ü
|
ÿþýÿ
|
ÿ " "r± c C sº |}d |j _t|V}| d|¡ | d¡}t ||¡ |jdddgd}|jddgd}t ||¡ W 5 Q R X | d }|j|ddd t |dddgd}|jddgd}t ||¡ d S ) NrI rA rD rB ztest.hdfr r r )
|
rC rK r r+ rM r) r, ro Zto_hdfr
|
)Ztmp_pathr4 Z multiindex_dataframe_random_datar r5 rR rS Úpathr6 r6 r7 Útest_append_hierarchicalh s
|
|
r³ c C sl t | Z}t ¡ }|jd|dd | d¡}t ||¡ |jd|dd | d¡}t ||¡ W 5 Q R X d S )Nr r ©Ú chunksizer r )Z expectedrows)r r) Ú makeDataFramer+ rM r, )r4 r5 r rR r6 r6 r7 Útest_append_misc} s
|
|
|
r· rµ r r iè c C s t ¡ }d|d< d|d< |d d¡|d< |d dk|d< td|d < td
|
|d < t| d d ,}|jd||d | d¡}t ||¡ W 5 Q R X d S )Nr< r rz Zfloat322Úfloat32r ÚboolÚ20130101Ztime1Z20130102Ztime2Úw)ÚmodeÚobjr´ )r) r¶ r_ r r r+ rM r, )r4 rµ r r5 rR r6 r6 r7 Útest_append_misc_chunksize s
|
r¾ c
|
C sØ t | Æ}ttdd}| d|¡ tjtdd | d¡ W 5 Q R X ttj
|
dd¡tdd}| d|¡ t | d¡|¡ | d|¡ t | d¡|¡ ttdd}| d|¡ t | d¡|¡ W 5 Q R X d S ) NÚABCrB r z 'No object named df in the file'rl r rG r )r r r| r+ rr rs ÚKeyErrorrM r. r1 Zrandr) r, r- )r4 r5 Zdf_emptyr r6 r6 r7 Ú test_append_misc_empty_frame s
|
rÁ c
|
C sX t | D}t ¡ }dggt| |d< |jd tjks<tt d¡}t
|
j t |d | d|¡ W 5 Q R X dggt| |d< dggt| |d< t
|
j t |d | d|¡ W 5 Q R X t ¡ }tt dd d
|
¡|jd }| t¡}tj|d d
< ||d< |jd tjkstd}t
|
j t |d | d|¡ W 5 Q R X d}t
|
j t |d | dt d¡¡ W 5 Q R X t d¡}t
|
j t |d | dtt d¡¡ W 5 Q R X t ¡ }| d|¡ d|d< t d¡}t
|
j t|d | d|¡ W 5 Q R X t|d td|d< | d|¡ d|d< t d¡}t
|
j t|d | d|¡ W 5 Q R X W 5 Q R X d S )Nr ÚinvalidziCannot serialize the column [invalid]
|
because its data contents are not [string] but [mixed] object dtyperl r Zinvalid2Zinvalid3rY r r r$ r r z>too many timezones in this block, create separate data columnsz(value must be None, Series, or DataFramer z]cannot properly create the storer for: [group->df,value-><class 'pandas.core.series.Series'>]r< zinvalid combination of [non_index_axes] on appending data [(1, ['A', 'B', 'C', 'D', 'foo'])] vs current table [(1, ['A', 'B', 'C', 'D'])]rº rF zûinvalid combination of [values_axes] on appending data [name->values_block_1,cname->values_block_1,dtype->bytes24,kind->string,shape->(1, 30)] vs current table [name->values_block_1,cname->values_block_1,dtype->datetime64,kind->datetime64,shape->None])r r) r¶ rO Zdtypesr. Zobject_rL rp rq rr rs rt r+ r r` r% r_ Úobjectr/ r3 r~ r r )r4 r5 r ru rT r6 r6 r7 Útest_append_raise² s^ ÿ
|
ÿ ÿ
|
ÿrÄ c C s~ t tddd tdD d}|d |d |d< tj|jd d
|
df< t| "}t|d |jd |d d | d ¡}t
|
||¡ |j d dd}t
|
||¡ |j d dd}t
|
||j d d
¡ | d d¡}t
|
||j d d
¡ | d d¡}|j dgd}t
|
||j dd
¡ | d d¡}|j dd
}t
|
||j dd
¡ t|d | d|¡ | d¡}t
|
||¡ W 5 Q R X d S )Nrº c S s g | ]}t d t|dd qS )rº r )ÚdaysÚseconds)r r )Ú.0r r6 r6 r7 Ú
|
<listcomp> s z.test_append_with_timedelta.<locals>.<listcomp>r r rA rD rE rG r r Tr' zC<100000)ÚwherezC<pd.Timedelta('-3D')zC<'-3D'z C<'-500000s')Zsubsetr z C<'-3.5D'r rk r )r r r{ r. r/ r0 r r r+ rM r) r, rn rc r- )r4 r r5 rR r6 r6 r7 Útest_append_with_timedeltaþ s< ÿþÿ
|
|
|
|
rÊ c
|
C s4 t ¡ }t ¡ jdjd}d|d< t||gdd}t| ð}d}tjt|d |j d d
|
gd d |d d W 5 Q R X tjt|d |j d d d |d d W 5 Q R X d}tjt|d | d|d¡ W 5 Q R X |j d d
|
gd d |dd |j
|
ddgddgdd}||j dk|j dk@ }t ||¡ W 5 Q R X d S )Nú{}_2rB rF r< r ©Zaxisz=append_to_multiple requires a selector that is in passed dictrl rA rD ©r r r )ÚselectorzQappend_to_multiple must have a dictionary specified as the way to split the valuer r zA>0r¥ )rÉ rÎ r )r) r* Úrenamer r r rr rs r~ Úappend_to_multipleÚselect_as_multiplerA rD r, )r4 r r r r5 ru rR rS r6 r6 r7 Útest_append_to_multiple. s4
|
ÿ ÿ ÿrÒ c C s¼ t ¡ }t ¡ jdjd}tj|jd|j ddg¡f< t ||gdd}t
|
| d}|j ddgd d|dd d
|
| dd g¡}| ¡ }t j||d d t | d¡j| d ¡j¡ W 5 Q R X d S ) NrË rB r rA rD rÌ rÍ r T©rÎ rc r r& )r) r* rÏ r r. r/ rn rC Ú get_indexerr r rÐ rÑ rc r, Zassert_index_equalrM r% )r4 r r r r5 rR rS r6 r6 r7 Ú test_append_to_multiple_dropnaO s
|
ÿrÕ c C sÜ t ¡ }t ¡ jdjd}tj|jd|j ddg¡f< t ||gdd}t
|
| }t dd¡l |j ddgd d |d
|
d d d }tjt|d | d
|
dg¡ W 5 Q R X | d
|
¡j | d¡j¡rÄtW 5 Q R X W 5 Q R X d S )NrË rB r rA rD rÌ re T)Údf1aÚdf2arÖ FrÓ z,all tables must have exactly the same nrows!rl r× )r) r* rÏ r r. r/ rn rC rÔ r r rf rg rÐ rr rs r~ rÑ rM r% ÚequalsrL )r4 r r r r5 ru r6 r6 r7 Ú$test_append_to_multiple_dropna_false` s$ ÿ ÿrÙ c C sÄ t t dd¡t dd¡t dd¡d dd tdD dd tdD d}|jd g }t| Z}|jd
|
gd d gd dgd|jd g dddddd | dddg¡}tj ||dd W 5 Q R X d S )Nr é éX c S s g | ]}d qS )r r6 ©rÇ Ú_r6 r6 r7 rÈ | s z8test_append_to_multiple_min_itemsize.<locals>.<listcomp>rV c S s g | ]}d qS )Zabcder6 rÜ r6 r6 r7 rÈ } s )ÚIXÚNumÚBigNumÚStrÚLongStrr rÞ rß rà rá râ )r% ÚnumsÚstrsr% r r9 r )rá râ rß r rã rä Tr& )
|
r r. r3 r{ rn r rÐ rÑ r) r, )r4 r rS r5 rR r6 r6 r7 Ú$test_append_to_multiple_min_itemsizeu s*
|
|
ûÿ
|
ý
|
|
ø
|
rå )2r` r rp Úwarningsr Únumpyr. rr Zpandas._libs.tslibsr Z pandas.util._test_decoratorsÚutilZ_test_decoratorsÚtdZpandasrf r r r r) r r r
|
Z pandas.tests.io.pytables.commonr r ÚmarkZ
|
single_cpuZ
|
pytestmarkr8 rU rb ri rv r r r¤ r± r³ r· Z parametrizer¾ rÁ Z&skip_array_manager_not_yet_implementedrÄ rÊ rÒ rÕ rÙ rå r6 r6 r6 r7 Ú<module> sB B-.S .t
|
|
K0!
|
