U
|
ý°dÈ2 ã @ sø d Z ddlZddlmZ ddlmZ ddlZddlZddl Z ddl
|
m m Z ddlZddlmZ ddlmZ ddlmZ e d¡ ddlZe jdd Ze d
|
ej d d gd di¡e d
|
ej dddgddi¡e d
|
ej dddej dddgi¡e d
|
ej dddej dddgi¡e d
|
ej gd i¡ !e "dej ¡¡gZ#dd Z$d d Z%d d Z&d!d" Z'd#d$ Z(d%d& Z)e j*d'd(d)d*d+ Z+e j*d'd(d)d,d- Z,e j*d'd(d)e j- .d.e#¡d/d0 Z/e j*d'd(d)d1d2 Z0e j*d'd(d)d3d4 Z1d5d6 Z2dS )7z test orc compat é N)ÚDecimal)ÚBytesIO)Úread_orc)Ú StringArrayz pyarrow.orcc C s | dddS )NÚioÚdataZorc© )Údatapathr r úOd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/io/test_orc.pyÚdirpath s r Zunimplé é Zuint64©ÚdtypeÚaÚbÚcategoryé )ÚleftÚrighté z
|
2022-01-03ÚD)Úfreqz
|
2022-01-04é2 Úfloatc C s ddddddddd g }d
|
d d d dddddg }t jt d¡d}t||D ]\}}t j|d||< qHtj | d¡}t||d}t
|
||¡ d S )NÚboolean1Úbyte1Úshort1Úint1Úlong1Úfloat1Údouble1Úbytes1Ústring1ÚboolÚint8Úint16Úint32Úint64Úfloat32Úfloat64Úobjectr )Úindexr zTestOrcFile.emptyFile.orc©Úcolumns) ÚpdÚ DataFrameZ
|
RangeIndexÚzipÚSeriesÚosÚpathÚjoinr ÚtmÚ assert_equal)r r. ZdtypesÚexpectedZcolnamer Ú inputfileÚgotr r r
|
Útest_orc_reader_empty0 s4 ÷ ÷ r; c C sÐ t jddgddt jddgddt jdd gd
|
dt jd d gd dt jd d gddt jddgddt jddgddt jddgddt jddgddd }tj |¡}tj | d¡}t|| ¡ d }t
|
||¡ d S ) NFTr$ r r éd r% é é r& é r' ì ÿÿÿÿ r( ç ð?ç @r) ç .Àç Àr* ó ó r+ ÚhiÚbye© r r r r r r r! r" r# zTestOrcFile.test1.orcr- ) ÚnpÚarrayr/ r0 Ú from_dictr3 r4 r5 r Úkeysr6 r7 ©r r r8 r9 r: r r r
|
Útest_orc_reader_basicQ s ÷ rO c C s dt jtdtdtdtdtdtdtdtd td
|
td g
|
d d i}tj |¡}tj | d¡}t |j
|
d d
}t ||¡ d S )NZ_col0z -1000.50000z
|
-999.60000z
|
-998.70000z
|
-997.80000z
|
-996.90000z
|
-995.10000z
|
-994.11000z
|
-993.12000z
|
-992.13000z
|
-991.14000r+ r zTestOrcFile.decimal.orcé
|
) rJ rK r r/ r0 rL r3 r4 r5 r Úilocr6 r7 rN r r r
|
Útest_orc_reader_decimale s( ö óÿ rR c C sæ t jddddddddd d
|
g
|
d d t jt d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡g
|
dd d}tj |¡}tj | d¡}t
|
|j d d
}t ||¡ d S )Nz1900-05-05 12:34:56.100000z1900-05-05 12:34:56.100100z1900-05-05 12:34:56.100200z1900-05-05 12:34:56.100300z1900-05-05 12:34:56.100400z1900-05-05 12:34:56.100500z1900-05-05 12:34:56.100600z1900-05-05 12:34:56.100700z1900-05-05 12:34:56.100800z1900-05-05 12:34:56.100900údatetime64[ns]r il é é r+ ©ÚtimeÚdatez TestOrcFile.testDate1900.orcrP ©rJ rK ÚdatetimerX r/ r0 rL r3 r4 r5 r rQ r6 r7 rN r r r
|
Útest_orc_reader_date_low sB ö ó ö óð r[ c C sæ t jddddddddd d
|
g
|
d d t jt d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡t d dd¡g
|
dd d}tj |¡}tj | d¡}t
|
|j d d
}t ||¡ d S )Nz2038-05-05 12:34:56.100000z2038-05-05 12:34:56.100100z2038-05-05 12:34:56.100200z2038-05-05 12:34:56.100300z2038-05-05 12:34:56.100400z2038-05-05 12:34:56.100500z2038-05-05 12:34:56.100600z2038-05-05 12:34:56.100700z2038-05-05 12:34:56.100800z2038-05-05 12:34:56.100900rS r iö rT rU r+ rV z TestOrcFile.testDate2038.orcrP rY rN r r r
|
Útest_orc_reader_date_high© sB ö ó ö óð r\ c C s t jddddddddd d
|
g
|
d d t jd dddddddddg
|
dd d}tj |¡}tj | d¡}t|j d d
}t
|
||¡ d S )NiEAÚºiùîjFiAî!{iÝ~ðiY5B
|
iðrhi;õÎSinåóqið:²i(är' r Zf50dcb8Z382fdaaaZ90758c6Z9e8caf3fZee97332bZd634da1Z2bea4396Zd67d89e8Zad71007eZe8c82066r+ )r r# zTestOrcFile.testSnappy.orcrP ) rJ rK r/ r0 rL r3 r4 r5 r rQ r6 r7 rN r r r
|
Ú!test_orc_reader_snappy_compressedÒ sB ö óö óð r] Úpyarrowz7.0.0)Ú min_versionc C sØ t jddgddt jddgddt jdd gd
|
dt jd d gd dt jd d gddt jddgddt jddgddt jddgddt jddgddd }tj |¡}t ¡ $}| |¡ t|}t ||¡ W 5 Q R X d S ©NFTr$ r r r< r% r= r> r& r? r' r@ r( rA rB r) rC rD r* rE rF r+ rG rH rI )
|
rJ rK r/ r0 rL r6 Ú ensure_cleanÚto_orcr r7 )r r r8 r4 r: r r r
|
Útest_orc_roundtrip_fileû s ÷
|
|
rc c C sÆ t jddgddt jddgddt jdd gd
|
dt jd d gd dt jd d gddt jddgddt jddgddt jddgddt jddgddd } tj | ¡}| ¡ }tt|}t ||¡ d S r` )
|
rJ rK r/ r0 rL rb r r r6 r7 )r r8 Úbytesr: r r r
|
Útest_orc_roundtrip_bytesio s ÷ re Údf_not_supportedc C s* d}t jt|d | ¡ W 5 Q R X d S )Nz6The dtype of one or more columns is not supported yet.©Úmatch)ÚpytestÚraisesÚNotImplementedErrorrb )rf Úmsgr r r
|
Ú$test_orc_writer_dtypes_not_supported* s rm c sÈ t tddtjdgdd dgddd gttddtjdd d
|
d d tjd gdddgddd gt jdddt d¡t j t d¡gd ¡
|
¡ ¡ } t t | dd}t fdd jD ¡}t ||¡ d S )NÚabcr Úcs foos barr é ç @ç @r* r rB ç @TFZ20130101é )ZperiodsZ20130103) ÚstringÚstring_with_nanÚstring_with_nonerd Úintr Úfloat_with_nanr$ Ú bool_with_narZ Zdatetime_with_natr^ ©Z dtype_backendc s( i | ] }|t j tj | d d¡qS )T)Z from_pandas)r/ ZarraysZArrowExtensionArrayÚparK )Ú.0Úcol©Údfr r
|
Ú
|
<dictcomp>N s ÿ z2test_orc_dtype_backend_pyarrow.<locals>.<dictcomp>)r/ r0 ÚlistrJ ÚnanÚrangeÚarangeZ
|
date_rangeÚ TimestampZNaTÚcopyrb r r r. r6 Úassert_frame_equal)Ú
|
bytes_dataÚresultr8 r r r
|
Ú test_orc_dtype_backend_pyarrow4 s2
|
|
ýõÿ
|
þÿr c C s t tddtjdgdd dgttddt jdt jdgddt jt jt jt jgddtjd d
|
d dd tjd gdddgddd gd
|
¡} | ¡
|
¡ }t t |dd}t t tjdddgtjdt tjdt jdgtjdt tjdt jdgtjdt jdddgddt jdt jdgddt jt jt jt jgddt jd ddgddt jd t jd gddt jdddgddt jddt jgddd
|
¡}t ||¡ d S )Nrn r ro r rp rt ZInt64r rq rr r* rB rs TF)
|
ru rv rw rx Z int_with_nanZna_onlyr ry r$ rz Znumpy_nullabler{ r r g @g @ZFloat64Úboolean)r/ r0 r rJ r r r2 ZNAr
r rb r r r rK Zobject_r6 r )r r r r8 r r r
|
Ú%test_orc_dtype_backend_numpy_nullableW sB
|
|
öÿ ÿÿòÿr c
|
C sf d} t dttddi¡}t d¡6}| |¡ tjt | d t
|
|dd W 5 Q R X W 5 Q R X d S ) NzPdtype_backend numpy is invalid, only 'numpy_nullable' and 'pyarrow' are allowed.rx r rp ztmp.orcrg Únumpyr{ ) r/ r0 r r r6 ra rb ri rj Ú
|
ValueErrorr )rl r r4 r r r
|
Útest_invalid_dtype_backend s ÿ
|
r )3Ú__doc__rZ Údecimalr r r r3 r rJ ri Z pandas.util._test_decoratorsÚutilZ_test_decoratorsÚtdZpandasr/ r Zpandas._testingZ_testingr6 Zpandas.core.arraysr Z importorskipr^ r| Zfixturer r0 rK r2 ZIntervalZPeriodr ZastypeZ SparseDtypeZ orc_writer_dtypes_not_supportedr; rO rR r[ r\ r] Z
|
skip_if_norc re ÚmarkZ parametrizerm r r r r r r r
|
Ú<module> s^
|
|
ÿ þÿÿ$ò!)))
|
|
|
"
|
*
|
