U
|
ý°dp% ã @ sà d dl Z d dlZd dlZd dlmZmZmZmZm Z m
|
Z
|
m Z m Z m Z mZ d dlmZ d dlmZ ejdd Zejdd Zdd Zd
|
d Zd d Zdd Zej dddg¡dd Z dd Z dd Z dd Z!e "d¡d d Z#e "d ¡d d Z$ej%e "d¡d!d" Z&ej j'e "d#¡d$d% Z(ej j'ej d&d'd(d)g¡e "d#¡d*d+ Z)ej j'ej%e "d#¡e "d¡d,d- Z*e +d.¡d/d0 Z,e "d ¡d1d2 Z-d3d4 Z.d5d6 Z/d7d8 Z0e "d9¡d:d; Z1e "d ¡d<d= Z2dS )>é N)
|
Ú DataFrameÚ
|
date_rangeÚread_csvÚ
|
read_excelÚ read_featherÚ read_jsonÚ read_parquetÚ read_pickleÚ
|
read_stataÚ
|
read_table)Ú_test_decoratorsc C s( t ddgdtjgddgtdddd S )
|
Né é g @ÚtÚsz
|
2018-06-18é )Zperiods)ÚintÚfloatÚstrÚdt)r ÚnpÚnanr © r r úRd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/io/test_fsspec.pyÚdf1 s
|
üÿr c c s( t d¡} | d¡}|V |j ¡ d S )NÚfsspecZmemory)ÚpytestÚ importorskipÚ
|
filesystemÚstoreÚclear)r Zmemfsr r r Ú
|
cleared_fs" s
|
|
r! c C sT t |jdd ¡ }| dd¡}| |¡ W 5 Q R X tddgd}t ||¡ d S )NF©Úindexz test/test.csvÚwbúmemory://test/test.csvr )Ú parse_dates)r Úto_csvÚencodeÚopenÚwriter ÚtmÚassert_frame_equal)r! r ÚtextÚwÚdf2r r r Ú test_read_csv+ s
|
r0 c C sl ddl m} tjtdd td W 5 Q R X d}| |dd|d ¡ tjt|d td
|
W 5 Q R X d S ) Nr )Úknown_implementationsZnosuchprotocol©Úmatchz nosuchprotocol://test/test.csvztest error messageZ
|
couldexistzunimportable.CouldExist)ÚclassÚerrzcouldexist://test/test.csv)Zfsspec.registryr1 r ÚraisesÚ
|
ValueErrorr ÚsetitemÚ ImportError)Z monkeypatchr! r1 Úerr_msgr r r Útest_reasonable_error4 s ýr; c C s. |j ddd tddgdd}t ||¡ d S )Nr% Tr" r r ©r& Z index_col)r' r r+ r, )r! r r/ r r r Ú test_to_csvC s r= c C sF t d¡ d}d| }|j|dd t|dgdd}t ||¡ d S ) NÚopenpyxlÚxlsxzmemory://test/test.Tr" r r r< )r r Úto_excelr r+ r, )r! r ÚextÚpathr/ r r r Ú test_to_excelK s
|
|
rC Ú binary_modeFTc C s t d¡}d}|rdnd}|j||d ¡ }|j|dd |jrFtW 5 Q R X | dd¡}|j||d }t|d gd
|
d }|jrtW 5 Q R X t ||¡ d S ) Nr r% r$ r. )ÚmodeTr" Úrr r r< )
|
r r r) r' ÚclosedÚAssertionErrorÚreplacer r+ r, )r! rD r r rB rE Z fsspec_objectr/ r r r Útest_to_csv_fsspec_objectV s
|
ýrJ c C sZ t ddgi}|jdddidd | jd dks4ttdddid | jd dksVtd S ©
|
NÚar útestmem://test/test.csvÚtestZ csv_writeF©Ústorage_optionsr# Zcsv_read©rP )r r' rN rH r ©Ú
|
fsspectestÚdfr r r Útest_csv_optionsl s ÿrU c C sZ t ddgi}|jdddidd | jd dks4ttdddid | jd dksVtd S rK )r r' rN rH r rR r r r Útest_read_table_optionsv s ÿrV c C sr t d¡ d}tddgi}d| }|j|ddidd | jd dksLtt|dd
|
id | jd d
|
ksntd S ) Nr> r? rL r ztestmem://test/test.rN r* FrO ÚreadrQ )r r r r@ rN rH r )rS Ú extensionrT rB r r r Útest_excel_options s
|
|
rY Ú fastparquetc C s |j ddddd dS )úCRegression test for writing to a not-yet-existent GCS Parquet file.r% TrZ N)r# ÚengineÚ compression)Ú
|
to_parquet)r! r r r r Útest_to_parquet_new_file s ÿr_ Úpyarrowc C s^ t ddgi}|jdddddid | jd dks6ttdddd id
|
| jd d ksZtdS ) r[ rL r rM r` NrN Ú parquet_write©r\ r] rP Ú parquet_read©r\ rP ©r r^ rN rH r rR r r r Útest_arrowparquet_options s üýrf c C s^ t ddgi}|jdddddid | jd dks6ttdddd id
|
| jd d ksZtdS ) r[ rL r rM rZ NrN ra rb rc rd re rR r r r Útest_fastparquet_optionsª s üýrg Zs3fsc C sL t td|dt|¡ t td|dt|¡ t td|dt|¡ d S )Nzs3://pandas-test/tips.csvrQ z s3://pandas-test/tips.csv.gzz s3://pandas-test/tips.csv.bz2©r+ Ú assert_equalr )Ú s3_resourceÚ tips_fileÚs3sor r r Útest_from_s3_csv¾ s
|
ÿ
|
þ
|
þrm ÚprotocolZs3Zs3aZs3nc C s" t t| d|dt|¡ d S )Nz://pandas-test/tips.csvrQ rh )rj rk rn rl r r r Útest_s3_protocolsÏ s þro c C s6 d}|j |ddd |d t|d|d}t ||¡ d S )Nz s3://pandas-test/test.parquetFrZ )r# r\ r] rP rd )r^ r r+ ri )rj rl r Úfnr/ r r r Útest_s3_parquetÙ s ÿrq r c C s* d} t jt| d td W 5 Q R X d S )Nz?Missing optional dependency 'fsspec'|fsspec library is requiredr2 r% )r r6 r9 r )Úmsgr r r Útest_not_present_exceptionæ s rs c C sd t ddgi}|jdddid | jd dks2ttdddid}| jd dksTtt ||¡ d S )NrL r útestmem://afilerN Z feather_writerQ Z feather_read)r Z
|
to_featherrN rH r r+ r, ©rS rT Úoutr r r Útest_feather_optionsí s rw c C sd t ddgi}|jdddid | jd dks2ttdddid}| jd dksTtt ||¡ d S )NrL r rt rN Z pickle_writerQ Z pickle_read)r Z to_picklerN rH r r+ r, ru r r r Útest_pickle_options÷ s rx c C sh t ddgi}|jd|ddid | jd dks4ttd|ddid}| jd dksXtt ||¡ d S )NrL r rt rN Z
|
json_write)r] rP Z json_read)r Úto_jsonrN rH r r+ r, )rS r] rT rv r r r Útest_json_options s ýýrz c C sl t ddgi}|jdddidd | jd dks4ttdddid }| jd dksVtt || d
|
¡¡ d S ) NrL r rt rN Z stata_writeF)rP Z write_indexZ
|
stata_readrQ Úint64)r Zto_statarN rH r
|
r+ r, Zastyperu r r r Útest_stata_options s ÿr| Útabulatec C sD t ddgi}|jdddid | jd dks2t| d¡s@td S )NrL r rt rN Zmd_writerQ )r Z to_markdownrN rH ÚcatrR r r r Útest_markdown_options s r c C sÄ t jtdd tdddid W 5 Q R X t jtdd tdddid W 5 Q R X t ¡ } t jtdd t| ddid W 5 Q R X tddgi}t jtdd |jdddid W 5 Q R X d S ) NrP r2 Ú localfilerL TrQ r Z nonfsspecpath) r r6 r7 r r ÚioÚBytesIOr r^ )ZbyrT r r r Útest_non_fsspec_options$ s r )3r Únumpyr r Zpandasr r r r r r r r r
|
r Zpandas._testingZ_testingr+ Z pandas.utilr ÚtdZfixturer r! r0 r; r= rC ÚmarkZ parametrizerJ rU rV rY Z
|
skip_if_nor_ rf Z&skip_array_manager_not_yet_implementedrg Z
|
single_cpurm ro rq Zskip_if_installedrs rw rx rz r| r r r r r r Ú<module> s` 0
|
|
|
|
|
|
|
|
|
|
