U
|
ý°dÒ ã @ sÄ d Z ddlmZ ddlZddlmZ ddlZddlmZm Z m
|
Z
|
ddl m Z ddl mZ ddlmZ ddlm m mZ ejdd gd
|
d d d d ZG dd dZdd Zdd Zdd ZdS )a
|
Tests that features that are currently unsupported in
|
either the Python or C parser are actually enforced
|
and are clearly communicated to the user.
|
|
Ultimately, the goal is to remove test cases from this
|
test suite as new feature support is added to the parsers.
|
é )ÚStringION)ÚPath)Úis_ci_environmentÚis_platform_macÚis_platform_windows)Ú ParserError)Úread_csvÚpythonz
|
python-fwfc C s | S ©N© )Úvalr r ú^d:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/tests/io/parser/test_unsupported.pyÚ<lambda> ó r )ÚparamsÚidsc C s | j S r
|
)Úparam)Úrequestr r r Ú python_engine s r c @ s< e Zd Zdd Zdd Zdd Zdd Zd d
|
Zd d Zd S )ÚTestUnsupportedFeaturesc
|
C s> d}dD ]0}t jtdd tt||dd W 5 Q R X qd S )Nú a b c
|
1 2 3)Úcr zunexpected keyword©ÚmatchT)ÚengineZmangle_dupe_cols)ÚpytestÚraisesÚ TypeErrorr r )ÚselfÚdatar r r r Útest_mangle_dupe_cols_false" s z3TestUnsupportedFeatures.test_mangle_dupe_cols_falsec C sX d}d}t jt|d tt|dd dd W 5 Q R X t jt|d tt|ddd W 5 Q R X t jt|d tt|dd td
|
d W 5 Q R X t jt|d tt|dd d W 5 Q R X t tj ¡ tt|d dd W 5 Q R X t tj ¡ tt|dd W 5 Q R X t tj ¡ tt|d td
|
d W 5 Q R X t tj ¡ tt|d d W 5 Q R X d}d}t jt
|
|d tt|dd W 5 Q R X t jt
|
|d tt|ddd W 5 Q R X d}d}t jt|d tt|dd W 5 Q R X t jt|d tt|dd W 5 Q R X d}d}t jt|d tt|d d W 5 Q R X d S ) Nr zdoes not supportr r F)r ÚsepÚdelim_whitespacez\s)r r! ú é )r r! Ú quotecharé )r Ú
|
skipfooter)r! r" )r! )r! r% )r' a A B C D E
|
one two three four
|
a b 10.0032 5 -0.5109 -2.3358 -0.4645 0.05076 0.3640
|
a q 20 4 0.4473 1.4152 0.2834 1.00661 0.1744
|
x q 30 3 -0.6662 -0.5243 -0.3580 0.89145 2.5838zError tokenizing dataz\s+z)Only length-1 thousands markers supportedzA|B|C
|
1|2,334|5
|
10|13|10.
|
z,,)Z thousandsÚ z(Only length-1 line terminators supportedza,b,c~~1,2,3~~4,5,6z~~)Úlineterminator) r r Ú
|
ValueErrorr r ÚchrÚtmÚassert_produces_warningÚparsersZ ParserWarningr )r r ÚmsgÚtextr r r Ú test_c_engine* sD " z%TestUnsupportedFeatures.test_c_enginec
|
C st ddl m} d}|D ]Z}dt| dt| d}|t i}tjt|d tt|fd|i| W 5 Q R X qd S ) Nr )Ú_python_unsupportedz*1,2,3,,
|
1,2,3,4,
|
1,2,3,4,5
|
1,2,,,
|
1,2,3,4,úThe z" option is not supported with the z enginer r ) Úpandas.io.parsers.readersr2 ÚreprÚobjectr r r* r r )r r Zpy_unsupportedr Údefaultr/ Úkwargsr r r Útest_python_engine^ s ÿ
|
z*TestUnsupportedFeatures.test_python_enginec C sD G dd d}d}d}t jt|d t|||d W 5 Q R X d S )Nc @ s2 e Zd ZddddZdd Zdd Zd d
|
ZdS ) zMTestUnsupportedFeatures.test_python_engine_file_no_iter.<locals>.NoNextBufferN)Úreturnc S s
|
|| _ d S r
|
©r )r Zcsv_datar r r Ú__init__t s zVTestUnsupportedFeatures.test_python_engine_file_no_iter.<locals>.NoNextBuffer.__init__c S s
|
| j ¡ S r
|
)r Ú__next__©r r r r r= w s zVTestUnsupportedFeatures.test_python_engine_file_no_iter.<locals>.NoNextBuffer.__next__c S s | j S r
|
r; r> r r r Úreadz s zRTestUnsupportedFeatures.test_python_engine_file_no_iter.<locals>.NoNextBuffer.readc S s | j S r
|
r; r> r r r Úreadline} s zVTestUnsupportedFeatures.test_python_engine_file_no_iter.<locals>.NoNextBuffer.readline)Ú__name__Ú
|
__module__Ú __qualname__r< r= r? r@ r r r r Ú NoNextBuffers s rD za
|
1zD'NoNextBuffer' object is not iterable|argument 1 must be an iteratorr )r )r r r r )r r rD r r/ r r r Ú test_python_engine_file_no_iterq s
|
z7TestUnsupportedFeatures.test_python_engine_file_no_iterc
|
C s¦ ddl m} d}|D ]}dt| d}|t i}ddh}|dkrLd ||< n"||kr^d
|
||< n|d krnd ||< tjt|d tt|fddi| W 5 Q R X qd S )Nr )Ú_pyarrow_unsupportedzJ1,2,3,,
|
1,2,3,4,
|
1,2,3,4,5
|
1,2,,,
|
1,2,3,4,r3 z2 option is not supported with the 'pyarrow' engineZwarn_bad_linesZerror_bad_linesÚdialectÚexcelTÚ on_bad_linesÚwarnr r Úpyarrow) r4 rF r5 r6 r r r* r r )r Zpa_unsupportedr r7 r/ r8 Zdefault_needs_boolr r r Útest_pyarrow_engine s ÿ
|
|
|
z+TestUnsupportedFeatures.test_pyarrow_enginec C s^ t d}dd }|}|jdkrLd}tjt|d |j||d W 5 Q R X n|j||d d S )Nza,b
|
1,2c S s | S r
|
r )Úxr r r r ¢ r zPTestUnsupportedFeatures.test_on_bad_lines_callable_python_only.<locals>.<lambda>r z>on_bad_line can only be a callable function if engine='python'r )rI )r r r r r* r )r Ú all_parsersÚsioZbad_lines_funcÚparserr/ r r r Ú&test_on_bad_lines_callable_python_only s
|
z>TestUnsupportedFeatures.test_on_bad_lines_callable_python_onlyN) rA rB rC r r1 r9 rE rL rQ r r r r r ! s 4r c C s¶ | }t }|jdkr@t d¡}|jj}t r@t s6t r@t d¡ t
|
d¡b}t | d¡ t
|
d¡4 tj|dd |j|dd dgd
|
W 5 Q R X W 5 Q R X t |¡ W 5 Q R X d S ) NrK z:GH#45547 causing timeouts on windows/mac builds 2022-01-22ztest.csvzcol1,col2
|
a,b
|
1,2FZcol3r Zcol1Zcol2)Zusecols)r* r r Z importorskipÚlibZ ArrowKeyErrorr r r Úskipr, Z ensure_cleanr Ú
|
write_textr- r r ÚosÚunlink)rN rP ÚerrorrK Úfnamer r r Ú)test_close_file_handle_on_invalid_usecols¬ s
|
|
|
(rY c C sT |}|j dkr,| j tjj|j dd¡ tjtdd | g ¡ W 5 Q R X d S )Nr z engine supports lists.)ÚreasonZInvalidr ) r ÚnodeZ
|
add_markerr ÚmarkZxfailr r* r )r rN rP r r r Útest_invalid_file_inputsÁ s
|
ÿr] c C s4 | }d}t jt|d |jddd W 5 Q R X d S )NzPdtype_backend numpy is invalid, only 'numpy_nullable' and 'pyarrow' are allowed.r ÚtestÚnumpy)Z dtype_backend)r r r* r )rN rP r/ r r r Útest_invalid_dtype_backendÍ s
|
ÿr` )Ú__doc__Úior rU Úpathlibr r Z pandas.compatr r r Z pandas.errorsr Zpandas._testingZ_testingr, Zpandas.io.parsersr r4 r. ZreadersZfixturer r rY r] r` r r r r Ú<module> s
|
|
