U
|
¬ý°dá1 ã @ sh d dl mZ d dlZd dlmZ d dlZd dlZd dlZd dlZd dl m
|
Z
|
m Z m Z d dl Z d dlmZmZ d dlmZ d dlmZ d dlZd dlmZ d d lmZ d d
|
lm Z e
|
rÄd d lm Z m Z d Z d Z dd Z!dd Z"e"dddde e fddddddZ#d/ddddZ$d0d d d d d d!Z%d1d"d#d$d%Z&d2d"d#d&d'Z'd3dd)d*d+Z(d4d,dd-d.Z)dS )5é )Ú annotationsN©Úwraps)Ú TYPE_CHECKINGÚAnyÚCallable)ÚFilePathÚReadPickleBuffer)Ú get_lzma_file)Úimport_optional_dependency)Úrands)Ú ensure_clean)Úurlopen)Ú DataFrameÚSeries) z timed outz Server Hangupz#HTTP Error 503: Service Unavailablez502: Proxy Errorz HTTP Error 502: internal errorzHTTP Error 502zHTTP Error 503zHTTP Error 403zHTTP Error 400z$Temporary failure in name resolutionzName or service not knownzConnection refusedzcertificate verify)ée éo én éh é6 é< c C s( dd l } dd l}t| jjt|jjtj fS )Nr )
|
Ú http.clientÚ urllib.errorÚOSErrorÚclientÚ HTTPExceptionÚ TimeoutErrorÚerrorÚURLErrorÚsocketÚtimeout)ÚhttpÚurllib© r# úJd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/_testing/_io.pyÚ_get_default_network_errorsI s ûr% c s t fdd}|S )aB
|
allows a decorator to take optional positional and keyword arguments.
|
Assumes that taking a single, callable, positional argument means that
|
it is decorating a function, i.e. something like this::
|
|
@my_decorator
|
def function(): pass
|
|
Calls decorator with decorator(f, *args, **kwargs)
|
c sN fdd} o,t dko,t d }|rF d }d ||S |S d S )Nc s | f S ©Nr# )Úf)ÚargsÚ decoratorÚkwargsr# r$ Údecf s z+optional_args.<locals>.wrapper.<locals>.decé r r# )ÚlenÚcallable)r( r* r+ Z is_decoratingr' ©r) )r( r* r$ Úwrapperd s z optional_args.<locals>.wrapperr )r) r0 r# r/ r$ Ú optional_argsX s r1 zhttps://www.google.comFÚstrÚbool)ÚurlÚraise_on_errorÚcheck_before_testc sB ddl dkrt d_t fdd}|S )a
|
Label a test as requiring network connection and, if an error is
|
encountered, only raise if it does not find a network connection.
|
|
In comparison to ``network``, this assumes an added contract to your test:
|
you must assert that, under normal conditions, your test will ONLY fail if
|
it does not have network connectivity.
|
|
You can call this in 3 ways: as a standard decorator, with keyword
|
arguments, or with a positional argument that is the url to check.
|
|
Parameters
|
----------
|
t : callable
|
The test requiring network connectivity.
|
url : path
|
The url to test via ``pandas.io.common.urlopen`` to check
|
for connectivity. Defaults to 'https://www.google.com'.
|
raise_on_error : bool
|
If True, never catches errors.
|
check_before_test : bool
|
If True, checks connectivity before running the test case.
|
error_classes : tuple or Exception
|
error classes to ignore. If not in ``error_classes``, raises the error.
|
defaults to OSError. Be careful about changing the error classes here.
|
skip_errnos : iterable of int
|
Any exception that has .errno or .reason.erno set to one
|
of these values will be skipped with an appropriate
|
message.
|
_skip_on_messages: iterable of string
|
any exception e for which one of the strings is
|
a substring of str(e) will be skipped with an appropriate
|
message. Intended to suppress errors where an errno isn't available.
|
|
Notes
|
-----
|
* ``raise_on_error`` supersedes ``check_before_test``
|
|
Returns
|
-------
|
t : callable
|
The decorated test ``t``, with checks for connectivity errors.
|
|
Example
|
-------
|
|
Tests decorated with @network will fail if it's possible to make a network
|
connection to another URL (defaults to google.com)::
|
|
>>> from pandas import _testing as tm
|
>>> @tm.network
|
... def test_network():
|
... with pd.io.common.urlopen("rabbit://bonanza.com"):
|
... pass
|
>>> test_network() # doctest: +SKIP
|
Traceback
|
...
|
URLError: <urlopen error unknown url type: rabbit>
|
|
You can specify alternative URLs::
|
|
>>> @tm.network("https://www.yahoo.com")
|
... def test_something_with_yahoo():
|
... raise OSError("Failure Message")
|
>>> test_something_with_yahoo() # doctest: +SKIP
|
Traceback (most recent call last):
|
...
|
OSError: Failure Message
|
|
If you set check_before_test, it will check the url first and not run the
|
test on failure::
|
|
>>> @tm.network("failing://url.blaher", check_before_test=True)
|
... def test_something():
|
... print("I ran!")
|
... raise ValueError("Failure")
|
>>> test_something() # doctest: +SKIP
|
Traceback (most recent call last):
|
...
|
|
Errors not related to networking will always be raised.
|
r NTc
|
sä r"s"t s" d ¡ z | |W S tk
|
rÞ } zt|dd }|sht|drht|jdd }|kr d| ¡ t| t fddD r® d| ¡ t|r¼r¾ d| ¡ W 5 d }~X Y nX d S ) Nz<May not have network connectivity because cannot connect to ÚerrnoÚreasonz+Skipping test due to known errno and error c 3 s | ]}| ¡ ¡ kV qd S r& )Úlower)Ú.0Úm©Ze_strr# r$ Ú <genexpr>ï s z+network.<locals>.wrapper.<locals>.<genexpr>z;Skipping test because exception message is known and error z4Skipping test due to lack of connectivity and error ) Ú can_connectÚskipÚ ExceptionÚgetattrÚhasattrr8 r2 ÚanyÚ
|
isinstance)r( r* Úerrr7 ©Ú_skip_on_messagesr6 Ú error_classesÚpytestr5 Ú skip_errnosÚtr4 r< r$ r0 Ø s2 ÿþýÿ ÿznetwork.<locals>.wrapper)rI r% Únetworkr )rK r4 r5 r6 rH rJ rG r0 r# rF r$ rL u s \ rL )Úreturnc C sd |dkrt }z6t| dd }|jdkr8W 5 Q R £ W dS W 5 Q R X W n |k
|
rZ Y dS X dS dS )a@
|
Try to connect to the given url. True if succeeds, False if OSError
|
raised
|
|
Parameters
|
----------
|
url : basestring
|
The URL to try to connect to
|
|
Returns
|
-------
|
connectable : bool
|
Return True if no OSError (unable to connect) or URLError (bad url) was
|
raised
|
Né )r éÈ FT)r% r Ústatus)r4 rH Úresponser# r# r$ r> û s
|
r> r z"FilePath | ReadPickleBuffer | NonezDataFrame | Series)ÚobjÚpathrM c
|
C sR |}|dkr dt d d}t|$}t | |¡ t |¡W 5 Q R £ S Q R X dS )a
|
Pickle an object and then read it again.
|
|
Parameters
|
----------
|
obj : any object
|
The object to pickle and then re-read.
|
path : str, path object or file-like object, default None
|
The path where the pickled object is written and then read.
|
|
Returns
|
-------
|
pandas object
|
The original object that was pickled and then re-read.
|
NÚ__é
|
z __.pickle)r r ÚpdZ to_pickleZ read_pickle)rR rS Ú_pathZ temp_pathr# r# r$ Úround_trip_pickle s
|
rX z
|
str | None)rS c C sP ddl }| d¡j}|dkr d}t| }| || |||}W 5 Q R X |S )aÛ
|
Write an object to file specified by a pathlib.Path and read it back
|
|
Parameters
|
----------
|
writer : callable bound to pandas object
|
IO writing function (e.g. DataFrame.to_csv )
|
reader : callable
|
IO reading function (e.g. pd.read_csv )
|
path : str, default None
|
The path where the object is written and then read.
|
|
Returns
|
-------
|
pandas object
|
The original object that was serialized and then re-read.
|
r NÚpathlibZ ___pathlib___)rI Ú importorskipÚPathr )ÚwriterÚreaderrS rI r[ rR r# r# r$ Úround_trip_pathlib7 s
|
r^ c C sP ddl }| d¡j}|dkr d}t| }| || |||}W 5 Q R X |S )aá
|
Write an object to file specified by a py.path LocalPath and read it back.
|
|
Parameters
|
----------
|
writer : callable bound to pandas object
|
IO writing function (e.g. DataFrame.to_csv )
|
reader : callable
|
IO reading function (e.g. pd.read_csv )
|
path : str, default None
|
The path where the object is written and then read.
|
|
Returns
|
-------
|
pandas object
|
The original object that was serialized and then re-read.
|
r Nzpy.pathZ___localpath___)rI rZ Úlocalr )r\ r] rS rI Z LocalPathrR r# r# r$ Úround_trip_localpathT s
|
r` Útest)Údestc C sê |f}d}d}| dkr.t j}d}||f}d}n| dkrntj}d}tj|d}t |¡} t||_|| f}d}nR| d kr~t j
|
}nB| d
|
krt j }n2| d kr¢t d j}n | d kr²t }ntd| |||d}
|
t|
|
|| W 5 Q R X dS )a¦
|
Write data to a compressed file.
|
|
Parameters
|
----------
|
compression : {'gzip', 'bz2', 'zip', 'xz', 'zstd'}
|
The compression type to use.
|
path : str
|
The file path to write the data.
|
data : str
|
The data to write.
|
dest : str, default "test"
|
The destination file (for ZIP only)
|
|
Raises
|
------
|
ValueError : An invalid compression value was passed in.
|
ÚwbÚwriteÚzipÚwÚwritestrÚtar)ÚnameÚaddfileÚgzipÚbz2ZzstdZ zstandardÚxzz Unrecognized compression type: )ÚmodeN)ÚzipfileÚZipFileÚtarfileÚTarFileÚTarInfoÚioÚBytesIOr- Úsizerk ÚGzipFilerl ÚBZ2Filer Úopenr
|
Ú
|
ValueErrorrA ) Ú compressionrS Údatarb r( rn ÚmethodZcompress_methodÚfileÚbytesr' r# r# r$ Úwrite_to_compressedq s6
|
|
r ÚNonec C s: ddl m}m} | d kr.| D ] } || q n|| d S )Nr )ÚcloseÚ get_fignums)Zmatplotlib.pyplotr r )ZfignumÚ_closer r# r# r$ r © s
|
|
r )N)N)N)N)ra )N)*Ú
|
__future__r rl Ú functoolsr rk rt r rq Útypingr r r ro Zpandas._typingr r Z pandas.compatr
|
Zpandas.compat._optionalr ZpandasrV Zpandas._testing._randomr Zpandas._testing.contextsr Zpandas.io.commonr r r Z_network_error_messagesZ_network_errno_valsr% r1 rL r> rX r^ r` r r r# r# r# r$ Ú<module> sJ ù # ÿ 8
|
