U
|
I=®dÅE ã @ s( d dl mZ d dlZd dlZd dlZd dlZddlmZ ddlm Z m
|
Z
|
ddlm Z ddl m Z mZmZmZ ddlmZ dd lmZ dd
|
lmZ dd lmZ dd lmZ d ddgZe e ¡Z dZ dZ e !de ¡Z"dd Z#e $e#e"¡e $e#e"¡dZ%e e
|
dZ&G dd d eZ'G dd de'Z(dd Z)dS )é )Úabsolute_importNé )ÚRecentlyUsedContainer)ÚHTTPConnectionPoolÚHTTPSConnectionPool)Úport_by_scheme)ÚLocationValueErrorÚ MaxRetryErrorÚProxySchemeUnknownÚ InvalidProxyConfigurationWarning)Úsix)Úurljoin)ÚRequestMethods)Ú parse_url)ÚRetryÚ PoolManagerÚ ProxyManagerÚproxy_from_url)Úkey_fileÚ cert_fileÚ cert_reqsÚca_certsÚ ssl_versionÚ ca_cert_dirÚ ssl_contextÚ key_password)Ú
|
key_schemeÚkey_hostÚkey_portÚ key_timeoutÚ key_retriesÚ
|
key_strictÚ key_blockÚkey_source_addressÚ key_key_fileÚkey_key_passwordÚ key_cert_fileÚ key_cert_reqsÚ key_ca_certsÚkey_ssl_versionÚkey_ca_cert_dirÚkey_ssl_contextÚ key_maxsizeÚ key_headersÚ
|
key__proxyÚkey__proxy_headersÚkey_socket_optionsÚkey__socks_optionsÚkey_assert_hostnameÚkey_assert_fingerprintÚkey_server_hostnameÚPoolKeyc C s | ¡ }|d ¡ |d< |d ¡ |d< dD ],}||kr,|| dk r,t|| ¡ ||< q,| d¡}|dk rxt||d< t| ¡ D ]}| |¡|d| < q| j D ]}||kr¢d||< q¢| f |S )a÷
|
Create a pool key out of a request context dictionary.
|
|
According to RFC 3986, both the scheme and host are case-insensitive.
|
Therefore, this function normalizes both before constructing the pool
|
key for an HTTPS request. If you wish to change this behaviour, provide
|
alternate callables to ``key_fn_by_scheme``.
|
|
:param key_class:
|
The class to use when constructing the key. This should be a namedtuple
|
with the ``scheme`` and ``host`` keys at a minimum.
|
:type key_class: namedtuple
|
:param request_context:
|
A dictionary-like object that contain the context for a request.
|
:type request_context: dict
|
|
:return: A namedtuple that can be used as a connection pool key.
|
:rtype: PoolKey
|
ÚschemeÚhost)ÚheadersÚ_proxy_headersÚ_socks_optionsNÚsocket_optionsÚkey_)
|
ÚcopyÚlowerÚ frozensetÚitemsÚgetÚtupleÚlistÚkeysÚpopÚ_fields)Ú key_classÚrequest_contextÚcontextÚkeyÚ socket_optsÚfield© rM úVD:\z\workplace\VsCode\pyvenv\venv\Lib\site-packages\pip/_vendor/urllib3/poolmanager.pyÚ_default_key_normalizerJ s
|
|
|
rO ©ÚhttpÚhttpsc @ sx e Zd ZdZdZd ddZdd Zdd Zd d
|
d Zd d Z d ddZ
|
dd Z d ddZ d ddZ dd Zd!ddZdS )"r a$
|
Allows for arbitrary requests while transparently keeping track of
|
necessary connection pools for you.
|
|
:param num_pools:
|
Number of connection pools to cache before discarding the least
|
recently used pool.
|
|
:param headers:
|
Headers to include with all requests, unless other headers are given
|
explicitly.
|
|
:param \**connection_pool_kw:
|
Additional parameters are used to create fresh
|
:class:`urllib3.connectionpool.ConnectionPool` instances.
|
|
Example::
|
|
>>> manager = PoolManager(num_pools=2)
|
>>> r = manager.request('GET', 'http://google.com/')
|
>>> r = manager.request('GET', 'http://google.com/mail')
|
>>> r = manager.request('GET', 'http://yahoo.com/')
|
>>> len(manager.pools)
|
2
|
|
Né
|
c K s8 t | |¡ || _t|dd d| _t| _t ¡ | _d S )Nc S s | ¡ S ©N)Úclose)ÚprM rM rN Ú<lambda>¨ ó z&PoolManager.__init__.<locals>.<lambda>)Ú dispose_func)r Ú__init__Úconnection_pool_kwr ÚpoolsÚpool_classes_by_schemeÚkey_fn_by_schemer= )ÚselfÚ num_poolsr8 r[ rM rM rN rZ ¥ s
|
zPoolManager.__init__c C s | S rT rM ©r_ rM rM rN Ú __enter__¯ s zPoolManager.__enter__c C s | ¡ dS )NF)Úclear)r_ Úexc_typeÚexc_valÚexc_tbrM rM rN Ú__exit__² s zPoolManager.__exit__c C s^ | j | }|dkr | j ¡ }dD ]}| |d¡ q |dkrPtD ]}| |d¡ q>|||f|S )a·
|
Create a new :class:`ConnectionPool` based on host, port, scheme, and
|
any additional pool keyword arguments.
|
|
If ``request_context`` is provided, it is provided as keyword arguments
|
to the pool class used. This method is used to actually create the
|
connection pools handed out by :meth:`connection_from_url` and
|
companion methods. It is intended to be overridden for customization.
|
N)r6 r7 ÚportrQ )r] r[ r= rE Ú SSL_KEYWORDS)r_ r6 r7 rh rH Úpool_clsrJ ÚkwrM rM rN Ú _new_pool· s
|
|
|
zPoolManager._new_poolc C s | j ¡ dS )z´
|
Empty our store of pools and direct them all to close.
|
|
This will not affect in-flight connections, but they will not be
|
re-used after completion.
|
N)r\ rc ra rM rM rN rc Ò s zPoolManager.clearrQ c C sT |s t d| |¡}|p d|d< |s:t |d ¡ d¡}||d< ||d< | |¡S )a
|
Get a :class:`ConnectionPool` based on the host, port, and scheme.
|
|
If ``port`` isn't given, it will be derived from the ``scheme`` using
|
``urllib3.connectionpool.port_by_scheme``. If ``pool_kwargs`` is
|
provided, it is merged with the instance's ``connection_pool_kw``
|
variable and used to create the new connection pool, if one is
|
needed.
|
zNo host specified.rQ r6 éP rh r7 )r Ú_merge_pool_kwargsr rA r> Úconnection_from_context)r_ r7 rh r6 Ú pool_kwargsrH rM rM rN Úconnection_from_hostÛ s
|
z PoolManager.connection_from_hostc C s, |d ¡ }| j| }||}| j||dS )zâ
|
Get a :class:`ConnectionPool` based on the request context.
|
|
``request_context`` must at least contain the ``scheme`` key and its
|
value must be a key in ``key_fn_by_scheme`` instance variable.
|
r6 ©rH )r> r^ Úconnection_from_pool_key)r_ rH r6 Úpool_key_constructorÚpool_keyrM rM rN ro ò s
|
z#PoolManager.connection_from_contextc
|
C sl | j jZ | j |¡}|r*|W 5 Q R £ S |d }|d }|d }| j||||d}|| j |< W 5 Q R X |S )zû
|
Get a :class:`ConnectionPool` based on the provided pool key.
|
|
``pool_key`` should be a namedtuple that only contains immutable
|
objects. At a minimum it must have the ``scheme``, ``host``, and
|
``port`` fields.
|
r6 r7 rh rr )r\ ÚlockrA rl )r_ ru rH Úpoolr6 r7 rh rM rM rN rs ÿ s
|
z$PoolManager.connection_from_pool_keyc C s t |}| j|j|j|j|dS )aÖ
|
Similar to :func:`urllib3.connectionpool.connection_from_url`.
|
|
If ``pool_kwargs`` is not provided and a new pool needs to be
|
constructed, ``self.connection_pool_kw`` is used to initialize
|
the :class:`urllib3.connectionpool.ConnectionPool`. If ``pool_kwargs``
|
is provided, it is used instead. Note that if a new pool does not
|
need to be created for the request, the provided ``pool_kwargs`` are
|
not used.
|
)rh r6 rp )r rq r7 rh r6 )r_ Úurlrp ÚurM rM rN Úconnection_from_url s ÿz PoolManager.connection_from_urlc C sV | j ¡ }|rR| ¡ D ]:\}}|dkrHz
|
||= W qP tk
|
rD Y qPX q|||< q|S )a
|
Merge a dictionary of override values for self.connection_pool_kw.
|
|
This does not modify self.connection_pool_kw and returns a new dict.
|
Any keys in the override dictionary with a value of ``None`` are
|
removed from the merged dictionary.
|
N)r[ r= r@ ÚKeyError)r_ ÚoverrideÚbase_pool_kwargsrJ ÚvaluerM rM rN rn ' s
|
|
|
z PoolManager._merge_pool_kwargsTc K s t |}| j|j|j|jd}d|d< d|d< d|krD| j ¡ |d< | jdk rj|jdkrj|j||f|}n|j||j f|}|o|
|
¡ }|s|S t ||}|j dkr¨d }| d
|
¡} t| tsÊtj| |d } | jr| |¡stt |d ¡}
|
|
|
D ]"} | ¡ | jkrô|d | d¡ qôz| j||||d } W n, tk
|
rZ | jrR| ¡ | Y S X | |d
|
< ||d< t d ||¡ | ¡ | j||f|S )a]
|
Same as :meth:`urllib3.connectionpool.HTTPConnectionPool.urlopen`
|
with custom cross-host redirect logic and only sends the request-uri
|
portion of the ``url``.
|
|
The given ``url`` parameter must be absolute, such that an appropriate
|
:class:`urllib3.connectionpool.ConnectionPool` can be chosen for it.
|
)rh r6 FÚassert_same_hostÚredirectr8 NrQ i/ ÚGETÚretries)r )ÚresponseÚ_poolzRedirecting %s -> %s) r rq r7 rh r6 r8 r= ÚproxyÚurlopenÚ request_uriÚget_redirect_locationr ÚstatusrA Ú
|
isinstancer Úfrom_intÚremove_headers_on_redirectÚ is_same_hostrC r Úiterkeysr> rE Ú incrementr Úraise_on_redirectÚ
|
drain_connÚlogÚinfo) r_ Úmethodrx r rk ry Úconnr Úredirect_locationr r8 ÚheaderrM rM rN r ; sJ
|
|
|
|
ÿ
|
zPoolManager.urlopen)rS N)N)NrQ N)N)N)T)Ú__name__Ú
|
__module__Ú __qualname__Ú__doc__r
rZ rb rg rl rc rq ro rs rz rn r rM rM rM rN r s
|
|
|
|
|
|
c sP e Zd ZdZd fdd Zd fdd Zdd d
|
Zd d Zd fdd Z Z S )r ax
|
Behaves just like :class:`PoolManager`, but sends all requests through
|
the defined proxy, using the CONNECT method for HTTPS URLs.
|
|
:param proxy_url:
|
The URL of the proxy to be used.
|
|
:param proxy_headers:
|
A dictionary containing headers that will be sent to the proxy. In case
|
of HTTP they are being sent with each request, while in the
|
HTTPS/CONNECT case they are sent only once. Could be used for proxy
|
authentication.
|
|
Example:
|
>>> proxy = urllib3.ProxyManager('http://localhost:3128/')
|
>>> r1 = proxy.request('GET', 'http://google.com/')
|
>>> r2 = proxy.request('GET', 'http://httpbin.org/')
|
>>> len(proxy.pools)
|
1
|
>>> r3 = proxy.request('GET', 'https://httpbin.org/')
|
>>> r4 = proxy.request('GET', 'https://twitter.com/')
|
>>> len(proxy.pools)
|
3
|
|
rS Nc s t |tr d|j|j|jf }t|}|jsFt |jd¡}|j|d}|jdkrZt |j|| _
|
|pfi | _ | j
|
|d< | j |d< t t | j||f| d S )Nz
|
%s://%s:%irm )rh rP Ú_proxyr9 )r r r6 r7 rh r r rA Ú_replacer
|
r
Ú proxy_headersÚsuperr rZ )r_ Ú proxy_urlr` r8 r r[ r
rh ©Ú __class__rM rN rZ s"
|
ý
|
|
|
|
|
zProxyManager.__init__rQ c sD |dkr t t| j||||dS t t| j| jj| jj| jj|dS )NrR )rp )r r rq r
r7 rh r6 )r_ r7 rh r6 rp r¡ rM rN rq · s
|
ÿ
|
ÿz!ProxyManager.connection_from_hostc C s0 ddi}t |j}|r ||d< |r,| |¡ |S )z
|
Sets headers needed by proxies: specifically, the Accept and Host
|
headers. Only sets headers not provided by the user.
|
ÚAcceptz*/*ÚHost)r ÚnetlocÚupdate)r_ rx r8 Úheaders_r¥ rM rM rN Ú_set_proxy_headersÁ s
|
|
z ProxyManager._set_proxy_headersc C s( |dkr$| j jdkr$tjdtdd d S )NrR a Your proxy configuration specified an HTTPS scheme for the proxy. Are you sure you want to use HTTPS to contact the proxy? This most likely indicates an error in your configuration. Read this issue for more info: https://github.com/urllib3/urllib3/issues/1850é )Ú
|
stacklevel)r
r6 ÚwarningsÚwarnr )r_ Ú
|
url_schemerM rM rN Ú$_validate_proxy_scheme_url_selectionÐ s ùz1ProxyManager._validate_proxy_scheme_url_selectionTc sZ t |}| |j¡ |jdkr<| d| j¡}| ||¡|d< tt| j||fd|i|S )z@Same as HTTP(S)ConnectionPool.urlopen, ``url`` must be absolute.rQ r8 r ) r r® r6 rA r8 r¨ r r r )r_ r rx r rk ry r8 r¡ rM rN r Ü s
|
zProxyManager.urlopen)rS NN)NrQ N)N)T)
|
r r r r rZ rq r¨ r® r Ú __classcell__rM rM r¡ rN r } s û
|
|
c K s t f d| i|S )Nr )r )rx rk rM rM rN r ë s )*Ú
|
__future__r Ú collectionsÚ functoolsÚloggingr« Ú _collectionsr Úconnectionpoolr r r Ú
|
exceptionsr r r
|
r Úpackagesr Z packages.six.moves.urllib.parser Úrequestr Zutil.urlr Z
|
util.retryr Ú__all__Ú getLoggerr r ri Ú _key_fieldsÚ
|
namedtupler5 rO Úpartialr^ r] r r r rM rM rM rN Ú<module> s6
|
|
6
|
|
þ
|
wn
|
