U
|
I=®d=n ã @ s` d dl mZ d dlmZ d dlZd dlZd dlZd dlmZ d dlm
|
Z z d dl Z W n e k
|
rl dZ Y nX ddlmZ ddlmZmZmZmZmZmZmZmZ dd lmZm Z dd
|
l m Z dd l m!Z!m"Z" dd l#m$Z$m%Z% e &e'¡Z(G d d de)Z*G dd de)Z+G dd de)Z,e dk r2G dd de)Z-G dd de)Z.dd Z/G dd dej0Z1dS )é )Úabsolute_import)ÚcontextmanagerN)Útimeout)Úerroré )ÚHTTPHeaderDict)ÚBodyNotHttplibCompatibleÚ ProtocolErrorÚ DecodeErrorÚReadTimeoutErrorÚResponseNotChunkedÚIncompleteReadÚ InvalidHeaderÚ HTTPError)Ú string_typesÚPY3)Ú http_client)Ú HTTPExceptionÚ BaseSSLError)Ú is_fp_closedÚis_response_to_headc @ s$ e Zd Zdd Zdd Zdd ZdS )ÚDeflateDecoderc C s d| _ d| _t ¡ | _d S )NTó )Ú
|
_first_tryÚ_dataÚzlibÚ decompressobjÚ_obj©Úself© r úSD:\z\workplace\VsCode\pyvenv\venv\Lib\site-packages\pip/_vendor/urllib3/response.pyÚ__init__" s zDeflateDecoder.__init__c C s t | j|S ©N©Úgetattrr ©r Únamer r r! Ú __getattr__' s zDeflateDecoder.__getattr__c C s |s|S | j s| j |¡S | j|7 _z"| j |¡}|rFd| _ d | _|W S tjk
|
r d| _ t tj ¡| _z| | j¡W ¢ Y S d | _X Y nX d S )NF)r r Ú
|
decompressr r r r Ú MAX_WBITS)r ÚdataÚ decompressedr r r! r) * s" zDeflateDecoder.decompressN©Ú__name__Ú
|
__module__Ú __qualname__r" r( r) r r r r! r ! s r c @ s e Zd ZdZdZdZdS )ÚGzipDecoderStater r é N)r. r/ r0 Ú FIRST_MEMBERÚ OTHER_MEMBERSÚ SWALLOW_DATAr r r r! r1 A s r1 c @ s$ e Zd Zdd Zdd Zdd ZdS )Ú GzipDecoderc C s t dt j ¡| _tj| _d S ©Né )r r r* r r1 r3 Ú_stater r r r! r" I s zGzipDecoder.__init__c C s t | j|S r# r$ r& r r r! r( M s zGzipDecoder.__getattr__c C s¤ t }| jtjks|s t|S z|| j |¡7 }W n< tjk
|
rn | j}tj| _|tj krht| Y S Y nX | jj
|
}|st|S tj | _t dtj ¡| _q d S r7 ) Ú bytearrayr9 r1 r5 Úbytesr r) r r r4 Ú unused_datar r* )r r+ ÚretÚprevious_stater r r! r) P s
|
zGzipDecoder.decompressNr- r r r r! r6 H s r6 c @ s$ e Zd Zdd Zdd Zdd ZdS )Ú BrotliDecoderc C s t ¡ | _d S r# )ÚbrotliZ Decompressorr r r r r! r" l s zBrotliDecoder.__init__c C s$ t | jdr| j |¡S | j |¡S )Nr) )Úhasattrr r) Úprocess)r r+ r r r! r) o s zBrotliDecoder.decompressc C s t | jdr| j ¡ S dS )NÚflushr )rA r rC r r r r! rC t s
|
zBrotliDecoder.flushN)r. r/ r0 r" r) rC r r r r! r? h s r? c @ s( e Zd ZdZdd Zdd Zdd ZdS ) Ú MultiDecodera
|
From RFC7231:
|
If one or more encodings have been applied to a representation, the
|
sender that applied the encodings MUST generate a Content-Encoding
|
header field that lists the content codings in the order in which
|
they were applied.
|
c C s dd | d¡D | _d S )Nc S s g | ]}t | ¡ qS r )Ú _get_decoderÚstrip)Ú.0Úmr r r! Ú
|
<listcomp> s z)MultiDecoder.__init__.<locals>.<listcomp>ú,)ÚsplitÚ _decoders)r Úmodesr r r! r" s zMultiDecoder.__init__c C s | j d ¡ S ©Nr )rL rC r r r r! rC s zMultiDecoder.flushc C s t | jD ]}| |¡}q
|
|S r# )ÚreversedrL r) )r r+ Údr r r! r) s zMultiDecoder.decompressN)r. r/ r0 Ú__doc__r" rC r) r r r r! rD z s rD c C s: d| krt | S | dkr t S td k r4| dkr4t S t S )NrJ ÚgzipÚbr)rD r6 r@ r? r )Úmoder r r! rE s rE c @ sl e Zd ZdZddgZedk r&edg7 Zdddd d
|
gZdNddZdd Zdd Z dd Z
|
e dd Z e dd Z dd Zd d Zd d Zd!d" ZeejfZedk r¬eejf7 Zd#d$ Zd%d& Zed'd( ZdOd)d*ZdPd,d-Ze d.d/ Z d0d1 Z dQd2d3Z d4d5 Z d6d7 Z!e d8d9 Z"d:d; Z#d<d= Z$d>d? Z%d@dA Z&dBdC Z'dDdE Z(dFdG Z)dRdHdIZ*dJdK Z+dLdM Z,dS )SÚ HTTPResponseaº
|
HTTP Response container.
|
|
Backwards-compatible to httplib's HTTPResponse but the response ``body`` is
|
loaded and decoded on-demand when the ``data`` property is accessed. This
|
class is also compatible with the Python standard library's :mod:`io`
|
module, and can hence be treated as a readable object in the context of that
|
framework.
|
|
Extra parameters for behaviour not present in httplib.HTTPResponse:
|
|
:param preload_content:
|
If True, the response's body will be preloaded during construction.
|
|
:param decode_content:
|
If True, will attempt to decode the body based on the
|
'content-encoding' header.
|
|
:param original_response:
|
When this HTTPResponse wrapper is generated from an httplib.HTTPResponse
|
object, it's convenient to include the original for debug purposes. It's
|
otherwise unused.
|
|
:param retries:
|
The retries contains the last :class:`~urllib3.util.retry.Retry` that
|
was used during the request.
|
|
:param enforce_content_length:
|
Enforce content length checking. Body returned by server must match
|
value of Content-Length header, if present. Otherwise, raise error.
|
rR ÚdeflateNrS i- i. i/ i3 i4 Ú r TFc C s t |tr|| _n
|
t|| _|| _|| _|| _|| _|| _| | _|| _ || _
|
d | _ d | _ d | _ | | _d| _| | _|| _|rt |ttfr|| _ |
|
| _| | _t|drª|| _ d| _d | _| j dd¡ ¡ }dd | d¡D }d |krêd
|
| _| |¡| _ |r| j s| j |d | _ d S ) Nr ÚreadFztransfer-encodingrW c s s | ]}| ¡ V qd S r# )rF )rG Úencr r r! Ú <genexpr>ú s z(HTTPResponse.__init__.<locals>.<genexpr>rJ ÚchunkedT©Údecode_content) Ú
|
isinstancer ÚheadersÚstatusÚversionÚreasonÚstrictr] ÚretriesÚenforce_content_lengthÚ
|
auto_closeÚ_decoderÚ_bodyÚ_fpÚ_original_responseÚ_fp_bytes_readÚmsgÚ _request_urlÚ
|
basestringr; Ú_poolÚ _connectionrA r[ Ú
|
chunk_leftÚgetÚlowerrK Ú _init_lengthÚlength_remainingrX )r Úbodyr_ r` ra rb rc Úpreload_contentr] Úoriginal_responseÚpoolÚ
|
connectionrl rd re Úrequest_methodÚ request_urlrf Útr_encÚ encodingsr r r! r" Â sB
|
|
|
zHTTPResponse.__init__c C s | j | jkr| j d¡S dS )a
|
Should we redirect and where to?
|
|
:returns: Truthy redirect location string if we got a redirect status
|
code and valid location. ``None`` if redirect status and no
|
location. ``False`` if not a redirect status code.
|
ÚlocationF)r` ÚREDIRECT_STATUSESr_ rr r r r r! Úget_redirect_location s z"HTTPResponse.get_redirect_locationc C s( | j r | jsd S | j | j¡ d | _d S r# )ro rp Ú _put_connr r r r! Ú release_conn s zHTTPResponse.release_connc C s. z | ¡ W n ttttfk
|
r( Y nX dS )zÏ
|
Read and discard any remaining HTTP response data in the response connection.
|
|
Unread data in the HTTPResponse connection blocks the connection from being released back to the pool.
|
N)rX r Ú SocketErrorr r r r r r! Ú
|
drain_conn s zHTTPResponse.drain_connc C s" | j r | j S | jr | jddS d S )NT)Ú cache_content)rh ri rX r r r r! r+ $ s zHTTPResponse.datac C s | j S r# )rp r r r r! rz - s zHTTPResponse.connectionc C s
|
t | jS r# )r ri r r r r! Úisclosed1 s zHTTPResponse.isclosedc C s | j S )zÛ
|
Obtain the number of bytes pulled over the wire so far. May differ from
|
the amount of content returned by :meth:``HTTPResponse.read`` if bytes
|
are encoded on the wire (e.g, compressed).
|
)rk r r r r! Útell4 s zHTTPResponse.tellc C sà | j d¡}|dk r| jr(t d¡ dS z<tdd | d¡D }t|dkrZtd| | ¡ }W n t
|
k
|
r| d}Y nX |d k rd}zt | j }W n t
|
k
|
r° d }Y nX |d
|
ksØd | krÎd k sØn |d krÜd }|S )zM
|
Set initial length value for Response content if available.
|
zcontent-lengthNzÒReceived response with both Content-Length and Transfer-Encoding set. This is expressly forbidden by RFC 7230 sec 3.3.2. Ignoring Content-Length and attempting to process response as Transfer-Encoding: chunked.c S s g | ] }t |qS r )Úint)rG Úvalr r r! rI V s z-HTTPResponse._init_length.<locals>.<listcomp>rJ r z8Content-Length contained multiple unmatching values (%s)r )éÌ i0 éd éÈ ÚHEAD) r_ rr r[ ÚlogÚwarningÚsetrK Úlenr ÚpopÚ
|
ValueErrorr r` )r r{ ÚlengthÚlengthsr` r r r! rt < s6 ÿ ÿÿ
|
|
&zHTTPResponse._init_lengthc sh j dd¡ ¡ } jdkrd| jkr2t| _n2d|krd fdd| d¡D }t|rdt| _dS )z=
|
Set-up the _decoder attribute if necessary.
|
úcontent-encodingrW NrJ c s" g | ]}| ¡ jkr| ¡ qS r )rF ÚCONTENT_DECODERS)rG Úer r r! rI { s þz.HTTPResponse._init_decoder.<locals>.<listcomp>)r_ rr rs rg r rE rK r )r Úcontent_encodingr~ r r r! Ú _init_decoderp s
|
|
|
þzHTTPResponse._init_decoderc
|
C sx |s|S z| j r | j |¡}W nD | jk
|
rb } z$| j dd¡ ¡ }td| |W 5 d}~X Y nX |rt|| ¡ 7 }|S )zN
|
Decode the data passed in and potentially flush the decoder.
|
r rW zEReceived response with content-encoding: %s, but failed to decode it.N)rg r) ÚDECODER_ERROR_CLASSESr_ rr rs r
|
Ú_flush_decoder)r r+ r] Ú flush_decoderr r r r r! Ú_decode s ÿý zHTTPResponse._decodec C s$ | j r | j d¡}|| j ¡ S dS )zk
|
Flushes the decoder. Should only be called if the decoder is actually
|
being used.
|
r )rg r) rC )r Úbufr r r! r s zHTTPResponse._flush_decoderc
|
c sì d}z¤z
|
dV W n tk
|
r2 t| jddY np tk
|
rn } z dt |krP t| jddW 5 d}~X Y n4 t
|
t fk
|
r } zt d| |W 5 d}~X Y nX d}W 5 |sÎ| j r¾| j ¡ | jrÎ| j ¡ | j ræ| j ¡ ræ| ¡ X dS )zç
|
Catch low-level python exceptions, instead re-raising urllib3
|
variants, so that low-level exceptions are not leaked in the
|
high-level api.
|
|
On exit, release the connection back to the pool.
|
FNzRead timed out.zread operation timed outzConnection broken: %rT) rj Úcloserp r r Ú SocketTimeoutr ro r Ústrr r r )r Ú
|
clean_exitr r r r! Ú_error_catcher¨ s(
|
|
|
zHTTPResponse._error_catcherc C s | ¡ |dkr| j}| jdkr$dS d}t| jdd}| ¡ v |dkr`|sV| j ¡ nd}d}nPd}|st| j |¡nd}|dkr°|s°| j ¡ d}| jr°| jdkr°t | j
|
| jW 5 Q R X |r| j
|
t |7 _
|
| jdk rî| jt |8 _| |||¡}|r|| _ |S )aP
|
Similar to :meth:`httplib.HTTPResponse.read`, but with two additional
|
parameters: ``decode_content`` and ``cache_content``.
|
|
:param amt:
|
How much of the content to read. If specified, caching is skipped
|
because it doesn't make sense to cache partial content as the full
|
response.
|
|
:param decode_content:
|
If True, will attempt to decode the body based on the
|
'content-encoding' header.
|
|
:param cache_content:
|
If True, will save the returned data such that the same result is
|
returned despite of the state of the underlying file object. This
|
is useful if you want the ``.data`` property to continue working
|
after having ``.read()`` the file object. (Overridden if ``amt`` is
|
set.)
|
NFÚclosedr Tr )r N)r r] ri r% r¥ rX r¡ re ru r rk r r rh )r Úamtr] r r Ú fp_closedr+ r r r! rX á s:
|
|
ÿÿ
|
|
|
zHTTPResponse.readé c c sR | j r*| ¡ r*| j||dD ]
|
}|V q n$t| jsN| j||d}|r*|V q*dS )a_
|
A generator wrapper for the read() method. A call will block until
|
``amt`` bytes have been read from the connection or until the
|
connection is closed.
|
|
:param amt:
|
How much of the content to read. The generator will return up to
|
much data per iteration, but may return less. This is particularly
|
likely when using compressed data. However, the empty string will
|
never be returned.
|
|
:param decode_content:
|
If True, will attempt to decode the body based on the
|
'content-encoding' header.
|
r\ )r§ r] N)r[ Úsupports_chunked_readsÚ read_chunkedr ri rX )r r§ r] Úliner+ r r r! Ústream+ s
|
|
zHTTPResponse.streamc
|
K s` |j }t|ts,tr"t| ¡ }n
|
t |¡}t|dd}| f |||j|j|j ||d|}|S )a
|
Given an :class:`httplib.HTTPResponse` instance ``r``, return a
|
corresponding :class:`urllib3.response.HTTPResponse` object.
|
|
Remaining parameters are passed to the HTTPResponse constructor, along
|
with ``original_response=r``.
|
rc r )rv r_ r` ra rb rc rx )
|
rl r^ r r ÚitemsÚ from_httplibr% r` ra rb )Ú ResponseClsÚrÚ response_kwr_ rc Úrespr r r! r¯ E s$
|
|
ùø
|
zHTTPResponse.from_httplibc C s | j S r# ©r_ r r r r! Ú
|
getheadersf s zHTTPResponse.getheadersc C s | j ||¡S r# )r_ rr )r r' Údefaultr r r! Ú getheaderi s zHTTPResponse.getheaderc C s | j S r# r´ r r r r! Úinfom s zHTTPResponse.infoc C s6 | j s| j ¡ | jr | j ¡ | js2tj | ¡ d S r# )r¦ ri r¡ rp rf ÚioÚIOBaser r r r! r¡ q s
|
|
zHTTPResponse.closec C sT | j stjj | ¡S | jd kr"dS t| jdr8| j ¡ S t| jdrL| jjS dS d S )NTr r¦ )rf r¹ rº r¦ Ú__get__ri rA r r r r r! r¦ { s
|
|
zHTTPResponse.closedc C s6 | j d krtdn t| j dr*| j ¡ S tdd S )Nz-HTTPResponse has no file to get a fileno fromÚfilenozOThe file-like object this HTTPResponse is wrapped around has no file descriptor)ri ÚIOErrorrA r¼ r r r r! r¼ s
|
|
|
ÿzHTTPResponse.filenoc C s2 | j d k r.t| j dr.t| j dds.| j ¡ S d S )NrC r¦ F)ri rA r% rC r r r r! rC s ÿ
|
þ ýzHTTPResponse.flushc C s dS )NTr r r r r! Úreadable s zHTTPResponse.readablec C s: | t|¡}t|dkr dS ||d t|
< t|S d S rN )rX r )r ÚbÚtempr r r! Úreadinto s
|
zHTTPResponse.readintoc C s t | jdS )zú
|
Checks if the underlying file-like object looks like a
|
httplib.HTTPResponse object. We do this by testing for the fp
|
attribute. If it is present we assume it returns raw chunks as
|
processed by read_chunked().
|
Úfp)rA ri r r r r! rª ¨ s z#HTTPResponse.supports_chunked_readsc C sf | j d k rd S | jj ¡ }| dd¡d }zt|d| _ W n& tk
|
r` | ¡ t |¡Y nX d S )Nó ;r r r8 )
|
rq ri r ÚreadlinerK r r r¡ Úhttplibr )r r¬ r r r! Ú_update_chunk_length± s
|
z!HTTPResponse._update_chunk_lengthc C s¬ d }|d kr2| j | j¡}|}| j d¡ d | _nv|| jk rZ| j |¡}| j| | _|}nN|| jkr| j |¡}| j d¡ d | _|}n | j | j¡}| j d¡ d | _|S )Nr2 )ri Ú
|
_safe_readrq )r r§ Úreturned_chunkÚchunkÚvaluer r r! Ú _handle_chunk¿ s&
|
|
zHTTPResponse._handle_chunkc c sþ | ¡ | jstd| ¡ s&td| ¡ Æ | jrXt| jrX| j ¡ W 5 Q R £ dS | j j
|
dkrrW 5 Q R £ dS | ¡ | j dkrq¬| |¡}| j||dd}|rr|V qr|rÂ| ¡ }|rÂ|V | j j
|
¡ }|sÔqà|dkrÂqàqÂ| jrð| j ¡ W 5 Q R X dS )aÆ
|
Similar to :meth:`HTTPResponse.read`, but with an additional
|
parameter: ``decode_content``.
|
|
:param amt:
|
How much of the content to read. If specified, caching is skipped
|
because it doesn't make sense to cache partial content as the full
|
response.
|
|
:param decode_content:
|
If True, will attempt to decode the body based on the
|
'content-encoding' header.
|
zHResponse is not chunked. Header 'transfer-encoding: chunked' is missing.zgBody should be httplib.HTTPResponse like. It should have have an fp attribute which returns raw chunks.Nr F)r] r s
|
)r r[ r rª r r¥ rj r r¡ ri r rÆ rq rË r r rÄ )r r§ r] rÉ Údecodedr¬ r r r! r« Õ sJ ÿÿ
|
|
|
|
ÿ zHTTPResponse.read_chunkedc C s. | j dk r$t| j jr$| j jd jS | jS dS )zÄ
|
Returns the URL that was the source of this response.
|
If the request that generated this response redirected, this method
|
will return the final redirect location.
|
Néÿÿÿÿ)rd r ÚhistoryÚredirect_locationrm r r r r! Úgeturl s zHTTPResponse.geturlc c s g }| j ddD ]n}d|krt| d¡}d |¡|d d V |dd
D ]}|d V qJ|d rn|d g}q~g }q| |¡ q|rd |¡V d S )NTr\ ó
|
r r r rÍ )r rK ÚjoinÚappend)r ÚbufferrÉ Úxr r r! Ú__iter__& s
|
zHTTPResponse.__iter__)rW Nr r Nr TTNNNNNFNNT)NNF)r© N)N)NN)-r. r/ r0 rQ r r@ r r" r r r
Úpropertyr+ rz r r rt r r½ r r r r r r r¥ rX r Ú classmethodr¯ rµ r· r¸ r¡ r¦ r¼ rC r¾ rÁ rª rÆ rË r« rÐ rÖ r r r r! rU sz
|
î
|
C
|
|
4
|
|
8
|
J
|
|
|
|
|
|
F rU )2Ú
|
__future__r Ú
|
contextlibr r r¹ ÚloggingÚsocketr r¢ r r r@ Ú ImportErrorÚ _collectionsr Ú
|
exceptionsr r r
|
r r r r r Z packages.sixr rn r Zpackages.six.movesr rÅ rz r r Z util.responser r Ú getLoggerr. r Úobjectr r1 r6 r? rD rE rº rU r r r r! Ú<module> s2
|
(
|
|
|
|
