U
|
I=®d+ ã @ s d Z ddlmZ ddlZddlZddlZddlmZ ddlm Z m
|
Z
|
m Z m Z m Z mZ ddlmZ ddlmZ dd lmZ dd
|
lmZ d d lmZ zdd lmZ W n ek
|
r¸ dZY nX e e ¡Z G dd de
|
Z G dd de Z G dd deZ!ej"Z"ej#Z#ej$Z$ej%Z%ej&Z&dS )a[
|
This module provides a pool manager that uses Google App Engine's
|
`URLFetch Service <https://cloud.google.com/appengine/docs/python/urlfetch>`_.
|
|
Example usage::
|
|
from pip._vendor.urllib3 import PoolManager
|
from pip._vendor.urllib3.contrib.appengine import AppEngineManager, is_appengine_sandbox
|
|
if is_appengine_sandbox():
|
# AppEngineManager uses AppEngine's URLFetch API behind the scenes
|
http = AppEngineManager()
|
else:
|
# PoolManager uses a socket-level API behind the scenes
|
http = PoolManager()
|
|
r = http.request('GET', 'https://google.com/')
|
|
There are `limitations <https://cloud.google.com/appengine/docs/python/urlfetch/#Python_Quotas_and_limits>`_ to the URLFetch service and it may not be
|
the best choice for your application. There are three options for using
|
urllib3 on Google App Engine:
|
|
1. You can use :class:`AppEngineManager` with URLFetch. URLFetch is
|
cost-effective in many circumstances as long as your usage is within the
|
limitations.
|
2. You can use a normal :class:`~urllib3.PoolManager` by enabling sockets.
|
Sockets also have `limitations and restrictions
|
<https://cloud.google.com/appengine/docs/python/sockets/ #limitations-and-restrictions>`_ and have a lower free quota than URLFetch.
|
To use sockets, be sure to specify the following in your ``app.yaml``::
|
|
env_variables:
|
GAE_USE_SOCKETS_HTTPLIB : 'true'
|
|
3. If you are using `App Engine Flexible
|
<https://cloud.google.com/appengine/docs/flexible/>`_, you can use the standard
|
:class:`PoolManager` without any configuration or special environment variables.
|
é )Úabsolute_importNé )Úurljoin)Ú HTTPErrorÚ HTTPWarningÚ MaxRetryErrorÚ ProtocolErrorÚ TimeoutErrorÚSSLError)ÚRequestMethods)Ú HTTPResponse)ÚTimeout)ÚRetryé )Ú_appengine_environ)Úurlfetchc @ s e Zd ZdS )ÚAppEnginePlatformWarningN©Ú__name__Ú
|
__module__Ú __qualname__© r r ú\D:\z\workplace\VsCode\pyvenv\venv\Lib\site-packages\pip/_vendor/urllib3/contrib/appengine.pyr G s r c @ s e Zd ZdS )ÚAppEnginePlatformErrorNr r r r r r K s r c @ sX e Zd ZdZdddZdd Zdd Zddddejfd
|
d Z d d Z
|
dd Z dd Z dS )ÚAppEngineManagera
|
Connection manager for Google App Engine sandbox applications.
|
|
This manager uses the URLFetch service directly instead of using the
|
emulated httplib, and is subject to URLFetch limitations as described in
|
the App Engine documentation `here
|
<https://cloud.google.com/appengine/docs/python/urlfetch>`_.
|
|
Notably it will raise an :class:`AppEnginePlatformError` if:
|
* URLFetch is not available.
|
* If you attempt to use this on App Engine Flexible, as full socket
|
support is available.
|
* If a request size is more than 10 megabytes.
|
* If a response size is more than 32 megabtyes.
|
* If you use an unsupported request method such as OPTIONS.
|
|
Beyond those cases, it will raise normal urllib3 errors.
|
NTc C s@ t s tdt dt¡ t | |¡ || _|| _|p8t j
|
| _ d S )Nz.URLFetch is not available in this environment.zÃurllib3 is using URLFetch on Google App Engine sandbox instead of sockets. To use sockets directly instead of URLFetch see https://urllib3.readthedocs.io/en/latest/reference/urllib3.contrib.html.) r r ÚwarningsÚwarnr r Ú__init__Úvalidate_certificateÚurlfetch_retriesr ÚDEFAULTÚretries)ÚselfÚheadersr! r r r r r r c s ÿü zAppEngineManager.__init__c C s | S )Nr )r" r r r Ú __enter__| s zAppEngineManager.__enter__c C s dS )NFr )r" Úexc_typeÚexc_valÚexc_tbr r r Ú__exit__ s zAppEngineManager.__exit__c
|
K sâ | ||¡}zF|o |jdko |j} tj||||p2i d| jo<| | |¡| jd}
|
W nB tjk
|
r } zt | | W 5 d } ~ X Y n tj
|
k
|
r } z"dt | krªt d| t | W 5 d } ~ X Y nÔ tjk
|
r } z&dt | krðt| || dt | W 5 d } ~ X Y n tjk
|
r6 } zt d| W 5 d } ~ X Y n` tjk
|
rb } z t| W 5 d } ~ X Y n4 tjk
|
r } zt d | | W 5 d } ~ X Y nX | j|
|
fd
|
|i|} |o¸| ¡ } | rv| jrÞ|jrÞt| |d n| jd krîd }z|j||| | d}W n. tk
|
r2 |jr*t| |d | Y S X | | ¡ t d|| ¡ t || }| j ||||f|||d|S t | d¡}| || j|¡rÞ|j||| | d}t d|¡ | !| ¡ | j ||f|||||d|S | S )Nr F)ÚpayloadÚmethodr# Zallow_truncatedÚfollow_redirectsÚdeadliner z too largezOURLFetch request too large, URLFetch only supports requests up to 10mb in size.zToo many redirects)ÚreasonzPURLFetch response too large, URLFetch only supportsresponses up to 32mb in size.z$URLFetch does not support method: %sr! ztoo many redirectsi/ ÚGET)ÚresponseÚ_poolzRedirecting %s -> %s)r! ÚredirectÚtimeoutz Retry-Afterz Retry: %s)Úbodyr# r! r1 r2 )"Ú _get_retriesr1 Útotalr Úfetchr Ú_get_absolute_timeoutr ZDeadlineExceededErrorr ZInvalidURLErrorÚstrr r Z DownloadErrorr ZResponseTooLargeErrorZSSLCertificateErrorr
|
ZInvalidMethodErrorÚ#_urlfetch_response_to_http_responseÚget_redirect_locationÚraise_on_redirectÚstatusÚ incrementÚsleep_for_retryÚlogÚdebugr ÚurlopenÚboolÚ getheaderÚis_retryÚsleep)r" r* Úurlr3 r# r! r1 r2 Ú response_kwr+ r/ ÚeÚ http_responseÚredirect_locationZ redirect_urlÚhas_retry_afterr r r rA s¾ ø
|
ý ý ÿÿÿÿ ÿ
|
|
|
|
üùø
|
þùø zAppEngineManager.urlopenc K s¤ t r"|j d¡}|dkr"|jd= |j d¡}|dkrZ| d¡}| d¡ d |¡|jd< tf t |j ¡|j
|
|j|j d|}tf t |j ¡|j|j |d|S )Nzcontent-encodingÚdeflateztransfer-encodingÚchunkedú,)r3 Úmsgr# r< )r3 r# r< Úoriginal_response) Úis_prod_appenginer# ÚgetÚsplitÚremoveÚjoinr ÚioÚBytesIOÚcontentZ
|
header_msgÚ status_code)r" Z urlfetch_resprG Úcontent_encodingZtransfer_encodingÚ encodingsrP r r r r9 õ s2
|
|
|
úù
|
|
üûz4AppEngineManager._urlfetch_response_to_http_responsec C sB |t jkrd S t|t r>|jd k s,|jd k r8t dt¡ |jS |S )NzdURLFetch does not support granular timeout settings, reverting to total or default URLFetch timeout.) r ÚDEFAULT_TIMEOUTÚ
|
isinstanceÚ_readÚ_connectr r r r5 )r" r2 r r r r7 s
|
|
ýz&AppEngineManager._get_absolute_timeoutc C s> t |ts tj||| jd}|js.|js.|jr:t dt ¡ |S )N)r1 ÚdefaultzhURLFetch only supports total retries and does not recognize connect, read, or redirect retry parameters.)
|
r] r Úfrom_intr! ÚconnectÚreadr1 r r r )r" r! r1 r r r r4 & s
|
ýz AppEngineManager._get_retries)NNTT) r r r Ú__doc__r r$ r( r r\ rA r9 r7 r4 r r r r r O s" û
|
ø
|
r$ r )'rd Ú
|
__future__r rV Úloggingr Z packages.six.moves.urllib.parser Ú
|
exceptionsr r r r r r
|
Úrequestr r/ r Z util.timeoutr Z
|
util.retryr Ú r Zgoogle.appengine.apir Ú ImportErrorÚ getLoggerr r? r r r Ú is_appengineÚis_appengine_sandboxÚis_local_appenginerQ Úis_prod_appengine_mvmsr r r r Ú<module> s2 (
|
|
h
|
