U
|
I=®dS) ã @ sæ d Z ddlmZ ddlZddlmZ dZddd d
|
d Zi Zd d Z dd Z
|
dd Z G dd de Z e
|
dZe
|
dZe
|
dZd+ddZdd Zed fd d Zd,d d Zd!d" Zed fd#d$Zd%d& ZG d'd( d(e ZG d)d* d*e ZdS )-a
|
|
webencodings
|
~~~~~~~~~~~~
|
|
This is a Python implementation of the `WHATWG Encoding standard
|
<http://encoding.spec.whatwg.org/>`. See README for details.
|
|
:copyright: Copyright 2012 by Simon Sapin
|
:license: BSD, see LICENSE for details.
|
|
é )Úunicode_literalsNé )ÚLABELSz0.5.1z
|
iso-8859-8z mac-cyrillicz mac-romanÚcp874)z iso-8859-8-izx-mac-cyrillicÚ macintoshz windows-874c C s | d¡ ¡ d¡S )a9 Transform (only) ASCII letters to lower case: A-Z is mapped to a-z.
|
|
:param string: An Unicode string.
|
:returns: A new Unicode string.
|
|
This is used for `ASCII case-insensitive
|
<http://encoding.spec.whatwg.org/#ascii-case-insensitive>`_
|
matching of encoding labels.
|
The same matching is also used, among other things,
|
for `CSS keywords <http://dev.w3.org/csswg/css-values/#keywords>`_.
|
|
This is different from the :meth:`~py:str.lower` method of Unicode strings
|
which also affect non-ASCII characters,
|
sometimes mapping them into the ASCII range:
|
|
>>> keyword = u'Bac\N{KELVIN SIGN}ground'
|
>>> assert keyword.lower() == u'background'
|
>>> assert ascii_lower(keyword) != keyword.lower()
|
>>> assert ascii_lower(keyword) == u'bac\N{KELVIN SIGN}ground'
|
|
Úutf8)ÚencodeÚlowerÚdecode)Ústring© r úXD:\z\workplace\VsCode\pyvenv\venv\Lib\site-packages\pip/_vendor/webencodings/__init__.pyÚ ascii_lower# s r c C sx t | d¡} t | ¡}|dkr$dS t |¡}|dkrt|dkrLddlm} nt ||¡}t |¡}t
|
||}|t|< |S )u<
|
Look for an encoding by its label.
|
This is the specâs `get an encoding
|
<http://encoding.spec.whatwg.org/#concept-encoding-get>`_ algorithm.
|
Supported labels are listed there.
|
|
:param label: A string.
|
:returns:
|
An :class:`Encoding` object, or :obj:`None` for an unknown label.
|
|
z
|
Nzx-user-definedr )Ú
|
codec_info) r Ústripr ÚgetÚCACHEÚx_user_definedr Ú PYTHON_NAMESÚcodecsÚlookupÚEncoding)ÚlabelÚnameÚencodingr Ú python_namer r r r = s
|
|
|
|
r c C s. t | dr| S t| }|dkr*td| |S )zç
|
Accept either an encoding object or label.
|
|
:param encoding: An :class:`Encoding` object or a label string.
|
:returns: An :class:`Encoding` object.
|
:raises: :exc:`~exceptions.LookupError` for an unknown label.
|
|
r NzUnknown encoding label: %r)Úhasattrr Ú LookupError)Úencoding_or_labelr r r r Ú _get_encoding[ s
|
r c @ s e Zd ZdZdd Zdd ZdS )r aO Reresents a character encoding such as UTF-8,
|
that can be used for decoding or encoding.
|
|
.. attribute:: name
|
|
Canonical name of the encoding
|
|
.. attribute:: codec_info
|
|
The actual implementation of the encoding,
|
a stdlib :class:`~codecs.CodecInfo` object.
|
See :func:`codecs.register`.
|
|
c C s || _ || _d S ©N)r r )Úselfr r r r r Ú__init__| s zEncoding.__init__c C s
|
d| j S )Nz <Encoding %s>)r )r! r r r Ú__repr__ s zEncoding.__repr__N)Ú__name__Ú
|
__module__Ú __qualname__Ú__doc__r" r# r r r r r m s r zutf-8zutf-16lezutf-16beÚreplacec C s2 t |}t| \}} |p|}|j | |¡d |fS )aÖ
|
Decode a single string.
|
|
:param input: A byte string
|
:param fallback_encoding:
|
An :class:`Encoding` object or a label string.
|
The encoding to use if :obj:`input` does note have a BOM.
|
:param errors: Type of error handling. See :func:`codecs.register`.
|
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
|
:return:
|
A ``(output, encoding)`` tuple of an Unicode string
|
and an :obj:`Encoding`.
|
|
r )r Ú _detect_bomr r
|
)ÚinputÚfallback_encodingÚerrorsÚ bom_encodingr r r r r
|
s r
|
c C sV | d¡rt| dd
fS | d¡r4t| dd
fS | d¡rNt| dd
fS d| fS )zBReturn (bom_encoding, input), with any BOM removed from the input.s ÿþé Ns þÿs é )Ú
|
startswithÚ_UTF16LEÚ_UTF16BEÚUTF8)r* r r r r) ¡ s
|
|
|
r) Ústrictc C s t |j | |¡d S )a;
|
Encode a single string.
|
|
:param input: An Unicode string.
|
:param encoding: An :class:`Encoding` object or a label string.
|
:param errors: Type of error handling. See :func:`codecs.register`.
|
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
|
:return: A byte string.
|
|
r )r r r )r* r r, r r r r ¬ s r c C s$ t ||}t| |}t|}||fS )aâ
|
"Pull"-based decoder.
|
|
:param input:
|
An iterable of byte strings.
|
|
The input is first consumed just enough to determine the encoding
|
based on the precense of a BOM,
|
then consumed on demand when the return value is.
|
:param fallback_encoding:
|
An :class:`Encoding` object or a label string.
|
The encoding to use if :obj:`input` does note have a BOM.
|
:param errors: Type of error handling. See :func:`codecs.register`.
|
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
|
:returns:
|
An ``(output, encoding)`` tuple.
|
:obj:`output` is an iterable of Unicode strings,
|
:obj:`encoding` is the :obj:`Encoding` that is being used.
|
|
)ÚIncrementalDecoderÚ_iter_decode_generatorÚnext)r* r+ r, ÚdecoderÚ generatorr r r r Ú iter_decodeº s
|
|
r: c c sª |j }t| } | D ]0}||}|r|jdk s0t|jV |V qtq|ddd}|jdk s^t|jV |rp|V dS | D ]}||}|rx|V qx|ddd}|r¦|V dS )zqReturn a generator that first yields the :obj:`Encoding`,
|
then yields output chukns as Unicode strings.
|
|
Nó T©Úfinal)r
|
Úiterr ÚAssertionError)r* r8 r
|
ÚchunckÚoutputr r r r6 Ö s, r6 c C s t ||j}t| |S )uY
|
âPullâ-based encoder.
|
|
:param input: An iterable of Unicode strings.
|
:param encoding: An :class:`Encoding` object or a label string.
|
:param errors: Type of error handling. See :func:`codecs.register`.
|
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
|
:returns: An iterable of byte strings.
|
|
)ÚIncrementalEncoderr Ú_iter_encode_generator)r* r r, r r r r Ú iter_encodeö s rD c c s6 | D ]}||}|r|V q|ddd}|r2|V d S )NÚ Tr< r )r* r r@ rA r r r rC s rC c @ s$ e Zd ZdZd ddZd
|
ddZdS ) r5 uO
|
âPushâ-based decoder.
|
|
:param fallback_encoding:
|
An :class:`Encoding` object or a label string.
|
The encoding to use if :obj:`input` does note have a BOM.
|
:param errors: Type of error handling. See :func:`codecs.register`.
|
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
|
|
r( c C s& t || _|| _d| _d | _d | _d S )Nr; )r Ú_fallback_encodingÚ_errorsÚ_bufferÚ_decoderr )r! r+ r, r r r r" s
|
|
zIncrementalDecoder.__init__Fc C s| | j }|dk r|||S | j| }t|\}}|dkrVt|dk rP|sP|| _dS | j}|j | j¡j}|| _ || _ |||S )zùDecode one chunk of the input.
|
|
:param input: A byte string.
|
:param final:
|
Indicate that no more input is available.
|
Must be :obj:`True` if this is the last call.
|
:returns: An Unicode string.
|
|
Nr/ rE )
|
rI rH r) ÚlenrF r ÚincrementaldecoderrG r
|
r )r! r* r= r8 r r r r r
|
' s
|
|
|
zIncrementalDecoder.decodeN)r( )F)r$ r% r& r' r" r
|
r r r r r5 s
|
|
r5 c @ s e Zd ZdZedfddZdS )rB uù
|
âPushâ-based encoder.
|
|
:param encoding: An :class:`Encoding` object or a label string.
|
:param errors: Type of error handling. See :func:`codecs.register`.
|
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
|
|
.. method:: encode(input, final=False)
|
|
:param input: An Unicode string.
|
:param final:
|
Indicate that no more input is available.
|
Must be :obj:`True` if this is the last call.
|
:returns: A byte string.
|
|
r4 c C s t |}|j |¡j| _d S r )r r Úincrementalencoderr )r! r r, r r r r" T s zIncrementalEncoder.__init__N)r$ r% r& r' r3 r" r r r r rB C s rB )r( )r( )r' Ú
|
__future__r r Úlabelsr ÚVERSIONr r r r r Úobjectr r3 r1 r2 r
|
r) r r: r6 rD rC r5 rB r r r r Ú<module> s4 ü
|
|
|
3
|
