fume-manage-python.git

U  
£ý°d-sã@sèdZdZddlZddlmZdZeZddZdd    Zd
dZ    dd Z
ddZddZe
eZ ZZe
eZZeeejZZedZZZedZZZedZddZddZddZddZddZ dd Z!d!d"Z"d#d$Z#e"Z$e#Z%d%d&Z&d'd(Z'd)d*Z(d+d,Z)d-d.Z*d/d0Z+e(ej,e%eZ-Z.Z/e(ej,e$eZ0Z1e)ej,e$eejZ2Z3e*ej4d1Z5e*ej6d2Z7e*ej4d3Z8e*ej6d4Z9e+ej4d5Z:e+ej6d6Z;d7d8Z<d9d:Z=d;d<Z>d=d>Z?d?d@Z@dAdBZAdCdDZBdS)EaCode for encoding protocol message primitives.
 
Contains the logic for encoding every logical protocol field type
into one of the 5 physical wire types.
 
This code is designed to push the Python interpreter's performance to the
limits.
 
The basic idea is that at startup time, for every field (i.e. every
FieldDescriptor) we construct two functions:  a "sizer" and an "encoder".  The
sizer takes a value of this field's type and computes its byte size.  The
encoder takes a writer function and a value.  It encodes the value into byte
strings and invokes the writer function to write those strings.  Typically the
writer function is the write() method of a BytesIO.
 
We try to do as much work as possible when constructing the writer and the
sizer rather than when calling them.  In particular:
* We copy any needed global functions to local variables, so that we do not need
  to do costly global table lookups at runtime.
* Similarly, we try to do any attribute lookups at startup time if possible.
* Every field's tag is encoded to bytes at startup, since it can't change at
  runtime.
* Whatever component of the field size we can compute at startup, we do.
* We *avoid* sharing code if doing so would make the code slower and not sharing
  does not burden us too much.  For example, encoders for repeated fields do
  not just call the encoders for singular fields in a loop because this would
  add an extra function call overhead for every loop iteration; instead, we
  manually inline the single-value encoder into the loop.
* If a Python function lacks a return statement, Python actually generates
  instructions to pop the result of the last statement off the stack, push
  None onto the stack, and then return that.  If we really don't care what
  value is returned, then we can save two instructions by returning the
  result of the last statement.  It looks funny but it helps.
* We assume that type and bounds checking has happened at a higher level.
z kenton@google.com (Kenton Varda)éN)Úwire_formatgðcCsp|dkrdS|dkrdS|dkr$dS|dkr0dS|d    kr<d
S|dkrHdS|d krTdS|dkr`dS|dkrldSdS)z#Compute the size of a varint value.éééÿ?ééÿÿééÿÿÿéìÿÿéìÿÿÿéìÿÿÿéìÿÿÿÿéìÿÿÿÿé    é
©©ÚvaluerrúWd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\google/protobuf/internal/encoder.pyÚ_VarintSizePs&rcCs||dkrdS|dkrdS|dkr$dS|dkr0dS|d    kr<d
S|dkrHdS|d krTdS|dkr`dS|dkrldS|dkrxdSdS)z*Compute the size of a signed varint value.rrrrrrrrr    r
rrr rrrrrrrrrrrrÚ_SignedVarintSize^s*rcCstt |d¡S)zQReturns the number of bytes required to serialize a tag with this field
  number.r)rrÚPackTag)Úfield_numberrrrÚ_TagSizemsrcsfdd}|S)zA sizer which uses the function compute_value_size to compute the size of
  each value.  Typically compute_value_size is _VarintSize.csPt||r$tfdd}|S|r:fdd}|Sfdd}|SdS)Ncs*d}|D]}||7}q||S©Nrr©rÚresultÚelement)Úcompute_value_sizeÚlocal_VarintSizeÚtag_sizerrÚPackedFieldSizesz<_SimpleSizer.<locals>.SpecificSizer.<locals>.PackedFieldSizecs&t|}|D]}||7}q|S©N©Úlenr ©r#r%rrÚRepeatedFieldSizesz>_SimpleSizer.<locals>.SpecificSizer.<locals>.RepeatedFieldSizecs|Sr'rrr*rrÚ    FieldSizesz6_SimpleSizer.<locals>.SpecificSizer.<locals>.FieldSize©rr©rÚis_repeatedÚ    is_packedr&r+r,©r#©r$r%rÚ SpecificSizersz#_SimpleSizer.<locals>.SpecificSizerr)r#r3rr1rÚ_SimpleSizer|sr4csfdd}|S)zLike SimpleSizer, but modify_value is invoked on each value before it is
  passed to compute_value_size.  modify_value is typically ZigZagEncode.csVt||r&tfdd}|S|r>fdd}|Sfdd}|SdS)Ncs.d}|D]}||7}q||Srrr )r#r$Úmodify_valuer%rrr&¡sz>_ModifiedSizer.<locals>.SpecificSizer.<locals>.PackedFieldSizecs*t|}|D]}||7}q|Sr'r(r ©r#r5r%rrr+¨sz@_ModifiedSizer.<locals>.SpecificSizer.<locals>.RepeatedFieldSizecs|Sr'rrr6rrr,¯sz8_ModifiedSizer.<locals>.SpecificSizer.<locals>.FieldSizer-r.©r#r5r2rr3sz%_ModifiedSizer.<locals>.SpecificSizerr)r#r5r3rr7rÚ_ModifiedSizersr8csfdd}|S)zWLike _SimpleSizer except for a fixed-size field.  The input is the size
  of one value.cs\t||r$tfdd}|S|r@fdd}|Sfdd}|SdS)Ncst|}||Sr'r()rr!)r$r%Ú
value_sizerrr&¾sz;_FixedSizer.<locals>.SpecificSizer.<locals>.PackedFieldSizecst|Sr'r(r)Úelement_sizerrr+Äsz=_FixedSizer.<locals>.SpecificSizer.<locals>.RepeatedFieldSizecsSr'rr)Ú
field_sizerrr,Ész5_FixedSizer.<locals>.SpecificSizer.<locals>.FieldSizer-r.©r9)r:r;r$r%rr3ºsz"_FixedSizer.<locals>.SpecificSizerr)r9r3rr<rÚ_FixedSizer¶sr=r
rrcsHt|tt|rt|r0fdd}|Sfdd}|SdS)z#Returns a sizer for a string field.cs8t|}|D]"}| d¡}|||7}q|S©Nzutf-8)r)Úencode©rr!r"Úl©r$Ú    local_lenr%rrr+ìs
z&StringSizer.<locals>.RepeatedFieldSizecs| d¡}||Sr>©r?©rrArBrrr,ôszStringSizer.<locals>.FieldSizeN©rrr)ÚAssertionError©rr/r0r+r,rrBrÚStringSizeräsrIcsHt|tt|rt|r0fdd}|Sfdd}|SdS)z"Returns a sizer for a bytes field.cs2t|}|D]}|}|||7}q|Sr'r(r@rBrrr+s
z%BytesSizer.<locals>.RepeatedFieldSizecs|}||Sr'rrErBrrr,
szBytesSizer.<locals>.FieldSizeNrFrHrrBrÚ
BytesSizerúsrJcs<t|d|rt|r(fdd}|Sfdd}|SdS)z"Returns a sizer for a group field.rcs&t|}|D]}|| ¡7}q|Sr'©r)ÚByteSizer ©r%rrr+sz%GroupSizer.<locals>.RepeatedFieldSizecs| ¡Sr'©rLrrMrrr,szGroupSizer.<locals>.FieldSizeN)rrGrHrrMrÚ
GroupSizersrOcs@t|t|rt|r*fdd}|Sfdd}|SdS)z$Returns a sizer for a message field.cs2t|}|D]}| ¡}|||7}q|Sr'rKr@r2rrr+)s
z'MessageSizer.<locals>.RepeatedFieldSizecs| ¡}||Sr'rNrEr2rrr,1szMessageSizer.<locals>.FieldSizeN)rrrGrHrr2rÚMessageSizer"srPcs:tddtdt|tdtfdd}|S)zìReturns a sizer for extensions of MessageSet.
 
  The message set message looks like this:
    message MessageSet {
      repeated group Item = 1 {
        required int32 type_id = 2;
        required string message = 3;
      }
    }
  rrrcs| ¡}||Sr'rNrE©r$Zstatic_sizerrr,Jsz&MessageSetItemSizer.<locals>.FieldSizer-)rr,rrQrÚMessageSetItemSizer;sÿrRcs(|jt|jddfdd}|S)z Returns a sizer for a map field.Fcs@d}|D]2}||}j||d}||7}r| ¡q|S)Nr©Úkeyr)Ú_concrete_classrL)Z    map_valueÚtotalrTrÚ    entry_msg©Úis_message_mapZ message_sizerÚmessage_typerrr,]s
zMapSizer.<locals>.FieldSize)rZrPÚnumber)Úfield_descriptorrYr,rrXrÚMapSizerUsr]cst d¡jdfdd    }|S)zBReturn an encoder for a basic varint value (does not include tag).ú>BNcsB|d@}|dL}|r6|d|B|d@}|dL}q||S)Nrrér©ÚwriterÚunused_deterministicÚbits©Zlocal_int2byterrÚEncodeVarintws
z$_VarintEncoder.<locals>.EncodeVarint)N©ÚstructÚStructÚpack)rerrdrÚ_VarintEncoderrs    rjcst d¡jdfdd    }|S)zKReturn an encoder for a basic signed varint value (does not include
  tag).r^NcsR|dkr|d7}|d@}|dL}|rF|d|B|d@}|dL}q ||S)Nrlrrr_rr`rdrrÚEncodeSignedVarints
z0_SignedVarintEncoder.<locals>.EncodeSignedVarint)Nrf)rkrrdrÚ_SignedVarintEncodersrlcCsg}t|j|dd |¡S)zEncode the given integer as a varint and return the bytes.  This is only
  called at startup time so it doesn't need to be fast.Tó)Ú _EncodeVarintÚappendÚjoin)rÚpiecesrrrÚ_VarintBytessrrcCsttt ||¡S)zCEncode the given tag and return the bytes.  Only called at startup.)Úbytesrrrr)rÚ    wire_typerrrÚTagBytes¤srucsfdd}|S)a_Return a constructor for an encoder for fields of a particular type.
 
  Args:
      wire_type:  The field's wire type, for encoding tags.
      encode_value:  A function which encodes an individual value, e.g.
        _EncodeVarint().
      compute_value_size:  A function which computes the size of an individual
        value, e.g. _VarintSize().
  csj|r*t|tjtfdd}|S|rJt|fdd}|St|fdd}|SdS)NcsH|d}|D]}||7}q||||D]}|||q2dSrr©rarÚ deterministicÚsizer")r#Úencode_valueÚlocal_EncodeVarintÚ    tag_bytesrrÚEncodePackedField½szB_SimpleEncoder.<locals>.SpecificEncoder.<locals>.EncodePackedFieldcs"|D]}||||qdSr'r©rarrwr"©ryr{rrÚEncodeRepeatedFieldÈszD_SimpleEncoder.<locals>.SpecificEncoder.<locals>.EncodeRepeatedFieldcs||||Sr'r©rarrwr~rrÚEncodeFieldÏsz<_SimpleEncoder.<locals>.SpecificEncoder.<locals>.EncodeField©rurÚWIRETYPE_LENGTH_DELIMITEDrn©rr/r0r|rr©r#ryrt©rzr{rÚSpecificEncoder¹s
 
z'_SimpleEncoder.<locals>.SpecificEncoderr)rtryr#rrrrÚ_SimpleEncoder®srcsfdd}|S)zLike SimpleEncoder but additionally invokes modify_value on every value
  before passing it to encode_value.  Usually modify_value is ZigZagEncode.csp|r,t|tjtfdd}|S|rNt|fdd}|St|fdd}|SdS)NcsP|d}|D]}||7}q||||D]}|||q6dSrrrv)r#ryrzr5r{rrr|ßszD_ModifiedEncoder.<locals>.SpecificEncoder.<locals>.EncodePackedFieldcs&|D]}||||qdSr'rr}©ryr5r{rrrêszF_ModifiedEncoder.<locals>.SpecificEncoder.<locals>.EncodeRepeatedFieldcs||||Sr'rrrrrrñsz>_ModifiedEncoder.<locals>.SpecificEncoder.<locals>.EncodeFieldrr©r#ryr5rtrrrÛs
 
z)_ModifiedEncoder.<locals>.SpecificEncoderr)rtryr#r5rrrrÚ_ModifiedEncoder×srcst ¡fdd}|S)z¿Return a constructor for an encoder for a fixed-width field.
 
  Args:
      wire_type:  The field's wire type, for encoding tags.
      format:  The format string to pass to struct.pack().
  csztj|r2t|tjtfdd}|S|rVt|dfdd    }|St|dfdd    }|SdS)    Ncs8||t|||D]}||q dSr'r(r})ÚformatrzÚlocal_struct_packr{r9rrr|szF_StructPackEncoder.<locals>.SpecificEncoder.<locals>.EncodePackedFieldcs$|D]}|||qdSr'r©rarrbr"©rrr{rrrszH_StructPackEncoder.<locals>.SpecificEncoder.<locals>.EncodeRepeatedFieldcs|||Sr'r©rarrbrrrrsz@_StructPackEncoder.<locals>.SpecificEncoder.<locals>.EncodeField)N)N©rgrirurrrnr©rr9rt©rzrr{rrs
 
z+_StructPackEncoder.<locals>.SpecificEncoder)rgÚcalcsize©rtrrrrrÚ_StructPackEncoderùs
rcsPt ¡dkrddndkr.ddntdfdd}|S)    aqReturn a constructor for an encoder for float fields.
 
  This is like StructPackEncoder, but catches errors that may be due to
  passing non-finite floating-point values to struct.pack, and makes a
  second attempt to encode those values.
 
  Args:
      wire_type:  The field's wire type, for encoding tags.
      format:  The format string to pass to struct.pack().
  r
cSs<|tkr|dn&|tkr$|dn||kr6|dndS)NssÿsÀ©Ú_POS_INFÚ_NEG_INF©rarrrrÚEncodeNonFiniteOrRaise-s
 
 
z5_FloatingPointEncoder.<locals>.EncodeNonFiniteOrRaisercSs<|tkr|dn&|tkr$|dn||kr6|dndS)Nsðsðÿsørrrrrr8s
 
 
zGCan't encode floating-point values that are %d bytes long (only 4 or 8)cstj|r4t|tjtfdd}|S|rZt|dfdd    }|St|dfdd    }|SdS)    Nc    s\||t|||D]6}z||Wq tk
rT||Yq Xq dSr')r)ÚSystemErrorr})rrrzrr{r9rrr|JszI_FloatingPointEncoder.<locals>.SpecificEncoder.<locals>.EncodePackedFieldc    sH|D]>}|z||Wqtk
r@||YqXqdSr'©rr©rrrr{rrrWszK_FloatingPointEncoder.<locals>.SpecificEncoder.<locals>.EncodeRepeatedFieldcs>|z||Wntk
r8||YnXdSr'rrrrrras
zC_FloatingPointEncoder.<locals>.SpecificEncoder.<locals>.EncodeField)N)Nrr©rrr9rtrrrEs
 
 
z._FloatingPointEncoder.<locals>.SpecificEncoder)rgrÚ
ValueErrorrrrrÚ_FloatingPointEncoders
 
 
 
 
ÿ$r¡z<Iz<Qz<iz<qz<fz<dcs~dd|r2t|tjtfdd}|S|rXt|tjd
fdd    }|St|tjdfdd        }|SdS)z'Returns an encoder for a boolean field.óócs<||t|||D]}|r.|q|qdSr'r(r}©Ú
false_byterzr{Ú    true_byterrr|s
z&BoolEncoder.<locals>.EncodePackedFieldNcs,|D]"}||r|q|qdSr'rr©r¥r{r¦rrrs
 
z(BoolEncoder.<locals>.EncodeRepeatedFieldcs||r|S|Sr'rrr§rrr¤sz BoolEncoder.<locals>.EncodeField)N)N)rurrrnÚWIRETYPE_VARINTrrr¤rÚBoolEncodersr©csLt|tjtt|rt|r4fdd}|Sfdd}|SdS)z&Returns an encoder for a string field.cs8|D].}| d¡}||||||qdSr>rD)rarrwr"Úencoded©rzrCÚtagrrr´s
 
z*StringEncoder.<locals>.EncodeRepeatedFieldcs*| d¡}||||||Sr>rD)rarrwrªr«rrr¼s
z"StringEncoder.<locals>.EncodeFieldN©rurrrnr)rG©rr/r0rrrr«rÚ StringEncoder¬sr¯csLt|tjtt|rt|r4fdd}|Sfdd}|SdS)z%Returns an encoder for a bytes field.cs.|D]$}||||||qdSr'rr}r«rrrÌsz)BytesEncoder.<locals>.EncodeRepeatedFieldcs ||||||Sr'rrr«rrrÓsz!BytesEncoder.<locals>.EncodeFieldNrr®rr«rÚBytesEncoderÄsr°csLt|tjt|tj|r t|r6fdd}|Sfdd}|SdS)z%Returns an encoder for a group field.cs*|D] }|| ||¡|qdSr'©Ú_InternalSerializer}©Zend_tagZ    start_tagrrrász)GroupEncoder.<locals>.EncodeRepeatedFieldcs|| ||¡|Sr'r±rr³rrrèsz!GroupEncoder.<locals>.EncodeFieldN)rurÚWIRETYPE_START_GROUPÚWIRETYPE_END_GROUPrGr®rr³rÚGroupEncoderÚsr¶csDt|tjt|rt|r.fdd}|Sfdd}|SdS)z'Returns an encoder for a message field.cs2|D](}||| ¡|| ||¡qdSr'©rLr²r}©rzr¬rrrösz+MessageEncoder.<locals>.EncodeRepeatedFieldcs$||| ¡|| ||¡Sr'r·rr¸rrrýsz#MessageEncoder.<locals>.EncodeFieldN)rurrrnrGr®rr¸rÚMessageEncoderïsr¹csRd tdtjtdtjt|tdtjg¡tdtjtfdd}|S)zäEncoder for extensions of MessageSet.
 
  The message set message looks like this:
    message MessageSet {
      repeated group Item = 1 {
        required int32 type_id = 2;
        required string message = 3;
      }
    }
  rmrrrcs,||| ¡|| ||¡|Sr'r·r©Z    end_bytesrzZstart_bytesrrrsz*MessageSetItemEncoder.<locals>.EncodeField)    rprurr´r¨rrrrµrn)rrrrºrÚMessageSetItemEncoders
 
 
ür»cs&|jt|jddfdd}|S)zÅEncoder for extensions of MessageSet.
 
  Maps always have a wire format like this:
    message MapEntry {
      key_type key = 1;
      value_type value = 2;
    }
    repeated MapEntry map = N;
  Fcs@|rt| ¡n|}|D]"}j|||d}|||qdS)NrS)ÚsortedÚkeysrU)rarrwZ
value_keysrTrW©Zencode_messagerZrrr7szMapEncoder.<locals>.EncodeField)rZr¹r[)r\rrr¾rÚ
MapEncoder(sr¿)CÚ__doc__Ú
__author__rgZgoogle.protobuf.internalrrrrrrr4r8r=Z
Int32SizerZ
Int64SizerZ    EnumSizerZUInt32SizerZUInt64SizerZZigZagEncodeZSInt32SizerZSInt64SizerZFixed32SizerZ SFixed32SizerZ
FloatSizerZFixed64SizerZ SFixed64SizerZDoubleSizerZ    BoolSizerrIrJrOrPrRr]rjrlrnZ_EncodeSignedVarintrrrurrrr¡r¨ZInt32EncoderZInt64EncoderZEnumEncoderZ UInt32EncoderZ UInt64EncoderZ SInt32EncoderZ SInt64EncoderZWIRETYPE_FIXED32ZFixed32EncoderZWIRETYPE_FIXED64ZFixed64EncoderZSFixed32EncoderZSFixed64EncoderZFloatEncoderZ DoubleEncoderr©r¯r°r¶r¹r»r¿rrrrÚ<module>s$!ÿ    
)"&Rÿÿþ%