U
|
¬ý°d~O ã @ sÀ d Z ddlmZ ddlZddlmZ ddlmZ ddlZ ddl
|
m Z m Z ddl mZ ddlmZ dd lmZ ddlm mZ dd
|
lmZmZmZ dd l m Z dd l m Z dd l m!Z! ddl"m#Z# ddl$m%Z% ddl&m'Z'm(Z( G dd dej)Z*G dd dej+Z+G dd de+Z,G dd dej-Z-G dd de-Z.G dd d e.Z/G d d d e-Z0G d d d e0Z1G d!d" d"ej2Z2G d#d$ d$e Z3d%d& Z4G d'd( d(ej5Z6G d)d* d*Z7d+d,d-d.Z8dS )/z1 manage PyTables query interface via Expressions é )Ú annotationsN)Úpartial)ÚAny)Ú TimedeltaÚ Timestamp)Únpt)ÚUndefinedVariableError)Ú is_list_like)ÚexprÚopsÚscope)Úensure_decoded)ÚBaseExprVisitor)Úis_term)Ú extract_array)ÚIndex)Ú pprint_thingÚpprint_thing_encodedc s6 e Zd ZU dZded< d dddd fd d
|
Z ZS ) Ú PyTablesScope)Ú
|
queryablesúdict[str, Any]r NÚintúdict[str, Any] | NoneÚNone)Úlevelr Úreturnc s$ t j|d ||d |p i | _d S )Né )Ú global_dictÚ
|
local_dict)ÚsuperÚ__init__r )Úselfr r r r ©Ú __class__© úWd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/core/computation/pytables.pyr * s zPyTablesScope.__init__)NNN)Ú__name__Ú
|
__module__Ú __qualname__Ú __slots__Ú__annotations__r Ú __classcell__r$ r$ r" r% r % s
|
ûr c sN e Zd ZU ded< dddZdddd fdd Zd
|
d Zed d Z Z S )ÚTermr ÚenvNc C s t |tr| }nt}t |¡S ©N)Ú
|
isinstanceÚstrÚConstantÚobjectÚ__new__)ÚclsÚnamer- ÚsideÚencodingÚklassr$ r$ r% r3 8 s
|
z Term.__new__r ©r- r c s t j||||d d S ©N)r6 r7 )r r )r! r5 r- r6 r7 r" r$ r% r ? s z Term.__init__c C sh | j dkr4| j| jjkr.tdt| j d| jS z| jj| jddW S tk
|
rb | j Y S X d S )NÚleftzname z is not definedF)Úis_local)r6 r5 r- r Ú NameErrorÚreprÚresolver ©r! r$ r$ r% Ú _resolve_nameB s
|
zTerm._resolve_namec C s | j S r. )Ú_valuer@ r$ r$ r% ÚvalueQ s z
|
Term.value)NN)NN)
|
r& r' r( r* r3 r rA ÚpropertyrC r+ r$ r$ r" r% r, 5 s
|
|
r, c s. e Zd Zd ddd fdd Zdd Z ZS )
|
r1 Nr r r9 c s. t |tstt|t j||||d d S r: )r/ r ÚAssertionErrorÚtyper r )r! rC r- r6 r7 r" r$ r% r W s zConstant.__init__c C s | j S r. )Ú_namer@ r$ r$ r% rA [ s zConstant._resolve_name)NN)r& r' r( r rA r+ r$ r$ r" r% r1 V s r1 c sÔ e Zd ZU dZded< ded< ded< dddd fd
|
d Zdd d dZdd Zdd Ze dd ddZ
|
e dd ddZ e dd Z e dd Z e d d Zdd d d Zd d d!d"Zdd d#d$Z ZS )%ÚBinOpé r0 Úopr r z
|
str | NoneÚ conditionr )rJ r r c s& t |||¡ || _|| _d | _d S r. )r r r r7 rK )r! rJ ÚlhsÚrhsr r7 r" r$ r% r f s zBinOp.__init__©r c C s d S r. r$ r@ r$ r$ r% Ú _disallow_scalar_only_bool_opsl s z$BinOp._disallow_scalar_only_bool_opsc s® fdd}j j }}t|r<t|r<||j|j}nnt|s`t|r`|| ¡|j}nJt|rt|s||j| ¡}n&t|sªt|sª|| ¡| ¡}|S )Nc s¦ | dkr |S |dkr| S }t | trTt |tr6t}qt | |rD| S t ||r|S n6t | trt |trnt}n t | |r|| S t ||r|S |j| |jjd ¡ S )z5create and return a new specialized BinOp from myselfN)r r7 ) r/ ÚConditionBinOpÚJointConditionBinOpÚ FilterBinOpÚJointFilterBinOprJ r r7 Úevaluate)r; ÚrightÚk©r8 r! r$ r% Úprp s4
|
|
|
|
|
|
|
|
ÿzBinOp.prune.<locals>.pr)rL rM r rC Úprune)r! r8 rX r; rU Úresr$ rW r% rY o s z BinOp.prunec C s& t |s|g}t|tjr"| ¡ }|S )zinplace conform rhs)r r/ ÚnpZndarrayZravel)r! rM r$ r$ r% Úconform s
|
z BinOp.conformÚboolc C s | j | jkS )z$return True if this is a valid field)rL r r@ r$ r$ r% Úis_valid¡ s zBinOp.is_validc C s | j | j¡dk S )zx
|
return True if this is a valid column name for generation (e.g. an
|
actual column in the table)
|
N)r ÚgetrL r@ r$ r$ r% Ú is_in_table¦ s zBinOp.is_in_tablec C s t | j | j¡ddS )zthe kind of my fieldÚkindN©Úgetattrr r_ rL r@ r$ r$ r% ra ® s z
|
BinOp.kindc C s t | j | j¡ddS )zthe meta of my fieldÚmetaNrb r@ r$ r$ r% rd ³ s z
|
BinOp.metac C s t | j | j¡ddS )zthe metadata of my fieldÚmetadataNrb r@ r$ r$ r% re ¸ s zBinOp.metadatac C s( | | j¡}d| j d| j d| dS )z2create and return the op string for this TermValueú(ú ú))Útostringr7 rL rJ )r! ÚvÚvalr$ r$ r% Úgenerate½ s zBinOp.generateÚ TermValuec s¶ fdd}t j}t j}|dkrvt|ttfr>||}t |}t| d¡}|jdk rh| d¡}t
|
||j |S |dkrºt|t rt |}n t |dd }| d¡j }t
|
t|||S |d
|
k rút jd d }||kràd }n|j|dd}t
|
||dS |dkr tt|}t
|
|||S |dkr:t|}t
|
|||S |dkrvt|t rb| ¡ ¡ dk}nt|}t
|
|||S t|t rt
|
|||dS td| dt| d| ddS )zn
|
convert the expression that is in the term to something that is
|
accepted by pytables
|
c s j d k rt| j dS t| S )N)r7 )r7 r r )rC r@ r$ r% Ú stringifyÈ s
|
z&BinOp.convert_value.<locals>.stringify)Z
|
datetime64ÚdatetimeÚnsNÚUTC)Z timedelta64Ú timedeltaÚs)ÚunitÚcategoryT)Z extract_numpyéÿÿÿÿr; )r6 ÚintegerÚfloatr] ) ÚfalseÚfÚnoÚnÚnoneÚ0z[]z{}Ú ÚstringzCannot compare z of type z to z column)r ra rd r/ r rx r Zas_unitÚtzZ
|
tz_convertrm rB r0 r r re Z searchsortedÚstripÚlowerr] Ú TypeErrorrF )r! rj rn ra rd re Úresultr$ r@ r% Ú convert_value sJ
|
|
|
|
|
|
|
|
|
|
zBinOp.convert_valuec C s d S r. r$ r@ r$ r$ r% Úconvert_values s zBinOp.convert_values)r& r' r( Ú_max_selectorsr* r rO rY r\ rD r^ r` ra rd re rl r r r+ r$ r$ r" r% rH _ s*
|
*
|
|
|
@rH c @ sP e Zd ZU dZded< ddddZdd Zd
|
d Zd d ZdddddZ dS )rR Nz tuple[Any, Any, Index] | NoneÚfilterr0 rN c C s0 | j d krdS td| j d d| j d dS )NzFilter: Not Initializedz [Filter : [r z] -> [r ú])r r r@ r$ r$ r% Ú__repr__ s
|
zFilterBinOp.__repr__c C s. | j dk r*| j d | jdd| j d f| _ | S )zinvert the filterNr T©Úinverté )r Úgenerate_filter_opr@ r$ r$ r% r s
|
|
ýzFilterBinOp.invertc C s | j gS )z return the actual filter format)r r@ r$ r$ r% Úformat s zFilterBinOp.formatc C s¤ | j std| d| | j¡}t|}| jrj| jdkrft|| jkrf| ¡ }| j
|
|t |f| _ | S d S | jdkr| ¡ }| j
|
|t |f| _ nt d| d| S )Núquery term is not valid [r ©ú==ú!=z7passing a filterable condition to a non-table indexer [)r^ Ú
|
ValueErrorr\ rM Úlistr` rJ Úlenr r rL r r r )r! rM ÚvaluesZ filter_opr$ r$ r% rT s"
|
|
ÿzFilterBinOp.evaluateFr] r c C s0 | j dkr|r | j dkr$|r$dd S dd S d S )Nr r c S s | |¡ S r. ©Úisin©ZaxisÚvalsr$ r$ r% Ú<lambda>: ó z0FilterBinOp.generate_filter_op.<locals>.<lambda>c S s
|
| |¡S r. r r r$ r$ r% r < r )rJ )r! r r$ r$ r% r 8 s z FilterBinOp.generate_filter_op)F)
|
r& r' r( r r* r r r rT r r$ r$ r$ r% rR s
|
|
rR c @ s e Zd Zdd Zdd ZdS )rS c C s t dd S )Nz unable to collapse Joint Filters©ÚNotImplementedErrorr@ r$ r$ r% r @ s zJointFilterBinOp.formatc C s | S r. r$ r@ r$ r$ r% rT C s zJointFilterBinOp.evaluateN)r& r' r( r rT r$ r$ r$ r% rS ? s rS c @ s2 e Zd ZddddZdd Zdd Zd d
|
Zd S ) rP r0 rN c C s t d| j dS )Nz[Condition : [z]])r rK r@ r$ r$ r% r H s zConditionBinOp.__repr__c C s t ddS )zinvert the conditionz6cannot use an invert condition when passing to numexprNr r@ r$ r$ r% r K s ÿzConditionBinOp.invertc C s | j S )zreturn the actual ne format)rK r@ r$ r$ r% r T s zConditionBinOp.formatc s j std d js d S j¡} fdd|D } jdkrt| jkr~ fdd|D }dd |¡ d _ qd S n
|
|d
|
¡ _ S ) Nr r c s g | ]} |¡qS r$ )r ©Ú.0rj r@ r$ r% Ú
|
<listcomp>a s z+ConditionBinOp.evaluate.<locals>.<listcomp>r c s g | ]} |¡qS r$ )rl r¡ r@ r$ r% r£ g s rf z | rh r ) r^ r r` r\ rM rJ r r ÚjoinrK rl )r! rM r Úvsr$ r@ r% rT X s
|
zConditionBinOp.evaluateN)r& r' r( r r r rT r$ r$ r$ r% rP G s rP c @ s e Zd Zdd ZdS )rQ c C s( d| j j d| j d| jj d| _| S )Nrf rg rh )rL rK rJ rM r@ r$ r$ r% rT t s $z JointConditionBinOp.evaluateN)r& r' r( rT r$ r$ r$ r% rQ s s rQ c @ s e Zd Zdd ZdS )ÚUnaryOpc C sh | j dkrtd| j}| |¡}|d k rdt|tr>|jd k s\t|tsdt|trd|jd k rd| ¡ S d S )Nú~z$UnaryOp only support invert type ops)
|
rJ r ÚoperandrY Ú
|
issubclassrP rK rR r r )r! r8 r¨ r$ r$ r% rY z s"
|
|
ÿþýüûz UnaryOp.pruneN)r& r' r( rY r$ r$ r$ r% r¦ y s r¦ c sb e Zd ZeZeZdd fdd Zdd Zdd Z d d
|
Z
|
d d Z d d Z dd Z dd Z ZS )ÚPyTablesExprVisitorr rN c sH t |||¡ | jD ],}| j| }t| d| |f fdd qd S )NZvisit_c s t t|f S r. )r rH )ÚnodeÚbin_op©Úkwargsr$ r% r r z.PyTablesExprVisitor.__init__.<locals>.<lambda>)r r Ú
|
binary_opsZbinary_op_nodes_mapÚsetattr)r! r- ÚengineÚparserr® r¬ Zbin_noder" r r% r s
|
|
ýz PyTablesExprVisitor.__init__c K sh t |jtjtjfr&td| |j¡S t |jtjrN| | |j¡j
|
| j ¡S t |jtj rdt dd S )Nr§ z Unary addition not supported)r/ rJ ÚastZNotZInvertr¦ Úvisitr¨ ZUSubÚ
|
const_typerC r- ZUAddr ©r! r« r® r$ r$ r% Ú visit_UnaryOp s z!PyTablesExprVisitor.visit_UnaryOpc K s | |j¡jS r. )r´ rC r¶ r$ r$ r% Ú visit_Index¢ s z PyTablesExprVisitor.visit_Indexc K s* t jt ¡ g|jd |jgd}| |¡S )Nr )r r; Z comparators)r³ ZCompareÚEqÚtargetsrC r´ )r! r« r® Zcmprr$ r$ r% Ú visit_Assign¥ s ÿz PyTablesExprVisitor.visit_Assignc
|
K s¢ | |j¡}| |j¡}z
|
|j}W n tk
|
r6 Y nX t|trH|j}z| || | j¡W S tk
|
r } z"t dt
|
| dt
|
| |W 5 d }~X Y nX d S )Nzcannot subscript z with ) r´ rC ÚsliceÚAttributeErrorr/ r, rµ r- r r r> )r! r« r® rC ZslobjÚerrr$ r$ r% Úvisit_Subscript« s
|
|
ÿþz#PyTablesExprVisitor.visit_Subscriptc K s¨ |j }|j}t|j}|tjkr| |¡}z
|
|j}W n tk
|
rH Y nX z| t ||| j
|
¡W S tk
|
r t |tj r|j |kr| Y S Y nX td|j d S )NzInvalid Attribute context )ÚattrrC rF Úctxr³ ÚLoadr´ r½ Ú term_typerc r- r/ ÚNameÚidr r& )r! r« r® rÀ rC rÁ Zresolvedr$ r$ r% Úvisit_AttributeÀ s
|
|
|
|
z#PyTablesExprVisitor.visit_Attributec C s t |tjrt ¡ S |S r. )r/ r³ ZInr¹ )r! rJ r$ r$ r% Ú translate_InØ s z PyTablesExprVisitor.translate_Inc C s | |j¡|j||fS r. )r´ rJ )r! r« r; rU r$ r$ r% Ú_rewrite_membership_opÛ s z*PyTablesExprVisitor._rewrite_membership_op)r& r' r( r1 rµ r, rà r r· r¸ r» r¿ rÆ rÇ rÈ r+ r$ r$ r" r% rª s
|
rª c C s" t | ttfs t| s td| S )a
|
Validate that the where statement is of the right type.
|
|
The type may either be String, Expr, or list-like of Exprs.
|
|
Parameters
|
----------
|
w : String term expression, Expr, or list-like of Exprs.
|
|
Returns
|
-------
|
where : The original where clause if the check was successful.
|
|
Raises
|
------
|
TypeError : An invalid data type was passed in for w (e.g. dict).
|
zLwhere must be passed as a string, PyTablesExpr, or list-like of PyTablesExpr)r/ Ú PyTablesExprr0 r r )Úwr$ r$ r% Ú_validate_whereß s
|
ÿrË c @ sT e Zd ZU dZded< ded< ded< dd
|
d d d ddZddddZdd ZdS )rÉ a½
|
Hold a pytables-like expression, comprised of possibly multiple 'terms'.
|
|
Parameters
|
----------
|
where : string term expression, PyTablesExpr, or list-like of PyTablesExprs
|
queryables : a "kinds" map (dict of column name -> kind), or None if column
|
is non-indexable
|
encoding : an encoding that will encode the query terms
|
|
Returns
|
-------
|
a PyTablesExpr object
|
|
Examples
|
--------
|
'index>=date'
|
"columns=['A', 'D']"
|
'columns=A'
|
'columns==A'
|
"~(columns=['A','B'])"
|
'index>df.index[3] & string="bar"'
|
'(index>df.index[3] & index<=df.index[6]) | string="bar"'
|
"ts>=Timestamp('2012-02-01')"
|
"major_axis>=20130101"
|
zPyTablesExprVisitor | NoneÚ_visitorr r- r0 r
|
Nr r r r )r Ú scope_levelr c C s t |}|| _d | _d | _d | _d | _d }t|trD|jj }|j
|
}nft |r¦t |}t |D ],\}}t|trx|jj }q\t |}|||< q\d dd t |¡D ¡}n|}|| _
|
t|d |d| _|d k rt| j
|
tr| jj |¡ t| j|dd|d| _| ¡ | _d S )Nz & c S s g | ]}d | dqS )rf rh r$ )r¢ rÊ r$ r$ r% r£ 8 s z)PyTablesExpr.__init__.<locals>.<listcomp>r )r Zpytables)r r² r± r7 )rË r7 rK r ÚtermsrÌ r/ rÉ r- r r
|
r r Ú enumerater¤ ÚcomÚflattenr r0 r Úupdaterª Úparse) r! Úwherer r7 rÍ r Z_whereÚidxrÊ r$ r$ r% r s>
|
|
|
|
ûzPyTablesExpr.__init__rN c C s | j d k rt| j S t| jS r. )rÎ r r
|
r@ r$ r$ r% r K s
|
|
zPyTablesExpr.__repr__c
|
C s¬ z| j t¡| _W n< tk
|
rN } z td| j d| d|W 5 d}~X Y nX z| j t¡| _W n< tk
|
r } z td| j d| d|W 5 d}~X Y nX | j| jfS )z2create and return the numexpr condition and filterzcannot process expression [z], [z] is not a valid conditionNz] is not a valid filter) rÎ rY rP rK r½ r r
|
rR r )r! r¾ r$ r$ r% rT P s" ÿýÿýzPyTablesExpr.evaluate)NNr )r& r' r( Ú__doc__r* r r rT r$ r$ r$ r% rÉ ú s
|
û1rÉ c @ s. e Zd ZdZdddddZdddd Zd
|
S ) rm z<hold a term value the we use to construct a condition/filterr0 r )ra r c C s( t |tst||| _|| _|| _d S r. )r/ r0 rE rC Ú convertedra )r! rC r× ra r$ r$ r% r g s zTermValue.__init__rN c C sH | j dkr*|dk r t| jS d| j dS | j dkr>t| jS t| jS )z6quote the string if not encoded else encode and returnr Nú"rx )ra r0 r× r> )r! r7 r$ r$ r% ri m s
|
|
|
|
zTermValue.tostringN)r& r' r( rÖ r ri r$ r$ r$ r% rm d s rm r] rN c s4 t tsdS tjtj d }t fdd|D S )z7loose checking if s is a pytables-acceptable expressionF)ú=c 3 s | ]}| kV qd S r. r$ )r¢ rJ ©rs r$ r% Ú <genexpr> s z#maybe_expression.<locals>.<genexpr>)r/ r0 rª r¯ Z unary_opsÚany)rs Ú
|
operationsr$ rÚ r% Úmaybe_expressionz s
|
rÞ )9rÖ Ú
|
__future__r r³ Ú functoolsr Útypingr Únumpyr[ Zpandas._libs.tslibsr r Zpandas._typingr Z pandas.errorsr Zpandas.core.dtypes.commonr Zpandas.core.commonÚcoreÚcommonrÐ Zpandas.core.computationr
|
r r Z_scopeZ pandas.core.computation.commonr Z pandas.core.computation.exprr Zpandas.core.computation.opsr Zpandas.core.constructionr Zpandas.core.indexes.baser Zpandas.io.formats.printingr r ZScoper r, r1 rH rR rS rP rQ r¦ rª rË ZExprrÉ rm rÞ r$ r$ r$ r% Ú<module> s@ ! (9,Sj
|
