U
|
¬ý°d$N ã @ s d dl mZ d dlmZmZ d dlZd dlmZ d dl m
|
Z
|
m Z d dl mZ d dlmZmZmZmZmZ d dlmZ d d lmZ d d
|
lmZ d d l m Z m Z m Z d d l m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z' d d l(m)Z) d dl*m+Z+ d dl,m-Z-m.Z.m/Z/ d dl0m1Z1 d dl2m3Z3 d dl4m5Z5 d dl6m7Z7 d dl8m9Z9 d dl:m;Z; erbd dl<Z<d dlm=Z=m>Z> d dl?m@Z@ e G dd de ZAG dd de-ZBG d d d eBe5ZCdS ) é )Ú annotations)Ú TYPE_CHECKINGÚLiteralN)Ú
|
get_option)ÚlibÚmissing)Ú NDArrayBacked)ÚAxisIntÚDtypeÚScalarÚnptÚtype_t)Úpa_version_under7p0)Úfunction)Údoc)ÚExtensionDtypeÚStorageExtensionDtypeÚregister_extension_dtype)Ú is_array_likeÚ is_bool_dtypeÚis_dtype_equalÚis_integer_dtypeÚis_object_dtypeÚis_string_dtypeÚ pandas_dtype)Úops)Úmasked_reductions)ÚExtensionArrayÚ FloatingArrayÚ IntegerArray)Ú FloatingDtype)Ú IntegerDtype)Ú PandasArray)Ú extract_array)Úcheck_array_indexer)Úisna)Ú NumpySorterÚNumpyValueArrayLike)ÚSeriesc @ sv e Zd ZdZdZeddddZdZdd dd
|
d Zed dd dZ e
|
dd Z ddddZ dddddZ dS )Ú StringDtypea
|
Extension dtype for string data.
|
|
.. warning::
|
|
StringDtype is considered experimental. The implementation and
|
parts of the API may change without warning.
|
|
Parameters
|
----------
|
storage : {"python", "pyarrow"}, optional
|
If not given, the value of ``pd.options.mode.string_storage``.
|
|
Attributes
|
----------
|
None
|
|
Methods
|
-------
|
None
|
|
Examples
|
--------
|
>>> pd.StringDtype()
|
string[python]
|
|
>>> pd.StringDtype(storage="pyarrow")
|
string[pyarrow]
|
Ústringzlibmissing.NAType©Úreturnc C s t jS ©N)Ú
|
libmissingÚNA©Úself© r2 úQd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/core/arrays/string_.pyÚna_valueg s zStringDtype.na_value©ÚstorageNÚNonec C sF |d krt d}|dkr(td| d|dkr<tr<td|| _d S )Nzmode.string_storage> ÚpythonÚpyarrowz+Storage must be 'python' or 'pyarrow'. Got z instead.r9 z:pyarrow>=7.0.0 is required for PyArrow backed StringArray.)r Ú
|
ValueErrorr Ú ImportErrorr6 )r1 r6 r2 r2 r3 Ú__init__m s
|
ÿ ÿzStringDtype.__init__z type[str]c C s t S r- )Ústrr0 r2 r2 r3 Útypez s zStringDtype.typec C sj t |ts tdt| |dkr*| S |dkr<| ddS |dkrN| ddS td| j d | d
|
d S ) a|
|
Construct a StringDtype from a string.
|
|
Parameters
|
----------
|
string : str
|
The type of the name. The storage type will be taking from `string`.
|
Valid options and their storage types are
|
|
========================== ==============================================
|
string result storage
|
========================== ==============================================
|
``'string'`` pd.options.mode.string_storage, default python
|
``'string[python]'`` python
|
``'string[pyarrow]'`` pyarrow
|
========================== ==============================================
|
|
Returns
|
-------
|
StringDtype
|
|
Raise
|
-----
|
TypeError
|
If the string is not a valid option.
|
z.'construct_from_string' expects a string, got r* zstring[python]r8 r5 zstring[pyarrow]r9 zCannot construct a 'z' from 'ú'N)Ú
|
isinstancer= Ú TypeErrorr> Ú__name__)Úclsr* r2 r2 r3 Úconstruct_from_string~ s
|
ÿ
|
|
z!StringDtype.construct_from_stringztype_t[BaseStringArray]c C s" ddl m} | jdkrtS |S dS )zq
|
Return the array type associated with this dtype.
|
|
Returns
|
-------
|
type
|
r ©ÚArrowStringArrayr8 N)Ú pandas.core.arrays.string_arrowrF r6 Ú StringArray)r1 rF r2 r2 r3 Úconstruct_array_typeª s
|
|
z StringDtype.construct_array_typez$pyarrow.Array | pyarrow.ChunkedArrayÚBaseStringArray)Úarrayr, c C s | j dkr ddlm} ||S ddl}t||jr:|g}n|j}g }|D ] }t t
|
|¡¡}| |¡ qH|rvt |¡S tt j
|
g ddS dS )zH
|
Construct StringArray from pyarrow Array/ChunkedArray.
|
r9 r rE NÚobject©Údtype) r6 rG rF r9 r@ ÚArrayÚchunksrH Ú_from_sequenceÚnprK ÚappendZ_concat_same_type)r1 rK rF r9 rP ÚresultsÚarrZstr_arrr2 r2 r3 Ú__from_arrow__» s
|
|
zStringDtype.__from_arrow__)N)rB Ú
|
__module__Ú __qualname__Ú__doc__ÚnameÚpropertyr4 Ú _metadatar< r> Ú classmethodrD rI rV r2 r2 r2 r3 r) D s
|
+r) c @ s" e Zd ZdZeejdd ZdS )rJ z8
|
Mixin class for StringArray, ArrowStringArray.
|
c C s$ | j dkrdd | D S t| ¡ S )Né c S s g | ] }| ¡ qS r2 )Útolist)Ú.0Úxr2 r2 r3 Ú
|
<listcomp>â s z*BaseStringArray.tolist.<locals>.<listcomp>)ÚndimÚlistÚto_numpyr0 r2 r2 r3 r_ ß s
|
zBaseStringArray.tolistN)rB rW rX rY r r r_ r2 r2 r2 r3 rJ Ú s rJ c sl e Zd ZdZdZdEddd fdd Zd d
|
Zed dd d dd ddZed dd d dd ddZ ed dddZ
|
dFddZ dd Z fddZ ddd d d ZdGdd fd!d" Zd d#d$d%dd&d'd(d)ZdHdd*d+d,d-ZdIdd*d+d.d/ZdJdd0d1d2d3ZdKdd4d5d6d7ZeejdLd9d:d;d<d= fd>d? Zd@dA ZeZejZ dMd ddBdCdDZ Z S )NrH aQ
|
Extension array for string data.
|
|
.. warning::
|
|
StringArray is considered experimental. The implementation and
|
parts of the API may change without warning.
|
|
Parameters
|
----------
|
values : array-like
|
The array of data.
|
|
.. warning::
|
|
Currently, this expects an object-dtype ndarray
|
where the elements are Python strings
|
or nan-likes (``None``, ``np.nan``, ``NA``).
|
This may change without warning in the future. Use
|
:meth:`pandas.array` with ``dtype="string"`` for a stable way of
|
creating a `StringArray` from any sequence.
|
|
.. versionchanged:: 1.5.0
|
|
StringArray now accepts array-likes containing
|
nan-likes(``None``, ``np.nan``) for the ``values`` parameter
|
in addition to strings and :attr:`pandas.NA`
|
|
copy : bool, default False
|
Whether to copy the array of data.
|
|
Attributes
|
----------
|
None
|
|
Methods
|
-------
|
None
|
|
See Also
|
--------
|
:func:`pandas.array`
|
The recommended function for creating a StringArray.
|
Series.str
|
The string methods are available on Series backed by
|
a StringArray.
|
|
Notes
|
-----
|
StringArray returns a BooleanArray for comparison methods.
|
|
Examples
|
--------
|
>>> pd.array(['This is', 'some text', None, 'data.'], dtype="string")
|
<StringArray>
|
['This is', 'some text', <NA>, 'data.']
|
Length: 4, dtype: string
|
|
Unlike arrays instantiated with ``dtype="object"``, ``StringArray``
|
will convert the values to strings.
|
|
>>> pd.array(['1', 1], dtype="object")
|
<PandasArray>
|
['1', 1]
|
Length: 2, dtype: object
|
>>> pd.array(['1', 1], dtype="string")
|
<StringArray>
|
['1', '1']
|
Length: 2, dtype: string
|
|
However, instantiating StringArrays directly with non-strings will raise an error.
|
|
For comparison methods, `StringArray` returns a :class:`pandas.BooleanArray`:
|
|
>>> pd.array(["a", None, "c"], dtype="string") == "a"
|
<BooleanArray>
|
[True, <NA>, False]
|
Length: 3, dtype: boolean
|
Ú extensionFÚboolr7 )Úcopyr, c sH t |}t j||d t|t| s.| ¡ t | | jtdd¡ d S )N©rh r8 r5 ) r# Úsuperr< r@ r> Ú _validater Ú_ndarrayr) )r1 Úvaluesrh ©Ú __class__r2 r3 r< : s
|
zStringArray.__init__c C sr t | jr"tj| jdds"td| jjdkrBtd| jj d| jjdkrbt | j d¡¡ n t | j¡ d S )
|
z*Validate that we only store NA or strings.T©Úskipnaz7StringArray requires a sequence of strings or pandas.NArL z>StringArray requires a sequence of strings or pandas.NA. Got 'z' dtype instead.é ÚKN) Úlenrl r Úis_string_arrayr: rN rc Zconvert_nans_to_NAZravelr0 r2 r2 r3 rk B s ÿ zStringArray._validateN©rN rh z Dtype | Nonec C s¼ |r6t |tr|dks6t|}t |tr2|jdks6tddlm} t ||rt|j}|j }t
|
j ||dd}t j ||< n&t|drt |¡}t
|
j |t j |d}| | ¡}t ||tdd ¡ |S )
|
Nr* r8 r )ÚBaseMaskedArrayF)rh Zconvert_na_valuer> )r4 rh r5 )r@ r= r r) r6 ÚAssertionErrorZpandas.core.arrays.maskedrw Z_maskÚ_datar Zensure_string_arrayr. r/ ÚhasattrrR rK Ú__new__r r< )rC ZscalarsrN rh rw Z na_valuesÚresultZnew_string_arrayr2 r2 r3 rQ R s
|
|
|
|
zStringArray._from_sequencec C s | j |||dS )Nrv )rQ )rC ÚstringsrN rh r2 r2 r3 Ú_from_sequence_of_stringso s z%StringArray._from_sequence_of_stringsr+ c C s. t j|td}tj|d d
< | |j|ddS )NrM Fri )rR ÚemptyrL r. r/ Úastype)rC ÚshaperN rm r2 r2 r3 Ú_emptyu s zStringArray._emptyc C s> ddl }|dkr| ¡ }| j ¡ }d|| ¡ < |j||ddS )z6
|
Convert myself into a pyarrow Array.
|
r NT)r> Z from_pandas)r9 r* rl rh r% rK )r1 r> Úparm r2 r2 r3 Ú__arrow_array__{ s
|
zStringArray.__arrow_array__c C s" | j ¡ }| ¡ }d ||< |d fS r- )rl rh r% )r1 rU Úmaskr2 r2 r3 Ú_values_for_factorize s
|
z!StringArray._values_for_factorizec sê t |dd}t|t| r |j}t| |}t |¡}t |¡}|rN|sNtd|r~t|rbt j
|
}qØt|t sØt d| dnZt |stj|td}t|r²tj|dds²t dt|}| ¡ rØ| ¡ }t j
|
|t|< t ||¡ d S ) NT)Z extract_numpyz)setting an array element with a sequence.z Cannot set non-string value 'z' into a StringArray.rM rp zMust provide strings.)r# r@ r> rl r$ r Ú is_scalarr: r% r. r/ r= rA r rR ÚasarrayrL rt ru Úanyrh rj Ú __setitem__)r1 ÚkeyÚvalueZ
|
scalar_keyZ scalar_valuer
rn r2 r3 r s0
|
|
|
|
|
ÿzStringArray.__setitem__znpt.NDArray[np.bool_])r
r, c C s t | ||¡ d S r- )r Ú_putmask)r1 r
r r2 r2 r3 r ¯ s zStringArray._putmaskTri c s t |}t|| jr$|r | ¡ S | S t|trb| j ¡ }| ¡ }d||< | |j ¡}t
|
||ddS t|t r| ¡ }| ¡ }d||< | |j ¡}t ||ddS t|t r¶t | ||¡S t |tj¡rö| j ¡ }| ¡ }d||< | |¡}tj||< |S t ||¡S )Nr Fri Ú0)r r rN rh r@ r! rl r% r Z numpy_dtyper r r r r rR Z
|
issubdtypeZfloatingÚnanrj )r1 rN rh rU r
rm rn r2 r3 r µ s6
|
|
|
|
|
|
|
zStringArray.astyper ©rq Úaxisr= zAxisInt | None)rZ rq r c K s. |dkrt | |||dS td| dd S )N)ÚminÚmaxr zCannot perform reduction 'z' with string dtype)ÚgetattrrA )r1 rZ rq r Úkwargsr2 r2 r3 Ú_reduceÖ s zStringArray._reducer )rq r, c K s0 t d|¡ tj| ¡ | ¡ |d}| ||¡S ©Nr2 )rm r
rq )ÚnvZ validate_minr r re r% Ú_wrap_reduction_result©r1 r rq r r| r2 r2 r3 r Þ s ÿzStringArray.minc K s0 t d|¡ tj| ¡ | ¡ |d}| ||¡S r )r Z validate_maxr r re r% r r r2 r2 r3 r å s ÿzStringArray.maxr( )Údropnar, c C s4 ddl m} || j|d d¡}|j | j¡|_|S )Nr )Ú value_counts)r ZInt64)Úpandasr rl r ÚindexrN )r1 r r r| r2 r2 r3 r ì s zStringArray.value_countsÚint)Údeepr, c C s | j j}|r |t | j ¡ S |S r- )rl Únbytesr Zmemory_usage_of_objects)r1 r r| r2 r2 r3 Ú memory_usageó s zStringArray.memory_usageÚleftz$NumpyValueArrayLike | ExtensionArrayzLiteral[('left', 'right')]r& z npt.NDArray[np.intp] | np.intp)r ÚsideÚsorterr, c s | j rtdt j|||dS )NzOsearchsorted requires array to be sorted, which is impossible with NAs present.)r r¤ r¥ )Z_hasnar: rj Ú searchsorted)r1 r r¤ r¥ rn r2 r3 r¦ ù s
|
ÿzStringArray.searchsortedc C sò ddl m} t|tr |j}t| t|B }| }t |¡szt|t| krht dt| dt| t
|
|¡}|| }|j t jkr¼t
|
j| jdd}tj||< || j| |||< t|S t
|
jt| jdd}|| j| |||< |||S d S )Nr ©Ú BooleanArrayz"Lengths of operands do not match: z != rL rM rg )Ú pandas.arraysr¨ r@ rH rl r% r r rt r: rR r rB r ZARITHMETIC_BINOPSZ
|
empty_liker. r/ Úzeros)r1 ÚotherÚopr¨ r
Zvalidr| r2 r2 r3 Ú _cmp_method s(
|
|
ÿ
|
|
zStringArray._cmp_method)rN Úconvertc C sø ddl m} |d kr tdd}|d kr.| jj}t| }t | ¡}t|sPt |r®t|r^t
|
}n|}t|} | rrd}t j ||| d¡d|t |¡d}
|
| s¤d|d d
< ||
|
|S t|ràt|sàt j ||| d¡d|d }
|
t|
|
S t ||| d¡¡S d S )
|
Nr r§ r8 r5 r^ Zuint8F)r® r4 rN )r® r4 )r© r¨ r) rN r4 r% rR r r r r r Zmap_infer_maskÚviewr r rH ) r1 Úfr4 rN r® r¨ r
rU Ú constructorZna_value_is_nar| r2 r2 r3 Ú_str_map- sF
|
|
÷
|
ÿzStringArray._str_map)F)N)T)NT)NT)T)F)r£ N)NNT) rB rW rX rY Z_typr< rk r] rQ r~ r r r r r r r r r r r¢ r r r¦ r Z _arith_methodr. r/ Z _str_na_valuer² Ú __classcell__r2 r2 rn r3 rH æ sF Q ÿ
|
!" ÿ ü ÿrH )DÚ
|
__future__r Útypingr r ÚnumpyrR Zpandas._configr Z pandas._libsr r r. Zpandas._libs.arraysr Zpandas._typingr r
|
r r r Z pandas.compatr Zpandas.compat.numpyr r Zpandas.util._decoratorsr Zpandas.core.dtypes.baser r r Zpandas.core.dtypes.commonr r r r r r r Z pandas.corer Zpandas.core.array_algosr Zpandas.core.arraysr r r Zpandas.core.arrays.floatingr Zpandas.core.arrays.integerr! Zpandas.core.arrays.numpy_r" Zpandas.core.constructionr# Zpandas.core.indexersr$ Zpandas.core.missingr% r9 r& r' r r( r) rJ rH r2 r2 r2 r3 Ú<module> s: $
|
|
