U
|
¬ý°dAe ã @ s d Z ddlmZ ddlmZ ddlmZmZmZm Z m
|
Z
|
m Z m Z m Z ddlZddlmZ ddlmZmZmZ ddlmZ dd lmZ dd
|
lmZm Z dd l m Z dd l m Z dd l!m"Z"m#Z# ddl$m% m&Z' ddl(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/ ddl0m1Z1 er ddl2m3Z3m4Z4 ddl5m6Z6 e dddddddddd ddddddddddd Z7e dddddddddd d ddddddd dd d Z7e dddddddddd d ddddddd!dd"d Z7e ddddddddd#d d$dddddddd%d Z7e dddddddddd d d&dddddd!dd'd Z7dd(d)dddd)d)dd d d&dddddd!dd*d Z7G d+d, d,Z8d-d.d/d0Z9d4d1d.d2d3Z:dS )5z
|
Concat routines.
|
é )Ú annotations)Úabc)Ú TYPE_CHECKINGÚCallableÚHashableÚIterableÚLiteralÚMappingÚcastÚoverloadN)Úusing_copy_on_write)ÚAxisÚAxisIntÚ HashableT)Úcache_readonly)Ú concat_compat)Ú ABCDataFrameÚ ABCSeries)Úis_bool)Úisna)Úfactorize_from_iterableÚfactorize_from_iterables)ÚIndexÚ
|
MultiIndexÚall_indexes_sameÚ default_indexÚ ensure_indexÚget_objs_combined_axisÚget_unanimous_names)Úconcatenate_managers)Ú DataFrameÚSeries)ÚNDFrame.) ÚaxisÚjoinÚ ignore_indexÚkeysÚlevelsÚnamesÚverify_integrityÚsortÚcopyz3Iterable[DataFrame] | Mapping[HashableT, DataFrame]zLiteral[(0, 'index')]ÚstrÚboolz bool | Noner )Úobjsr# r$ r% r) r* r+ Úreturnc
|
C s d S ©N© ©
|
r. r# r$ r% r& r' r( r) r* r+ r1 r1 úQd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\pandas/core/reshape/concat.pyÚconcat@ s r4 z-Iterable[Series] | Mapping[HashableT, Series]r! c
|
C s d S r0 r1 r2 r1 r1 r3 r4 Q s ú/Iterable[NDFrame] | Mapping[HashableT, NDFrame]úDataFrame | Seriesc
|
C s d S r0 r1 r2 r1 r1 r3 r4 b s )r$ r% r& r' r( r) r* r+ zLiteral[(1, 'columns')]c
|
C s d S r0 r1 r2 r1 r1 r3 r4 s s r c
|
C s d S r0 r1 r2 r1 r1 r3 r4 s ÚouterFc C sL | dkrt rd} q(d} n| r(t r(d} t| |||||||| |d
|
}
|
|
|
¡ S )a
|
Concatenate pandas objects along a particular axis.
|
|
Allows optional set logic along the other axes.
|
|
Can also add a layer of hierarchical indexing on the concatenation axis,
|
which may be useful if the labels are the same (or overlapping) on
|
the passed axis number.
|
|
Parameters
|
----------
|
objs : a sequence or mapping of Series or DataFrame objects
|
If a mapping is passed, the sorted keys will be used as the `keys`
|
argument, unless it is passed, in which case the values will be
|
selected (see below). Any None objects will be dropped silently unless
|
they are all None in which case a ValueError will be raised.
|
axis : {0/'index', 1/'columns'}, default 0
|
The axis to concatenate along.
|
join : {'inner', 'outer'}, default 'outer'
|
How to handle indexes on other axis (or axes).
|
ignore_index : bool, default False
|
If True, do not use the index values along the concatenation axis. The
|
resulting axis will be labeled 0, ..., n - 1. This is useful if you are
|
concatenating objects where the concatenation axis does not have
|
meaningful indexing information. Note the index values on the other
|
axes are still respected in the join.
|
keys : sequence, default None
|
If multiple levels passed, should contain tuples. Construct
|
hierarchical index using the passed keys as the outermost level.
|
levels : list of sequences, default None
|
Specific levels (unique values) to use for constructing a
|
MultiIndex. Otherwise they will be inferred from the keys.
|
names : list, default None
|
Names for the levels in the resulting hierarchical index.
|
verify_integrity : bool, default False
|
Check whether the new concatenated axis contains duplicates. This can
|
be very expensive relative to the actual data concatenation.
|
sort : bool, default False
|
Sort non-concatenation axis if it is not already aligned.
|
|
copy : bool, default True
|
If False, do not copy data unnecessarily.
|
|
Returns
|
-------
|
object, type of objs
|
When concatenating all ``Series`` along the index (axis=0), a
|
``Series`` is returned. When ``objs`` contains at least one
|
``DataFrame``, a ``DataFrame`` is returned. When concatenating along
|
the columns (axis=1), a ``DataFrame`` is returned.
|
|
See Also
|
--------
|
DataFrame.join : Join DataFrames using indexes.
|
DataFrame.merge : Merge DataFrames by indexes or columns.
|
|
Notes
|
-----
|
The keys, levels, and names arguments are all optional.
|
|
A walkthrough of how this method fits in with other tools for combining
|
pandas objects can be found `here
|
<https://pandas.pydata.org/pandas-docs/stable/user_guide/merging.html>`__.
|
|
It is not recommended to build DataFrames by adding single rows in a
|
for loop. Build a list of rows and make a DataFrame in a single concat.
|
|
Examples
|
--------
|
Combine two ``Series``.
|
|
>>> s1 = pd.Series(['a', 'b'])
|
>>> s2 = pd.Series(['c', 'd'])
|
>>> pd.concat([s1, s2])
|
0 a
|
1 b
|
0 c
|
1 d
|
dtype: object
|
|
Clear the existing index and reset it in the result
|
by setting the ``ignore_index`` option to ``True``.
|
|
>>> pd.concat([s1, s2], ignore_index=True)
|
0 a
|
1 b
|
2 c
|
3 d
|
dtype: object
|
|
Add a hierarchical index at the outermost level of
|
the data with the ``keys`` option.
|
|
>>> pd.concat([s1, s2], keys=['s1', 's2'])
|
s1 0 a
|
1 b
|
s2 0 c
|
1 d
|
dtype: object
|
|
Label the index keys you create with the ``names`` option.
|
|
>>> pd.concat([s1, s2], keys=['s1', 's2'],
|
... names=['Series name', 'Row ID'])
|
Series name Row ID
|
s1 0 a
|
1 b
|
s2 0 c
|
1 d
|
dtype: object
|
|
Combine two ``DataFrame`` objects with identical columns.
|
|
>>> df1 = pd.DataFrame([['a', 1], ['b', 2]],
|
... columns=['letter', 'number'])
|
>>> df1
|
letter number
|
0 a 1
|
1 b 2
|
>>> df2 = pd.DataFrame([['c', 3], ['d', 4]],
|
... columns=['letter', 'number'])
|
>>> df2
|
letter number
|
0 c 3
|
1 d 4
|
>>> pd.concat([df1, df2])
|
letter number
|
0 a 1
|
1 b 2
|
0 c 3
|
1 d 4
|
|
Combine ``DataFrame`` objects with overlapping columns
|
and return everything. Columns outside the intersection will
|
be filled with ``NaN`` values.
|
|
>>> df3 = pd.DataFrame([['c', 3, 'cat'], ['d', 4, 'dog']],
|
... columns=['letter', 'number', 'animal'])
|
>>> df3
|
letter number animal
|
0 c 3 cat
|
1 d 4 dog
|
>>> pd.concat([df1, df3], sort=False)
|
letter number animal
|
0 a 1 NaN
|
1 b 2 NaN
|
0 c 3 cat
|
1 d 4 dog
|
|
Combine ``DataFrame`` objects with overlapping columns
|
and return only those that are shared by passing ``inner`` to
|
the ``join`` keyword argument.
|
|
>>> pd.concat([df1, df3], join="inner")
|
letter number
|
0 a 1
|
1 b 2
|
0 c 3
|
1 d 4
|
|
Combine ``DataFrame`` objects horizontally along the x axis by
|
passing in ``axis=1``.
|
|
>>> df4 = pd.DataFrame([['bird', 'polly'], ['monkey', 'george']],
|
... columns=['animal', 'name'])
|
>>> pd.concat([df1, df4], axis=1)
|
letter number animal name
|
0 a 1 bird polly
|
1 b 2 monkey george
|
|
Prevent the result from including duplicate index values with the
|
``verify_integrity`` option.
|
|
>>> df5 = pd.DataFrame([1], index=['a'])
|
>>> df5
|
0
|
a 1
|
>>> df6 = pd.DataFrame([2], index=['a'])
|
>>> df6
|
0
|
a 2
|
>>> pd.concat([df5, df6], verify_integrity=True)
|
Traceback (most recent call last):
|
...
|
ValueError: Indexes have overlapping values: ['a']
|
|
Append a single row to the end of a ``DataFrame`` object.
|
|
>>> df7 = pd.DataFrame({'a': 1, 'b': 2}, index=[0])
|
>>> df7
|
a b
|
0 1 2
|
>>> new_row = pd.Series({'a': 3, 'b': 4})
|
>>> new_row
|
a 3
|
b 4
|
dtype: int64
|
>>> pd.concat([df7, new_row.to_frame().T], ignore_index=True)
|
a b
|
0 1 2
|
1 3 4
|
NFT) r# r% r$ r& r' r( r) r+ r* )r Ú _ConcatenatorÚ
|
get_result) r. r# r$ r% r& r' r( r) r* r+ Úopr1 r1 r3 r4 s( X
|
ö c
|
@ s e Zd ZdZd"ddd d
|
d
|
d
|
d
|
d d d dZdd ZddddZddddZddddd Ze ddd d Z
|
dd d d!Z dS )#r8 zB
|
Orchestrates a concatenation operation for BlockManagers
|
r r7 NFTr5 r r, r- ÚNone)r. r# r$ r% r) r+ r* r/ c s t tttfr&tdt j d|dkr6d| _n|dkrFd| _ntdt t j
|
r|d krnt ¡ } fdd |D nt t d
|
krtd |d kr¶t tj nxg } g } t| D ]&\} }|d krÚqÈ| | ¡ | |¡ qÈ| t |trt|j| |jd }nt|d d }t| |d}t d
|
krDtdt } D ]:}t |ttfszdt| d}t|| |j¡ qNd }t |dkrÖt|} D ]*}|j|kr¨t |j ¡r¨|} q q¨nJdd D }t |r |d kr |d kr |d kr | js | d
|
}|d kr2 d
|
} | _ t |tr\d
|
dl m } | !|¡}n
|
| !|¡}t |t| _"| j"r| #|¡}t |t| _$d
|
| krª|jksÂn t%d|j d| t |dkrd
|
}|j}g | j | _ D ]}|j}||krnr||d krtdnZt|d d }|s6|d krB|}|d7 }| j"rX|dkrXd
|
}t&d|}|j'||idd}| j |¡ qì|| _(| j"rd| j( nd
|
| _)|| _ |p¸t|dd | _|| _*t+|
|
sÜtd|
|
d |
|
| _,|| _-|| _.| | _/| 0¡ | _1d S ) NzTfirst argument must be an iterable of pandas objects, you passed an object of type "ú"r7 FÚinnerTz?Only can inner (intersect) or outer (union) join the other axisc s g | ] } | qS r1 r1 )Ú.0Úk©r. r1 r3 Ú
|
<listcomp>¨ s z*_Concatenator.__init__.<locals>.<listcomp>r zNo objects to concatenate)r( Úname)rB z All objects passed were Nonez#cannot concatenate object of type 'z+'; only Series and DataFrame objs are validé c S s( g | ] }t |jd ks t|tr|qS )r )ÚsumÚshapeÚ
|
isinstancer )r> Úobjr1 r1 r3 rA à s
|
)r zaxis must be between 0 and z , input was z>cannot concatenate unaligned mixed dimensional NDFrame objectsr6 )r+ r( z0The 'sort' keyword only accepts boolean values; z was passed.)2rF r r r, Ú TypeErrorÚtypeÚ__name__Ú intersectÚ
|
ValueErrorr r Úlistr& ÚlenÚcomZnot_noneÚzipÚappendr Ú from_tuplesr( Úgetattrr ÚsetÚaddÚndimÚmaxÚnprD rE r. Úpandasr Z_get_axis_numberZ _is_frameÚ_get_block_manager_axisÚ
|
_is_seriesÚAssertionErrorr
|
Ú _constructorÚbm_axisr# r' r r* r% r) r+ Ú _get_new_axesÚnew_axes)Úselfr. r# r$ r& r' r( r% r) r+ r* Z
|
clean_keysZ
|
clean_objsr? ÚvrB ZndimsrG ÚmsgÚsampleZmax_ndimZ non_emptiesr Zcurrent_columnrV r1 r@ r3 Ú__init__ sà ÿÿ
|
ÿ ÿ
|
ÿÿÿÿ
|
|
|
ÿ
|
ÿ
|
|
|
ÿz_Concatenator.__init__c C s | j rÄtd| jd }| jdkrtt | j¡}|j}dd | jD }t|dd}||| jd ||j d}|j
|
| ddS t t t t| j| j}|j}| j\}} |||| jd }
|
| |
|
_|
|
j
|
| ddS nÂtd
|
| jd }g } | jD ]`} i } t| jD ]<\}}|| jkrqð| jd | }| |¡sð| |¡| |< qð| | j| f¡ qÞt| | j| j| jd }| jsnt sn| ¡ |j}||j
|
| ddS d S ) Nr! r c S s g | ]
|
}|j qS r1 )Z_values)r> Zserr1 r1 r3 rA B s z,_Concatenator.get_result.<locals>.<listcomp>)r# )ÚindexrB Údtyper4 )Úmethod)rf r+ r rC )Ú concat_axisr+ )r[ r
|
r. r^ rO Zconsensus_name_attrr] r r` rg Z __finalize__ÚdictrP ÚrangerN Z_constructor_expanddimr+ ÚcolumnsÚ enumerateÚaxesÚequalsÚ get_indexerrQ Z_mgrr r Z_consolidate_inplace)ra rd rB ZconsZarrsÚresÚresultÚdatarf rl ZdfZ mgrs_indexersrG ZindexersZaxZ
|
new_labelsZ
|
obj_labelsZnew_datar1 r1 r3 r9 5 sH
|
|
|
|
ÿz_Concatenator.get_resultÚint©r/ c C s$ | j r| jdkrdS | jd jS d S )NrC é r )r[ r^ r. rV ©ra r1 r1 r3 Ú_get_result_dimq s z _Concatenator._get_result_dimz list[Index]c s ¡ } fddt|D S )Nc s& g | ] }| j kr jn |¡qS r1 )r^ Ú_get_concat_axisÚ_get_comb_axis©r> Úirw r1 r3 rA y s ÿz/_Concatenator._get_new_axes.<locals>.<listcomp>)rx rk )ra rV r1 rw r3 r_ w s
|
þz_Concatenator._get_new_axesr r )r| r/ c C s* | j d |¡}t| j || j| j| jdS )Nr )r# rK r* r+ )r. rZ r rK r* r+ )ra r| Z data_axisr1 r1 r3 rz ~ s ûz _Concatenator._get_comb_axisc sl j rê jdkr"dd jD }nÆ jr:tt j}|S jdkrÖdgt j }d}d}t jD ]R\}}t|t st
|
dt |j d|j dk r¨|j ||< d}qf|||< |d 7 }qf|rÆt|S tt jS nt j j¡S n fd
|
d jD } jr ttd d |D }|S jdkrJ jdk r@td t|}nt| j j j} |¡ |S )zC
|
Return index to be used along concatenation axis.
|
r c S s g | ]
|
}|j qS r1 )rf ©r> Úxr1 r1 r3 rA s z2_Concatenator._get_concat_axis.<locals>.<listcomp>NFz6Cannot concatenate type 'Series' with object of type 'ú'TrC c s g | ]}|j j qS r1 )rn r# r} rw r1 r3 rA ª s c s s | ]}t |V qd S r0 )rN r{ r1 r1 r3 Ú <genexpr> s z1_Concatenator._get_concat_axis.<locals>.<genexpr>z+levels supported only when keys is not None)r[ r^ r. r% r rN r& rm rF r rH rI rJ rB r r Z set_namesr( rD r' rL Ú_concat_indexesÚ_make_concat_multiindexÚ_maybe_check_integrity) ra ÚindexesÚidxr( ÚnumZ has_namesr| r~ ri r1 rw r3 ry sP
|
|
|
ÿ
|
|
|
|
ÿ
|
z _Concatenator._get_concat_axis)Ú concat_indexc C s. | j r*|js*|| ¡ ¡ }td| d S )Nz!Indexes have overlapping values: )r) Ú is_uniqueZ
|
duplicatedÚuniquerL )ra r Úoverlapr1 r1 r3 r ½ s z$_Concatenator._maybe_check_integrity) r r7 NNNFFTF) rJ Ú
|
__module__Ú __qualname__Ú__doc__re r9 rx r_ rz r ry r r1 r1 r1 r3 r8 s& õ -<
|
4r8 r ru c C s | d | dd
¡S )Nr rC )rQ )r r1 r1 r3 r Ä s r r c sR |d krt |d ts*|d k rrt|dkrrtt| }|d krLd gt| }|d krbt|\}}q¬dd |D }n:|g}|d krd g}|d krt| ¡ g}ndd |D }|D ] }|js°t d|
|
¡ q°t | rêt dd |D s8g }t||D ]\}}g } t|| D ]h\}
|
} t |t |
|
@ ||
|
kB } | ¡ sLt d |
|
d
|
| t | ¡d d } | t | t| ¡¡ q| t | ¡¡ qøt| }t |tr¸| |j¡ | |j¡ n t|\}}| |¡ | |¡ t|t|krôt|}n4td d | D dkstd t|tt| }t|||ddS | d }t|}t| t|}t|}g }t||D ]R\}}t|}| |¡}|dk} | ¡ r¬t d|| | t ||¡¡ qnt |trö| |j¡ | fdd|jD ¡ n.| | ¡ ¡ | ¡ |¡}| t | ¡¡ t|t|k rB| |j ¡ t|||ddS )Nr rC c S s g | ] }t |qS r1 ©r r} r1 r1 r3 rA Ó s z+_make_concat_multiindex.<locals>.<listcomp>c S s g | ] }t |qS r1 r r} r1 r1 r3 rA Ü s zLevel values not unique: c s s | ] }|j V qd S r0 )r )r> Úlevelr1 r1 r3 r â s z*_make_concat_multiindex.<locals>.<genexpr>zKey z not in level c S s h | ]
|
}|j qS r1 )Znlevels)r> r
r1 r1 r3 Ú <setcomp> s z*_make_concat_multiindex.<locals>.<setcomp>z@Cannot concat indices that do not have the same number of levelsF)r' Úcodesr( r) éÿÿÿÿz"Values not found in passed level: c s g | ]}t | ¡qS r1 )rX Útile)r> Zlab©Zkpiecesr1 r3 rA ( s ) rF ÚtuplerN rM rP r r r r rL Útolistr Úallr ÚanyrX ZnonzerorQ ÚrepeatZ concatenater r Úextendr' r r r\ r rp r r( )r r& r' r( ZzippedÚ_r Z
|
codes_listZhlevelZ to_concatÚkeyrf Úmaskr| r r Ú
|
categoriesZ new_indexÚnZ new_namesZ
|
new_levelsZ new_codesZmappedZ single_codesr1 r r3 r È s ÿ
|
ÿ
|
|
|
|
ÿ ÿ
|
|
ÿr )NN);r Ú
|
__future__r Ú collectionsr Útypingr r r r r r r
|
r ÚnumpyrX Zpandas._configr Zpandas._typingr r r Zpandas.util._decoratorsr Zpandas.core.dtypes.concatr Zpandas.core.dtypes.genericr r Z pandas.core.dtypes.inferencer Zpandas.core.dtypes.missingr Z pandas.core.arrays.categoricalr r Zpandas.core.commonÚcoreÚcommonrO Zpandas.core.indexes.apir r r r r r r Zpandas.core.internalsr rY r r! Zpandas.core.genericr" r4 r8 r r r1 r1 r1 r3 Ú<module> s° ( $ õ"õ"õ"õ"õ"õ p B
|
