U f/eK;2@sPdZddlmZddlZddlmZmZddlZddlm Z ddl Z ddl m Z m Z mZmZmZmZmZddlZddlZddlmZddlmZmZmZmZdd lmZdd lm Z dd l!m"Z"m#Z#m$Z$m%Z%dd l&m'Z'm(Z(m)Z)dd l*m+Z+ddl,m-Z-e r ddl.m/Z/Gddde0Z1Gddde2Z3ddZ4ddZ5dddddZ6dudddd Z7d!d"Z8dd#d$d%Z9dd#d&d'Z:dd#d(d)Z;dd#d*d+Zdwd/d0d1d4d5Z?d6d7Z@d8d9d:d;d<ZAdd#d=d>ZBd?d#d@dAZCd,ddBdCdDZDdEdFZEdGdHZFdIdJZGdxdKdLZHdMdNdOdPdQZIdRdSZJdTdUdVdWdXZKejLdYdZd[d\d]ZMd^d_d`daZNejOejOejPejPejQejQiZRejOdbejPdcejQddejSdeejTdfejOdbejUdbejVdgejWdgejXdhejYdhejZdiej[diej\djej]djej^dkej_dkejPdcej`dcejQddejaddejbdlejcdlejddmejedmiZfdndodpdqdrZgdsdtZhdS)yzh Misc tools for implementing data structures Note: pandas.core.common is *not* part of the public API. ) annotationsN)abc defaultdict)partial) TYPE_CHECKINGAnyCallable CollectionIterableIteratorcast)lib) AnyArrayLikeNpDtypeScalarT)np_version_under1p18)'construct_1d_object_array_from_listlike) is_array_like is_bool_dtypeis_extension_array_dtype is_integer)ABCExtensionArrayABCIndex ABCSeries)iterable_not_string)isna)Indexc@s eZdZdS)SettingWithCopyErrorN__name__ __module__ __qualname__r#r#6/tmp/pip-unpacked-wheel-tiezk1ph/pandas/core/common.pyr9src@s eZdZdS)SettingWithCopyWarningNrr#r#r#r$r%=sr%ccs,|D]"}t|r t|EdHq|VqdS)a Flatten an arbitrarily nested sequence. Parameters ---------- line : sequence The non string sequence to flatten Notes ----- This doesn't consider strings sequences. Returns ------- flattened : generator N)rflatten)lineelementr#r#r$r&Asr&c CsL|dj}|ddD]0}z|j|kr*d}Wqtk rDd}YqXq|S)Nr)name ValueError)objsr*objr#r#r$consensus_name_attrYs   r.rbool)keyreturncCst|ttjtfs$t|rt|jr|jtjkrrt |}t |snd}t |dkrjt |rjt|dSdSt|jrdSn t|trt|dkot |SdS)a Check whether `key` is a valid boolean indexer. Parameters ---------- key : Any Only list-likes may be considered boolean indexers. All other types are not considered a boolean indexer. For array-like input, boolean ndarrays or ExtensionArrays with ``_is_boolean`` set are considered boolean indexers. Returns ------- bool Whether `key` is a valid boolean indexer. Raises ------ ValueError When the array is an object-dtype ndarray or ExtensionArray and contains missing values. See Also -------- check_array_indexer : Check that `key` is a valid array to index, and convert to an ndarray. z=Cannot mask with non-boolean array containing NA / NaN valuesbooleanFTr) isinstancernpndarrayrrrdtypeobject_asarrayr Z is_bool_arrayZ infer_dtyperanyr+rlistlenZ is_bool_list)r0Zna_msgr#r#r$is_bool_indexerds$     r<F) warn_floatcCs2t|r.|r.|r&tjdtddt|S|S)a To avoid numpy DeprecationWarnings, cast float to integer where valid. Parameters ---------- val : scalar warn_float : bool, default False If True, issue deprecation warning for a float indexer. Returns ------- outval : scalar zIndexing with a float is deprecated, and will raise an IndexError in pandas 2.0. You can manually convert to an integer key instead.) stacklevel)r Zis_floatrwarningswarn FutureWarningint)valr=r#r#r$cast_scalar_indexersrEcGsdd|DS)zL Returns a generator consisting of the arguments that are not None. css|]}|dk r|VqdSNr#.0argr#r#r$ sznot_none..r#argsr#r#r$not_nonesrM)r1cGstdd|DS)z? Returns a boolean indicating if any argument is None. css|]}|dkVqdSrFr#rGr#r#r$rJszany_none..r9rKr#r#r$any_nonesrOcGstdd|DS)zA Returns a boolean indicating if all arguments are None. css|]}|dkVqdSrFr#rGr#r#r$rJszall_none..allrKr#r#r$all_nonesrRcGstdd|DS)zC Returns a boolean indicating if any argument is not None. css|]}|dk VqdSrFr#rGr#r#r$rJszany_not_none..rNrKr#r#r$ any_not_nonesrScGstdd|DS)zE Returns a boolean indicating if all arguments are not None. css|]}|dk VqdSrFr#rGr#r#r$rJszall_not_none..rPrKr#r#r$ all_not_nonesrTrCcGstdd|DS)z; Returns the count of arguments that are not None. css|]}|dk VqdSrFr#rHxr#r#r$rJsz!count_not_none..)sumrKr#r#r$count_not_nonesrXzNpDtype | Nonez np.ndarray)r6r1cCst|ttfs"t|ds"t|}nt|tr2|jSt|trR|tjtfkrRt |Stj ||d}t |j j tr|tj |td}|jdkrdd|D}t |}|S)NZ __array__r6cSsg|] }t|qSr#)tuplerUr#r#r$ sz%asarray_tuplesafe..)r3r:r[hasattrrZ_valuesr4r7objectrr8 issubclassr6typestrndim)valuesr6resultr#r#r$asarray_tuplesafes     recCs\t|ttfr|g}t|ttjfsLz t|}Wntk rJ|g}YnXt||d}|S)z Transform label or iterable of labels to array, for use in Index. Parameters ---------- dtype : dtype If specified, use as dtype of the resulting array, otherwise infer. Returns ------- array rY)r3rar[r:r4r5 TypeErrorre)labelsr6r#r#r$index_labels_to_arrays    rhcCs |dk rt|ttfs|gS|SrF)r3r[r:r-r#r#r$maybe_make_listsrjzIterable[T] | TzCollection[T] | T)r-r1cCs.t|tjr t|tjs t|Stt|}|S)zB If obj is Iterable but not list-like, consume into list. )r3rr Sizedr:r r rir#r#r$maybe_iterable_to_lists rlcCs(t|to&|jdko&|jdko&|jdkS)z We have a null slice. Nr3slicestartstopsteprir#r#r$ is_null_slice%s rrz list[bool]cCsdd|DS)zX Find non-trivial slices in "line": return a list of booleans with same length. cSs g|]}t|tot| qSr#)r3rnrr)rHkr#r#r$r\5sz"is_true_slices..r#)r'r#r#r$is_true_slices1srt)r'r1cCs(t|to&|jdko&|j|ko&|jdkS)z& We have a full length slice. rNrm)r-r'r#r#r$ is_full_slice9s rucCs>t|drt|dSt|tr(t|jSt|r:t|jSdS)Nr ) r]getattrr3rget_callable_namefunccallabler`r rir#r#r$rwEs     rwcKst|r||f|S|S)z Evaluate possibly callable input using obj and kwargs if it is callable, otherwise return as it is. Parameters ---------- maybe_callable : possibly a callable obj : NDFrame **kwargs )ry)Zmaybe_callabler-kwargsr#r#r$apply_if_callableVs  r{cCsXt|s(t|tr tt|jSt|}t|tj sDt d|n|tkrTt d|S)a Helper function to standardize a supplied mapping. Parameters ---------- into : instance or subclass of collections.abc.Mapping Must be a class, an initialized collections.defaultdict, or an instance of a collections.abc.Mapping subclass. Returns ------- mapping : a collections.abc.Mapping subclass or other constructor a callable object that can accept an iterator to create the desired Mapping. See Also -------- DataFrame.to_dict Series.to_dict zunsupported type: z/to_dict() only accepts initialized defaultdicts) inspectisclassr3rrdefault_factoryr`r_rMappingrf)Zintor#r#r$standardize_mappinggs    rcCsZt|s"t|s"ts.t|tjjr.tj|St|tjjr@|S|dkrNtjStddS)a Helper function for processing random_state arguments. Parameters ---------- state : int, array-like, BitGenerator (NumPy>=1.17), np.random.RandomState, None. If receives an int, array-like, or BitGenerator, passes to np.random.RandomState() as seed. If receives an np.random.RandomState object, just returns object. If receives `None`, returns np.random. If receives anything else, raises an informative ValueError. .. versionchanged:: 1.1.0 array-like and BitGenerator (for NumPy>=1.18) object now passed to np.random.RandomState() as seed Default None. Returns ------- np.random.RandomState or np.random if state is None NzYrandom_state must be an integer, array-like, a BitGenerator, a numpy RandomState, or None) rrrr3r4randomZ BitGeneratorZ RandomStater+)stater#r#r$ random_states   rz/Callable[..., T] | tuple[Callable[..., T], str]r)rxr1cOsRt|tr>|\}}||kr,|d}t||||<|||S||f||SdS)ar Apply a function ``func`` to object ``obj`` either by passing obj as the first argument to the function or, in the case that the func is a tuple, interpret the first element of the tuple as a function and pass the obj to that function as a keyword argument whose key is the value of the second element of the tuple. Parameters ---------- func : callable or tuple of (callable, str) Function to apply to this object or, alternatively, a ``(callable, data_keyword)`` tuple where ``data_keyword`` is a string indicating the keyword of `callable`` that expects the object. *args : iterable, optional Positional arguments passed into ``func``. **kwargs : dict, optional A dictionary of keyword arguments passed into ``func``. Returns ------- object : the return type of ``func``. z/ is both the pipe target and a keyword argumentN)r3r[r+)r-rxrLrztargetmsgr#r#r$pipes   rcs&ttjtfrfdd}n}|S)zv Returns a function that will map names/labels, dependent if mapper is a dict, Series or just a function. cs|kr|S|SdSrFr#)rVmapperr#r$fszget_rename_function..f)r3rrr)rrr#rr$get_rename_functionsrz Scalar | Iterable | AnyArrayLikezlist | AnyArrayLike)rcr1cCs>t|ttjtttfr|St|tjr8t|t s8t|S|gS)z Convert list-like or scalar input to list-like. List, numpy and pandas array-like inputs are returned unmodified whereas others are converted to list. ) r3r:r4r5rrrrr ra)rcr#r#r$convert_to_list_likes rrazIterator[None])attrr1ccs,t||}t||||Vt|||dS)zTemporarily set attribute on an object. Args: obj: Object whose attribute will be modified. attr: Attribute to modify. value: Value to temporarily set attribute to. Yields: obj with modified attribute. N)rvsetattr)r-rvalue old_valuer#r#r$ temp_setattrs  rr)indexcCs2t|t|kr.tdt|dt|ddS)zC Check the length of data matches the length of the index. zLength of values (z") does not match length of index ()N)r;r+)datarr#r#r$require_length_match srrWmaxminrQr9meanprodstdvarmediancumprodcumsumrz str | None)rIr1cCs t|S)zH if we define an internal function for this argument, return it ) _cython_tablegetrIr#r#r$get_cython_func6srcCs t||S)ze if we define an builtin function for this argument, return it, otherwise return the arg )_builtin_tablerrr#r#r$is_builtin_func=sr)F)N)N)N)i__doc__ __future__rbuiltins collectionsrr contextlib functoolsrr|typingrrrr r r r r@Znumpyr4Z pandas._libsr Zpandas._typingrrrrZ pandas.compatrZpandas.core.dtypes.castrZpandas.core.dtypes.commonrrrrZpandas.core.dtypes.genericrrrZpandas.core.dtypes.inferencerZpandas.core.dtypes.missingrZpandasrr+rWarningr%r&r.r<rErMrOrRrSrTrXrerhrjrlrrrtrurwr{rrrrrcontextmanagerrrrWrrrrQr9ZnansumrZnanmeanrZnanprodrZnanstdrZnanvarrZ nanmedianZnanmaxZnanminrZ nancumprodrZ nancumsumrrrr#r#r#r$s  $        3    *%