U /eK @sUdZddlmZddlZeeZddlZddlZ ddl Z ddl Z ddl m Z mZddlmZddlmZmZmZmZmZmZmZmZmZddlZddlmZmZm Z erddl!Z"ndd l#m$Z$e$d Z"d d l%m&Z&d d l'm'Z'ddl(m)Z)er d dl*m+Z+d dl,m-Z-e.ej/e.ej0e.ej1e.ej2e.ej3e.ej4e.ej5e.ej6hZ7e j8e jej9hZ:de;d<e"rz e"jk re"j?jZYe)eYjd?Jd@de7DdeY_dad1dhsr$)Zbinary_array_types)array_encoding_disabledconvert_date_to_datetimeconvert_datetime_arrayconvert_datetime_typeconvert_timedelta_typedecode_base64_dictencode_binary_dictencode_base64_dictis_datetime_typeis_timedelta_typemake_globally_unique_idmake_idserialize_arraytransform_arraytransform_array_to_listtransform_column_source_data traverse_datatransform_series)littlebigc@s.eZdZUded<ded<ded<ded<d S) BufferJsonr __buffer__Tuple[int, ...]shapestrdtype ByteOrderorderN__name__ __module__ __qualname____annotations__rrrr#r9s r9c@s.eZdZUded<ded<ded<ded<dS) Base64BufferJsonr= __ndarray__r;r<r>r?r@NrArrrr#rFs rFrz0TypeGuard[dt.time | dt.datetime | np.datetime64])objreturncCs t|tS)z Whether an object is any date, time, or datetime type recognized by Bokeh. Arg: obj (object) : the object to test Returns: bool : True if ``obj`` is a datetime type ) isinstance _dt_tuplerHrrr#r-s r-z(TypeGuard[dt.timedelta | np.timedelta64]cCst|tjtjfS)z Whether an object is any timedelta type recognized by Bokeh. Arg: obj (object) : the object to test Returns: bool : True if ``obj`` is a timedelta type )rJdt timedeltanp timedelta64rLrrr#r.s r.zdt.datefloatcCs(tj|dddditdS)z Convert a date object to a datetime Args: obj (date) : the object to convert Returns: datetime Ntzinfo)rMdatetime timetupleDT_EPOCH total_secondsrLrrr#r&s r&zdt.timedelta | np.timedelta64cCs4t|tjr|dSt|tjr0t|tSdS)z Convert any recognized timedelta value to floating point absolute milliseconds. Arg: obj (object) : the object to convert Returns: float : milliseconds @@N)rJrMrNrXrOrPrQ NP_MS_DELTArLrrr#r)s   r)zbpd.NaT | pd.Period | pd.Timestamp | pd.Timedelta | dt.datetime | dt.date | dt.time | np.datetime64cCstr|tjkrtjStr2t|tjr2|jdStrJt|trJ|jdStrdt|tj rd|jdSt|t j r|j ddt }|dSt|t jrt|St|tjr|t}t|tSt|t jr|jd|jd|jd|jdSdS)z Convert any recognized date, time, or datetime value to floating point milliseconds since epoch. Arg: obj (object) : the object to convert Returns: float : milliseconds g.AN)rSrTi<rY)pdNaTrOnanrJPeriod to_timestampvalue _pd_timestamp TimedeltarMrUreplacerWrXdater& datetime64NP_EPOCHrQrZtimehourminutesecond microsecond)rHZdiffZ epoch_deltarrr#r(s$         r(ARz np.ndarray)bound)arrayrIcCst|tjs|S|jjdkr0|dddS|jjdkrP|dddS|jjdkrt|dkrt|dtjrz|dddWSt k rYnX|S) a Convert NumPy datetime arrays to arrays to milliseconds since epoch. Args: array : (obj) A NumPy array of datetime to convert If the value passed in is not a NumPy array, it will be returned as-is. Returns: array Mzdatetime64[us]Zint64rYmztimedelta64[us]Or) rJrOndarrayr>kindastypelenrMre Exceptionrorrr#r's   (r'r)rIc Cs@tr6t"td7atttW5QRSQRXntSdS)a Return a new unique ID for a Bokeh object. Normally this function will return simple monotonically increasing integer IDs (as strings) for identifying Bokeh objects within a Document. However, if it is desirable to have globally unique for every object, this behavior can be overridden by setting the environment variable ``BOKEH_SIMPLE_IDS=no``. Returns: str rN)rZ simple_ids_simple_id_lock _simple_idrr=r/rrrr#r0s  r0cCstttS)z Return a globally unique UUID. Some situations, e.g. id'ing dynamically created Divs in HTML documents, always require globally unique IDs. Returns: str )rr=uuidZuuid4rrrr#r//s r/boolcCs |jtkS)z Determine whether an array may be binary encoded. The NumPy array dtypes that can be encoded are: {binary_array_types} Args: array (np.ndarray) : the array to check Returns: bool )r>BINARY_ARRAY_TYPESrxrrr#r%;sr%z ccs|]}d|dVqdSrrr rrr#r$OsFzBuffers | Nonero force_listbufferscCst|}t|||dS)a Transform a NumPy arrays into serialized format Converts un-serializable dtypes and returns JSON serializable format Args: array (np.ndarray) : a NumPy array to be transformed force_list (bool, optional) : whether to only output to standard lists This function can encode some dtypes using a binary encoding, but setting this argument to True will override that and cause only standard Python lists to be emitted. (default: False) buffers (set, optional) : If binary buffers are desired, the buffers parameter may be provided, and any columns that may be sent as binary buffers will be added to the set. If None, then only base64 encoding will be used (default: None) If force_list is True, then this value will be ignored, and no buffers will be generated. **This is an "out" parameter**. The values it contains will be modified in-place. Returns: JSON rr)r'r1r~rrr#r2Rsr2z Sequence[Any]cCs|jjdkrXt|rX|d}d|t|<d|t|<d|t|<| S|jjdkrt rt |r|d}d|t |<| S| S)z Transforms a NumPy array into a list of values Args: array (np.nadarray) : the NumPy array series to transform Returns: list or dict )uifobjectNaNInfinity -Infinityrr) r>rtrOisfiniteanyrurZisposinfZisneginftolistr\Zisnull)roZ transformedrrr#r3us   r3zpd.Series | pd.Index)seriesrrcCs,t|tjr|j}n|j}t|||dS)a Transforms a Pandas series into serialized form Args: series (pd.Series) : the Pandas series to transform force_list (bool, optional) : whether to only output to standard lists This function can encode some dtypes using a binary encoding, but setting this argument to True will override that and cause only standard Python lists to be emitted. (default: False) buffers (set, optional) : If binary buffers are desired, the buffers parameter may be provided, and any columns that may be sent as binary buffers will be added to the set. If None, then only base64 encoding will be used (default: None) If force_list is True, then this value will be ignored, and no buffers will be generated. **This is an "out" parameter**. The values it contains will be modified in-place. Returns: list or dict r)rJr\Z PeriodIndexr`valuesr2)rrrvalsrrr#r6s  r6cCs`t|tjjr|tj}t|s&|r.t|S|jdsBt |}|dkrRt |St ||SdS)a Transforms a NumPy array into serialized form. Args: array (np.ndarray) : the NumPy array to transform force_list (bool, optional) : whether to only output to standard lists This function can encode some dtypes using a binary encoding, but setting this argument to True will override that and cause only standard Python lists to be emitted. (default: False) buffers (set, optional) : If binary buffers are desired, the buffers parameter may be provided, and any columns that may be sent as binary buffers will be added to the set. If None, then only base64 encoding will be used (default: None) If force_list is True, then this value will be ignored, and no buffers will be generated. **This is an "out" parameter**. The values it contains will be modified in-place. Returns: list or dict Z C_CONTIGUOUSN) rJrOmaZ MaskedArrayZfilledr^r%r3flagsZascontiguousarrayr,r+r~rrr#r1s    r1)rHrcstdd|Dr$fdd|DSg}|D]l}t|tkrpt|rJd}nt|rd|dkr`d}nd}||q,t|ttfr|t |q,||q,|S) z Recursively traverse an object until a flat list is found. The flat list is converted to a numpy array and passed to transform_array() to handle ``nan``, ``inf``, and ``-inf``. Args: obj (list) : a list of values or lists css|]}t|tjVqdS)N)rJrOrsr!elrrr#r$sz traverse_data..csg|]}t|dqS)r)r2rrrr# sz!traverse_data..rrrr) alltyperQrrappendrJlisttupler5)rHrZobj_copyitemrrr#r5s    r5rzList[str] | None)datarcolsrIcCs|dkrt|nt|}i}|D]n}trTt||tjtjfrTt|||d||<q t||tjrzt|||d||<q t |||d||<q |S)a Transform ``ColumnSourceData`` data to a serialized format Args: data (dict) : the mapping of names to data columns to transform buffers (set, optional) : If binary buffers are desired, the buffers parameter may be provided, and any columns that may be sent as binary buffers will be added to the set. If None, then only base64 encoding will be used (default: None) **This is an "out" parameter**. The values it contains will be modified in-place. cols (list[str], optional) : Optional list of subset of columns to transform. If None, all columns will be transformed (default: None) Returns: JSON compatible dict Nr) setr\rJZSeriesZIndexr6rOrsr2r5)rrrZ to_transformZ data_copykeyrrr#r4sr4Buffers)rorrIcCsDt}t|d|f}||t||jt|jjt t t j dS)a| Send a numpy array as an unencoded binary buffer The encoded format is a dict with the following structure: .. code:: python { '__buffer__' : << an ID to locate the buffer >>, 'shape' : << array shape >>, 'dtype' : << dtype name >>, 'order' : << byte order at origin (little or big)>> } Args: array (np.ndarray) : an array to encode buffers (set) : Set to add buffers to **This is an "out" parameter**. The values it contains will be modified in-place. Returns: dict )id)r:r<r>r@) r0dicttobytesrr9r<r=r>namerr?sys byteorder)rorZ buffer_idbufrrr#r+s   r+cCs0tt|jd|jt|jjt t t j dS)a Encode a NumPy array using base64: The encoded format is a dict with the following structure: .. code:: python { '__ndarray__' : << base64 encoded array data >>, 'shape' : << array shape >>, 'dtype' : << dtype name >>, } Args: array (np.ndarray) : an array to encode Returns: dict zutf-8)rGr<r>r@) rFbase64 b64encoderdecoder<r=r>rrr?rrrxrrr#r,;s   r,)rrIcCsHt|d}ttj||dd}t|ddkrD||d}|S)z Decode a base64 encoded array into a NumPy array. Args: data (dict) : encoded array data to decode Data should have the format encoded by :func:`encode_base64_dict`. Returns: np.ndarray rGr>)r>r<r)r b64decoderOcopyZ frombufferrvZreshape)rZb64rorrr#r*Ws r*i)FN)FN)FN)N)NN)g__doc__ __future__rlogging getLoggerrBlogrrUrMrr{mathrr threadingrtypingrrrr r r r r rZnumpyrOZtyping_extensionsrrrrr\Z dependenciesrZ core.typesrrstringrZmodels.sourcesrZprotocol.messagerr>Zfloat32Zfloat64Zuint8Zint8Zuint16Zint16Zuint32Zint32r}rhrfrrEZ TimestamprbAttributeErrorZtslibaddrcr_rr]rgrPrZutcfromtimestamprWjoin__all__r?r9rFrr-r.r&r)r(rmr'r0r/r%r2r3r6r1r5r4r+r,r*rzryrrKrrrr#s   ,                            .! #"%$&