U /eA< @s:ddlmZddlZddlZddlZddlmZddlmZm Z ddl m Z m Z m Z mZmZmZmZddlmZmZddlmZddlmZdd lmZdd lmZmZdd lmZm Z dd l!m"Z"m#Z#dd l$m%Z%ddl&m'Z'm(Z(m)Z)m*Z*ddl+m,Z,m-Z-m.Z.ddl/m0Z0ddl1m2Z2e3e4Z5eeej67ej68e9dddddZ:eej67ej68e9dddZ;ddddgiZGd"d#d#e'Z?Gd$d%d%e'Z@Gd&d'd'e'ZAGd(d)d)e'ZBe=d*dd+d,d-ZCe=d.dd+d/d0ZDe=d1d2d+d3d4ZEe=d5dd+d6d7ZFe=d8dd+d9d:ZGdS);) annotationsN)without_property_validation)columnrow)ColumnDataSource DataRange1d HoverToolNumeralTickFormatterPanTool ResetTool WheelZoomTool) DataTable TableColumn)RdBu)figure)Theme) EnvironmentFileSystemLoader)merge partition_all) format_bytes format_time)add_periodic_callback)DashboardComponent ProfileServerProfileTimePlot SystemMonitor)_DATATABLE_STYLESHEETS_KWARGS transposeupdate)time log_errorsz..httpZ templates)loaderz theme.yaml)filenameZpagesstatussystemprofilez simple.html)templatecsfdd}|S)Ncs tddfdd}|S)N)Z unroll_stackcsB|_t|_dk r$|jd<|j|t|_|||S)N active_page)titleenvZ get_templater)template_variablesr BOKEH_THEMEZtheme)argextradoc)r+fr)r,K/tmp/pip-unpacked-wheel-g426oqom/distributed/dashboard/components/worker.pywrapper6s   z0standard_doc..decorator..wrapperr!)r3r6r+r)r,)r3r5 decorator5s zstandard_doc..decoratorr4)r,r+r)r8r4r7r5 standard_doc4s r9c@s(eZdZdZddZeeddZdS) StateTablezCurrently running taskscsh||_ddddddg}tdd|D|_d d|Dtf|jfd d |Dd d t}||_dS)NStored ExecutingReadyWaiting ConnectionsServingcSsi|] }|gqSr4r4.0namer4r4r5 Lsz'StateTable.__init__..cSsi|]}|t||dqS))fieldr,)rrAr4r4r5rDNscsg|] }|qSr4r4)rBncolumnsr4r5 Rsz'StateTable.__init__..F)sourcerHheight)workerrrKr rroot)selfrMnamestabler4rGr5__init__HszStateTable.__init__cCsd|j}t|jgd|jj|jjfgt|jjgt|jjg|jjgt|j gd}t |j |dS)Nz%d / %d)r;r<r=r>r?r@) rMlendatastateexecuting_countnthreadsreadyZwaitingtransfer_incoming_count_commsrrK)rOwdr4r4r5rXs    zStateTable.updateN)__name__ __module__ __qualname____doc__rRrr"rr4r4r4r5r:Es r:c@s*eZdZedddZeeddZdS)CommunicatingStream,c Ks||_ddddddddd d g }td d |D|_td d |D|_tdd}tdd}tfdd|||dd|}|j|jddddddd|j|jdddddddtddd}||t t ddt dd||_ d|_ d|_t|_dS)Nstartstopmiddledurationwhoyhoveralpha bandwidthtotalcSsi|] }|gqSr4r4rAr4r4r5rDxsz0CommunicatingStream.__init__..cSsi|] }|gqSr4r4rAr4r4r5rDysr) range_paddingzPeer Communicationsdatetime)r, x_axis_typex_rangey_rangerLtoolsg?red)rKxrhwidthrLcolorrjblue follow_mousez@hoverZ point_policyZtooltipsrvZ dimensions)rMrtransfer_incomingtransfer_outgoingrrrectr add_toolsr r r rN"last_transfer_incoming_count_total"last_transfer_outgoing_count_totaldictrg) rOrMrLkwargsrPrqrrfigrir4r4r5rRhsn      zCommunicatingStream.__init__c s|jj|jj|j}fddtd|dD|jj|_|jj|jjj|j}fddtd|dD|jjj|_|j g|j gfD]P\}}|D]}d|kr|d=|d=|d|dpd }t t |d dd }||d <z|j |d |d<Wn<tk r8t|j |j |d <|j |d |d<YnXdt|dt|dt|d|d|d<dD]}||d||<qpq|rt|}t|jdrt |d|jdddkr|j|q|j|ddqdS)Ncsg|]}| qSr4copyrBi)transfer_outgoing_logr4r5rIsz.CommunicatingStream.update..csg|]}| qSr4rr)transfer_incoming_logr4r5rIs compressedkeysrlrf?geͽA333333?rjrgrhz{} / {} = {}/sri)rerfrcrdrdrc')rollover)rMrZtransfer_outgoing_count_totalrrangerrUZtransfer_incoming_count_totalrr|r}maxminrgKeyErrorrSformatrrrrTrstream)rOrFZmsgsrKmsgrkZbwkr4)rrr5rsd       zCommunicatingStream.updateN)rb)r]r^r_r"rRrrr4r4r4r5rags  @rac@s$eZdZddZeeddZdS)CommunicatingTimeSeriesc Ks||_tgggd|_tdddd}tfddd|jjd gd d |d |}|j|jd ddd|j|jd ddd|t t ddt dd||_ dS)N)ruinoutend NrfollowZfollow_intervalrmzCommunication Historyrn皙rror,rprrrLrsrqrurrt)rKrurhrwrrxrvr{) rMrrKrrrUZtransfer_incoming_count_limitlinerr r r rNrOrMrrqrr4r4r5rRs* z CommunicatingTimeSeries.__init__cCs4|jtdgt|jjg|jjjgdddS)Nr)rurrr)rKrr rSrMrZrUrYrOr4r4r5rs   zCommunicatingTimeSeries.updateNr]r^r_rRrr"rr4r4r4r5rsrc@s$eZdZddZeeddZdS)ExecutingTimeSeriesc Ks||_tggd|_tdddd}tfddd|jjd gd d |d |}|j|jd dd|t t ddt dd||_ dS)NrurhrrrrzExecuting Historyrnrg?rrorrurh)rKrurhrvr{) rMrrKrrrUrWrrr r r rNrr4r4r5rRs( zExecutingTimeSeries.__init__cCs(|jtdg|jjjgdddS)Nrr)rKrr rMrUrVrr4r4r5r)szExecutingTimeSeries.updateNrr4r4r4r5rsrc@s>eZdZd ddZeddZeddZeedd Zd S) Counters stretch_bothc s||_i|_i|_i|_i|_|_|jjrD|jjD]}||q4|jjD]}| |qLt |j|jfddt Dt dkrt d|_n$t fddtdDdi|_dS) Ncsg|] }|qSr4r4)rBr)figuresr4r5rIAsz%Counters.__init__.. sizing_modec3s|]}t|diVqdS)rN)r)rBpairrr4r5 Gsz$Counters.__init__..r*r)servercounter_figurescounter_sourcesdigest_figuresdigest_sourcesrdigestsadd_digest_figurecountersadd_counter_figurersortedrSrrNr)rOrrrrCr4)rrr5rR2s,      zCounters.__init__c Cst|jj|j}ddt|D}i}|dr:d|d<tf|dd|jd|}d |j_ d |j _ |d sx|d rt d d |j d_ t|D]@}dd|||}|j||dd|tt|d| dqtjd|j _||j|<||j|<|S)NcSsi|]}|tggdqS)rrrr4r4r5rDQsz.Counters.add_digest_figure..rfrnrpror)r,rsrLrFrkbytesz0.0b)rrrrurh)rKrurhrjrw )rSrr intervalsrendswithrrZyaxisvisibleygridr xaxis formatterrrrmathpimajor_label_orientationrr)rOrCrFsourcesrrrrjr4r4r5rNs<    zCounters.add_digest_figurec Cst|jj|j}ddt|D}t|dd|jtdd|jj|jdDd}d |j _ t|D]d}d d ||}|j ||d d |ddt t |d| dtddd}||tjd|j_qd||j|<||j|<|S)Nc Ss i|]}|tggggdqS)rurhy-centercountsrrr4r4r5rDqsz/Counters.add_counter_figure..rorcss|]}t|VqdS)NstrrBrur4r4r5r{sz.Counters.add_counter_figure..r)r,rsrLrrqFrg?rurrhrr)rKrurhrvrLrjrwryz @x : @countsrzr)rSrrrrrrr componentsrrr~rrrrrrrrrr)rOrCrFrrrrvrir4r4r5rns:     zCounters.add_counter_figurec s|jD]\}}|jj|}it|jD]X\}r,d\}}|dd}|drh|d9}|j ||j ||dq,d||f|j _ q |jD]\}}|jj|}it|jD]\}rVt}|jd|j|fdd |D}fd d |D}d d |D} d d |D}||| |d |j||j d||f|j _ dd |D|j_qqdS)Ndrrfrrz%s: %drcsg|] }|qSr4r4r)r\r4r5rIsz#Counters.update..csg|] }|qSr4r4)rBc)factorr4r5rIscSsg|] }|dqS)r*r4)rBrhr4r4r5rIscSsg|] }t|qSr4rrr4r4r5rIsrcSsg|] }t|qSr4rrr4r4r5rIs)ritemsrr enumeratersizeZ histogramrrrTrr,textrrrrrrqZfactors) rOrCrdigestrZysxscounterrZ y_centersr4)r\rr5rs4    zCounters.updateN)r) r]r^r_rRr"rrrrr4r4r4r5r1s   #rzDask Worker Internal Monitor)r+c Cst|}t|dd}t|dd}t|dd}|jj}||j_||j_t||dt||dt||dt||d|t|j|j|j|jdddS)N scale_widthr) r:rrrarNrqradd_rootr)rMr1r2Z statetableZ executing_tsZcommunicating_tsZcommunicating_streamZxrr4r4r5 status_docs(       rzDask Worker MonitorcCs(t|dd}t||d||jdS)Nrr)rrrrN)rMr1r2Zsysmonr4r4r5systemmonitor_docs  rzDask Work CountersrcCs(t|dd}t||d||jdS)Nrrr)rrrrN)rr1r2rr4r4r5 counters_docs  rzDask Worker ProfilecCs&t|d|d}||j|dSNr)rr2)rrrNtrigger_updaterr1r2r(r4r4r5 profile_docs rzDask: Profile of Event LoopcCs&t|d|d}||j|dSr)rrrNrrr4r4r5profile_server_docs r)H __future__rloggingrosZbokeh.core.propertiesrZ bokeh.layoutsrrZ bokeh.modelsrrrr r r r Zbokeh.models.widgetsr rZbokeh.palettesrZbokeh.plottingrZ bokeh.themesrZjinja2rrZtlzrrZ dask.utilsrrZ distributed.dashboard.componentsrZ'distributed.dashboard.components.sharedrrrrZdistributed.dashboard.utilsrrrZdistributed.metricsr Zdistributed.utilsr" getLoggerr]loggerpathjoindirname__file__r-r/r.r9r:rarrrrrrrrr4r4r4r5s\  $        "&