U /e@ @s ddlmZddlZddlZddlmZddlmZmZm Z ddl m Z m Z m Z mZddZdd Zd d Zed Zed Zd-ddZd.ddZd/ddZeddgZeddgZddZd0ddZdd Zd1d!d"Zd2dd#d#d$ddd%d&d&d'd(d(d(d)d)d*d+d,ZdS)3) annotationsN)partial)get_dependencies ishashableistask)applyfuncnameimport_required key_splitcCs|d}|tkr|d}t|drTt|jdkrDt|jddSt|jd}nt|}tdd|ddDr|dS|SdS)zLabel for a task on a dot graph. Examples -------- >>> from operator import add >>> task_label((add, 1, 2)) 'add' >>> task_label((add, (add, 1, 2), 3)) 'add(...)' rfuncsz(...)css|]}t|VqdSN has_sub_tasks.0ir,/tmp/pip-unpacked-wheel-dbjnr7gq/dask/dot.py sztask_label..N)rhasattrlenr rany)taskfuncheadrrr task_label s   rcCs0t|r dSt|tr(tdd|DSdSdS)z&Returns True if the task has sub tasksTcss|]}t|VqdSr rrrrrr+sz has_sub_tasks..FN)r isinstancelistr)rrrrr&s  rcCs8ztt|WStk r2ttt|YSXdSr )strhash TypeError)xrrrname0sr#z([0-9a-z]{32})z>([0-9a-z]{8}-[0-9a-z]{4}-[0-9a-z]{4}-[0-9a-z]{4}-[0-9a-z]{12})cCsxt|}ttfD]b}t||}|dk r|D]@}|dk r`||t|}d|}|||<nd}|||}q0q|S)a >>> label('x') 'x' >>> label(('x', 1)) "('x', 1)" >>> from hashlib import md5 >>> x = 'x-%s-hello' % md5(b'1234').hexdigest() >>> x 'x-81dc9bdb52d04dc20036dbd8313ed055-hello' >>> label(x) 'x-#-hello' >>> from uuid import uuid1 >>> x = 'x-%s-hello' % uuid1() >>> x # doctest: +SKIP 'x-4c1a3d7e-0b45-11e6-8334-54ee75105593-hello' >>> label(x) 'x-#-hello' N#) r_HASHPAT_UUIDPATresearchgroupsgetrreplace)r"cachespatternmhnlabelrrrr2;s     r2FcCsDt|tr0|dd}t|dkr(|\}t|S|r>> box_label(('x', 1, 2, 3)) '(1, 2, 3)' >>> box_label(('x', 123)) '123' >>> box_label('x') '' r N)rtuplerr)keyverboserrr box_labelds   r7BTc Ks@tdd} |pi}|pi}|p i}|p(i}|p0i}||d<d|d<|| | j|||d} t} t} |D]\}}t|}t|r|st|dfn|}|s|| kr| |||i }| dt || d d | j |f||s| ||| || |t||D]~}t|}|| kr|| |||i }| dt||| d d | j |f|| ||| || |q ncollapse_outputsr6kwargsr9gseen connectedkvk_name func_nameattrsdepdep_namev_namerrr to_graphvizysp                    rYZjpegpngdotZpdfcCsrdd}zddlm}Wntk r0|YSX|tkr>|S|tkrTt|j|dS|dkrb|jStd|dS)a Get the appropriate IPython display class for `format`. Returns `IPython.display.SVG` if format=='svg', otherwise `IPython.display.Image`. If IPython is not importable, return dummy function that swallows its arguments and returns None. c_sdSr r)argsrMrrrz"_get_display_cls..rNformatsvgz)Unknown format '%s' passed to `dot_graph`) ZIPython.displaydisplay ImportErrorIPYTHON_NO_DISPLAY_FORMATSIPYTHON_IMAGE_FORMATSrZImageZSVG ValueError)r`dummyrbrrr_get_display_clss  rhmydaskcKst|f|}t|||S)a$ Render a task graph using dot. If `filename` is not None, write a file to disk with the specified name and extension. If no extension is specified, '.png' will be used by default. Parameters ---------- dsk : dict The graph to display. filename : str or None, optional The name of the file to write to disk. If the provided `filename` doesn't include an extension, '.png' will be used by default. If `filename` is None, no file will be written, and we communicate with dot using only pipes. Default is 'mydask'. format : {'png', 'pdf', 'dot', 'svg', 'jpeg', 'jpg'}, optional Format in which to write output file. Default is 'png'. **kwargs Additional keyword arguments to forward to `to_graphviz`. Returns ------- result : None or IPython.display.Image or IPython.display.SVG (See below.) Notes ----- If IPython is installed, we return an IPython.display object in the requested format. If IPython is not installed, we just return None. We always return None if format is 'pdf' or 'dot', because IPython can't display these formats natively. Passing these formats with filename=None will not produce any useful output. See Also -------- dask.dot.to_graphviz )rYgraphviz_to_file)rIfilenamer`rMrNrrr dot_graphs& rlc sddddddg}|dkrVdk rVtfdd|DrVtj\}|d d}|dkrbd }|j|d }|sztd t|}dkr||d Sd|g}t |d}| |W5QRX||dS)Nz.pngz.pdfz.dotz.svgz.jpegz.jpgc3s|]}|VqdSr )lowerendswith)rfmtrkrrrsz#graphviz_to_file..r rZr_zGraphviz failed to properly produce an image. This probably means your installation of graphviz is missing png support. See: https://github.com/ContinuumIO/anaconda-issues/issues/485 for more information.)data.wbrp) rospathsplitextrmpipe RuntimeErrorrhjoinopenwrite)rNrkr`ZfmtsrqZ display_clsZ full_filenamefrrprrjs.   rjc Ksg}g}||d}|pi}|p i}t} t} |D]\} } t| } t| r`|sbt| dfn| }|sr|| kr| ||| i}|d|t| ddd|i|s|d|| di| || | t || D]z}t|}|| kr4| |||i}|d|t ||ddd|i|d||di| || |qnDt | r| |krt| }|d|| di| || | |r| | kr6| | kr6| | || i}|d| t | |ddd|iq6|S) zf Convert a dask graph to Cytoscape JSON: https://js.cytoscape.org/#notation/elements-json )nodesedgesr?rqZellipsegray)idr2r@color)sourcetargetZ rectangle) rBrCr#rrDr*rEappendr rr7r)rIrJrKrLr6rMr}r~rqrOrPrQrRrSrTrUrVrWrXrrr_to_cytoscape_json9s                r r )r:node_sepedge_sepspacing_factor node_style edge_stylez str | Nonerfloatzdict[str, str] | None)rkr`r:rrrrrcKstdd} |pi}|pi}t|f| } | jddid} | jd||||dd| jj| dd | d d d d dddddddddddd|dddddddd|dg| j} | d| _| d | _ d!| _ |d"k rd#d$l m }| d%r|n|d%}||| gd&d'| S)(a Create an ipycytoscape widget for a dask graph. If `filename` is not None, write an HTML file to disk with the specified name. This uses the Cytoscape dagre layout algorithm. Options for that are documented here: https://github.com/cytoscape/cytoscape.js-dagre#api Parameters ---------- dsk : dict The graph to display. filename : str or None, optional The name of the HTML file to write to disk. format : str, optional Not used in this engine. rankdir: str The direction in which to orient the visualization. node_sep: float The separation (in px) between nodes in the DAG layout. edge_sep: float The separation (in px) between edges in the DAG layout. spacing_factor: float An overall scaling factor to increase (>1) or decrease (<1) the spacing of the layout. node_style: dict[str, str], optional A dictionary of style attributes for nodes (refer to Cytoscape JSON docs for available options: https://js.cytoscape.org/#notation/elements-json) edge_style: dict[str, str], optional A dictionary of style attributes for edges (refer to Cytoscape JSON docs for available options: https://js.cytoscape.org/#notation/elements-json) **kwargs Additional keyword arguments to forward to `_to_cytoscape_json`. Returns ------- result : ipycytoscape.CytoscapeWidget ipycytoscapeaDrawing dask graphs with the cytoscape engine requires the `ipycytoscape` python library. Please either conda or pip install as follows: conda install ipycytoscape # either conda install python -m pip install ipycytoscape # or pip installheightZ400px)ZlayoutZdagreT)r#ZrankDirZnodeSepZedgeSepZ spacingFactorZnodeDimensionsIncludeLabels)ZdirectedrGr;Z24pxZboldZblackz#eeez data(color)z1.0centerz data(label)z data(shape)@)z font-familyz font-sizez font-weightrzbackground-colorz border-colorz border-widthZopacityz text-valignz text-halignr2r@widthr)selectorstylerHrZtriangleZbezier)rz line-colorztarget-arrow-shapeztarget-arrow-colorz curve-styleg@g$@g?Nr)embed_minimal_htmlz.htmlzDask task graph)Zviewstitle)r rZCytoscapeWidgetZ set_layoutgraphZadd_graph_from_jsonZ set_styleZzoomZmax_zoomZmin_zoomZwheel_sensitivityZipywidgets.embedrrn)rIrkr`r:rrrrrrMrrqrNzrrrrcytoscape_graphs~3  $    r)N)F)NNr8NNNFF)riN)NNFF)riN) __future__rrtr' functoolsrZ dask.corerrrZ dask.utilsrrr r rrr#compiler%r&r2r7rY frozensetrerdrhrlrjrrrrrrsR      )  P   *& i