U /e]@s,ddlmZddZd ddZd d d ZdS) )corecs"|jtfddtjDS)Nc3s|]}j|jVqdS)N)domainZdimtile).0ischema8/tmp/pip-unpacked-wheel-dbjnr7gq/dask/array/tiledb_io.py sz$_tiledb_to_chunks..)rlistrangendim)Z tiledb_arrayr rr _tiledb_to_chunkssrNc Ksddl}|pt}|dd}t||jr0|}n|j||||d}|jjrRtd|sz|jj dkrlt dn|j dj }|j rtd|pt|}t||jjksttj||d |d S) aLoad array from the TileDB storage format See https://docs.tiledb.io for more information about TileDB. Parameters ---------- uri: TileDB array or str Location to save the data attribute: str or None Attribute selection (single-attribute view on multi-attribute array) Returns ------- A Dask Array Examples -------- >>> import tempfile, tiledb >>> import dask.array as da, numpy as np >>> uri = tempfile.NamedTemporaryFile().name >>> _ = tiledb.from_numpy(uri, np.arange(0,9).reshape(3,3)) # create a tiledb array >>> tdb_ar = da.from_tiledb(uri) # read back the array >>> tdb_ar.shape (3, 3) >>> tdb_ar.mean().compute() 4.0 rNkey)attrconfigrz&Sparse TileDB arrays are not supportedzOkeyword 'attribute' must be providedwhen loading a multi-attribute TileDB arrayz%TileDB array must be open for readingz tiledb-%s)name)tiledbdictpop isinstanceArrayopenrsparse ValueErrorZnattr TypeErrorrr iswritablerlenrAssertionErrorrZ from_array) uri attributechunksstorage_optionskwargsr tiledb_configrtdbr r r from_tiledb s&     r(TFc Ksddl}|pt}|p |dd}t|js6tdt|trndd|jD} |j ||f| ||d|} n:t||j r|} |j | j kr|j | j kstdntd | j r| jstd |j| d ||d S) aSave array to the TileDB storage format Save 'array' using the TileDB storage manager, to any TileDB-supported URI, including local disk, S3, or HDFS. See https://docs.tiledb.io for more information about TileDB. Parameters ---------- darray: dask.array A dask array to write. uri: Any supported TileDB storage location. storage_options: dict Dict containing any configuration options for the TileDB backend. see https://docs.tiledb.io/en/stable/tutorials/config.html compute, return_stored: see ``store()`` key: str or None Encryption key Returns ------- None Unless ``return_stored`` is set to ``True`` (``False`` by default) Notes ----- TileDB only supports regularly-chunked arrays. TileDB `tile extents`_ correspond to form 2 of the dask `chunk specification`_, and the conversion is done automatically for supported arrays. Examples -------- >>> import dask.array as da, tempfile >>> uri = tempfile.NamedTemporaryFile().name >>> data = da.random.random(5,5) >>> da.to_tiledb(data, uri) >>> import tiledb >>> tdb_ar = tiledb.open(uri) >>> all(tdb_ar == data) True .. _chunk specification: https://docs.tiledb.io/en/stable/tutorials/tiling-dense.html .. _tile extents: http://docs.dask.org/en/latest/array-chunks.html rNrz^Attempt to save array to TileDB with irregular chunking, please call `arr.rechunk(...)` first.cSsg|] }|dqS)rr )rcr r r szto_tiledb..)rrrz>Target TileDB array layout is not compatible with source arrayzc'uri' must be string pointing to supported TileDB store location or an open, writable TileDB array.z-Target TileDB array is not open and writable.F)lockcompute return_stored)rrrrZ_check_regular_chunksr#rrstrZ empty_likerZdtyperZisopenrstore) Zdarrayr!r,r-r$rr%rr&r#r'r r r to_tiledbHs>;     r0)NNN)TFNN)Z dask.arrayrrr(r0r r r r s  B