U /e@sxUddlmZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl mZddlmZddgZedZejjefZd ed <e eje d kred ZeejjfZejd dddZddZ ddZ!ddZ"ej#$dddgddZ%ddZ&ddZ'dd Z(d!d"Z)ej#j*ej#$d#d$d%d&Z+ej#j,d'd(d)d*ej#j*d+d,Z-ej#j*d-d.Z.dS)/) annotationsN) open_files)parse)tmpdirabrequestsztuple[type[Exception], ...]errsz0.7.4aiohttpmodule)Zscopec cst}tD]2}ttj||d}|ddW5QRXq tjdddg}t j ||d}d}zt d WqWq`t j jk r}z(td |d 8}|d krtd |W5d}~XYq`Xq`|V|W5QRXdS) Nwbai'z-mz http.serverZ8999)cwd zhttp://localhost:8999g?rzServer did not appear)rfilesopenospathjoinwritesys executable subprocessPopenrget exceptionsConnectionErrortimesleep RuntimeError terminate)dfnfcmdptimeouter(>/tmp/pip-unpacked-wheel-dbjnr7gq/dask/bytes/tests/test_http.py dir_servers"  r*c Cshd}td}t||d}|}|}W5QRXttj||d}||ksZtW5QRXdS)Nhttp://localhost:8999/rrbrrreadrrrrAssertionError)r*rootr"r#dataexpectedr(r(r) test_simple3sr3c Csd}td}t||d}ttj||d}|}|t}|d}||ddks^t|jdkslt| d|d}||ddkst| dd|jdkstW5QRXW5QRXdS)Nr+rr,) rrrrrrr.r/locseek)r*r0r"r#r2r1r(r(r)test_loc=s    r:c Csd}td}ddi}t|||dd}|}|jdd|jdd}W5QRXttj||d }||ksvtW5QRXdS) Nr+rDatezWed, 21 Oct 2015 07:28:00 GMT)headersr6)lengthr,r-)r*r0r"r<r#r1r2r(r(r)test_fetch_range_with_headersNs"r? block_sizeic Csd}td}t||d}ttj||d}|}|}|d|ddksZt|d|d|ddks~t|d|ddkst|dd||ddkstW5QRXW5QRXdS)Nr+rr,rir4) rrrrrrr.r/r9)r*r@r0r"r#r2r(r(r)test_opsZs  rBc Csd}td}t||ddd}ttj||d}|}|(}||ksTt|jt |ksftW5QRXtd}t||ddd}|d}t t j t dkrt t |d|ddkstW5QRXn|d|ddkstW5QRXW5QRXdS) Nr+rr4)r@r,r6z 2021.11.1r)rrrrrrr.r/sizelen parse_versionfsspec __version__pytestraises ValueError)r*r0r"r#r2r(r(r)test_ops_blocksizeks &rKc Cstdd}tt|}|W5QRXW5QRXtdd}t}t||}|W5QRXW5QRXd}td}t||ddd}tt|W5QRXW5QRXt||d}|&}tt| dW5QRXW5QRXdS)Nz"http://localhost:8999/doesnotexistrzhttp://nohost/r+r )moder>) rrHrIr r.FileNotFoundErrorrNotImplementedErrorrJr9)r*r#r2r0r"r(r(r) test_errorss&      rOc svdtfddtD}t|tD]L\}}|:}ttj||d}||ks\tW5QRXW5QRXq$dS)Nr+csg|] }|qSr(r().0r#r0r(r) sztest_files..r,) rrziprrrrr.r/)r*fsr#f2r2r(rQr) test_filess rVcCs8d}t|d}|djdks"t|djdks4tdS)Nr+z/*rzhttp://localhost:8999/ar6zhttp://localhost:8999/b)rrr/)r*r0rTr(r(r)test_open_globs rWengine)ZpyarrowZ fastparquetcCsntjdddtd}t||jdg|d}|jttdksPt|j dd d d gksjtdS) Nrz2.21.0)Z minversiondask.dataframezthttps://github.com/Parquet/parquet-compatibility/raw/master/parquet-testdata/impala/1.1.1-NONE/nation.impala.parquet)rX n_nationkeyZn_nameZ n_regionkeyZ n_comment) rH importorskipZ read_parquetcomputer[tolistlistranger/columns)rXddZdfr(r(r) test_parquets   rcrz(https://github.com/dask/dask/issues/3696)ZrerunsZ reruns_delayreasoncCs,ddg}t|}|jdks t|dS)Nrhttps://raw.githubusercontent.com/weierophinney/pastebin/master/public/js-src/dojox/data/tests/stores/patterns.csvzhttps://en.wikipedia.orgr4)db read_textZ npartitionsr/r])urlsrr(r(r)test_bags  rjcCs$td}d}||}|dS)NrYrf)rHr\Zread_csvr])rburlrr(r(r) test_read_csvs   rl)/ __future__rrrrrrFrHZ fsspec.corerZpackaging.versionrrEZdask.bagZbagrgZ dask.utilsrrr\rrRequestExceptionrMr __annotations__rGr Zclient_exceptionsZClientResponseErrorZfixturer*r3r:r?markZ parametrizerBrKrOrVrWnetworkrcZflakyrjrlr(r(r(r)sT