U /e#@sddlmZddlZddlZddlZddlZddlZddlZddlZddl Z ddl m Z ddl Z ddl Z eeZdZddZddZGd d d ZGd d d ZdS) ) annotationsN)ClassVarz.dirlockcCs tjdS)Nz#distributed.worker.use-file-locking)daskconfiggetrr9/tmp/pip-unpacked-wheel-g426oqom/distributed/diskutils.pyis_locking_enabledsr c Cs^zt|WnJtk r"Yn8tk rX}ztd|d|W5d}~XYnXdS)NzFailed to remove z: )osunlinkFileNotFoundErrorOSErrorloggererror)patherrr safe_unlinks rc@sHeZdZUdZded<ded<ded<ddd Zd d Zed d ZdS)WorkDirz8 A temporary work directory inside a WorkSpace. strdir_path _lock_pathzweakref.finalize _finalizerNc Csb|dks|dkst|dkr0tj||jd|_ntj|j||_t|jt rDztj|jt |_ tj |j r~tt d|j z0|t|j |_|jW5QRXWn,tk rt jd|j ddd|_YnXWn(tk rtj|jddYnX|j|j t||j||j |j|j|_nt||j|dd|j|_dS)N)prefixdirz Locking %r...zyCould not acquire workspace lock on path: %s .Continuing without lock. This may result in workspaces not being cleaned upTexc_info) ignore_errors)AssertionErrortempfilemkdtempbase_dirrr rjoinmkdirr DIR_LOCK_EXTrexistsrdebug _global_locklocket lock_fileZ _lock_fileacquirer exception Exceptionshutilrmtree _known_locksaddweakreffinalize _finalizer)self workspacenamerrrr__init__-sR    zWorkDir.__init__cCs |dS)z, Dispose of this directory. N)r)r3rrrrelease^szWorkDir.releasec CsBz||W5|dk r ||dk r<|j|t|XdSN)r7r.remover_purge_directory)clsr4 lock_pathr(rrrrr2ds zWorkDir._finalize)NN) __name__ __module__ __qualname____doc____annotations__r6r7 classmethodr2rrrrr$s  1rc@seZdZUdZded<ded<ded<eZded<ddd d Zddd d d ZddZ ddZ ddZ ddZ ddZ ddZddZddZdS) WorkSpacez An on-disk workspace that tracks disposable work directories inside it. If a process crashes or another event left stale directories behind, this will be detected and the directories purged. rr _global_lock_path_purge_lock_pathzClassVar[set[str]]r.)r cCs4|||_tj|jd|_tj|jd|_dS)Nz global.lockz purge.lock)_init_workspacer r rr!rDrE)r3r rrrr6s zWorkSpace.__init__)r returnc Cstj|}|g}tjdkr4||dt|D]f}zt|WnLtk rzt j |dW5QRXWnt k rYYq8YnXYnX|St j |ddS)zyCreate base_dir if it doesn't exist. If base_dir already exists but it's not writeable, change the name. win32-)r)r) r rabspathsysplatformappendgetuidmakedirsFileExistsErrorr TemporaryFilePermissionErrorr)r3r Ztry_dirsZtry_dirrrrrFs  zWorkSpace._init_workspacecKstj|jf|Sr8)r'r(rDr3kwargsrrrr&szWorkSpace._global_lockcKstj|jf|Sr8)r'r(rErSrrr _purge_lockszWorkSpace._purge_lockcCsts gS|jdd}z |Wntjk r<gYSXzt|}W5|Xg}|jdd}z |Wntjk rYn0Xz"|D]}| |r| |qW5|X|S)Nrtimeout) r r&r)r' LockErrorr7list_list_unknown_locksrU_check_lock_or_purgerM)r3lock candidatesZpurgedrrrr_purge_leftoverss,        zWorkSpace._purge_leftoversc csZttj|jdtD]:}zt|}Wntk r@YqXt|j r|VqdS)N*) globr rr!r r#statr S_ISREGst_mode)r3pstrrrrZs zWorkSpace._list_unknown_lockscCstj||jddS)N)onerror)r,r-_on_remove_error)r3rrrrr:szWorkSpace._purge_directorycCs|tst||jkrdStd|tj|dd}z |Wntj k rZYdSXz8|dt t }t j |rtd|||W5| Xt|dS)z Try locking the given path, if it fails it's in use, otherwise the corresponding directory is deleted. Return True if the lock was stale. FzChecking lock file %r...rrVNz/Found stale lock file and directory %r, purgingT)endswithr#rr.rr%r'r(r)rXr7lenr rr$infor:r)r3r<r\rrrrr[s"      zWorkSpace._check_lock_or_purgecCs"|\}}}td||t|dS)Nz&Failed to remove %r (failed in %r): %s)rrr)r3funcrrtypexctbrrrrgs zWorkSpace._on_remove_errorcKs<z |Wn"tk r.tjdddYnXt|f|S)a Create and return a new WorkDir in this WorkSpace. Either the *prefix* or *name* parameter should be given (*prefix* is preferred as it avoids potential collisions) Parameters ---------- prefix : str (optional) The prefix of the temporary subdirectory name for the workdir name : str (optional) The subdirectory name for the workdir zr?r@rAsetr.r6rFr&rUr^rZr:r[rgrorrrrrCps ' rC) __future__rr`loggingr r,rarKrr0typingrr'r getLoggerr=rr#r rrrCrrrrs"    L