U f/e,@s"ddlmZddlZddlmZddlZddlmZmZddl Z ddl m Z m Z ddl mZmZddlZddlmZddlmZdd lmZd ZeZd Zd Zd dZddZeded deefddZeZd'ddZ d(ddddddZ!d)ddddZ"d*ddd d!Z#d+d#d$Z$d,d%d&Z%dS)-) annotationsNwraps)AnyCallable)FilePathOrBuffer FrameOrSeries) get_lzma_file import_lzma)rands) ensure_clean)urlopenF) z timed outz Server Hangupz#HTTP Error 503: Service Unavailablez502: Proxy ErrorzHTTP Error 502: internal errorzHTTP Error 502zHTTP Error 503zHTTP Error 403zHTTP Error 400z$Temporary failure in name resolutionzName or service not knownzConnection refusedzcertificate verify)eonh6<cCsddl}t|jjtfS)Nr) http.clientIOErrorclient HTTPException TimeoutError)httpr7/tmp/pip-unpacked-wheel-tiezk1ph/pandas/_testing/_io.py_get_default_network_errorsEsrcstfdd}|S)aB allows a decorator to take optional positional and keyword arguments. Assumes that taking a single, callable, positional argument means that it is decorating a function, i.e. something like this:: @my_decorator def function(): pass Calls decorator with decorator(f, *args, **kwargs) csNfdd} o,tdko,td}|rFd}d||S|SdS)Ncs|fSNr)f)args decoratorkwargsrrdecZsz+optional_args..wrapper..decrr)lencallable)rr!r"Z is_decoratingrr )rr!rwrapperXszoptional_args..wrapperr)r r'rr&r optional_argsLs  r(zhttps://www.google.comc sFddlmdkrtd_tfdd}|S)a\ Label a test as requiring network connection and, if an error is encountered, only raise if it does not find a network connection. In comparison to ``network``, this assumes an added contract to your test: you must assert that, under normal conditions, your test will ONLY fail if it does not have network connectivity. You can call this in 3 ways: as a standard decorator, with keyword arguments, or with a positional argument that is the url to check. Parameters ---------- t : callable The test requiring network connectivity. url : path The url to test via ``pandas.io.common.urlopen`` to check for connectivity. Defaults to 'https://www.google.com'. raise_on_error : bool If True, never catches errors. check_before_test : bool If True, checks connectivity before running the test case. error_classes : tuple or Exception error classes to ignore. If not in ``error_classes``, raises the error. defaults to IOError. Be careful about changing the error classes here. skip_errnos : iterable of int Any exception that has .errno or .reason.erno set to one of these values will be skipped with an appropriate message. _skip_on_messages: iterable of string any exception e for which one of the strings is a substring of str(e) will be skipped with an appropriate message. Intended to suppress errors where an errno isn't available. Notes ----- * ``raise_on_error`` supersedes ``check_before_test`` Returns ------- t : callable The decorated test ``t``, with checks for connectivity errors. Example ------- Tests decorated with @network will fail if it's possible to make a network connection to another URL (defaults to google.com):: >>> from pandas._testing import network >>> from pandas.io.common import urlopen >>> @network ... def test_network(): ... with urlopen("rabbit://bonanza.com"): ... pass Traceback ... URLError: You can specify alternative URLs:: >>> @network("https://www.yahoo.com") ... def test_something_with_yahoo(): ... raise IOError("Failure Message") >>> test_something_with_yahoo() Traceback (most recent call last): ... IOError: Failure Message If you set check_before_test, it will check the url first and not run the test on failure:: >>> @network("failing://url.blaher", check_before_test=True) ... def test_something(): ... print("I ran!") ... raise ValueError("Failure") >>> test_something() Traceback (most recent call last): ... Errors not related to networking will always be raised. r)skipNTc srstsz ||WStk r}zt|dd}|s^t|dr^t|jdd}|krtd|t|tfddDrd|t|sstrnd|W5d}~XYnXdS)Nerrnoreasonz+Skipping test due to known errno and error c3s|]}|kVqdSr)lower).0mZe_strrr sz+network..wrapper..z;Skipping test because exception message is known and error z4Skipping test due to lack of connectivity and error ) can_connect Exceptiongetattrhasattrr+strany isinstance)rr!errr*_skip_on_messagescheck_before_test error_classesraise_on_errorr) skip_errnosturlr/rr's2   znetwork..wrapper)pytestr)rnetworkr)r?r@r=r;r<r>r:r'rr9rrBhs\ !rBc CsF|dkrt}zt|W5QRXWn|k r<YdSXdSdS)a@ Try to connect to the given url. True if succeeds, False if IOError raised Parameters ---------- url : basestring The URL to try to connect to Returns ------- connectable : bool Return True if no IOError (unable to connect) or URLError (bad url) was raised NFT)rr )r@r<rrrr1s r1rzFilePathOrBuffer | Noner)objpathreturnc CsR|}|dkrdtdd}t|$}t||t|W5QRSQRXdS)a Pickle an object and then read it again. Parameters ---------- obj : any object The object to pickle and then re-read. path : str, path object or file-like object, default None The path where the pickled object is written and then read. Returns ------- pandas object The original object that was pickled and then re-read. N__ z __.pickle)r r pdZ to_pickleZ read_pickle)rCrD_pathZ temp_pathrrrround_trip_pickles   rJz str | None)rDc CsPddl}|dj}|dkr d}t|}||||||}W5QRX|S)a Write an object to file specified by a pathlib.Path and read it back Parameters ---------- writer : callable bound to pandas object IO writing function (e.g. DataFrame.to_csv ) reader : callable IO reading function (e.g. pd.read_csv ) path : str, default None The path where the object is written and then read. Returns ------- pandas object The original object that was serialized and then re-read. rNpathlibZ ___pathlib___)rA importorskipPathr )writerreaderrDrArMrCrrrround_trip_pathlib+s   rPc CsPddl}|dj}|dkr d}t|}||||||}W5QRX|S)a Write an object to file specified by a py.path LocalPath and read it back. Parameters ---------- writer : callable bound to pandas object IO writing function (e.g. DataFrame.to_csv ) reader : callable IO reading function (e.g. pd.read_csv ) path : str, default None The path where the object is written and then read. Returns ------- pandas object The original object that was serialized and then re-read. rNzpy.pathZ___localpath___)rArLlocalr )rNrOrDrAZ LocalPathrCrrrround_trip_localpathHs   rRtestc Cs|f}d}d}|dkr.tj}d}||f}d}n@|dkr>tj}n0|dkrNtj}n |dkr`tt}ntd ||||d }t |||W5QRXd S) a Write data to a compressed file. Parameters ---------- compression : {'gzip', 'bz2', 'zip', 'xz'} The compression type to use. path : str The file path to write the data. data : str The data to write. dest : str, default "test" The destination file (for ZIP only) Raises ------ ValueError : An invalid compression value was passed in. wbwritezipwwritestrgzipbz2xzzUnrecognized compression type: )modeN) zipfileZipFilerYGzipFilerZBZ2Filer lzma ValueErrorr3) compressionrDdatadestrr\methodZcompress_methodrrrrwrite_to_compressedes" rgcCs:ddlm}m}|dkr.|D] }||qn||dS)Nr)close get_fignums)Zmatplotlib.pyplotrhri)Zfignum_closerirrrrhs   rh)N)N)N)N)rS)N)& __future__rrZ functoolsrrYtypingrrr]Zpandas._typingrrZ pandas.compatr r ZpandasrHZpandas._testing._randomr Zpandas._testing.contextsr Zpandas.io.commonr Z_RAISE_NETWORK_ERROR_DEFAULTraZ_network_error_messagesZ_network_errno_valsrr(rBZwith_connectivity_checkr1rJrPrRrgrhrrrrsB        .