o i]+ @sdZddlmZddlmZddlZddlZddlmZddl m Z m Z m Z dd l mZmZmZmZeZeZejjejjd gd gd d ddZejjddZejjejjdddgddgd ejjdddgfdddgfddgfddgfdddgfggdd ejjde d fe d!fgd"d#gd d$d%Zejjejde d fe d!fgd&d'Zejjejde d fe d!fgd(d)Zd*d+Zd,d-Zejjejde d fe d!fgd.d/Zejjejde d fe d!fgd0d1ZdS)2z Test the processor hooks )Path)TemporaryDirectoryN)Pooch)UnzipUntar Decompress)pooch_test_urlpooch_test_registrycheck_tiny_data capture_logzmethod,ext,name))autoxzN)lzmarN)rrN)bzip2bz2N)gzipgzN)rrzdifferent-name.txt)rrrrrname)idsc Cs~t||d}t}t|}|durt|dd|dg}nt||}t|ttd}t>}|j d||d} | } | } t | d ksIJ| d  d d ksUJ| d d s^J|| d vsfJWdn1spwY| |ks{Jt| t}|j d||d} | dksJWdn1swY| |ksJt| WddS1swYdS)z=Check that decompression after download works for all formats)methodrN. tiny-data.txtdecomppathbase_urlregistryztiny-data.txt. processorrr Downloading Decompressing)rrrstrjoinrBASEURLREGISTRYr fetchgetvalue splitlineslensplit startswithr ) rextrr local_storer true_pathpuplog_filefnamelogslinesr7Y/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/pooch/tests/test_processors.pytest_decompresss2     "r9c Cst8}t|}t|ttd}tt&}t |j dt dddWdn1s/wYWdn1s>wY|j j ddsNJd |j j dvsXJtt&}t |j dt d ddWdn1swwYWdn1swY|j j dd sJd |j j dvsJtt&}t |j dt d ddWdn1swYWdn1swY|j j dd sJd |j j dvsJtt'}t |j dt dddWdn 1swYWdn 1swY|j j dds)Jd |j j dvs4JWddS1s@wYdS)zGShould fail if method='auto' and no extension is given in the file namerrr)rrNrz"Unrecognized file extension '.txt'zpooch.Unzip/Untarblaz Invalid compression method 'bla'zipz Invalid compression method 'zip'z store.zipz"Unrecognized file extension '.zip')rrrr'r(pytestraises ValueErrorwarningscatch_warningsr)rvalueargsr.)r0rr2 exceptionr7r7r8test_decompress_failsEsH         $rD target_pathsome_custom_path default_path custom_pathzarchive,members tiny-datar)storeNrJstore/tiny-data.txtstore/subdir/tiny-data.txtz store/subdir) single_file archive_all archive_filearchive_subdir_filearchive_subdirarchive_multiplezprocessor_class,extensionz.zipz.tar.gzrrc CsD|||d}|dur|||j}t}t|}t|||||j\}}t|ttd} t} | j |||d} t | |ksAJt | |Wdn1sPwY| D]} t | qWt} | j |||d} t | |kssJt | gWdn1swY| D]} t | qWddS1swYdS)zGTests the behaviour of processors for unpacking archives (Untar, Unzip))members extract_dirNrr) suffixrr"_unpacking_expected_paths_and_logs__name__rr'r(r r)set _check_logsr ) processor_class extensionrEarchiverSr r true_paths expected_logr2r3fnamesr4r7r7r8test_unpackingds2     "r`c Cstj}tt|ttd}|dgd}|jd||d}t|dks$Jt|d|ddgd}|jd||d}t|d ksBJt|dt|d|jd||d}t|dks_Jt|dWd d S1spwYd S) zHTest that multiple subsequent calls to a processor yield correct resultsrrKrSrJrr rrLrNrrrr'r(r)r,r ) rZr[r0r2 processor1 filenames1 processor2 filenames2 filenames3r7r7r8test_multiple_unpackings"    "rhcCsxt/}tt|ttd}|dgd}|jd||d}t|dks$Jt|dWddS1s5wYdS) zDTest that unpack members can also be specifed both with a leading ./rz./store/tiny-data.txtrarJrr rNrb)rZr[r0r2rcrdr7r7r8$test_unpack_members_with_leading_dots "ricCsF|}t|t|ksJt||D] \}}||s JqdS)zC Assert that the lines in the log match the expected ones. N)r*r+r,r;r.)r3expected_linesr6line expected_liner7r7r8rYs rYcCsdg}|dkrt|dh}|d||fS|dkrA|durAt|ddt|dddh}|||dd ||fS|dkrx|durxg}|D]&}|t|d }t|dsc|d}|t||d |d qMt|}||fS) zo Generate the appropriate expected paths and log message depending on the parameters for the test. r!rIrzExtracting 'tiny-data.txt'rJNsubdirr"z ing contents/z Extracting '')r%appendrr-endswithrX)r\rSrr log_linesr]memberr1r7r7r8rVs*  rVcCt=}tt|ttd}|dgd}|jd||d}t|dks$J|}|jd||d}t|dks8JWddS1sCwYdS)zx Test that calling with valid members then without them works. https://github.com/fatiando/pooch/issues/364 rrKrarJrr Nrrrr'r(r)r,rZr[r0r2rcrdrerfr7r7r8&test_unpacking_members_then_no_members  "rwcCrt)zz Test that calling with invalid members then without them works. https://github.com/fatiando/pooch/issues/364 rznot-a-valid-file.csvrarJrrNrurvr7r7r8,test_unpacking_wrong_members_then_no_members rxry) __doc__pathlibrtempfilerr?r<r$r processorsrrrutilsr r r r r(r'marknetwork parametrizer9rDr`rhrirYrVrwryr7r7r7r8s