o Gih @sN ddlZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlmZddlmZddlmZmZddlmZddlmZmZmZmZddlZ ddl!Z"ddl#Z"ddl$Z$ddl%m&Z&ddl'm(Z(d d l)m*Z*d d l+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ>d d lm?Z?e:rddl@Z@e@j(jAduZBe@j(jCduZDeEe@j(d dduZFndZBdZDdZFe GZHe?eIZJeJKde8oe(Le(LejM(djNe(LdkZOe>oe(Le(LejM(djNe(LdkZPeOoePZQeReSddZTe:rddl@Z@dejUvrXejUdZVzeWeVZXWneYyWZZz eYdeVdeZeZdZZ[ZwwdejUvrejUdZ[ze@\e[ZXWne]yZZze]de[eZdZZ[ZwweJ^de[n:e@jC_rdZ[n e@j`_rd Z[ndZ[e(Le(Le@jajNe(LdkZbebrece@jddZeeere@jdjf_rdne[Z[d d lgmhZhd!d"Zid#d$Zjd%d&Zk   ' (dd)d*Zldd+d,Zmd-eRfd.d/Zndd0d1Zoeod2dd3Zpeod4dd3Zqeod5dd3Zrdd7d8Zsd9d:Ztd;d<Zud=d>Zvd?d@ZwdAdBZxdCdDZydEdFZzdGdHZ{dIdJZ|dKdLZ}dMdNZ~dOdPZdQdRZdSdTZdUdVZdWdXZdYdZZd[d\Zd]d^Zd_d`ZdadbZdcddZdedfZdgdhZdidjZdkdlZdmdnZdodpZdqdrZdsdtZdudvZdwdxZdydzZd{d|Zd}d~ZddZddZddZddZddZddee jBdedBd-e jfddZddededBdedBfddZdee"jjBd-e"jjfddZde"jdeRfddZddee"jjded-efddZeddZddefddZddefddZddee jded-efddZd-e jfddZiZddZddZddeRdedBdedBfddZdddZGdddZddZddZddZddZe:rddddddZe@jCje@j`jde@jfjddZe@jCje@j`jdd„dd„ddZe@jCje@j`je@je@jfje@jdZe@jCjeEe@j`ddddddZe@jCjeEe@j`ddddddZe@jCjeEe@j`ddddddZe@jCjeEe@j`ddddddZdedeeeffddʄZdedeRfdd̈́ZdefddτZdefddфZdefddӄZdefddՄZdefddׄZdefddلZdefddۄZe:rdeeefdefdd߄ZdejUvrejUdZeeЃѡs@edeЛz edeРdZWneҐy`ZZzedeЛeZdZZ[ZwweWeԡZzejZWn eؐywedwdejUvre[ekrde[deכdZed7ZeeكeZ[eedeedeedeedeedeedeedeedBeRdBfZejd-efddZereeefZneZe:rddlmZddlmZmZmZmZmZ dde@jjdededeRdBd-eef ddZ dde@jjdededeRdBd-ef ddZGdddeރZdS(N)UserDict)contextmanager)BytesIOStringIO)Path) TYPE_CHECKINGAnyCallableSet)norm)version)DIFFUSERS_REQUEST_TIMEOUT)BACKENDS_MAPPINGis_accelerate_availableis_bitsandbytes_availableis_compel_availableis_flax_availableis_gguf_availableis_kernels_availableis_note_seq_availableis_nvidia_modelopt_availableis_onnx_availableis_opencv_availableis_optimum_quanto_availableis_peft_availableis_timm_availableis_torch_availableis_torch_versionis_torchao_availableis_torchsde_availableis_transformers_available) get_loggerxpuFzdiffusers.utils.testing_utils' is deprecated and will be removed in a future version. Determinism and device backend utilities have been moved to `diffusers.utils.torch_utils`. peftz0.5 transformersz4.33BIG_GPU_MEMORY(DIFFUSERS_TEST_BACKENDz+Failed to import `DIFFUSERS_TEST_BACKEND` 'zg'! This should be the name of an installed module to enable a specified backend.): DIFFUSERS_TEST_DEVICEzRUnknown testing device specified by environment variable `DIFFUSERS_TEST_DEVICE`: ztorch_device overrode to cudacpuz1.12mps) get_torch_cuda_device_capabilitycOsVtstdtj||g|Ri|s)Jd||d||ddS)Nz3PyTorch needs to be installed to use this function.FzMax diff is absolute z. Diff tensor is .T)r ValueErrortorchallcloseabsmax)abargskwargsr8Q/home/ubuntu/.local/lib/python3.10/site-packages/diffusers/utils/testing_utils.pytorch_all_closes *r:cCs,t||t|t|}d|}|S)N?)npdotr mean)r4r5 similaritydistancer8r8r9 numpy_cosine_similarity_distances rAcCs||}}|D]\}}t|trt|||<q |D]\}}t|tr0t|||<q!|D]}||vr<dS||||krGdSq3|D] }||vrSdSqJdS)NFT)copyitems isinstancesetsorted)dict1dict2keyvaluer8r8r9check_if_dicts_are_equals(    rKtest_corrections.txtexpected_slicec Cs|rtjddtjd}t|st|}|r&|ddddddf}t| tj  dd}| d |d }|d \}} } | d} t|d } td || | |g| d WddS1smwYdS)Ni') thresholdPYTEST_CURRENT_TESTr tensorz = np.arrayz::r4file)r0set_printoptionsosenvironget is_tensor from_numpystrdetachr+flattentofloat32replacesplitopenprintjoin) rTlimit_to_slicesmax_torch_printfilenameexpected_tensor_name test_name tensor_str output_str test_file test_classtest_fnfr8r8r9print_tensor_tests    $  "rrcCsZtdd}tjtj|}|ds"tj|}|dr|r+t||S|S)a Args: append_path: optional path to append to the tests dir path Return: The full path to the `tests` dir, so that the tests can be invoked from anywhere. Optionally `append_path` is joined after the `tests` dir the former is provided. r tests) inspectstackrXpathabspathdirnameendswithras_posix) append_pathcaller__file__ tests_dirr8r8r9 get_tests_dirs    r~returncCs.|}|dvr dS|dvrdStd|)z Converts a string representation of truth to `True` (1) or `False` (0). True values are `y`, `yes`, `t`, `true`, `on`, and `1`; False value are `n`, `no`, `f`, `false`, `off`, and `0`; )yyesttrueon1r )nnorqfalseoff0rzinvalid truth value )lowerr/)rJr8r8r9 str_to_bools rcCsVztj|}Wn ty|}Y|Swzt|}W|Sty*td|dw)NzIf set, z must be yes or no.)rXrYKeyErrorrr/)rIdefaultrJ_valuer8r8r9parse_flag_from_envs   rRUN_SLOW)r RUN_NIGHTLY RUN_COMPILEr;cCs`|durt}d}|D]}||9}q g}t|D] }|||qtj|tjd|S)zCreates a random float32 tensorNr )datadtype) global_rngrangeappendrandomr0rTfloatview contiguous)shapescalerngname total_dimsdimvalues_r8r8r9 floats_tensors  rcCttd|S)z Decorator marking a test as slow. Slow tests are skipped by default. Set the RUN_SLOW environment variable to a truthy value to run them. z test is slow)unittest skipUnless_run_slow_tests test_caser8r8r9slow rcCr)z Decorator marking a test that runs nightly in the diffusers CI. Slow tests are skipped by default. Set the RUN_NIGHTLY environment variable to a truthy value to run them. ztest is nightly)rr_run_nightly_testsrr8r8r9nightlyrrcCr)z Decorator marking a test that runs compile tests in the diffusers CI. Compile tests are skipped by default. Set the RUN_COMPILE environment variable to a truthy value to run them. ztest is torch compile)rr_run_compile_testsrr8r8r9is_torch_compilerrcCttd|S)zo Decorator marking a test that requires PyTorch. These tests are skipped when PyTorch isn't installed. test requires PyTorch)rrrrr8r8r9 require_torch'rcCstto tddd|S)zl Decorator marking a test that requires PyTorch 2. These tests are skipped when it isn't installed. >=z2.0.0ztest requires PyTorch 2)rrrrrr8r8r9require_torch_2.srcfdd}|S)zPDecorator marking a test that requires torch with a specific version or greater.c&totd}t|d|S)Nrz>test requires torch with the version greater than or equal to rrrrrcorrect_torch_version torch_versionr8r9 decorator:  z6require_torch_version_greater_equal..decoratorr8rrr8rr9#require_torch_version_greater_equal7 rcr)zMDecorator marking a test that requires torch with a specific version greater.cr)N>z2test requires torch with the version greater than rrrr8r9rFrz0require_torch_version_greater..decoratorr8rr8rr9require_torch_version_greaterCrrcCsttotdkd|S)z8Decorator marking a test that requires CUDA and PyTorch.r*ztest requires PyTorch+CUDArrr torch_devicerr8r8r9require_torch_gpuOrcr)Ncs,tjrt}tt|tkdSdS)Nz/Test not supported for this compute capability.)r0r* is_availabler-rrr)rcurrent_compute_capabilityexpected_compute_capabilityr8r9rWs z3require_torch_cuda_compatibility..decoratorr8)rrr8rr9 require_torch_cuda_compatibilityV rcCsttotdkd|S)zJDecorator marking a test that requires an accelerator backend and PyTorch.r+z!test requires accelerator+PyTorchrrr8r8r9require_torch_acceleratorcrrcCs6ts td|Sddl}t|jdkd|S)a Decorator marking a test that requires a multi-GPU setup (in PyTorch). These tests are skipped on a machine without multiple GPUs. To run *only* the multi_gpu tests, assuming all test names contain multi_gpu: $ pytest -sv ./tests -k "multi_gpu" rrNr ztest requires multiple GPUs)rrskipr0rr* device_countrr0r8r8r9require_torch_multi_gpujsrcCsDts td|Sddl}t|jdkp|jdkd|S)z Decorator marking a test that requires a multi-accelerator setup (in PyTorch). These tests are skipped on a machine without multiple hardware accelerators. rrNr z,test requires multiple hardware accelerators)rrrr0rr*rr#rr8r8r9require_torch_multi_acceleratorxsrcCtttd|S)zZDecorator marking a test that requires an accelerator with support for the FP16 data type.z+test requires accelerator with fp16 support)rr_is_torch_fp16_availablerrr8r8r9#require_torch_accelerator_with_fp16rcCr)zZDecorator marking a test that requires an accelerator with support for the FP64 data type.z+test requires accelerator with fp64 support)rr_is_torch_fp64_availablerrr8r8r9#require_torch_accelerator_with_fp64rrcCsfts td|Sddl}|jstd|S|jd}|jd}t|t kdt d|S)z Decorator marking a test that requires a bigger GPU (24GB) for execution. Some example pipelines: Flux, SD3, Cog, etc. rrNtest requires PyTorch CUDA@z"test requires a GPU with at least GB memory) rrrr0r*rget_device_properties total_memoryrr&)rr0device_propertiesrr8r8r9require_big_gpu_with_torch_cudas   rcCsddl}|j|}tstd|Sddl}|js)|j s)td|S|j r5|j d}n|j d}|j d}t |t kdt d|S)z Decorator marking a test that requires a bigger hardware accelerator (24GB) for execution. Some example pipelines: Flux, SD3, Cog, etc. rNrrrz3test requires a hardware accelerator with at least r)pytestmarkbig_acceleratorrrrr0r*rr#rrrr&)rrr0rrr8r8r9require_big_accelerators"     rcCsttottd|S)zPDecorator marking a test that requires an accelerator with support for training.z/test requires accelerator with training support)rrrbackend_supports_trainingrrr8r8r9'require_torch_accelerator_with_trainings  rcCttdkd|S)z9Decorator marking a test to skip if torch_device is 'mps'r,ztest requires non 'mps' devicerrrrr8r8r9skip_mpssrcCr)zv Decorator marking a test that requires JAX & Flax. These tests are skipped when one / both are not installed ztest requires JAX & Flax)rrrrr8r8r9 require_flaxrrcCr)z Decorator marking a test that requires compel: https://github.com/damian0815/compel. These tests are skipped when the library is not installed. ztest requires compel)rrrrr8r8r9require_compelsrcCr)zw Decorator marking a test that requires onnxruntime. These tests are skipped when onnxruntime isn't installed. ztest requires onnxruntime)rrrrr8r8r9require_onnxruntimerrcCr)zq Decorator marking a test that requires note_seq. These tests are skipped when note_seq isn't installed. ztest requires note_seq)rrrrr8r8r9require_note_seqrrcCr)z Decorator marking a test that requires a hardware accelerator backend. These tests are skipped when there are no hardware accelerator available. r+z$test requires a hardware acceleratorrrr8r8r9require_acceleratorsrcCr)zq Decorator marking a test that requires torchsde. These tests are skipped when torchsde isn't installed. ztest requires torchsde)rrr rr8r8r9require_torchsderrcCr)z Decorator marking a test that requires PEFT backend, this would require some specific versions of PEFT and transformers. ztest requires PEFT backendrrUSE_PEFT_BACKENDrr8r8r9require_peft_backendsrcCr)zi Decorator marking a test that requires timm. These tests are skipped when timm isn't installed. ztest requires timm)rrrrr8r8r9 require_timmrrcCr)zy Decorator marking a test that requires bitsandbytes. These tests are skipped when bitsandbytes isn't installed. ztest requires bitsandbytes)rrrrr8r8r9require_bitsandbytesrrcCr)zm Decorator marking a test that requires quanto. These tests are skipped when quanto isn't installed. ztest requires quanto)rrrrr8r8r9require_quantorrcCr)zu Decorator marking a test that requires accelerate. These tests are skipped when accelerate isn't installed. ztest requires accelerate)rrrrr8r8r9require_acceleraterrcr)z Decorator marking a test that requires PEFT backend with a specific version, this would require some specific versions of PEFT and transformers. c@totttjdjtk}t|d|S)Nr$z9test requires PEFT backend with the version greater than )rr parse importlibmetadata base_versionrr)rcorrect_peft_version peft_versionr8r9r)s  z/require_peft_version_greater..decoratorr8)rrr8rr9require_peft_version_greater#s rcr)z Decorator marking a test that requires transformers with a specific version, this would require some specific versions of PEFT and transformers. cr)Nr%z9test requires transformers with the version greater than )r!r rrrrrr)rcorrect_transformers_versiontransformers_versionr8r9r:s z7require_transformers_version_greater..decoratorr8)rrr8rr9$require_transformers_version_greater4s  rcr)NcBtotttjdjtk}t|dd|S)N acceleratez7Test requires accelerate with the version greater than r.)rr rrrrrr)rcorrect_accelerate_versionaccelerate_versionr8r9rG  z5require_accelerate_version_greater..decoratorr8)r rr8r r9"require_accelerate_version_greaterFrr cr)Ncr)N bitsandbytesz9Test requires bitsandbytes with the version greater than r.)rr rrrrrr)rcorrect_bnb_version bnb_versionr8r9rSr z7require_bitsandbytes_version_greater..decoratorr8)rrr8rr9$require_bitsandbytes_version_greaterRrrcr)Ncs<tttjdjtk}t|dd|S)Nhuggingface_hubz.decoratorr8)rrr8rr9require_hf_hub_version_greater^rrcr)NcBtotttjdjtk}t|dd|S)Nggufz1Test requires gguf with the version greater than r.)rr rrrrrr)rcorrect_gguf_version gguf_versionr8r9rkr z8require_gguf_version_greater_or_equal..decoratorr8)rrr8rr9%require_gguf_version_greater_or_equaljrrcr)Ncr)Ntorchaoz0Test requires torchao with version greater than r.)rr rrrrrr)rcorrect_torchao_versiontorchao_versionr8r9rwr z;require_torchao_version_greater_or_equal..decoratorr8)r rr8rr9(require_torchao_version_greater_or_equalvrr!cr)Ncr)Nmodeloptz1Test requires modelopt with version greater than r.)rr rrrrrr)rcorrect_nvidia_modelopt_versionmodelopt_versionr8r9rr z.decoratorr8)r%rr8r$r9)require_modelopt_version_greater_or_equalrr&cr)Ncr)Nkernelsz0Test requires kernels with version greater than r.)rr rrrrrr)rcorrect_kernels_versionkernels_versionr8r9rr z;require_kernels_version_greater_or_equal..decoratorr8)r*rr8r)r9(require_kernels_version_greater_or_equalrr+cCstt d|S)zJ Decorator marking a test that will be skipped after PEFT backend z%test skipped in favor of PEFT backendrrr8r8r9deprecate_after_peft_backendrr,cCstj}|j|j}}||fSN)sys version_infomajorminor)sys_infor0r1r8r8r9get_python_versionsr3arry local_pathcCst|trU|dur!t||dd|dd|ddS|ds+|dr@tj|td}| t t |j }|Stj|rMt |}|Std|d t|t jr^ |Std ) N/rQhttp://https://timeoutIIncorrect path or url, URLs must start with `http://` or `https://`, and  is not a valid pathzjIncorrect format used for numpy ndarray. Should be an url linking to an image, a local path, or a ndarray.)rDr]rrcrz startswithrequestsrZrraise_for_statusr<loadrcontentrXrvisfiler/ndarray)r4r5responser8r8r9 load_numpys( 0    rGTurl map_location weights_onlycCs0tj|td}|tjt|j||d}|S)Nr;)rIrJ)r@rZrrAr0rBrrC)rHrIrJrFr4r8r8r9load_ptsrKimagecCst|tr2|ds|drtjtj|dtdj }n#t j |r*tj|}nt d|dt|tjjr<|}nt dtj|}|d}|S) z Loads `image` to a PIL Image. Args: image (`str` or `PIL.Image.Image`): The image to convert to the PIL Image format. Returns: `PIL.Image.Image`: A PIL Image. r9r:T)streamr<r=r>zdIncorrect format used for image. Should be an url linking to an image, a local path, or a PIL image.RGB)rDr]r?PILImagerdr@rZrrawrXrvrDr/ImageOpsexif_transposeconvert)rLr8r8r9 load_images     rU batch_sizecCs|j\}}dd||fD\}}|j||ftjjd}t|tjd}t |d ddddg|}t |}d |d S) Ncss|] }||dVqdS)Nr8.0xr8r8r9 sz#preprocess_image..)resamplego@rr g@r;) sizeresizerOrPLANCZOSr<arrayastyperavstack transposer0r\)rLrVwhr8r8r9preprocess_images    rhoutput_gif_pathcCs<|dur tjddj}|dj|d|dddddd|S) Nz.gifsuffixrTr Fd)save_all append_imagesoptimizedurationloop)tempfileNamedTemporaryFilersave)rLrir8r8r9 export_to_gifs ruccst|}|V|dSr-)ioBufferedWriterflush)raw_frqr8r8r9buffered_writers  rzoutput_ply_pathc s|dur tjddj}j}j}tj fdddDdd}t t |d }| d | d | t d t|d d| d| d| d|durk| d| d| d|dur| t dt|d d| d| d|dur|dt}ddt||D}td}|D] }| |j|qntd}|D] } | |j| q|dur|D]} | |jt| g| Rqtd}Wd|SWd|S1swY|S)z& Write a PLY file for a mesh. Nz.plyrjc"g|] }j|qSr8vertex_channelsr^r+numpyrXmeshr8r9 "z!export_to_ply..rNr axiswbsply s format binary_little_endian 1.0 zelement vertex rRasciisproperty float x sproperty float y sproperty float z sproperty uchar red sproperty uchar green sproperty uchar blue z element face s%property list uchar int vertex_index s end_header go@cSsg|] \}}g||RqSr8r8)rYcoordrgbr8r8r9r$s z<3f3Bz<3fz.rNr rcSs$g|]\}}djg||RqS)z{} {} {} {} {} {})r)rYrcolorr8r8r9rBsc Ss>g|]}dt|ddt|ddt|ddqS)z f {} {} {}rr r^)rr])rYrr8r8r9rFs>cSsg|]}d|qS)zv r8)rYrr8r8r9rHsrfrR)rrrsrrr^r+rrr<rurrrd writelinesrf)rrrr vertex_colorsr combined_datarqr8rr9 export_to_obj:s "r video_framesoutput_video_pathc Cstrddl}n ttddd|durtjddj}|jd}|dj \}}}|j ||d||fd }t t |D]}| |||j} || q<|S) Nropencvr export_to_videoz.mp4rjmp4vrW)fps frameSize)rcv2 ImportErrorrrrrrsrVideoWriter_fourccr VideoWriterrrcvtColor COLOR_RGB2BGRr) rrrfourccrgrfc video_writeriimgr8r8r9rNs   rcCs6d}|ds|dstj|tj|}t|S)NzEhttps://huggingface.co/datasets/fusing/diffusers-testing/resolve/mainr9r:)r?rXrvrfurllibrquoterG)rvbase_urlr8r8r9 load_hf_numpy_srcCs.d}|tvr|j|dddddt|<dSdS)z This function is to be called from `conftest.py` via `pytest_addoption` wrapper that has to be defined there. It allows loading both `conftest.py` files at once without causing a failure due to adding the same `pytest` option. z--make-reportsstoreFzSgenerate report files. The value of this option is used as a prefix to report names)actionrhelpr N)pytest_opt_registered addoption)parseroptionr8r8r9pytest_addoption_sharedns rc sddlm}ts d|j}|}|jj}|j}dtj dddfddd D}g}|j D]} | D] } t | d rF| | q:q6|r|jd d dd t|ddA} d} | dt|D]-\} } | j| kr| t|| d| dn| | jdd| jdd| jdqfWdn1swYdd}d|j_t|dd} ||| |_|Wdn1swYt|dd} ||| |_||Wdn1swYd|j_t|d d} ||| |_|Wdn 1swYt|d!d} ||| |_|Wdn 1s0wYt|d"d} ||| |_||Wdn 1sVwYd#|_t|d$d} ||| |_|Wdn 1s{wYt|d%d} ||| |_|Wdn 1swYt|d&d} ||| |_|Wdn 1swY||_||_||j_dS)'a Generate multiple reports at the end of test suite run - each report goes into a dedicated file in the current directory. The report files are prefixed with the test suite name. This function emulates --duration and -rA pytest arguments. This function is to be called from `conftest.py` via `pytest_terminal_summary` wrapper that has to be defined there. Args: - tr: `terminalreporter` passed from `conftest.py` - id: unique id like `tests` or `examples` that will be incorporated into the final reports filenames - this is needed as some jobs have multiple runs of pytest, so we can't have them overwrite each other. NB: this functions taps into a private _pytest API and while unlikely, it could break should pytest do internal changes - also it calls default internal methods of terminalreporter which can be hijacked by various `pytest-` plugins and interfere. r)create_terminal_writerrsreportsT)parentsexist_okc s$i|]}|dd|dqS)r6rz.txtr8)rYkdiridr8r9 sz0pytest_terminal_summary_main..) durationserrors failures_longfailures_short failures_linepassesstats summary_shortwarningsrpcSs|jSr-)rprZr8r8r9sz.pytest_terminal_summary_main..)rIreverserrfg?zslowest durations z durations < z secs were omittedz02.2fzs z<8 rRNc Ssp|d}|s dS|dd|D]$}||}|jd|dddtdd|jd tjtjB}|j |qdS) Nfailed=zFAILURES SHORT STACKrT)redboldz.*_ _ _ (_ ){10,}_ _ rSr) getreports write_sep_getfailureheadlineresub longreprtextMS_twline)trrrepmsglongreprr8r8r9summary_failures_shorts   z.summary_failures_shortautorrrrrrwPpsxXEfrrr)_pytest.configrrconfigget_terminal_writerrtbstyle reportcharsrmkdirrrhasattrrsortrdr enumeraterpwhennodeidrsummary_failuressummary_errorssummary_warningssummary_passesshort_test_summary summary_stats)rrrr orig_writer orig_tbstyleorig_reportchars report_filesdlistreplistrrq durations_minrrr8rr9pytest_terminal_summary_mains      (                  r max_attemptswait_before_retry descriptioncsfddS)a To decorate flaky tests (methods or entire classes). They will be retried on failures. Args: max_attempts (`int`, *optional*, defaults to 5): The maximum number of attempts to retry the flaky test. wait_before_retry (`float`, *optional*): If provided, will wait that number of seconds before retrying the test. description (`str`, *optional*): A string to describe the situation (what / where / why is flaky, link to GH issue/PR comments, errors, etc.) cshtr$tjD]\}}t|r!|dr!t||q St fdd}|S)Ntestc sd}|krJz|i|WStyE}z+dpjd|dd|}t|tjddur7t|d7}WYd}~nd}~ww|ks|i|S)Nr z[FLAKY] z failed on attempt r6z: rU) Exception__name__rer.stderrtimesleep)r6r7 retry_counterrr)rrobjrr8r9wrappers*  z,is_flaky..decorator..wrapper) rtisclasslist__dict__rCcallabler?setattr functoolswraps)r attr_name attr_valuerrrrr)rr9rs zis_flaky..decoratorr8)rrrr8rr9is_flakysrc Cs|dur ttjdd}d}t|}|d}|d}|j||d|j ||||fd}| z |j|d} | Wnt yZ} z| || WYd} ~ nd} ~ ww|j|d| ddurq|| ddSdS) a To run a test in a subprocess. In particular, this can avoid (GPU) memory issue. Args: test_case (`unittest.TestCase`): The test that will run `target_func`. target_func (`Callable`): The function implementing the actual testing logic. inputs (`dict`, *optional*, defaults to `None`): The inputs that will be passed to `target_func` through an (input) queue. timeout (`int`, *optional*, defaults to `None`): The timeout (in seconds) that will be passed to the input and output queues. If not specified, the env. variable `PYTEST_TIMEOUT` will be checked. If still `None`, its value will be set to `600`. NPYTEST_TIMEOUTiXspawnr r;)targetr6error)rrXrYrZmultiprocessing get_contextQueue JoinableQueueputProcessstart task_doner  terminatefailrf) r target_funcinputsr< start_methohdctx input_queue output_queueprocessresultser8r8r9run_test_in_subprocess3s*       r5c@s0eZdZdZddZddZddZdd Zd S) CaptureLoggeraG Args: Context manager to capture `logging` streams logger: 'logging` logger object Returns: The captured output is available via `self.out` Example: ```python >>> from diffusers import logging >>> from diffusers.testing_utils import CaptureLogger >>> msg = "Testing 1, 2, 3" >>> logging.set_verbosity_info() >>> logger = logging.get_logger("diffusers.pipelines.stable_diffusion.pipeline_stable_diffusion.py") >>> with CaptureLogger(logger) as cl: ... logger.info(msg) >>> assert cl.out, msg + " " ``` cCs&||_t|_t|j|_d|_dS)NrS)loggerrrvlogging StreamHandlershout)selfr7r8r8r9__init__ss zCaptureLogger.__init__cCs|j|j|Sr-)r7 addHandlerr:r<r8r8r9 __enter__yszCaptureLogger.__enter__cGs|j|j|j|_dSr-)r7 removeHandlerr:rvgetvaluer;)r<excr8r8r9__exit__}szCaptureLogger.__exit__cCsd|jdS)Nz captured: rR)r;r?r8r8r9__repr__szCaptureLogger.__repr__N)r  __module__ __qualname____doc__r=r@rDrEr8r8r8r9r6^s  r6cCddlm}td|S)z Helper function for reproducible behavior during distributed training. See - https://pytorch.org/docs/stable/notes/randomness.html for pytorch r )enable_full_determinismzenable_full_determinism has been moved to diffusers.utils.torch_utils. Importing from diffusers.utils.testing_utils is deprecated and will be removed in a future version.) torch_utilsrJr7warning)_enable_full_determinismr8r8r9rJs rJcCrI)Nr )disable_full_determinismzdisable_full_determinism has been moved to diffusers.utils.torch_utils. Importing from diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKrNr7rL)_disable_full_determinismr8r8r9rNs rNc CtsdSddl}||}z|jd|jd|}|||}WdStyA}z|jdkr6t d|WYd}~dSd}~ww)NFrr^r^rTr*zYou have passed a device of type 'cuda' which should work with 'fp16', but 'cuda' does not seem to be correctly installed on your machine: ) rr0devicezerosfloat16r`mulr typer/rSr0rZrr4r8r8r9r    rc CrP)NFrrQrRTr*zYou have passed a device of type 'cuda' which should work with 'fp64', but 'cuda' does not seem to be correctly installed on your machine: ) rr0rSrTfloat64r`rVr rWr/rXr8r8r9rrYr)r*r#r+r,rcCdSNrr8r8r8r8r9rrcCr[r\r8r8r8r8r9rr]reset_peak_memory_statsmax_memory_allocated synchronizerSdispatch_tablecOs<||vr |d|i|S||}t|s|S||i|S)Nr)r)rSrar6r7fnr8r8r9_device_agnostic_dispatchs rcseedcCs ddlm}td|||S)Nr )backend_manual_seedzbackend_manual_seed has been moved to diffusers.utils.torch_utils. diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKrer7rL)rSrd_backend_manual_seedr8r8r9res  recCddlm}td||S)Nr )backend_synchronizezbackend_synchronize has been moved to diffusers.utils.torch_utils. diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKrhr7rL)rS_backend_synchronizer8r8r9rh rhcCrg)Nr )backend_empty_cachezbackend_empty_cache has been moved to diffusers.utils.torch_utils. diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKrkr7rL)rS_backend_empty_cacher8r8r9rk'rjrkcCrg)Nr )backend_device_countzbackend_device_count has been moved to diffusers.utils.torch_utils. diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKrmr7rL)rS_backend_device_countr8r8r9rm1rjrmcCrg)Nr )backend_reset_peak_memory_statszbackend_reset_peak_memory_stats has been moved to diffusers.utils.torch_utils. diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKror7rL)rS _backend_reset_peak_memory_statsr8r8r9ro;rjrocCrg)Nr )"backend_reset_max_memory_allocatedzbackend_reset_max_memory_allocated has been moved to diffusers.utils.torch_utils. diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKrqr7rL)rS#_backend_reset_max_memory_allocatedr8r8r9rqErjrqcCrg)Nr )backend_max_memory_allocatedzbackend_max_memory_allocated has been moved to diffusers.utils.torch_utils. diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKrsr7rL)rS_backend_max_memory_allocatedr8r8r9rsOrjrscCrg)Nr )rzbackend_supports_training has been moved to diffusers.utils.torch_utils. diffusers.utils.testing_utils is deprecated and will be removed in a future version.)rKrr7rL)rS_backend_supports_trainingr8r8r9r[rjrdevice_fn_dictattribute_namec Cs`z tt|}||t<WdSty/}zd|vr$td|dtd|WYd}~dSd}~ww)Nr`z` not found in 'z)' and no default fallback function found.)getattrdevice_spec_modulerAttributeErrordevice_spec_path)rvrwspec_fnr4r8r8r9update_mapping_from_spechs r~DIFFUSERS_TEST_DEVICE_SPECzCSpecified path to device specification file is not found. Received z.pyz9Provided device spec file is not a Python file! Received z.Device spec file did not contain `DEVICE_NAME`z?Mismatch between environment variable `DIFFUSERS_TEST_DEVICE` 'z' and device found in spec 'z' zKEither unset `DIFFUSERS_TEST_DEVICE` or ensure it matches device spec name.MANUAL_SEED_FNEMPTY_CACHE_FNDEVICE_COUNT_FNSUPPORTS_TRAININGRESET_PEAK_MEMORY_STATS_FNRESET_MAX_MEMORY_ALLOCATED_FNMAX_MEMORY_ALLOCATED_FNcCsltstrddl}|j\}}trd|fSd|fStr2ddl}|jd}d}||@d?}d|fStdfS) z, Get environment device properties. rNrocmr* architecturel r#)IS_CUDA_SYSTEMIS_ROCM_SYSTEMr0r*get_device_capability IS_XPU_SYSTEMr#r)r0r0rarchgen_maskgenr8r8r9rs r)_GO_LC_SUPPORTED_PYTORCH_LAYERS)_GROUP_ID_LAZY_LEAF_compute_group_hash"_find_parent_module_in_module_dict/_gather_buffers_with_no_group_offloading_parent2_gather_parameters_with_no_group_offloading_parentmoduleoffload_to_disk_path offload_typenum_blocks_per_groupc st}dtdtffdd }|dkrv|durtdg}|D]B\}}t|tjjtjjfs5| |q t dt ||D]$} || | |} | sJq=|d| d| t | d } | || q=q |D]}| ||j jd qe|S|d kr|D]\}}t|tr| ||q~d d |D} t|| } t|| }| |}|ri}t|}|D]\}}t||}||vrg||<|| |q|D] }| ||q| |t|Std|)Ngroup_idrcst|}tjd|dS)Ngroup_z .safetensors)rrXrvrf)r short_hashrr8r9get_hashed_filenamesz<_get_expected_safetensors_files..get_hashed_filename block_levelzCnum_blocks_per_group must be provided for 'block_level' offloading.rrr _unmatched_group leaf_levelcSsh|] \}}t|tr|qSr8)rDr)rYrsmr8r8r9 s z2_get_expected_safetensors_files..zUnsupported offload_type: )rEr]r/named_childrenrDr0nn ModuleList Sequentialrrradd __class__r  named_modulesrrrdictrr)rrrrexpected_filesrunmatched_modulesr submodulercurrent_modulesrmodules_with_group_offloading parametersbuffers all_orphansparent_to_tensors module_dict tensor_namer parent_namer8rr9_get_expected_safetensors_filessX  "      rc Cs\tj|sdSt||||}tttj|d}||}||}| o(| }|||fS)N)FNNz *.safetensors)rXrvisdirrrEglobrf) rrrrr actual_files missing_files extra_files is_correctr8r8r9 _check_safetensors_serializations   rc@sfeZdZdefddZededefddZededede fdd Z ddedefd d Z d dZ dS) ExpectationsrcCs |tS)zX Find best matching expectation based on environment device properties. )find_expectationrr?r8r8r9get_expectations zExpectations.get_expectationrIcCstdd|DS)Ncss|]}|duVqdSr-r8)rYpr8r8r9r[%sz*Expectations.is_default..)allrIr8r8r9 is_default#szExpectations.is_defaultothercCsp|\}}|\}}d}||kr|dO}n |dvr|dvr|dO}||kr+|dur+|dO}t|r4|dO}t|S)a Returns score indicating how similar two instances of the `Properties` tuple are. Points are calculated using bits, but documented as int. Rules are as follows: * Matching `type` gives 8 points. * Semi-matching `type`, for example cuda and rocm, gives 4 points. * Matching `major` (compute capability major version) gives 2 points. * Default expectation (if present) gives 1 points. rrW)r*rNr^r )rrr)rIr device_typer0other_device_type other_majorscorer8r8r9r's   zExpectations.scoreNNcs@t|jfddd\}}t|dkrtd|S)zU Find best matching expectation based on provided device properties. cst|dSr\)rrrrr8r9rFsz/Expectations.find_expectation..rrz"No matching expectation found for )r3rrCrrr/)r<rI result_keyresultr8rr9rBszExpectations.find_expectationcCs|jSr-)rr?r8r8r9rEMszExpectations.__repr__N)r) r rFrGrr staticmethodDevicePropertiesboolrrrrrEr8r8r8r9rs r)NNrLrMr-)F)r;NN)NT)rNNr)rrrimportlib.metadatartrvr8r"rXrrrr.rrr r urllib.parser collectionsr contextlibrrrpathlibrtypingrrr r rr< PIL.ImagerO PIL.ImageOpsr@ numpy.linalgr packagingr constantsr import_utilsrrrrrrrrrrrrrrrrrr r!r"r0hiprr*rryrRandomrr r7rLrrr_required_peft_version_required_transformers_versionrrgetenvr&rYbackend import_modulerModuleNotFoundErrorr4rrS RuntimeErrorinforr# __version__is_torch_higher_equal_than_1_12rbackendsmps_backend_registeredr,rKr-r:rArKrrr~rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrr!r&r+r,r3r]rErGrrKrPrUrhrrurzrrrrrrrrrr5r6rJrNrrBACKEND_SUPPORTS_TRAINING empty_cacheBACKEND_EMPTY_CACHErBACKEND_DEVICE_COUNT manual_seedBACKEND_MANUAL_SEEDr^BACKEND_RESET_PEAK_MEMORY_STATSreset_max_memory_allocated"BACKEND_RESET_MAX_MEMORY_ALLOCATEDr_BACKEND_MAX_MEMORY_ALLOCATEDr`BACKEND_SYNCHRONIZErrcrerhrkrmrorqrsrr~r|is_filer/index import_namerz DEVICE_NAME device_namer{rtupler lru_cacherDevicePropertiesUserDictdiffusers.hooks._commonr diffusers.hooks.group_offloadingrrrrrrModulerrrr8r8r8r9sJ      T                                   $"  3 " 0+'                           H