o ۷iV@s:dZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z ddl mZddlmZmZddlmZmZddlmZd d lmZd d lmZmZmZd d lmZeeZ dZ!e"e#ddZ$e%Z&ddZ'ddZ(de)ej*BfddZ+ddZ,ddZ-ddZ.ddZ/d4d!d"Z0d#d$Z1e      d5d%e)ej*Bd&e)d'e)dBd(e)ej*BdBd)e2d*e3e)e)fdBd+e2e)BdBd,e)dBd-e2d.e)dBfd/d0Z4e       d6d%e)ej*Bd&e)d'e)dBd1e)dBd(e)ej*BdBd)e2d*e3e)e)fdBd+e2e)BdBd,e)dBd-e2d.e)dBfd2d3Z5dS)7z3Utilities to dynamically load objects from the Hub.N)Path) ModuleType)request)hf_hub_download model_info)RevisionNotFoundErrorvalidate_hf_hub_args)version) __version__)DIFFUSERS_DYNAMIC_MODULE_NAMEHF_MODULES_CACHElogging)DIFFUSERS_DISABLE_REMOTE_CODEz$diffusers/community-pipelines-mirrorDIFFUSERS_TIMEOUT_REMOTE_CODEcCs0d}tt|d}t|dddS)Nz$https://pypi.org/pypi/diffusers/jsonreleasescSs t|S)N)r Version)xr[/home/ubuntu/vllm_env/lib/python3.10/site-packages/diffusers/utils/dynamic_modules_utils.py1s z(get_diffusers_versions..)key)jsonloadsrurlopenreadkeyssorted)urlrrrrget_diffusers_versions.sr!cCsLttjvrdStjttjtddttd}|s$|dSdS)z_ Creates the cache directory for modules with an init, and adds it to the Python path. NTexist_ok __init__.py) rsyspathappendosmakedirsrexiststouch) init_pathrrrinit_hf_modules4s    r-namecCsTttt|}|jst|jtj|dd|d}|s(|dSdS)zF Creates a dynamic module in the cache directory for modules. Tr"r$N) r-rrparentr*create_dynamic_moduler(r)r+)r.dynamic_module_pathr,rrrr0Cs    r0cCsjt|ddd }|}Wdn1swYtjd|tjd}|tjd|tjd7}tt|S)z Get the list of modules that are relatively imported in a module file. Args: module_file (`str` or `os.PathLike`): The module file to inspect. rutf-8encodingNz^\s*import\s+\.(\S+)\s*$flagsz^\s*from\s+\.(\S+)\s+import)openrrefindall MULTILINElistset) module_filefcontentrelative_importsrrrget_relative_importsRs   rBcsd}|g}g|sBg}|D] }|t|q t|jfdd|D}fdd|D}dd|D}t|dk}||r S)a) Get the list of all files that are needed for a given module. Note that this function recurses through the relative imports (if a imports b and b imports c, it will return module files for b and c). Args: module_file (`str` or `os.PathLike`): The module file to inspect. Fcsg|]}t|qSr)str).0m) module_pathrr wz-get_relative_import_files..csg|]}|vr|qSrrrDr?)all_relative_importsrrrGxrHcSsg|]}|dqS).pyrrIrrrrGysr)extendrBrr/len)r> no_changefiles_to_check new_importsr?new_import_filesr)rJrFrget_relative_import_filesds    rRc Cst|ddd }|}Wdn1swYtjd|tjd}|tjd|tjd7}dd |D}tt|}g}|D]}zt|Wq@t yW| |Yq@wt |d krpt d d |d d|dt|S)zi Check if the current Python environment contains all the libraries that are imported in a file. r2r3r4Nz^\s*import\s+(\S+)\s*$r6z^\s*from\s+(\S+)\s+importcSs$g|]}|ds|ddqS).r) startswithsplit)rDimprrrrGs$z!check_imports..rzaThis modeling file might require the following packages that were not found in your environment: , z. Run `pip install  `)r8rr9r:r;r<r= importlib import_module ImportErrorr'rMloggerwarningjoinrB)filenamer?r@importsmissing_packagesrVrrr check_importss.    rccCsb|ot }tr td|r"|s"d|d}|trdnd7}t||r/|r/td|d|S)NzDownloading remote code is disabled globally via the DIFFUSERS_DISABLE_REMOTE_CODE environment variable. Ignoring `trust_remote_code`.zThe repository for z contains custom code. zhDownloading remote code is disabled globally via the DIFFUSERS_DISABLE_REMOTE_CODE environment variable.zCPass `trust_remote_code=True` to allow loading remote code modules.z6`trust_remote_code` is enabled. Downloading code from z9. Please ensure you trust the contents of this repository)rr]r^ ValueError)trust_remote_code model_namehas_remote_code error_msgrrrresolve_trust_remote_codes$   riFcCstj|}|dr|dd}|tjjd}tt|}t;|r/t j |dt t j |}t jj||d}|durMt j|}|t j |<n|}|j|Wdn1s_wY|durlt|St||S)zY Import a module on the cache directory for modules and extract a class from it. rKNrS)location)r(r&normpathendswithreplaceseprr_HF_REMOTE_CODE_LOCKr%modulespoprZinvalidate_cachesgetutilspec_from_file_locationmodule_from_specloader exec_modulefind_pipeline_classgetattr) class_namerF force_reloadr.r> cached_module module_specmodulerrrget_class_in_modules(        rc Csddlm}tt|tj}d}|D]1\}}||jkrFt||rF|j dddkrF|durDt d|jd|jd |d |d |}q|S) z Retrieve pipeline class that inherits from `DiffusionPipeline`. Note that there has to be exactly one class inheriting from `DiffusionPipeline`. r )DiffusionPipelineNrSr diffusersz#Multiple classes that inherit from z have been found: z, and z). Please make sure to define only one in ) pipelinesrdictinspect getmembersisclassitems__name__ issubclass __module__rUrd) loaded_moduler cls_memberspipeline_classcls_nameclsrrrrzs*   rzpretrained_model_name_or_pathr> subfolder cache_dirforce_downloadproxiestokenrevisionlocal_files_only local_dirc  Cst|}|durtj|||} ntj||} tj| r#| } d} n|ddkrt} ddtddd}|durU|dd| vrI|nd }t d |dn"|| vr_d|}n|d krf|}nt d |d d | d gdzt t d|d|d||||| d} d} |d}WnZty}z td|d|d}~wtyt d|d|dwzt |||||||| ||d } tjdd|d} Wntyt d|d|dwt| }ttjj| }t|tt|}| dks | dkrft| |||D]N}t|ddkrAd|d}|dd}tj||sAt|||d}|durTtj|||}ntj||}t|||qnxt|||dj}||}|tjj|}t|||st|ddkr|dd}tj||st||t| |||D]-}t|ddkrd|d}||st||d|||||||| d qtj||S)a Prepares Downloads a module from a local folder or a distant repo and returns its path inside the cached Transformers module. Args: pretrained_model_name_or_path (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a pretrained model configuration hosted inside a model repo on huggingface.co. Valid model ids can be located at the root-level, like `bert-base-uncased`, or namespaced under a user or organization name, like `dbmdz/bert-base-german-cased`. - a path to a *directory* containing a configuration file saved using the [`~PreTrainedTokenizer.save_pretrained`] method, e.g., `./my_model_directory/`. module_file (`str`): The name of the module file containing the class to look for. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. proxies (`dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or *bool*, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `transformers-cli login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. > [!TIP] > You may pass a token in `token` if you are not logged in (`hf auth login`) and want to use private or [gated > models](https://huggingface.co/docs/hub/models-gated#gated-models). Returns: `str`: The path to the module inside the cache. Nlocal/rvrSr mainzDefaulting to latest_version: z`custom_revision`: z3 does not exist. Please make sure to choose one of rWdatasetrK)repo_id repo_typer`rrrrrgitz Revision 'a' not found in the community pipelines mirror. Check available revisions on https://huggingface.co/datasets/diffusers/community-pipelines-mirror/tree/main. If you don't find the revision you are looking for, please open an issue on https://github.com/huggingface/diffusers/issues.zCould not locate the z inside )rrrrrrrrz--r )rrrrrrrrrr)rCr(r&r_isfilecountr!r rUr]infordrCOMMUNITY_PIPELINES_MIRROR_IDrEnvironmentErrorerrorrcr ror0rrshutilcopyfilerMr*r)rshaget_cached_module_file)rr>rrrrrrrrmodule_file_or_urlresolved_module_file submoduleavailable_versionslatest_versionemodules_neededfull_submodulesubmodule_path module_needed module_folder source_path commit_hashrrrrs7          rr|c Cs&t||||||||| | d } t|| S)a Extracts a class from a module file, present in the local folder or repository of a model. > [!WARNING] > Calling this function will execute the code in the module file found locally or downloaded from the Hub. It should > therefore only be called on trusted repos. Args: pretrained_model_name_or_path (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a pretrained model configuration hosted inside a model repo on huggingface.co. Valid model ids can be located at the root-level, like `bert-base-uncased`, or namespaced under a user or organization name, like `dbmdz/bert-base-german-cased`. - a path to a *directory* containing a configuration file saved using the [`~PreTrainedTokenizer.save_pretrained`] method, e.g., `./my_model_directory/`. module_file (`str`): The name of the module file containing the class to look for. class_name (`str`): The name of the class to import in the module. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. proxies (`dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or `bool`, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `transformers-cli login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. > [!TIP] > You may pass a token in `token` if you are not logged in (`hf auth login`) and want to use private or [gated > models](https://huggingface.co/docs/hub/models-gated#gated-models). Returns: `type`: The class, dynamically imported from the module. Examples: ```python # Download module `modeling.py` from huggingface.co and cache then extract the class `MyBertModel` from this # module. cls = get_class_from_dynamic_module("sgugger/my-bert-model", "modeling.py", "MyBertModel") ```r)rr) rr>rr|rrrrrrr final_modulerrrget_class_from_dynamic_modulesC r)F)NNFNNNFN) NNNFNNNFN)6__doc__rZrrr(r9rr% threadingpathlibrtypesrurllibrhuggingface_hubrrhuggingface_hub.utilsrr packagingr r r rr constantsr get_loggerrr]rintgetenvTIME_OUT_REMOTE_CODELockrpr!r-rCPathLiker0rBrRrcrirrzboolrrrrrrrs        !    <