o پi @sddlZddlZddlZddlZddlZddlZddlmZddlm Z ddl Z ddl m Z e eZeZddede efddZ dded edBd ed efd dZded d fddZdefddZddZeddd efddZdS)N) lru_cache)Optional)envsmodel_name_or_path cache_dircCsd|pt}tjtj|dd|dd}t| }||d}t j tj ||dd}|S)NT)exist_ok/-z.locki)mode) temp_dirosmakedirspathdirnamereplacehashlibsha256encode hexdigestfilelockFileLockjoin)rrlock_dir model_name hash_namelock_file_namelockrD/home/ubuntu/.local/lib/python3.10/site-packages/sglang/cli/utils.py _get_locks  rT local_dirdownloadreturnc CsFddlm}tj|rtd|S|s|St|~tj r#dnd}z"td||||d|d}td |tj |WWd St y_}z t d |WYd }~nd }~wwz"td ||||d |d}td |tj |WWd St y}z td|||f|d }~ww1swYd S)a Resolve a model path. If it's a local directory, return it. If it's a Hugging Face Hub ID, download only the config file (`model_index.json` or `config.json`) and return its directory. Args: model_name_or_path: Local path or Hugging Face Hub model ID local_dir: Local directory to save the downloaded file (if any) download: Whether to download from Hugging Face Hub when needed Returns: Local directory path that contains the downloaded config file, or the original local directory. r)hf_hub_downloadzModel already exists locallyzMS HubzHF Hubz.Downloading model_index.json from %s for %s...model_index.json)repo_idfilenamer zDownloaded to %sNz(model_index.json not found or failed: %sz)Downloading config.json from %s for %s...z config.jsonzbCould not find model locally at %s and failed to download model_index.json/config.json from %s: %s)6sglang.multimodal_gen.runtime.utils.hf_diffusers_utilsr#r rexistsloggerinforrSGLANG_USE_MODELSCOPEgetr Exceptiondebug ValueError)rr r!r# source_hub file_pathe_indexe_configrrr_maybe_download_modelsf        !r4 model_pathcCs`tj|d}tj|sdSt| }t|}Wdn1s#wYd|vr.dSdS)a& Verify if the model directory contains a valid diffusers configuration. Args: model_path: Path to the model directory Returns: The loaded model configuration as a dictionary if the model is a diffusers model None if the model is not a diffusers model r$FN_diffusers_versionT)r rrr(openjsonload)r5 config_pathfconfigrrris_diffusers_model_pathds   r=cCs"t|}t|}|rtd|S)NzDiffusion model detected)r4r=r)r*)r5is_diffusion_modelrrrget_is_diffusion_models  r?csd}tD](\}}|dkr|dtkr|d}nq|dr.|ddd}nq|durFtfdddDrBtdtd |S) Nz --model-pathz --model-path==c3s|]}|vVqdSNr).0h extra_argvrr sz!get_model_path..)z-hz--helpaUsage: sglang serve --model-path [additional-arguments] This command can launch either a standard language model server or a diffusion model server. The server type is determined by the model path. For specific arguments, please provide a model_path.zFError: --model-path is required. Please provide the path to the model.) enumeratelen startswithsplitanyr-)rFr5iargrrErget_model_paths(  rOr@)maxsizec CsXztjd}|stjgdtjdd}|}|WStjt fy+d}YdSw)NSGLANG_GIT_COMMIT)gitz rev-parseHEAD)stderrzutf-8zN/A) r environr, subprocess check_outputDEVNULLstripdecodeCalledProcessErrorFileNotFoundError) commit_hash_CACHED_COMMIT_HASHrrrget_git_commit_hashs  r_rB)NT)rr8loggingr rVtempfile functoolsrtypingrrsglang.srt.environr getLogger__name__r) gettempdirr strrboolr4r=r?rOr_rrrrs8      F