o wi@sxddlmZddlmZmZmZmZddlmZm Z ddl m Z ddl m Z mZddlmZGddde d d d d Zd S))Path)AnyDictOptionalUnion) CONFIG_NAMEPyTorchModelHubMixin)DataclassInstance) DictConfig OmegaConf) cached_filecseZdZeddddedeedeeeefdedee d eed ed eeed fd edeffddZ d d dd ddeeefdeee dfdeededee ee fdeef fddZ ZS) HFHubMixincpuF) map_locationstrictmodel_idrevision cache_dirforce_downloadproxiesresume_downloadlocal_files_onlytokenNrrc  st|t|||||||dddd } | durtdtd|tt| | d<d| dd<tjd ||||||||| | d | S) z Load Pytorch pretrained weights and return the loaded model. Wrapper over PyTorchModelHubMixin that auto-handles config in **model_kwargs. F) rrrrrrr _raise_exceptions_for_gated_repo%_raise_exceptions_for_missing_entries'_raise_exceptions_for_connection_errorsNzMissing z file for model_id=cfgpretrained_weights) rrrrrrrrrr)r r RuntimeErrorr to_containerloadsuper_from_pretrained) clsrrrrrrrrrr model_kwargsresolved_config_file __class__rd/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nemo/collections/speechlm2/parts/hf_hub.pyr#s@  zHFHubMixin._from_pretrained)configrepo_id push_to_hubmodel_card_kwargssave_directoryr*r r+r,r-returnc sF|durt|d}t|trt|j}tjd|||||d|S)a Save weights in local directory. Args: save_directory (`str` or `Path`): Path to directory in which the model weights and configuration will be saved. config (`dict` or `DataclassInstance`, *optional*): Model configuration specified as a key/value dictionary or a dataclass instance. If not provided, we will automatically serialize attribute ``model.cfg``. push_to_hub (`bool`, *optional*, defaults to `False`): Whether or not to push your model to the Huggingface Hub after saving it. repo_id (`str`, *optional*): ID of your repository on the Hub. Used only if `push_to_hub=True`. Will default to the folder name if not provided. model_card_kwargs (`Dict[str, Any]`, *optional*): Additional arguments passed to the model card template to customize the model card. push_to_hub_kwargs: Additional key word arguments passed along to the [`~ModelHubMixin.push_to_hub`] method. Returns: `str` or `None`: url of the commit on the Hub if `push_to_hub=True`, `None` otherwise. Nr)r.r*r+r,r-r)getattr isinstancer r r rr"save_pretrained)selfr.r*r+r,r-push_to_hub_kwargsr'rr)r2Vs   zHFHubMixin.save_pretrained)__name__ __module__ __qualname__ classmethodstrrrrbooldictr#rrr2 __classcell__rrr'r)r sT     <  r NeMozhttps://github.com/NVIDIA/NeMozDhttps://docs.nvidia.com/nemo-framework/user-guide/latest/nemotoolkit) library_namerepo_urldocs_urlN)pathlibrtypingrrrrhuggingface_hubrrhuggingface_hub.hub_mixinr omegaconfr r transformers.utilsr r rrrr)s