o ̳i!@sddlmZddlmZddlmZddlmZmZm Z m Z ddl m Z m Z ddlmZddlmZmZded e d d fd d Zde eeefe fd efddZded efddZdede ed e fddZdeeefded d fddZd S)) Namespace) import_module) ModuleType)AnyDictListUnion) DictConfig OmegaConf)InstantiationError) get_logger log_rank_zero recipe_namecfgreturnNcCs4td}tj|ddd}t|d|d|ddS)z Logs the resolved config (merged YAML file and CLI overrides) to rank zero. Args: recipe_name (str): name of the recipe to display cfg (DictConfig): parsed config object DEBUGT)resolve sort_keyszRunning z with resolved config: )loggermsgN)r r to_yamlr )rrrcfg_strrK/home/ubuntu/.local/lib/python3.10/site-packages/torchtune/config/_utils.py log_configs  rnodecCst|s t|to d|vS)N _component_)r is_dict isinstancedict)rrrr_has_component!sr pathc Cs|dkrtddd|dD}|D]}t|s$td|ddq|d }zt|}WntyN}ztd|d t|d |d |d }~wwtdt|D]}||}zt||}WqVt y}zud |d |}t |t rd |d |d} z t| }WWYd }~qVt y}ztd|d t|d|d|d|d }~wty}z td|d t||d }~wwtd|d t|d|d|d|d }~ww|S)aY Return an object by name or dotted path, importing as necessary. The base functionality relies on ``getattr()`` and handles all possible exceptions accordingly. Based on Hydra's `_locate` from Facebook Research: https://github.com/facebookresearch/hydra/blob/main/hydra/_internal/utils.py#L614 Args: path (str): Dotted path of the object Returns: Any: The object Raises: InstantiationError: If there is an exception loading the object from the provided path ValueError: If a relative or invalid dotpath is passed in z Empty pathcSsg|]}|qSrr).0partrrr <sz,_get_component_from_path...zError loading 'z': invalid dotstring.z$ Relative imports are not supported.rz': z Are you sure that module 'z' is installed?Nz Are you sure that 'z' is importable from module 'z'?z' is an attribute of ') ValueErrorsplitlenr ImportErrorr reprrangegetattrAttributeErrorjoinrrModuleNotFoundError Exception) r!partsr$part0obj exc_importmexc_attrparent_dotpathmodrrr_get_component_from_path%s|    r; yaml_argscli_argsc Cs t|}g}|D]w}|dr@|dddd}d|vr%td|zt||Wnttfy>td|d dwqz |d\}}WntyXtd |dw||vrgt||rg|d 7}|d krmd }d|vrud|}||d|qt |}t |} t | |S)a Takes the direct output of argparse's parse_known_args which returns known args as a Namespace and unknown args as a dotlist (in our case, yaml args and cli args, respectively) and merges them into a single OmegaConf DictConfig. If a cli arg overrides a yaml arg with a _component_ field, the cli arg can be specified with the parent field directly, e.g., model=torchtune.models.lora_llama2_7b instead of model._component_=torchtune.models.lora_llama2_7b. Nested fields within the component should be specified with dot notation, e.g., model.lora_rank=16. Example: >>> config.yaml: >>> a: 1 >>> b: >>> _component_: torchtune.models.my_model >>> c: 3 >>> tune full_finetune --config config.yaml b=torchtune.models.other_model b.c=4 >>> yaml_args, cli_args = parser.parse_known_args() >>> conf = _merge_yaml_and_cli_args(yaml_args, cli_args) >>> print(conf) >>> {"a": 1, "b": {"_component_": "torchtune.models.other_model", "c": 4}} Args: yaml_args (Namespace): Namespace containing args from yaml file, components should have _component_ fields cli_args (List[str]): List of key=value strings Returns: DictConfig: OmegaConf DictConfig containing merged args Raises: ValueError: If a cli override is not in the form of key=value ~r'N=rr0Removing components from CLI is not supported: ~zCould not find key z in yaml config to removez=Command-line overrides must be in the form of key=value, got z ._component_Nonez!!null max_filenamez!!str ) vars startswithr)r(_remove_key_by_dotpathKeyErrorr appendr from_dotlistcreatemerge) r<r= yaml_kwargs cli_dotlistargdotpathkvcli_conf yaml_confrrr_merge_yaml_and_cli_argspsL$      rS nested_dictrNcsbd}dtttfdtddffdd dtttfdttddffd d ||dS) z Removes a key specified by dotpath from a nested dict. Errors should handled by the calling function. Args: nested_dict (Dict[str, Any]): Dict to remove key from dotpath (str): dotpath of key to remove, e.g., "a.b.c" r&dkeyrNcs$t||r td||=dS)Nr@)r r()rUrV)rNrrdelete_non_components  z4_remove_key_by_dotpath..delete_non_componentr!csZt|dkr||ddS||d|dd||ds+||ddSdS)Nr'r)r*)rUr!)rWrecurse_and_deleterrrXs  z2_remove_key_by_dotpath..recurse_and_delete)r)rstrrr)rTrNr!r)rWrNrXrrEs "(rE)argparser importlibrtypesrtypingrrrr omegaconfr r torchtune.config._errorsr torchtune.utils._loggingr r rYrboolr r;rSrErrrrs    "K"T