o wi:@spddlZddlmZddlmZmZmZddlmZdee effddZ dee efd ee effd d Z dS) N)Path)AnyDictUnion)maybe_cast_to_type quant_cfgcCs|D]C\}}|dkrdd|D}|||<n|dvr*t|tr*t|||<qt|tr4t|qt|trG|D] }t|trFt|q;qdS)zStandardize the quantization configuration loaded from a JSON file to ensure compatibility with modelopt. Modifiy the input dictionary in place. Args: quant_cfg (Dict[str, Any]): The quantization config dictionary to standardize. block_sizescSsi|] \}}t|t|qS)rint).0kvr r m/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nemo/collections/llm/modelopt/quantization/utils.py sz+standardize_json_config..>num_bits scale_bitsN)items isinstancelisttupledictstandardize_json_config)rkeyvaluexr r rrs      rcfg_pathreturncCs@t|d }t|}Wdn1swYt||S)zLoad quantization configuration from a JSON file and adjust for modelopt standards if necessary. Args: cfg_path (str): Path to the quantization config JSON file. Returns: dict: The loaded quantization configuration. rN)openjsonloadr)rfrr r rload_quant_cfg,s r") rpathlibrtypingrrrnemo.utils.cast_utilsrstrrr"r r r rs   &