o }oio@sddlmZmZmZddlZddlmZddlmZdZ zddl Z ddl m Z m Z Wney9eZ dZ dZ Ynwde d e fd d ZGd d d eZdS))AnyMappingSequenceN) HalfPrecision)overrideT) DictConfig OmegaConfF trainer_cfgreturncCstj|dd}ts |S|d}|dvr!|ddt|g|d<|dd}dur8t|tr8tj ||d<|dd}dur[t|t r[g}|D] }| tj |qK||d<|S) a Resolves and processes a trainer configuration. This function handles specific trainer configuration details: - For half precision setups, replaces precision settings with custom plugins - Instantiates strategy objects from mapping configurations - Instantiates custom callbacks from sequences Args: trainer_cfg: A DictConfig containing trainer configuration parameters Returns: A processed DictConfig with resolved configuration values T)resolve precision)z fp16-truez bf16-trueNpluginsstrategy callbacks) r to_container _HAS_HYDRAgetpopHalfPrecisionForAudio isinstancerhydrautils instantiaterappend)r r rcbsresolvedcbrL/home/ubuntu/.local/lib/python3.10/site-packages/nemo/utils/trainer_utils.pyresolve_trainer_cfg s  rcs.eZdZdZededeffdd ZZS)rz Adjusted Pytorch Lightning plugin for training with half precision. It avoids downcasting audio to bfloat16 when the mini-batch is a dict with 'audio' string in the keys corresponding to audio tensors. datar cs,t|ts t|Sfdd|S)a  Converts input data to the appropriate precision format, preserving audio tensor precision. This method overrides the parent class implementation to avoid downcasting tensors with 'audio' in their dictionary keys. It processes input data recursively when encountering nested dictionaries. Args: data: The input data to convert (can be tensor, dict, or other types) Returns: The converted data with appropriate precision for each element cslt|tr#i}|D]\}}d|vst|s|}|||<q |St|tjr4t|r4|jS|S)Naudio) rdictitemstorch is_tensorTensoris_floating_pointto_desired_input_dtype)vansk_convertselfrrr.`s   z5HalfPrecisionForAudio.convert_input.._convert)rr"super convert_input)r/r  __class__r-rr1Ns   z#HalfPrecisionForAudio.convert_input)__name__ __module__ __qualname____doc__rrr1 __classcell__rrr2rrGs r)typingrrrr$lightning.pytorch.pluginsrtyping_extensionsrrr omegaconfrrModuleNotFoundErrorrrrrrrs   '