o ॵi@sVddlmZddlmZddlmZmZedZejdedd ded e fd d Z dS) )DistributedDataParallel) ConfigDict)Registrybuild_from_cfgparallelr) module_name module_clsNcfg default_argscCst|t|dS)z build parallel Args: cfg (:obj:`ConfigDict`): config dict for parallel object. default_args (dict, optional): Default initialization arguments. )r )rPARALLEL)r r r X/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/trainers/parallel/builder.pybuild_parallel sr)N) torch.nn.parallel.distributedrmodelscope.utils.configrmodelscope.utils.registryrrr register_moduledictrr r r r s