o ॵiòã@sddlmZdd„ZdS)é)ÚPARALLELcCs8g}tj ¡D] \}}| t| ¡ƒ¡qt|t|ƒƒS)a¹Check if a module is wrapped by parallel object. The following modules are regarded as parallel object: - torch.nn.parallel.DataParallel - torch.nn.parallel.distributed.DistributedDataParallel You may add you own parallel object by registering it to `modelscope.parallel.PARALLEL`. Args: module (nn.Module): The module to be checked. Returns: bool: True if the is wrapped by parallel object. )rÚmodulesÚitemsÚextendÚlistÚvaluesÚ isinstanceÚtuple)ÚmoduleÚmodule_wrappersÚgroupÚ module_dict©rúV/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/trainers/parallel/utils.pyÚ is_parallelsrN)ÚbuilderrrrrrrÚs