o …wÖi)ã@s6ddlZddlmZdd„Zdd„Zdefdd „ZdS) éN©Ú get_envintcCsxtddƒ}|dur |dkStddƒ}|dur|dkStddƒ}|dur'|dkStdtddƒƒ}tddƒ}|dko;|dkS) zWHelper function to determine if the current process is global_rank 0 (the main process)ÚRANKNrÚ SLURM_PROCIDÚOMPI_COMM_WORLD_RANKÚ NODE_RANKÚ GROUP_RANKÚ LOCAL_RANKr)ÚrankÚ slurm_rankÚmpi_rankÚ node_rankÚ local_rank©rúP/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nemo/utils/get_rank.pyÚis_global_rank_zeros    rcCstƒrdStj ¡S)zmHelper function that returns torch.distributed.get_rank() if DDP has been initialized otherwise it returns 0.r)rÚtorchÚ distributedÚget_rankrrrrr/s rÚreturncCstj ¡sdStj ¡dS)z*Get the last rank in the distributed groupré)rrÚis_initializedÚget_world_sizerrrrÚ get_last_rank8s r)rÚnemo.utils.env_var_parsingrrrÚintrrrrrÚs