o $iF@sRdZddlZddlZddlZeeZejGdddZejGdddZ dS)z#Some utility class for Collectives.Nc@s0eZdZdZddZddZddZdd Zd S) NCCLUniqueIDStorezNCCLUniqueID Store as a named actor class. Args: name: the unique name for this named actor. Attributes: name: the unique name for this named actor. nccl_id: the NCCLUniqueID held in this store. cCs||_d|_t|_dS)N)namenccl_idasyncioEventevent)selfrr U/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/ray/util/collective/util.py__init__szNCCLUniqueIDStore.__init__cs||_|j|S)z Initialize the NCCL unique ID for this store. Args: uid: the unique ID generated via the NCCL generate_communicator_id API. Returns: The NCCL unique ID set. )rrset)ruidr r r set_ids zNCCLUniqueIDStore.set_idcs|jIdH|jS)z4Wait for the NCCL unique ID to be set and return it.N)rwaitrrr r r wait_and_get_id)sz!NCCLUniqueIDStore.wait_and_get_idcCs|js td|j|jS)z*Get the NCCL unique ID held in this store.z.The NCCL ID has not been set yet for store {}.)rloggerwarningformatrrr r r get_id.s  zNCCLUniqueIDStore.get_idN)__name__ __module__ __qualname____doc__r rrrr r r r r s   rc@s(eZdZdZddZddZddZdS) InfozrStore the group information created via `create_collective_group`. Note: Should be used as a NamedActor. cCs"d|_d|_d|_d|_d|_dS)Ni0uids world_sizerankbackend gloo_timeoutrr r r r >s  z Info.__init__cCs"||_||_||_||_||_dS)zStore collective information.Nr)rrrrr r!r r r set_infoEs  z Info.set_infocCs|j|j|j|j|jfS)z-Get previously stored collective information.rrr r r get_infoMs z Info.get_infoN)rrrrr r"r#r r r r r7s  r) rrloggingray getLoggerrrremoterrr r r r s ,