o ˜à·i+ã @sÌddlmZddlZddlZddlmZdejdejfdd„Z ddejd edejfd d „Z ddejd edejfd d„Z ddejded edejdBfdd„Z dde eejeBfdBdefdd„Z dS)é)ÚAnyNé)Ú get_tp_groupÚinput_ÚreturncCs tƒ |¡S)z8All-reduce the input tensor across model parallel group.)rÚ all_reduce)r©rúW/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/distributed/communication_op.pyÚ tensor_model_parallel_all_reduce s r éÿÿÿÿÚdimcCótƒ ||¡S)z8All-gather the input tensor across model parallel group.)rÚ all_gather©rr rrr Ú tensor_model_parallel_all_gatherórcCr )zsJ  ÿÿÿ þÿÿÿ þÿÿÿÿ þÿÿÿ