o ߗiR@sPUddlmZddlmZddlmZdaeeje d<deejfddZ dS) )OptionalN)config _COMPILE_PGreturncCs4tjrtrtrtdurtjjddatSdS)Npt2_compile_pg)pg_tag)renable_compiler_collectivesdist is_availableis_initializedrdistributed_c10d_new_group_with_tagrrW/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/torch/_dynamo/distributed.pyget_compile_pg sr) typingrtorch.distributed distributedr rr ProcessGroup__annotations__rrrrrs