o ॵi¹ã@sBddlZddlZddlmZdd„Zdd„ZedkreƒdSdS)éN)Úinit_megatron_utilcCs$dddddœ}dtjd<t|ƒdS)NéÚncclé*)Útensor_model_parallel_sizeÚ world_sizeÚdistributed_backendÚseedÚ39501Ú MASTER_PORT)ÚosÚenvironr)Údummy_megatron_cfg©rúP/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/utils/pre_compile.pyÚpre_compile_megatron_utilsü  rcCs$tj ¡rddlm}tƒdSdS)Nr©Úms_deform_attn_func)ÚtorchÚcudaÚ is_availableÚ0easycv.thirdparty.deformable_attention.functionsrrrrrrÚpre_compile_alls   ürÚ__main__)r rÚmodelscope.utils.megatron_utilsrrrÚ__name__rrrrÚs   ÿ