o ãÊiÔã@sJddlZddlmmZddlmZddlmZdej de fdd„Z dS)éN)ÚDTensor)ÚFloat8TrainingTensorÚtensorÚreturncCs<t|tƒrdSt|tƒrt|jƒSt|tjƒrt|jƒSdS)zl Check if the tensor is already casted to fp8, works if the local tensor is wrapped in DTensor. TF)Ú isinstancerrÚtensor_already_casted_to_fp8Ú _local_tensorÚfuncolÚAsyncCollectiveTensorÚelem)r©r úT/home/ubuntu/.local/lib/python3.10/site-packages/torchao/float8/distributed_utils.pyrs     r) ÚtorchÚ)torch.distributed._functional_collectivesÚ distributedÚ_functional_collectivesr Útorch.distributed._tensorrÚ%torchao.float8.float8_training_tensorrÚTensorÚboolrr r r r Ús