o Ti@sddlZddZddZdS)NcCs@ddlm}|st|||||Sddlm}|||||S)Nr)get_accelerator)matmul_fp8_triton) deepspeedris_triton_supportedmatmul_fp8_fallbackfp8_gemm_tritonr)inpweightscalequantization_group_size quantizerrrrW/home/ubuntu/.local/lib/python3.10/site-packages/deepspeed/ops/fp_quantizer/fp8_gemm.py matmul_fp8s   rcCst||j||dS)N)r )torchmatmul dequantize)r r r r r rrrrsr)rrrrrrrs