o i @sLdZddlmZerddlmZddlmZddlmZdefddZd S) zFP-Quant integration file)is_fp_quant_available) FPQuantConfig) FPQuantDtypeconfigc Csz|jdkr tj}n|jdkrtj}ntd|j|jdkr#tj}ntd|jt||j||j |j |j |j |j dS)Nmxfp4nvfp4zUnsupported forward dtype: bf16zUnsupported backward dtype: ) forward_dtypeforward_methodbackward_dtypestore_master_weightshadamard_group_sizepseudoquantizationtransform_initmodules_to_not_convert)r rMXFP4NVFP4 ValueErrorr BF16FPQuantLinearConfigr r rrrr)rr r r_/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/transformers/integrations/fp_quant.pyadapt_fp_quant_configs$   rN) __doc__utilsrfp_quantrrr&transformers.utils.quantization_configrrrrrs