o TÃi ã@s0ddlmZmZddlmZGdd„deƒZdS)é)ÚActivationTypeÚ DtypeEnum)ÚDSModuleConfigc@szeZdZUdZeed< eed< eed< dZeed< ejZ eed< ejZ eed< e j Z e ed < d Zeed <d S) Ú DSMoEConfigz$ Config class for DSMoEBase Ú model_dimÚintermediate_featuresÚ n_expertséÚtop_kÚ input_dtypeÚ output_dtypeÚ activationFÚnormalize_scoresN)Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚintÚ__annotations__r rÚfp16r r rÚIDENTITYr rÚbool©rrúe/home/ubuntu/.local/lib/python3.10/site-packages/deepspeed/inference/v2/modules/configs/moe_config.pyr s$   rN)Úinference_utilsrrÚmodules.ds_modulerrrrrrÚs