o TÃià ã@s:ddlTddlmZ Gdd„deƒZGdd„deƒZdS)é)Ú*)ÚLayerContainerc @sZeZdZUdZeed<eed<eed<eed<e ed<e ed<dd d d d d ddddœ Z dS)ÚMistralTransformerContainerz@ Transformer layer container for the Mistral model. Úqkv_wÚ attn_out_wÚmlp_1_wÚmlp_2_wÚattn_norm_gammaÚmlp_norm_gammazqkv_w.q_paramszqkv_w.k_paramszqkv_w.v_paramszattn_out_w.paramszmlp_1_w.gate_paramszmlp_1_w.up_paramszmlp_2_w.paramszattn_norm_gamma.paramszmlp_norm_gamma.params) zself_attn.q_proj.weightzself_attn.k_proj.weightzself_attn.v_proj.weightzself_attn.o_proj.weightzmlp.gate_proj.weightzmlp.up_proj.weightzmlp.down_proj.weightzinput_layernorm.weightzpost_attention_layernorm.weightN) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚUnfusedQKVParameterÚ__annotations__ÚAttentionOutputParameterÚGatedMLPParameterÚ MLP2ParameterÚ NormParameterÚ PARAM_MAPPING©rrúr/home/ubuntu/.local/lib/python3.10/site-packages/deepspeed/inference/v2/model_implementations/mistral/container.pyr)s$  ÷rc@s6eZdZUdZeed<eed<eed<ddddœZd S) ÚMistralNonTransformerContainerzD Non-Transformer layer container for the Mistral model. Úword_embÚ word_unembedÚ final_normzword_emb.paramszfinal_norm.paramszword_unembed.params)zmodel.embed_tokens.weightzmodel.norm.weightzlm_head.weightN) r r r rÚEmbeddingParameterrÚUnembedParameterrrrrrrrAs  ýrN)Ú>deepspeed.inference.v2.model_implementations.common_parametersÚAdeepspeed.inference.v2.model_implementations.layer_container_baserrrrrrrÚs