o TÃi  ã@s:ddlTddlmZ Gdd„deƒZGdd„deƒZdS)é)Ú*)ÚLayerContainerc@sTeZdZUdZeed<eed<eed<eed<e ed<e ed<dd d d d d dœZ dS)ÚPhi3TransformerContainerz< Transformer layer container for the Phi model. Úqkv_wÚ attn_out_wÚmlp_1_wÚmlp_2_wÚattn_norm_gammaÚmlp_norm_gammaz qkv_w.paramszattn_out_w.paramszmlp_1_w.paramszmlp_2_w.paramszattn_norm_gamma.paramszmlp_norm_gamma.params)zself_attn.qkv_proj.weightzself_attn.o_proj.weightzmlp.gate_up_proj.weightzmlp.down_proj.weightzinput_layernorm.weightzpost_attention_layernorm.weightN) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚFusedQKVParameterÚ__annotations__ÚAttentionOutputParameterÚFusedGatedMLPParameterÚ MLP2ParameterÚ NormParameterÚ PARAM_MAPPING©rrúp/home/ubuntu/.local/lib/python3.10/site-packages/deepspeed/inference/v2/model_implementations/phi3/containers.pyr*s  úrc@s6eZdZUdZeed<eed<eed<ddddœZd S) ÚPhi3NonTransformerContainerz@ Non-Transformer layer container for the Phi model. Úword_embÚword_unembed_wÚfinal_norm_gammazword_emb.paramszfinal_norm_gamma.paramszword_unembed_w.params)zmodel.embed_tokens.weightzmodel.norm.weightzlm_head.weightN) r r r rÚEmbeddingParameterrÚUnembedParameterrrrrrrr?s  ýrN)Úcommon_parametersÚlayer_container_baserrrrrrrÚs