o TÃi} ã@s:ddlTddlmZ Gdd„deƒZGdd„deƒZdS)é)Ú*)ÚLayerContainerc@s„eZdZUdZeed<eed<eed<eed<eed<eed<eed<eed <e ed <e ed <d d dddddddddddddœZ dS)ÚPhiTransformerContainerz< Transformer layer container for the Phi model. Úqkv_wÚqkv_bÚ attn_out_wÚ attn_out_bÚmlp_1_wÚmlp_1_bÚmlp_2_wÚmlp_2_bÚln_gammaÚln_betazqkv_w.q_paramszqkv_w.k_paramszqkv_w.v_paramszqkv_b.q_paramszqkv_b.k_paramszqkv_b.v_paramszattn_out_w.paramszattn_out_b.paramszmlp_1_w.paramszmlp_1_b.paramszmlp_2_w.paramszmlp_2_b.paramszln_gamma.paramszln_beta.params)zself_attn.q_proj.weightzself_attn.k_proj.weightzself_attn.v_proj.weightzself_attn.q_proj.biaszself_attn.k_proj.biaszself_attn.v_proj.biaszself_attn.dense.weightzself_attn.dense.biaszmlp.fc1.weightz mlp.fc1.biaszmlp.fc2.weightz mlp.fc2.biaszinput_layernorm.weightzinput_layernorm.biasN) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚUnfusedQKVParameterÚ__annotations__ÚAttentionOutputParameterÚ MLP1ParameterÚ MLP2ParameterÚ NormParameterÚ PARAM_MAPPING©rrúo/home/ubuntu/.local/lib/python3.10/site-packages/deepspeed/inference/v2/model_implementations/phi/containers.pyr*s6  òrc@sJeZdZUdZeed<eed<eed<eed<eed<ddd d d d œZd S)ÚPhiNonTransformerContainerz@ Non-Transformer layer container for the Phi model. Úword_embÚword_unembed_wÚword_unembed_bÚfinal_norm_gammaÚfinal_norm_betazword_emb.paramszfinal_norm_gamma.paramszfinal_norm_beta.paramszword_unembed_w.paramszword_unembed_b.params)zmodel.embed_tokens.weightzmodel.final_layernorm.weightzmodel.final_layernorm.biaszlm_head.weightz lm_head.biasN) rrrrÚEmbeddingParameterrÚUnembedParameterrrrrrrrKs  ûrN)Úcommon_parametersÚlayer_container_baserrrrrrrÚs   !