o TÃiW ã@s:ddlTddlmZ Gdd„deƒZGdd„deƒZdS)é)Ú*)ÚLayerContainerc@sÖeZdZUdZeed<eed<eed<eed<eed<eed<eed<eed <e ed <e ed <e ed <e ed <idd“dd“dd“dd“dd“dd“dd“dd“dd“d d!“d"d#“d$d%“d&d'“d(d)“d*d+“d,d-“Z d.S)/ÚOPTTransformerContainerz< Transformer layer container for the OPT model. Úqkv_wÚqkv_bÚ attn_out_wÚ attn_out_bÚmlp_1_wÚmlp_1_bÚmlp_2_wÚmlp_2_bÚattn_norm_betaÚattn_norm_gammaÚ mlp_norm_betaÚmlp_norm_gammazself_attn.q_proj.weightzqkv_w.q_paramszself_attn.q_proj.biaszqkv_b.q_paramszself_attn.k_proj.weightzqkv_w.k_paramszself_attn.k_proj.biaszqkv_b.k_paramszself_attn.v_proj.weightzqkv_w.v_paramszself_attn.v_proj.biaszqkv_b.v_paramszself_attn.out_proj.weightzattn_out_w.paramszself_attn.out_proj.biaszattn_out_b.paramsz fc1.weightzmlp_1_w.paramszfc1.biaszmlp_1_b.paramsz fc2.weightzmlp_2_w.paramszfc2.biaszmlp_2_b.paramszself_attn_layer_norm.weightzattn_norm_gamma.paramszself_attn_layer_norm.biaszattn_norm_beta.paramszfinal_layer_norm.weightzmlp_norm_gamma.paramszfinal_layer_norm.biaszmlp_norm_beta.paramsN) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚUnfusedQKVParameterÚ__annotations__ÚAttentionOutputParameterÚ MLP1ParameterÚ MLP2ParameterÚ NormParameterÚ PARAM_MAPPING©rrún/home/ubuntu/.local/lib/python3.10/site-packages/deepspeed/inference/v2/model_implementations/opt/container.pyr*s^ ÿþýüûúùø ÷ ö õ ô óòñðrc@sLeZdZUdZeed<eed<eed<eed<eed<ddgd d d d œZd S)ÚOPTNonTransformerContainerz@ Non-Transformer layer container for the OPT model. Úword_embÚ word_emb_posÚ word_unembedÚ final_norm_wÚ final_norm_bzword_emb.paramszword_unembed.paramszword_emb_pos.paramszfinal_norm_w.paramszfinal_norm_b.params)z*decoder.embed_tokens.weightz*decoder.embed_positions.weightz *decoder.final_layer_norm.weightz*decoder.final_layer_norm.biasN) rrrrÚEmbeddingParameterrÚUnembedParameterrrrrrrrOs  ürN)Úcommon_parametersÚlayer_container_baserrrrrrrÚs   %