o TÃiã@sLddlTddlmZ Gdd„deƒZGdd„deƒZ Gdd„deƒZd S) é)Ú*)ÚLayerContainerc@sTeZdZUdZeed<eed<eed<eed<e ed<e ed<dd d d d d dœZ dS)ÚFalconTransformerContainerú? Transformer layer container for the Falcon model. Úqkv_wÚ attn_out_wÚmlp_1_wÚmlp_2_wÚ ln_attn_gammaÚ ln_attn_betaú qkv_w.paramsúattn_out_w.paramsúmlp_1_w.paramsúmlp_2_w.paramsúln_attn_gamma.paramsúln_attn_beta.params)ú%self_attention.query_key_value.weightúself_attention.dense.weightúmlp.dense_h_to_4h.weightúmlp.dense_4h_to_h.weightzinput_layernorm.weightzinput_layernorm.biasN) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚFusedQKVParameterÚ__annotations__ÚAttentionOutputParameterÚ MLP1ParameterÚ MLP2ParameterÚ NormParameterÚ PARAM_MAPPING©r!r!úq/home/ubuntu/.local/lib/python3.10/site-packages/deepspeed/inference/v2/model_implementations/falcon/container.pyr's  úrc@s@eZdZUdZeed<eed<eed<eed<dddd d œZd S) ÚFalconNonTransformerContainerzC Non-Transformer layer container for the Falcon model. Úword_embÚ word_unembedÚfinal_norm_gammaÚfinal_norm_betazword_emb.paramszfinal_norm_gamma.paramszfinal_norm_beta.paramszword_unembed.params)z"transformer.word_embeddings.weightztransformer.ln_f.weightztransformer.ln_f.biaszlm_head.weightN) rrrrÚEmbeddingParameterrÚUnembedParameterrr r!r!r!r"r#<s  ür#c @sheZdZUdZeed<eed<eed<eed<e ed<e ed<e ed<e ed <d d d d dddddœZ dS)Ú!FalconNewArchTransformerContainerrrrrr r r Ú ln_mlp_gammaÚ ln_mlp_betar r rrrrzln_mlp_gamma.paramszln_mlp_beta.params)rrrrzln_attn.weightz ln_attn.biasz ln_mlp.weightz ln_mlp.biasN) rrrrÚGQAMegatronQKVParameterrrrrrr r!r!r!r"r*ks&  ør*N)Úcommon_parametersÚlayer_container_baserrr#r*r!r!r!r"Ús