o -iT@s<dZddlmZddlmZddlmZGdddeZdS) zCInference-only HF format GLM-4 model compatible with THUDM weights.) VllmConfig)LlamaForCausalLM)PPMissingLayercs,eZdZdddedeffddZZS)GlmForCausalLM)prefix vllm_configrcs\|jj}d|jd<tj||d|jjD]}t|ts+d|j j _ d|j j _ d|j j _qdS)Ng?partial_rotary_factor)r rFT) model_config hf_configrope_parameterssuper__init__modellayers isinstancer self_attn rotary_emb is_neox_styleo_projbias skip_bias_add)selfr rr layer __class__[/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/model_executor/models/glm.pyr s      zGlmForCausalLM.__init__)__name__ __module__ __qualname__rstrr __classcell__rrrrr s$rN)__doc__ vllm.configr vllm.model_executor.models.llamarutilsrrrrrrs