o 5tie@szdZddlmZddlZddlmZmZddlZddlm Z ddl m Z er*ddl Z e eZe dGdd d e ZdS) a Mistral3 model adapter for lm-evaluation-harness. This adapter enables evaluation of Ministral-3 models (3B, 8B, 14B) which use Mistral3ForConditionalGeneration instead of AutoModelForCausalLM. Usage: lm_eval --model hf-mistral3 --model_args pretrained=mistralai/Ministral-3-3B-Instruct-2512-BF16,dtype=bfloat16 --tasks hellaswag --device cuda:0 --batch_size 8 ) annotationsN) TYPE_CHECKINGLiteral)register_model)HFLMz hf-mistral3csReZdZdZdZfddZ  ddddZ  ddddZedddZ Z S) Mistral3LMz Model adapter for Mistral3 models (Ministral-3 family). These models use Mistral3ForConditionalGeneration which is a vision-language model class, but can be used for text-only evaluation by ignoring the vision encoder. Nc sFz ddlm}||_Wn tytddwtjdi|dS)Nr) Mistral3ForConditionalGenerationzMistral3ForConditionalGeneration not found in transformers. Please install transformers >= 5.0.0 or from main: pip install git+https://github.com/huggingface/transformers) transformersrAUTO_MODEL_CLASS ImportErrorsuper__init__)selfkwargsr __class__r K/home/ubuntu/.local/lib/python3.10/site-packages/lm_eval/models/mistral3.pyr,s   zMistral3LM.__init__defaultFconfig7transformers.PretrainedConfig | transformers.AutoConfigbackend'Literal['default', 'causal', 'seq2seq']trust_remote_code bool | NonereturnNonecCsd|_tddS)z Override to force causal backend for Mistral3 models. Mistral3 models are decoder-only despite using a conditional generation class. causalz)Using backend 'causal' for Mistral3 modelN)r eval_loggerinfo)rrrrr r r _get_backend;s zMistral3LM._get_backendinps torch.Tensor attn_masktorch.Tensor | Nonelabelsc Cst4tj|jj|j|jdud||jWdWdS1s+wYWddS1s;wYdS)a Override to handle Mistral3 model output format. Mistral3ForConditionalGeneration returns logits in the same format as causal LMs, so we call the model directly but bypass the base class assertion that checks for AutoModelForCausalLM. N) device_typedtypeenabled)torchno_gradautocastdevicetypemixed_precision_dtypemodellogits)rr!r#r%r r r _model_callJs RzMistral3LM._model_callintcCs|jr|jSd}t|jjdr%|jjj}|D]}t||r$t||Sq|D]}t|jj|r9t|jj|Sq't|jdrJ|jjdkrJ|jjS|jS)z.Get the maximum sequence length for the model.)max_position_embeddings n_positionsn_ctx text_configmodel_max_lengthiʚ;) _max_lengthhasattrr/rr6getattr tokenizerr7_DEFAULT_MAX_LENGTH)rseqlen_config_attrsr6attrr r r max_lengthbs$    zMistral3LM.max_length)rF)rrrrrrrr)NN)r!r"r#r$r%r$rr")rr2) __name__ __module__ __qualname____doc__r rr r1propertyr? __classcell__r r rrr s   r)rC __future__rloggingtypingrrr)lm_eval.api.registryrlm_eval.models.huggingfacerr getLoggerr@rrr r r rs