o i @sUddlmZmZmZddlmZddlmZddlm Z ee Z edZ ee Z ee dfed<edZeeZeedfed <eGd d d Zd S) )AnyLiteralget_args)config) init_logger) safe_hash)CLSLASTMEAN.SEQ_POOLING_TYPES)ALLSTEPTOK_POOLING_TYPESc@seZdZUdZdZeeBdBed< dZedBed< dZ edBed< dZ e dBed< dZ e dBed< dZe dBed< dZe dBed < dZedBed < dZe dBed < dZee dBed < dddZd efddZd efddZd efddZdS) PoolerConfigz:Controls the behavior of output pooling in pooling models.N pooling_typeseq_pooling_typetok_pooling_typeuse_activation dimensionsenable_chunked_processing max_embed_len logit_bias step_tag_idreturned_token_idsreturncCsz|j}r;|jdurtd|jdurtd|tvr'td||||_dS|tvr7td||||_dSt|dS)Nz5Cannot set both `pooling_type` and `seq_pooling_type`z5Cannot set both `pooling_type` and `tok_pooling_type`z4Resolved `pooling_type=%r` to `seq_pooling_type=%r`.z4Resolved `pooling_type=%r` to `tok_pooling_type=%r`.) rr ValueErrorrr loggerdebugrNotImplementedError)selfrr H/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/config/pooler.py __post_init__^s2     zPoolerConfig.__post_init__cC|jdus Jd|jSNz!Should be resolved by ModelConfig)rrr r r!get_seq_pooling_typezz!PoolerConfig.get_seq_pooling_typecCr#r$)rr%r r r!get_tok_pooling_type~r'z!PoolerConfig.get_tok_pooling_typecCs g}tt|dd}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)rstrencode hexdigest)rfactorshash_strr r r! compute_hashszPoolerConfig.compute_hash)rN)__name__ __module__ __qualname____doc__rSequencePoolingTypeTokenPoolingType__annotations__rrrboolrintrrrfloatrrlistr"r&r(r*r/r r r r!rs4    rN)typingrrrvllm.config.utilsr vllm.loggerrvllm.utils.hashingrr0rr4r tupler6r5rrr r r r!s