o i @sUddlZddlmZddlmZddlmZddlmZddl m Z m Z ddl m Z mZmZmZddlmZdd lmZdd lmZeeZGd d d eeeZGd ddee eZeeBZeed<Gddde ZGddde ZdS)N) TypeAlias)Field) PoolingParams) ModelConfig)OpenAIBaseModel UsageInfo)ChatRequestMixinClassifyRequestMixinCompletionRequestMixinPoolingBasicRequestMixin) init_logger)TokenizeParams random_uuidc@&eZdZdedefddZddZdS)ClassificationCompletionRequest model_configreturncC,|jpi}t|jd|j|dd|jddSNr do_lower_caseF max_model_len)max_total_tokensmax_output_tokenstruncate_prompt_tokensradd_special_tokensmax_total_tokens_paramencoder_configr rrgetrselfrrr"`/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/entrypoints/pooling/classify/protocol.pybuild_tok_params  z0ClassificationCompletionRequest.build_tok_paramscCtd|j|jdSNclassify)taskruse_activationrrr*r!r"r"r#to_pooling_params( z1ClassificationCompletionRequest.to_pooling_paramsN__name__ __module__ __qualname__rr r$r-r"r"r"r#r rc@r)ClassificationChatRequestrrcCrrrr r"r"r#r$3r%z*ClassificationChatRequest.build_tok_paramscCr&r'r+r,r"r"r#r-?r.z+ClassificationChatRequest.to_pooling_paramsNr/r"r"r"r#r40r3r4ClassificationRequestc@s6eZdZUeed<edBed<eeed<eed<dS)ClassificationDataindexNlabelprobs num_classes)r0r1r2int__annotations__strlistfloatr"r"r"r#r6Ls    r6c@sbeZdZUedddZeed<dZeed<edddZe ed<eed <e e ed <e ed <d S) ClassificationResponsecCs dtS)Nz classify-rr"r"r"r#T zClassificationResponse.)default_factoryidr>objectcCs ttS)N)r;timer"r"r"r#rAVrBcreatedmodeldatausageN) r0r1r2rrDr=r<rErGr;r>r6rr"r"r"r#r@Ss    r@)rFtypingrpydanticrvllmr vllm.configr'vllm.entrypoints.openai.engine.protocolrr&vllm.entrypoints.pooling.base.protocolrr r r vllm.loggerr vllm.renderersr vllm.utilsrr0loggerrr4r5r<r6r@r"r"r"r#s*