o ۾i "@sdUddlmZddlmZmZmZmZddlZddlm Z m Z ddl m Z er4ddl mZmZmZmZneZeZeZeZGddde ZGd d d eZGd d d eZGd ddeZeeBeeBeBeBZeed< eeBeeBeBZeed< eeBeeBeBZeed< Gddde ZeeBZeed< eeBeBZ eed< eeBZ!eed< GdddeZ"Gddde Z#Gddde#Z$ d0deededBde$fd d!Z%Gd"d#d#e#Z& d0d$ej'dedBde&fd%d&Z(e$e&BeBZ)eed'< e$eBZ*eed(< e$eBZ+eed)< Gd*d+d+e Z,e)e,BZ-eed,< e)eBZ.eed-<eGd.d/d/Z/dS)1) dataclass) TYPE_CHECKINGAnyLiteral TypeAliasN) NotRequired TypedDict)SamplingParams)MultiModalDataDictMultiModalEncDecInputsMultiModalInputsMultiModalUUIDDictc@sXeZdZUdZeedBed< eeee fdBed< ee ed< eeed<dS)_PromptOptionszh Additional options available to all [`SingletonPrompt`][vllm.inputs.data.SingletonPrompt]. Nmulti_modal_datamm_processor_kwargsmulti_modal_uuids cache_salt) __name__ __module__ __qualname____doc__rr __annotations__dictstrrr rrD/home/ubuntu/.local/lib/python3.10/site-packages/vllm/inputs/data.pyrs   rc@seZdZUdZeed<dS) TextPromptzSchema for a text prompt.promptN)rrrrrrrrrrr=s rc@s>eZdZUdZeeed< eeed< eeeed<dS) TokensPromptzSchema for a tokenized prompt.prompt_token_idsrtoken_type_idsN) rrrrlistintrrrrrrrrDs   rc@s*eZdZUdZejed< eeed<dS) EmbedsPromptz2Schema for a prompt provided via token embeddings. prompt_embedsrN) rrrrtorchTensorrrrrrrrr#Qs   r#DecoderOnlyPrompt EncoderPrompt DecoderPromptc@s(eZdZUdZeed< edBed<dS)ExplicitEncoderDecoderPromptz Schema for a pair of encoder and decoder singleton prompts. Note: This schema is not valid for decoder-only models. encoder_promptNdecoder_prompt)rrrrr(rr)rrrrr*s  r*EncoderDecoderPromptSingletonPrompt PromptTypec@$eZdZUdZeed< eed<dS) DataPromptz Represents generic inputs that are converted to [`PromptType`][vllm.inputs.data.PromptType] by IO processor plugins. data data_formatN)rrrrrrrrrrrr1s r1c@seZdZUdZeeed<dS) _InputOptionsz: Additional options available to all input types. rN)rrrrrrrrrrrr4s  r4c@s,eZdZUdZeded< eeed<dS) TokenInputszRepresents token-based inputs.tokentyperN)rrrrrrr!r"rrrrr5s   r5rrreturncC td|d}|dur||d<|S)zQConstruct [`TokenInputs`][vllm.inputs.data.TokenInputs] from optional values.r6)r7rNr)r5)rrinputsrrr token_inputs r;c@s*eZdZUdZeded< ejed<dS) EmbedsInputsz#Represents embeddings-based inputs.embedsr7r$N)rrrrrrr%r&rrrrr=s   r=r$cCr9)zSConstruct [`EmbedsInputs`][vllm.inputs.data.EmbedsInputs] from optional values.r>)r7r$Nr)r=)r$rr:rrr embeds_inputsr<r?DecoderOnlyInputs EncoderInputs DecoderInputsc@r0)EncoderDecoderInputsa  A processed pair of encoder and decoder singleton prompts. [`InputPreprocessor`][vllm.inputs.preprocess.InputPreprocessor] which can be passed to [`InputProcessor`][vllm.v1.engine.input_processor.InputProcessor] for encoder-decoder models. encoderdecoderN)rrrrrArrBrrrrrCs rCProcessorInputsSingletonInputsc@s*eZdZUdZeed<dZedBed<dS)StreamingInputzInput data for a streaming generation request. This is used with generate() to support multi-turn streaming sessions where inputs are provided via an async generator. rNsampling_params)rrrrr/rrIr rrrrrH/s rH)N)0 dataclassesrtypingrrrrr%typing_extensionsrrvllm.sampling_paramsr vllm.multimodal.inputsr r r r objectrrrr#rr!r"r'rr(r)r*r-r.r/r1r4r5r;r=r&r?r@rArBrCrFrGrHrrrrsz #