o ٷi& @sUddlZddlZddlmZmZmZddlmZmZddl m Z ddl m Z ddl mZzddlmZWneyDddlmZYnwddlZddlmZmZmZmZGd d d eZGd d d eZGd ddeZGdddeZeeeBeBeBeBZee d< e eBeBeBZ!ee d<    ddeededBdedBdej"dBde#eefdBdef ddZ$eGdddZ%e e%BZ&ee d<dS)N)asdict dataclassfield)Any TypeAlias) PromptType)SamplingParams) LoRARequest) NotRequired) EmbedsPrompt TextPrompt TokenInputs TokensPromptc@sNeZdZUdZeeed<eejed<eejed<ee ee fed<dS)OmniTextPromptaText prompt with optional embeddings and additional information. Extends TextPrompt to support prompt embeddings and additional information payloads for direct transfer between pipeline stages. Attributes: prompt_embeds: Optional tensor containing prompt embeddings additional_information: Optional dictionary containing additional information (tensors or lists) to pass along with the prompt negative_prompt prompt_embedsnegative_prompt_embedsadditional_informationN) __name__ __module__ __qualname____doc__r str__annotations__torchTensordictrrrI/home/ubuntu/.local/lib/python3.10/site-packages/vllm_omni/inputs/data.pyrs  rc@sXeZdZUdZeeed<eejed<ee ejdBed< ee ee fed<dS)OmniTokensPromptaTokens prompt with optional embeddings and additional information. Extends TokensPrompt to support prompt embeddings and additional information payloads for direct transfer between pipeline stages. Attributes: prompt_embeds: Optional tensor containing prompt embeddings additional_information: Optional dictionary containing additional information (tensors or lists) to pass along with the prompt rrNrr rrrrr rrrrlistrrrrrrr(s  rc@sVeZdZUdZeeed<eejed<ee ejdBed<ee ee fed<dS)OmniTokenInputsaToken inputs with optional embeddings and additional information. Extends TokenInputs to support prompt embeddings and additional information payloads for direct transfer between pipeline stages. Attributes: prompt_embeds: Optional tensor containing prompt embeddings aligned with token IDs additional_information: Optional dictionary containing additional information (tensors or lists) to pass along with the inputs rrNrrr rrrrr">s  r"c@sJeZdZUdZeejed<eeejdBed<ee e e fed<dS)OmniEmbedsPromptaEmbeddings prompt with optional additional information. Extends EmbedsPrompt to support additional information payloads for direct transfer between pipeline stages. Attributes: prompt_embeds: Optional tensor containing prompt embeddings additional_information: Optional dictionary containing additional information (tensors or lists) to pass along with the prompt rNrr) rrrrr rrrr!rrrrrrrr#Us  r#OmniSingletonPromptOmniPromptTypeprompt_token_idsprompt cache_saltrrreturncCsPtd|d}|dur||d<|dur||d<|dur||d<|dur&||d<|S)asConstruct token inputs with optional embeddings and metadata. Creates an OmniTokenInputs object with token IDs and optional embeddings and additional information for pipeline stage transfer. Args: prompt_token_ids: List of token IDs for the prompt prompt: Optional prompt string cache_salt: Optional cache salt for prefix caching prompt_embeds: Optional tensor containing prompt embeddings additional_information: Optional dictionary containing additional information (tensors or lists) Returns: OmniTokenInputs instance with the provided data token)typer&Nr'r(rr)r")r&r'r(rrinputsrrrtoken_inputs_omniss r-c@seZdZUdZdZedBed<dZee e fdBed<dZ e ed<dZ eed<dZedBed <dZejeejBdBed <dZe dBed <d Zeed <dZe ed<dZe ed<dZeed<dZe ed<dZejdBed<dZejdBed<dZejdBed<dZejdBed<dZeeeBdBed<dZeeeBdBed<dZ eed<dZ!e ed<dZ"edBed<dZ#edBed<dZ$edBed<dZ%e ed<dZ&e ed<dZ'ejdBed <dZ(eje)BeBdBed!<dZ*edBed"<dZ+e)dBed#<d$Z,eed%<d&Z-e)ed'<dZ.e ed(<dZ/e)dBed)<d&Z0e)ed*<d&Z1e)ed+<dZ2ee)dBed,<dZ3e)dBed-<dZ4edBed.<e5ed/Z6ee e fed0<dZ7e dBed1<dZ8ee e fdBed2<d3Z9e ed4<e5ed/Z:ee e fed5<dZ;e ed6<dZejdBed9<e5ed/Z?ee e fed:<d3Z@e ed;<dZAe ed<<dZBeCdBed=<d>ZDe)ed?<dZEedBed@<dZFe edA<dZGeedBedB<dZHeedBedC<d&ZIe)edD<dZJe edE<dFZKeedG<dZLe edH<dZMejdBedI<eNdJdKZOdLdMZPdQdOdPZQdS)ROmniDiffusionSamplingParamsa The collection of sampling parameters passed to diffusion pipelines. This dataclass contains all information needed during the diffusion pipeline execution, allowing methods to update specific components without needing to manage numerous individual parameters. Nmax_sequence_lengthprompt_templateFdo_classifier_free_guidancenum_outputs_per_promptseed generatorgenerator_devicelayers cfg_normalize use_en_prompti resolutionis_prompt_processedlatentsraw_latent_shape noise_pred image_latentheight_latents width_latents num_framesnum_frames_round_downheightwidthfpsheight_not_providedwidth_not_provided timestepstimestep step_indexboundary_ratio2num_inference_stepsgguidance_scaleguidance_scale_providedguidance_scale_2guidance_rescaleetasigmastrue_cfg_scalen_tokens)default_factoryextra_step_kwargspast_key_values kv_metadataTneed_kv_receivemodulesreturn_trajectory_latentsreturn_trajectory_decodedtrajectory_timestepstrajectory_latents extra_args save_output return_frames lora_requestg? lora_scale STA_paramis_cfg_negativemask_search_final_result_posmask_search_final_result_neg VSA_sparsityprofilenum_profiled_timestepsdebugoutputcCs|jSN)r3selfrrr batch_sizesz&OmniDiffusionSamplingParams.batch_sizecCstjt|dddS)Nx)indentrF)pprintpformatrrrrrr__str__sz#OmniDiffusionSamplingParams.__str__r)cCs t|Srq)copydeepcopyrrrrrclones z!OmniDiffusionSamplingParams.clone)r)r.)Rrrrrr/intrr0rrrr1boolr3r4r5r Generatorr!r6r8r9r:r;r<r=rr>r?r@rArBrCrDrErFrGrHrIrJrKfloatrLrMrOrPrQrRrSrTrUrVrWrrYrZr[r\r]r^r_r`rarbrcrdrer rfrgrhrirjrkrlrnrorppropertyrtrzr}rrrrr.s                              r.OmniSamplingParams)NNNN)'r{rx dataclassesrrrtypingrr vllm.inputsrvllm.sampling_paramsrvllm_omni.lora.requestr r ImportErrortyping_extensionsrvllm.inputs.datar r r rrrr"r#rr!r~r$rr%rrr-r.rrrrrsT       %