o ٷiv@sdZddlmZddlZddlZddlZddlmZddlm Z ddl Z ddl Z ddl mZd(d dZd)ddZd*ddZd+ddZd,ddZd-d!d"Zd.d&d'ZdS)/zE Shared helper utilities for OpenAI-compatible video generation API. ) annotationsN)BytesIO)Any)Imageinput_reference str | Noneinput_reference_bytes bytes | NonereturnImage.Image | Nonec Cs|r|rtd|rtt|dS|rI|dr$|dd\}}n|}zt|}Wnt y>}ztd|d}~wwtt|dSdS)z;Decode image input from multipart bytes or base64/data URL.zBProvide input_reference either as file upload or base64, not both.RGBz data:image,zInvalid base64 input_reference.N) ValueErrorropenrconvert startswithsplitbase64 b64decode Exception)rr_b64_data image_bytesexcr`/home/ubuntu/.local/lib/python3.10/site-packages/vllm_omni/entrypoints/openai/video_api_utils.pydecode_input_references   r video_tensor torch.Tensor np.ndarraycCs|}|dkrtd|dkr%|jddvr%|dddd}|r4|d dd d }n|t j d }| }t |S) zINormalize a torch video tensor into a numpy array of frames (F, H, W, C).zBBatched video tensors are not supported for single-video encoding.rr"rr$?o@) detachcpudimrshapepermuteis_floating_pointclamptotorchfloat32numpy_normalize_single_video_array)r video_arrayrrr_normalize_video_tensor's  r6r5cCs|jdkr td|jdkr7|jddvr#|jddvr#t|d}n|jddvr7|jddvr7t|d }t|jtjrX|d ksK| d krVt |d d d d }|St|jtj rh| tj d}|S)z7Normalize a single video array into shape (F, H, W, C).r!zABatched video arrays are not supported for single-video encoding.r"rr#r&)rr%r$rr)rr%r$r?r'r()ndimrr,np transpose issubdtypedtypefloatingminmaxclipintegerastyper2r5rrrr48s   r4list[np.ndarray] | np.ndarraycs.jdkrfddtjdDStS)zNormalize a numpy video array into shape (F, H, W, C). If a batch dimension is present, returns a list of per-video arrays. r!csg|]}t|qSr)r4).0irErr Rsz*_normalize_video_array..r)r:ranger,r4rErrEr_normalize_video_arrayLs rKframes list[Any]list[np.ndarray]cCsg}|D]}}t|tjr|}nt|tjr!t|}nt|tj r*|}n t dt ||j dkrL|j ddvrL|j ddvrLt|d}t|jtjrl|dks`|dkrkt|d dd d }nt|jtjr||tjd }||q|S) zBNormalize a list of frames into numpy arrays with values in [0,1].zUnsupported frame type: r$rr#r&)rr%rr7r8r9r'r() isinstancer1Tensorr)r*r3rr;arrayndarrayrtyper:r,r<r=r>r?r@rArBrCrDr2append)rL normalizedframe frame_arrayrrr_normalize_framesVs&    &  rXvideorcCst|tjrt|}t|St|tjr:t|}t|tr!td|j dkr*t|S|j dkr2|gStd|j t|tra|sCgSt dd|Dr]t dd|DrYtdt |Std td t |) zBConvert a video payload into a list of frames for export_to_video.z3Batched video arrays must be split before encoding.r"r$zUnsupported video array shape: css&|]}t|tjtjtjfVqdS)N)rOr;rRr1rPrrGitemrrr s$z*_coerce_video_to_frames..css$|] }t|do |jdkVqdS)r:r"N)hasattrr:rZrrrr\s"zs"