o ۷i"@sdZddlZddlmZmZddlZddlmZddl m Z m Z m Z ddl mZmZddlmZmZmZmZmZmZdd lmZdd lmZmZd d lmZGd dde ZeGdddeZdgZ dS)z%Fast Image processor class for OWLv2.N)OptionalUnion) functional)BaseImageProcessorFast BatchFeatureDefaultFastImageProcessorKwargs)group_images_by_shapereorder_images)OPENAI_CLIP_MEANOPENAI_CLIP_STDChannelDimension ImageInputPILImageResamplingSizeDict)Unpack) TensorTypeauto_docstring)OwlViTImageProcessorFastc@s eZdZdS)Owlv2FastImageProcessorKwargsN)__name__ __module__ __qualname__rr]/home/ubuntu/vllm_env/lib/python3.10/site-packages/transformers/models/owlv2/modular_owlv2.pyr-s rc@sHeZdZejZeZeZ dddZ dZ dZ dZ dZdZeZdZdZdeefddZed edeefd d Zd&d d dedd fddZ d&d ed deededed fddZ  d'dd dededd fddZ d ed dedededdededed ed!ee!eeefd"ee!eeefdeed#ee!e"e#fde$fd$d%Z%dS)(Owlv2ImageProcessorFasti)heightwidthgp?TNkwargscKstj|fi|dSN)r__init__)selfrrrrr!?sz Owlv2ImageProcessorFast.__init__imagescKstj||fi|Sr )r preprocess)r"r#rrrrr$Bsz"Owlv2ImageProcessorFast.preprocess?z torch.Tensorconstant_valuereturnc CsL|jdd\}}t||}||}||}dd||f}tj|||d} | S)z< Pad an image with zeros to the given size. Nr)fill)shapemaxFpad) r"r#r&rrsize pad_bottom pad_rightpadding padded_imagerrr _pad_imagesFs  z#Owlv2ImageProcessorFast._pad_imagesdisable_groupingc KsJt||d\}}i}|D]\}} |j| |d} | ||<qt||} | S)z Unlike the Base class `self.pad` where all images are padded to the maximum image size, Owlv2 pads an image to square. r4)r&)r itemsr3r ) r"r#r4r&rgrouped_imagesgrouped_images_indexprocessed_images_groupedr*stacked_imagesprocessed_imagesrrrr-Ss   zOwlv2ImageProcessorFast.padimager. anti_aliasingc Ks|j|jf}|j}t|dd|jt||j}|r}|dur0|ddjdd}n%t|t |}t |dkrEt dt |dk|dk@rUt dt |dkr_|} n dtd|d} tj|| d| df|d } n|} tj| |j|jfd d } | S) az Resize an image as per the original implementation. Args: image (`Tensor`): Image to resize. size (`dict[str, int]`): Dictionary containing the height and width to resize the image to. anti_aliasing (`bool`, *optional*, defaults to `True`): Whether to apply anti-aliasing when downsampling the image. anti_aliasing_sigma (`float`, *optional*, defaults to `None`): Standard deviation for Gaussian kernel when downsampling the image. If `None`, it will be calculated automatically. rNr)minzFAnti-aliasing standard deviation must be greater than or equal to zerozWAnti-aliasing standard deviation greater than zero but not down-sampling along all axesr)sigmaF)r. antialias)rrr*torchtensortodeviceclamp atleast_1d ones_likeany ValueErrorwarningswarnceilintr, gaussian_blurtolistresize) r"r<r.r=anti_aliasing_sigmar output_shape input_shapefactorsfiltered kernel_sizesoutrrrrQks, ,zOwlv2ImageProcessorFast.resize do_resize interpolationzF.InterpolationModedo_pad do_rescalerescale_factor do_normalize image_mean image_stdreturn_tensorsc  Ks"t|| d\}}i}|D]\}}||||d| | }|||<qt||}|r0|j|d| d}t|| d\}}i}|D]\}}|rR|j|||tjd}|||<q>t||}t|| d\}}i}|D]\}}||d||| | }|||<qft||}| rtj |ddn|}t d|i| d S) Nr5Fr%)r&r4)r<r.rZinput_data_formatr)dim pixel_values)data tensor_type) r r6rescale_and_normalizer r-rQr FIRSTrBstackr)r"r#rYr.rZr[r\r]r^r_r`r4rarr7r8r9r*r:r;resized_images_grouped resized_stackresized_imagesrrr _preprocesssF        z#Owlv2ImageProcessorFast._preprocess)r%)TN)&rrrrBILINEARresampler r_r r`r.r]rYr\r^r[r valid_kwargs crop_sizedo_center_croprr!rrr$floatr3listrboolr-rrQrstrrrrmrrrrr0s   8     r)!__doc__rKtypingrrrBtorchvision.transforms.v2rr,image_processing_utils_fastrrrimage_transformsr r image_utilsr r r rrrprocessing_utilsrutilsrr#owlvit.image_processing_owlvit_fastrrr__all__rrrrs      4