o ]iU @sFddlZddlmZddlZddlmZddlmZddlm Z ddl m Z m Z ddl mZddlmZeZhd Zejd efd d ZGd ddeZejdejfddZejdedejdejdejfddZejdedejfddZej d%dedejdefddZejded ejfd!d"Zej Gd#d$d$e!ZdS)&N)IntEnum) err_checkget_display_rotation) check_ndarray) get_pix_fmtget_video_format VideoPlane)uint8_t>Tabgrargbbgr8bgragbrpgraynv12pal8rgb8rgbabgr24gbrapgray8rgb24bgr48bebgr48legbrp9begbrp9legray9begray9lergb48bergb48leyuv420pyuv444pyuyv422bgra64bebgra64legbrp10begbrp10legbrp12begbrp12legbrp14begbrp14legbrp16begbrp16legray10begray10legray12begray12legray14begray14legray16begray16lergba64bergba64lergbf32bergbf32leyuvj420pyuvj444p gbrap10be gbrap10le gbrap12be gbrap12le gbrap14be gbrap14le gbrap16be gbrap16le gbrpf32be gbrpf32le grayf32be grayf32le rgbaf16be rgbaf16le rgbaf32be rgbaf32le gbrapf32be gbrapf32le bayer_bggr8 bayer_gbrg8 bayer_grbg8 bayer_rggb8 yuv422p10le yuv444p16be yuv444p16le yuva444p16be yuva444p16lebayer_bggr16bebayer_bggr16lebayer_gbrg16bebayer_gbrg16lebayer_grbg16bebayer_grbg16lebayer_rggb16bebayer_rggb16lereturncCsttS)zGet a mostly uninitialized VideoFrame. You MUST call VideoFrame._init(...) or VideoFrame._init_user_attributes() before exposing to the user. ) VideoFrame_cinit_bypass_sentinelrcrcB/home/ubuntu/.local/lib/python3.10/site-packages/av/video/frame.pyalloc_video_framegrec@s<eZdZejZejZejZ ej Z ej Z ejZejZejZdS) PictureTypeN)__name__ __module__ __qualname__libAV_PICTURE_TYPE_NONENONEAV_PICTURE_TYPE_IIAV_PICTURE_TYPE_PPAV_PICTURE_TYPE_BBAV_PICTURE_TYPE_SSAV_PICTURE_TYPE_SISIAV_PICTURE_TYPE_SPSPAV_PICTURE_TYPE_BIBIrcrcrcrdrgrs rg big_endiancCstjdk|kr |S|S)Nbig)sys byteorderbyteswap)arrayr|rcrcrdbyteswap_array}srplanebytes_per_pixelflip_horizontal flip_verticalcCs|}d}|j|}|}d} t|j} ttj\} } } |r'|jd} d} d} nd} |j} d} t| | | D]=}||}|r_td||D]}t|D]}|||||||| ||<qHqBn|||||| | |<| | 7} q4dS)Nr)widthabs line_sizecythondeclareintheightrange) img_bytesrrrri_bufi_posi_strideo_bufo_poso_stride start_rowend_rowsteprowijrcrcrdcopy_bytes_to_planes6     rcCs|}t|||dddS)NF)tobytesr)rrrimgbytesrcrcrdcopy_array_to_planesrruint8dtypecCsdddl}t|j}|j|}|||j}||kr*|d|ddd|fd}|||S)z Return the useful part of the VideoPlane as a single dimensional array. We are simply discarding any padding which was added for alignment. rNr) numpyrrr frombufferrreshapeviewr)rrrnptotal_line_sizeuseful_line_sizearrrcrcrd useful_arrays  "rrokcCs|s td|jddS)NzUnexpected numpy array shape ``) ValueErrorshape)rrrcrcrdcheck_ndarray_shapesrc@speZdZd?ddZejdejdejdejfdd Z ejd d Z d d Z ddZ e ddZe ddZe ddZe ddZe ddZe ddZejddZe ddZejddZe d d!Zejd"d!Zd#d$Zd%d&Zejd'efd(d)Zd*d+Zd@d-d.Zd/d0Zed1d2Z edAd4d5Z!d6d7Z"edBd8d9Z#e : , ,dCd;e$de%de%fdS)Drarr"cCs&|turdSt|}||||dSN)rbr_init)selfrrformatc_formatrcrcrd __cinit__szVideoFrame.__cinit__rrrc Csd}tj-||j_||j_||j_|r+|r+t|jj|jj |||d}|jjd|_ Wdn1s5wY|r@t || dS)Nr) rnogilptrrrrrkav_image_allocdatalinesize_bufferr_init_user_attributes)rrrrresrcrcrdrs  zVideoFrame._initcCs(tttj|jj|jj|jj|_dSr) rrcastrk AVPixelFormatrrrrrrcrcrdrs  z VideoFrame._init_user_attributescCstt|jd|_dSr)rkav_freepraddressr _np_bufferrrcrcrd __dealloc__s zVideoFrame.__dealloc__c Cs>d|jjd|jd|jjd|jd|jdt|dd S)Nz) __class__rhptsrnamerridrrcrcrd__repr__szVideoFrame.__repr__csd}tjjjD]}jjj|jd}||kr|}q jjdkr$d}d}||kr>jj|r>|d7}||kr>jj|s0tfddt|DS)z: A tuple of :class:`.VideoPlane` objects. rrrcsg|]}t|qSrcr ).0rrrcrd sz%VideoFrame.planes..) rrr nb_componentscomprr extended_datatuple)rmax_plane_countrcount plane_countrcrrdplaness zVideoFrame.planescC|jjS)zWidth of the image, in pixels.)rrrrcrcrdrzVideoFrame.widthcCr)zHeight of the image, in pixels.)rrrrcrcrdrrzVideoFrame.heightcCst|S)zThe rotation component of the `DISPLAYMATRIX` transformation matrix. Returns: int: The angle (in degrees) by which the transformation rotates the frame counterclockwise. The angle will be in range [-180, 180]. rrrcrcrdrotationrfzVideoFrame.rotationcCst|jjtj@S)z+Is this frame an interlaced or progressive?)boolrflagsrkAV_FRAME_FLAG_INTERLACEDrrcrcrdinterlaced_frame'szVideoFrame.interlaced_framecCr)zReturns an integer that corresponds to the PictureType enum. Wraps :ffmpeg:`AVFrame.pict_type` :type: int r pict_typerrcrcrdr-rfzVideoFrame.pict_typecC ||j_dSrrrvaluercrcrdr7 cCr)zKColorspace of frame. Wraps :ffmpeg:`AVFrame.colorspace`. r colorspacerrcrcrdr;zVideoFrame.colorspacecCrrrrrcrcrdrDrcCr)zMColor range of frame. Wraps :ffmpeg:`AVFrame.color_range`. r color_rangerrcrcrdrHrzVideoFrame.color_rangecCrrrrrcrcrdrQrcOs(|jst|_|jj|g|Ri|S)areformat(width=None, height=None, format=None, src_colorspace=None, dst_colorspace=None, interpolation=None) Create a new :class:`VideoFrame` with the given width/height/format/colorspace. .. seealso:: :meth:`.VideoReformatter.reformat` for arguments. ) reformatterVideoReformatterreformat)rargskwargsrcrcrdrUszVideoFrame.reformatcKs|jdddi|S)a Get an RGB version of this frame. Any ``**kwargs`` are passed to :meth:`.VideoReformatter.reformat`. >>> frame = VideoFrame(1920, 1080) >>> frame.format.name 'yuv420p' >>> frame.to_rgb().format.name 'rgb24' rrNrc)r)rrrcrcrdto_rgbas zVideoFrame.to_rgbfilepathcCs|drd}n|ds|drd}ntd|rdnd}|r#d nd }d d lm}||d ddid,}|j||d}|j|_|j|_|||j |d||dWddS1scwYdS)zPSave a VideoFrame as a JPG or PNG. :param filepath: str | Path z.pngFz.jpgz.jpegTz"filepath must end with png or jpg.mjpegpngr;rr)openwupdate1)options)pix_fmt)rN) endswithrav.container.corer add_streamrrmuxencoder)rris_jpgencoderrroutput output_streamrcrcrdsaveos    "zVideoFrame.savec Ksddlm}|jd ddi|jd}|}d}|j}d}|jd}|j|} t| } || krH||||| |||<||7}||7}|| ks.|d|j|jft | ddddS) zGet an RGB ``PIL.Image`` of this frame. Any ``**kwargs`` are passed to :meth:`.VideoReformatter.reformat`. .. note:: PIL or Pillow must be installed. r)ImagerrRGBrawrNrc) PILrrrrrr bytearray frombytesbytes) rrrrrrrrro_sizerrcrcrdto_images"   zVideoFrame.to_imageFc s|jdii|ddl}jjdvr(jddksJdjddks(Jdiddd dd d d d d d dd ddddddddddddddddddddddidd dddd d!d d"d d#dd$dd%dd&dd'dd(dd)dd*dd+d,d-d,d.d d/did0dd1dd2dd3dd4dd5dd6dd7dd8dd9d,d:d,d;d ddd?dd@didAddBddCddDd dEddFddGd,dHd,dIddJddKddLd dMddNd dOd dPdQdRdQdSdSdTdTd ddddd dUdV jjdW\durfdXdYjD}t|dZkr/|d}n|j |dd[}t |jj d\}|j ddZkrM| dSjjd]r|dddddf}|dddddf|dddddf<|dddddZf|dddddf<||dddddZf<|sjjd^vr||dd}|Sjjd_vr|tjdtjdZtjdgd`jSjjdakr*tjdddbjj}tjdZddbjjd}tjdddbjjd} |j|ddZd[} |j| ddZd[} |r |j|| | gdd[S|j|| | gdd[SjjdckrVtjdjj} |jdZddded`dZ|j} | | fSjjdfkrt|tjdtjdZdgd`jStdgjjdh)jaIGet a numpy array of this frame. Any ``**kwargs`` are passed to :meth:`.VideoReformatter.reformat`. The array returned is generally of dimension (height, width, channels). :param bool channel_last: If True, the shape of array will be (height, width, channels) rather than (channels, height, width) for the "yuv444p" and "yuvj444p" formats. .. note:: Numpy must be installed. .. note:: For formats which return an array of ``uint16``, ``float16`` or ``float32``, the samples will be in the system's native byte order. .. note:: For ``pal8``, an ``(image, palette)`` tuple will be returned, with the palette being in ARGB (PyAV will swap bytes if needed). .. note:: For ``gbrp`` formats, channels are flipped to RGB order. rN>r"yuv422pr$r;rSrz.the width has to be even for this pixel formatz/the height has to be even for this pixel formatr )rr rOrrrPrQrRrY)ruint16rXr[rZr]r\r_r^r)rrr)rrrrr%)rr&rr=r>r?r@rArBrCrDrM)rfloat32rNrr'r(r)r*r+r,r-r.rrrErFrr/r0r1r2r3r4r5r6rrrrGrHrr r!rrr7r8rI)rfloat16rJ)rr) r)rr) rKrLr9r:r#rTrUrVrWr<r$)NNcs&g|]}t|jjdqS)r)rrrr)rplanrframeitemsizercrdr%s  z)VideoFrame.to_ndarray..raxisbegbrr#r<>r"rr;rrSrri4>i4rz'Conversion to numpy array with format `` is not yet supportedrc)rrrrrrgetrlen concatenaterrrsqueeze startswithcopymoveaxishstackrrrepeatstackrastyperrr)r channel_lastrrlayersrbufferyuvu_fullv_fullimagepalettercrrd to_ndarrays       !"#$%&'()*+,-./0123456789:;<=>?@ABCDE P Q  ((        zVideoFrame.to_ndarraycCs*|jdkr |d}t||jdddS)z6 Update content from a ``PIL.Image``. rrrN)modeconvertrr)rimgrcrcrd set_imageks  zVideoFrame.set_imagecCs&t|jd|jdd}|||S)z9 Construct a frame from a ``PIL.Image``. rrr)rasizer>)r=rrcrcrd from_imagets zVideoFrame.from_imagercCs ddl}|jd}|s|jd}|dvr9t|ddt||jddk|jdddkr1td |jdf}n|d vrbt|d dt||jddk|jddd krZtd |jdf}n|d vrt|ddt||jddk|jdddkrtd |jdf}n|dvrt|ddt||jddk|jdddkrtd |jdf}n|dvrt|d dt||jddk|jdddkrtd |jdf}nw|dvrt|ddt||jddk|jdddkrtd |jdf}nM|dvr2t|ddt||jddk|jdddkr*td |jdf}n"|dvrQt|dd|jddkrItd |jdf}n|dvrpt|d d|jddkrhtd |jdf}n|dvrt|dd|jddkrtd |jdf}n|dvrt|ddt||jddk|jdddkrtd |jdd|jdd|jddf}n|dvrt|d dt||jddk|jddd krtd |jdd|jdd|jddf}nS|dvr:t|ddt||jddk|jdddkr$td |jdd|jdd|jddf}n|dvrxt|ddt||jddk|jdddkr]td |jdd|jdd|jdd|jddf}n|d vrt|d dt||jddk|jdddkrtd |jdd|jdd|jdd|jddf}n|d!vrt|ddt||jddk|jdddkrtd |jdd|jdd|jdd|jddf}n`|d"vrLt|ddt||jdddkt||jdddk|d#d}|jddkr)td |d$vrA|jd|jdd|jddf}n|jd|jdf}ntd%|d&|d'rk|||d(gd)fd*d}n|d+r|||d(gd,fd*d}t t }| ||||||S)-a Construct a frame from a numpy buffer. :param int width: optional width of actual image, if different from the array width. .. note:: For formats which expect an array of ``uint16``, ``float16`` or ``float32``, the samples must be in the system's native byte order. .. note:: for ``gbrp`` formats, channels are assumed to be given in RGB order. .. note:: For formats where width of the array is not the same as the width of the image, for example with yuv420p images the UV rows at the bottom have padding bytes in the middle of the row as well as at the end. To cope with these, callers need to be able to pass the actual width. rNrrrrrr)rrz.provided array does not have C_CONTIGUOUS rowsrrr r!r)rrr9r:r)rrr r rrr)rrr%r&r7r8)rrrIrJrrKrL)rr>rrrrrOrPrQrR>rrr/r0r1r2r3r4r5r6rXrYrZr[r\r]r^r_>rGrH>r> rrr'r(r)r*r+r,r-r.>rErF>r>r=r>r?r@rArBrCrD>rMrN>rr"r;rr"r;)Conversion from numpy array with format `r$r.)rrrrrr)rrr) rrrrstridesrr)ascontiguousarrayr+rarb_image_fill_pointers_numpy)rrrrr linesizesrrcrcrdfrom_numpy_buffer~s                                                          "  zVideoFrame.from_numpy_bufferc Cs|jj}ttjt|}t|}tt |j ||_ ||j _ ||j _||j _t|D] \} } | |j j| <q-t|j jttj|j j |j j||j j} | rTt| |dSr)ctypesrrrpointerr rrkrrrrrrrr enumeraterav_image_fill_pointersrrr) rr2rrrMrc_datac_ptrrrrrrcrcrdrL[s( z%VideoFrame._image_fill_pointers_numpyc Cs ddl}iddddddddd dd dd dd dd dddddddddddddddddiddddddddddddddd d!d"d#d$d#d%d#d&d#d'd#d(d#d)d#d*d#d+d#id,d#d-d.d/d.d0dd1dd2dd3dd4dd5dd6dd7dd8dd9dd:dd;ddd=dd!d#d#ddd!d?|d@\}}}|durI|jdAkr|dddddf}t||dB|s|dCvr||ddA}t||jdA|kt||dD}t |jdE|jd|}|j j dFr-|j |dddddEdBf|ddddddEf|dddddBdfgdAdG}t|D]}t|dddd|f|j||q1|S|dHkr|\}} t|dIdAt| dIdAt| | jdJkt |jdE|jd|}t||jddE|jdE| dKdL|S|dMvrt|dIdAt||jddBdkt||jdEdAdkt |jdE|jddAdB|}|j|j} dN| dO} |dP} t| d| |jddEt| | | |jdEdEt| | d|jdAdE|S|dQkret|dIdAt||jddOdkt||jdEdAdkt |jdE|jddA|}|j|j} | | dA} |dP} t| d| |jddEt| | | |jdEdEt| | d|jdAdE|S|dRkrt||jrx|j|jkr|tdS|r|jdAdBkr||dAd}n |jddBkstdT|jdEd\} }|dAdks| dAdkrtdUt || |}t|d|jddA|dEdddddAf}|dAdddddAf}t||jdEdAt||jdAdA|S|dVkr&t|dIdBt||jddAdkt||jdEdAdkt||jdAdAkn|dWvr=t|dIdBt||jdAdBkns|dXvrTt|dIdBt||jdAdOkn\|dYvrt|dZdBt||jdAdBkt |jdE|jd|}tt||dD|jdd[|S|d\vrt|d]dBt||jdAdBkt |jdE|jd|}tt||dD|jdd^|S|d_vrt|dZdBt||jdAdOkt |jdE|jd|}tt||dD|jdd`|S|davrt|dbdBt||jdAdOkt |jdE|jd|}tt||dD|jdd`|S|dcvrNt|d]dBt||jdAdOkt |jdE|jd|}tt||dD|jddd|S|dekrt|dIdAt||jddBdkt||jdEdAdkt |jdE|jddAdB|}|j|j}|dP} t| d||jddEt| |d|jdEdA|Stdf|dgt |jdE|jd|}t||jd|jdAkrdE|S|jdA|S)ha Construct a frame from a numpy array. :param bool channel_last: If False (default), the shape for the yuv444p and yuvj444p is given by (channels, height, width) rather than (height, width, channels). .. note:: For formats which expect an array of ``uint16``, ``float16`` or ``float32``, the samples must be in the system's native byte order. .. note:: for ``pal8``, an ``(image, palette)`` pair must be passed. `palette` must have shape (256, 4) and is given in ARGB format (PyAV will swap bytes if needed). .. note:: for ``gbrp`` formats, channels are assumed to be given in RGB order. rNrX)rrrrYrO)rrrrZr[rPr\r]rQr^r_rRrr)rrrr=)rrrr>r?r@rArBrCrDrM)rrrrNr)rrrr')rrrr(r)r*r+r,r-r.rrrE)rrrrFrr/r0r1r2r3r4r5r6rrrrG)rrrrH)rr#rTrUrVrWr<)NNNrrr!rrr rrr)rr#r"rHrrrrSzArray must be uint16 typez>Array must have shape (3, height, width) or (height, width, 3)zWidth and height must be evenr$rArDrBrrrCrrrErrFrrGrrrIr$)rr%ndimrr+rrrrrarrr)r'rrrrrr/rrrr isinstancendarrayrrrr*)rrr0rchannelsrrrrr9u_startv_startflatrrr4r5uv_startrcrcrd from_ndarrays      !"#$%&'()*+,-./01234; <    (                                       zVideoFrame.from_ndarrayrrcCsnt|||}|dkrt||jdd|||S|dvr/t||jd|dr(dnd|||Std|d ) Nrrr> rOrPrQrRrXrYrZr[r\r]r^r_8rrzFormat 'z' is not supported.)rarrrNotImplementedError)rrrrrrrrcrcrd from_bytesvs  zVideoFrame.from_bytesN)rrr")F)rr)rF)rFF)'rhrirjrrcfuncrkruintrrrrpropertyrrrrrrsetterrrrrccallobjectrrr:r> staticmethodr@rNrLr_r rrbrcrcrcrdrast               C  ]. mrar)"r~enumrrcython.cimports.av.errorr$cython.cimports.av.sidedata.sidedatarcython.cimports.av.utilsrcython.cimports.av.video.formatrrcython.cimports.av.video.planer cython.cimports.libc.stdintr rhrbsupported_np_pix_fmtsrcrarergbintrrdrrstrrrcclassFramercrcrcrdsR      X   &