o Qi@sfddlZddlmZddlZddlZddlZddlZdZddZ de e e e e Bde fdd Z dS) N)BytesIOi>cCs&t|}dd|jD}|sdSdS)NcSsg|] }|jdkr|qS)audio)type).0streamrV/home/ubuntu/.local/lib/python3.10/site-packages/qwen_omni_utils/v2_5/audio_process.py sz-_check_if_video_has_audio..FT)avopenstreams) video_path container audio_streamsrrr_check_if_video_has_audio s r conversationsuse_audio_in_videoc Csjg}t|dtr |g}|D]}|D]}t|dtsq|dD]}|ddkrd|vs3d|vr|d|d}|dd}|dd }t|tjro|jd krWtd ||t t ||d ured nt t |q"| d r| d d \} } t t| } n| ds| drtj|} n{| dr|tdd } nm|} njtd||r|ddkrd|vsd|vr|d|d}|dd}|dd }t|sJd| ds| drtj|} n"| drtj|tdd } ntj|} ntd|q"|tj| t ||d ur ||nd ddq"qqt|dkr3d }|S)z Read and process audio info Support dict keys: type = audio - audio - audio_start - audio_end type = video - video - video_start - video_end rcontentrr audio_url audio_startg audio_endNzSupport only mono audioz data:audiozbase64,zhttp://zhttps://zfile://zUnknown audio {}video video_url video_start video_endz7Video must has audio track when use_audio_in_video=TruezUnknown video {})sroffsetduration) isinstancedictlistgetnpndarrayndim ValueErrorappendint SAMPLE_RATE startswithsplitrbase64 b64decode audioreadffdecFFmpegAudioFilelenformatrlibrosaload) rraudios conversationmessageelepathrr_ base64_datadatarrrprocess_audio_infosz       &     5r=)r,iorr.r r3numpyr#r)rr!r boolr=rrrrs &