o ia@spdZddlZddlmZddlmZmZddlmZm Z m Z m Z m Z ddl mZddlmZGdd d eZdS) zVoice Activity Detection controller for managing speech state transitions. This module provides a controller that wraps a VADAnalyzer to track speech state and emit events when speech starts, stops, or is actively detected. N)Type) VADAnalyzerVADState)FrameInputAudioRawFrameSpeechControlParamsFrame StartFrameVADParamsUpdateFrame)FrameDirection) BaseObjectcseZdZdZdddedeffddZdefd d Zde fd d Z de fd dZ de dedefddZddZejfdedefddZdeefddZZS) VADControllera(Manages voice activity detection state and emits speech events. Wraps a `VADAnalyzer` to process audio and trigger events based on speech state transitions. Tracks whether the user is speaking, quiet, or transitioning between states. Event handlers available: - on_speech_started: Called when speech begins. - on_speech_stopped: Called when speech ends. - on_speech_activity: Called periodically while speech is detected. - on_push_frame: Called when the controller wants to push a frame. - on_broadcast_frame: Called when the controller wants to broadcast a frame. Example:: @vad_controller.event_handler("on_speech_started") async def on_speech_started(controller): ... @vad_controller.event_handler("on_speech_stopped") async def on_speech_stopped(controller): ... @vad_controller.event_handler("on_speech_activity") async def on_speech_activity(controller): ... @vad_controller.event_handler("on_push_frame") async def on_push_frame(controller, frame: Frame, direction: FrameDirection): ... @vad_controller.event_handler("on_broadcast_frame") async def on_broadcast_frame(controller, frame_cls: Type[Frame], **kwargs): ... g?)speech_activity_period vad_analyzerr csnt||_tj|_d|_||_|jddd|jddd|jddd|jddd|jdddd S) aInitialize the VAD controller. Args: vad_analyzer: The `VADAnalyzer` instance for processing audio. speech_activity_period: Minimum interval in seconds between `on_speech_activity` events. Defaults to 0.2. ron_speech_startedT)syncon_speech_stoppedon_speech_activity on_push_frameon_broadcast_frameN) super__init__ _vad_analyzerrQUIET _vad_state_speech_activity_time_speech_activity_period_register_event_handler)selfrr  __class__T/home/ubuntu/.local/lib/python3.10/site-packages/pipecat/audio/vad/vad_controller.pyrBs zVADController.__init__framecstt|tr||IdHdSt|tr||IdHdSt|tr8|j|j|j t |jdIdHdSdS)zProcess a frame and handle VAD-related events. Handles `StartFrame` to initialize the sample rate and `InputAudioRawFrame` to analyze audio for voice activity. Args: frame: The frame to process. N vad_params) isinstancer_startr _handle_audior r set_paramsparamsbroadcast_framerrr"r r r! process_frameZs   zVADController.process_framecs,|j|j|jt|jjdIdHdS)Nr#)rset_sample_rateaudio_in_sample_rater*rr)r+r r r!r&kszVADController._startcs>||j|jIdH|_|jtjkr|dIdHdSdS)a Process an audio chunk and emit speech events as needed. Analyzes the audio for voice activity and triggers `on_speech_started`, `on_speech_stopped`, or `on_speech_activity` events based on state changes. Args: frame: Audio frame to process. Nr) _handle_vadaudiorrSPEAKING_call_event_handlerr+r r r!r'ps  zVADController._handle_audior0 vad_statereturncsn|j|IdH}||kr5|tjkr5|tjkr5|tjkr&|dIdHn |tjkr3|dIdH|}|S)zGHandle Voice Activity Detection results and trigger appropriate events.Nrr)r analyze_audiorSTARTINGSTOPPINGr1r2r)rr0r3 new_vad_stater r r!r/~s    zVADController._handle_vadcs<t|j}||jkrt|_|dIdHdSdS)zHandle user speaking frame.rN)timerrr2)r diff_timer r r!_maybe_speech_activitys   z$VADController._maybe_speech_activity directioncs|d||IdHdS)a-Request a frame to be pushed through the pipeline. This emits an on_push_frame event that must be handled by a processor to actually push the frame into the pipeline. Args: frame: The frame to push. direction: The direction to push the frame. rNr2)rr"r<r r r! push_frames zVADController.push_frame frame_clscs |jd|fi|IdHdS)a[Request a frame to be broadcast upstream and downstream. This emits an on_broadcast_frame event that must be handled by a processor to actually broadcast the frame in the pipeline. Args: frame_cls: The class of the frame to broadcast. **kwargs: Arguments to pass to the frame constructor. rNr=)rr?kwargsr r r!r*s zVADController.broadcast_frame)__name__ __module__ __qualname____doc__rfloatrrr,rr&rr'bytesrr/r;r DOWNSTREAMr>rr* __classcell__r r rr!r s% r )rDr9typingrpipecat.audio.vad.vad_analyzerrrpipecat.frames.framesrrrrr "pipecat.processors.frame_processorr pipecat.utils.base_objectr r r r r r!s