o i$ @s`dZddlZddlZddlmZddlmZddlZ ddl m Z ddl m Z mZmZmZddlmZddlmZdd lmZmZzddlZWn eyfZze d ee d ed edZ[wwzddlZWn eyZze d ee d ed edZ[wwGdddeZGdddeZGdddeZGdddeZ dS)zTkinter-based local transport implementation for Pipecat. This module provides a local transport using Tkinter for video display and PyAudio for audio I/O, suitable for desktop applications and testing. N)ThreadPoolExecutor)Optional)logger)InputAudioRawFrameOutputAudioRawFrameOutputImageRawFrame StartFrame)BaseInputTransport)BaseOutputTransport) BaseTransportTransportParamsz Exception: z~In order to use local audio, you need to `pip install pipecat-ai[local]`. On MacOS, you also need to `brew install portaudio`.zMissing module: zOtkinter missing. Try `apt install python3-tk` or `brew install python-tk@3.10`.c@s2eZdZUdZdZeeed<dZeeed<dS)TkTransportParamsaConfiguration parameters for Tkinter transport. Parameters: audio_input_device_index: PyAudio device index for audio input. If None, uses default. audio_output_device_index: PyAudio device index for audio output. If None, uses default. Naudio_input_device_indexaudio_output_device_index) __name__ __module__ __qualname____doc__rrint__annotations__rrrO/home/ubuntu/.local/lib/python3.10/site-packages/pipecat/transports/local/tk.pyr 0s r cs\eZdZUdZeed<dejdeffdd Zde ffdd Z fd d Z d d Z Z S)TkInputTransportzTkinter-based audio input transport. Captures audio from the system's audio input device using PyAudio and converts it to InputAudioRawFrame objects for pipeline processing. _paramspy_audioparamscs"t|||_d|_d|_dS)zInitialize the Tkinter input transport. Args: py_audio: PyAudio instance for audio device management. params: Transport configuration parameters. Nr)super__init__ _py_audio _in_stream _sample_rate)selfrr __class__rrrEs  zTkInputTransport.__init__framec st|IdH|jrdS|jjp|j|_t|jdd}|jj|j d|jj |j||j d|jj d|_|j ||IdHdS)z~Start the audio input stream. Args: frame: The start frame containing initialization parameters. NdT)formatchannelsrateframes_per_bufferstream_callbackinputinput_device_index)rstartrraudio_in_sample_rater rropenget_format_from_widthaudio_in_channels_audio_in_callbackr start_streamset_transport_ready)r!r$ num_framesr"rrr.Qs"  zTkInputTransport.startc:tIdH|jr|j|jd|_dSdS)z(Stop and cleanup the audio input stream.N)rcleanupr stop_streamcloser!r"rrr8l   zTkInputTransport.cleanupcCs4t||j|jjd}t|||dtj fS)z+Callback function for PyAudio input stream.)audio sample_rate num_channelsN) rr rr2asynciorun_coroutine_threadsafepush_audio_frameget_event_looppyaudio paContinue)r!in_data frame_count time_infostatusr$rrrr3ts z#TkInputTransport._audio_in_callback)rrrrr rrDPyAudiorrr.r8r3 __classcell__rrr"rr<s  rcseZdZUdZeed<dejdej deffdd Z de ffd d Z fd d Z ded efddZded efddZdefddZZS)TkOutputTransportzTkinter-based audio and video output transport. Plays audio through PyAudio and displays video frames in a Tkinter window, providing a complete multimedia output solution for desktop applications. rtk_rootrrcst|||_d|_d|_tdd|_tdd}ddd dd  | tj  }t jdd|d d }t j||d |_|jdS)zInitialize the Tkinter output transport. Args: tk_root: The root Tkinter window for video display. py_audio: PyAudio instance for audio device management. params: Transport configuration parameters. Nr) max_workers)rPzP5 rP  255 PPMwidthheightdatar'image)rrr _out_streamr r _executornponesencodeastypeuint8tobytestk PhotoImageLabel _image_labelpack)r!rMrrarrayrYphotor"rrrs  &zTkOutputTransport.__init__r$csvt|IdH|jrdS|jjp|j|_|jj|jd|jj |jd|jj d|_|j | |IdHdS)zStart the audio output stream. Args: frame: The start frame containing initialization parameters. Nr&T)r'r(r)outputoutput_device_index) rr.r\raudio_out_sample_rater rr0r1audio_out_channelsrr4r5r!r$r"rrr.s  zTkOutputTransport.startcr7)z)Stop and cleanup the audio output stream.N)rr8r\r9r:r;r"rrr8r<zTkOutputTransport.cleanupreturncs0|jr||j|jj|jIdHdSdS)zWrite an audio frame to the output stream. Args: frame: The audio frame to write to the output device. Returns: True if the audio frame was written successfully, False otherwise. NTF)r\rCrun_in_executorr]writer=rorrrwrite_audio_frames  z#TkOutputTransport.write_audio_framecs||j|dS)zWrite a video frame to the Tkinter display. Args: frame: The video frame to display in the Tkinter window. Returns: True if the video frame was written successfully, False otherwise. T)rC call_soon_write_frame_to_tkrorrrwrite_video_frames z#TkOutputTransport.write_video_framecCs\|jd}|jd}d|d|d|j}tj|||dd}|jj|d||j_d S) z,Write frame data to the Tkinter image label.rrNzP6 rSrTrUrVrZN)sizer`r[rdrergconfig)r!r$rWrXrYrjrrrrus   z$TkOutputTransport._write_frame_to_tk)rrrrr rrdTkrDrJrrr.r8rboolrsrrvrurKrrr"rrLs   rLcsHeZdZdZdejdeffdd ZdefddZ de fd d Z Z S) TkLocalTransportzComplete Tkinter-based local transport with audio and video capabilities. Provides a unified interface for local multimedia I/O using Tkinter for video display and PyAudio for audio, suitable for desktop applications and testing. rMrcs0t||_||_t|_d|_d|_dS)zInitialize the Tkinter local transport. Args: tk_root: The root Tkinter window for video display. params: Transport configuration parameters. N) rr_tk_rootrrDrJ_pyaudio_input_output)r!rMrr"rrrs   zTkLocalTransport.__init__rpcCs|js t|j|j|_|jS)zGet the input frame processor for this transport. Returns: The Tkinter input transport processor. )r~rr}rr;rrrr,szTkLocalTransport.inputcCs |js t|j|j|j|_|jS)zGet the output frame processor for this transport. Returns: The Tkinter output transport processor. )rrLr|r}rr;rrrrkszTkLocalTransport.output) rrrrrdryr rrr,rLrkrKrrr"rr{s  r{)!rr@tkinterrdconcurrent.futuresrtypingrnumpyr^logururpipecat.frames.framesrrrrpipecat.transports.base_inputr pipecat.transports.base_outputr !pipecat.transports.base_transportr r rDModuleNotFoundErroreerror Exceptionr rrLr{rrrrsB         Ej