o i @sUdZddlZddlZddlZddlmZmZddlmZddl m Z m Z m Z m Z mZmZmZddlZddlmZddlmZmZddlmZmZmZmZmZmZmZmZdd l m!Z!dd l"m#Z#dd l$m%Z%m&Z&m'Z'dd l(m)Z)m*Z*m+Z+dd l,m-Z-m.Z.ddl/m0Z0zddl1m2Z3ddl4m5Z5Wn e6yZ7ze8de7e8de9de7dZ7[7wwGddde:eZ;Gddde:eZe>ddddd d!de?d"d#edddd%d&d'de?d(d#e=Dd$e>dddd%d&d'de?d)d#e=Dd$d*Z@e e:e>feAd+<d,e:d-ee:fd.d/ZBd0e-d-ee:fd1d2ZCeGd3d4d4e&ZDeGd5d6d6eDZEGd7d8d8e+ZFGd9d:d:e)ZGdS);avSarvam AI text-to-speech service implementation. This module provides TTS services using Sarvam AI's API with support for multiple Indian languages and two model variants: **Model Variants:** - **bulbul:v2** (default): Standard TTS model - Supports: pitch, loudness, pace (0.3-3.0) - Default sample rate: 22050 Hz - Speakers: anushka (default), abhilash, manisha, vidya, arya, karun, hitesh - **bulbul:v3-beta**: Advanced TTS model with temperature control - Does NOT support: pitch, loudness - Supports: pace (0.5-2.0), temperature (0.01-1.0) - Default sample rate: 24000 Hz - Preprocessing is always enabled - Speakers: aditya (default), ritu, priya, neha, rahul, pooja, rohan, simran, kavya, amit, dev, ishita, shreya, ratan, varun, manan, sumit, roopa, kabir, aayan, shubh, ashutosh, advait, amelia, sophia - **bulbul:v3**: Advanced TTS model with temperature control - Does NOT support: pitch, loudness - Supports: pace (0.5-2.0), temperature (0.01-1.0) - Default sample rate: 24000 Hz - Preprocessing is always enabled - Speakers: aditya (default), ritu, priya, neha, rahul, pooja, rohan, simran, kavya, amit, dev, ishita, shreya, ratan, varun, manan, sumit, roopa, kabir, aayan, shubh, ashutosh, advait, amelia, sophia See https://docs.sarvam.ai/api-reference-docs/text-to-speech/stream for full API details. N) dataclassfield)Enum)AnyAsyncGeneratorClassVarDictListOptionalTuple)logger) BaseModelField) CancelFrameEndFrame ErrorFrameFrameLLMFullResponseEndFrame StartFrameTTSAudioRawFrameTTSStoppedFrame)FrameDirection) sdk_headers) NOT_GIVEN TTSSettings _NotGiven)InterruptibleTTSServiceTextAggregationMode TTSService)Languageresolve_language) traced_tts)connect)Statez Exception: zEIn order to use Sarvam, you need to `pip install pipecat-ai[sarvam]`.zMissing module: c@seZdZdZdZdZdZdS)SarvamTTSModelaAvailable Sarvam TTS models. Attributes: BULBUL_V2: Standard TTS model with pitch/loudness control. - Supports pitch, loudness, pace (0.3-3.0) - Default sample rate: 22050 Hz BULBUL_V3_BETA: Advanced model with temperature control. - Does NOT support pitch/loudness - Pace range: 0.5-2.0 - Supports temperature parameter - Default sample rate: 24000 Hz - Preprocessing is always enabled bulbul:v2bulbul:v3-beta bulbul:v3N)__name__ __module__ __qualname____doc__ BULBUL_V2BULBUL_V3_BETA BULBUL_V3r/r/O/home/ubuntu/.local/lib/python3.10/site-packages/pipecat/services/sarvam/tts.pyr$Ms r$c@s,eZdZdZdZdZdZdZdZdZ dZ d S) SarvamTTSSpeakerV2zAvailable speakers for bulbul:v2 model. Female voices: anushka, manisha, vidya, arya Male voices: abhilash, karun, hitesh anushkaabhilashmanishavidyaaryakarunhiteshN) r(r)r*r+ANUSHKAABHILASHMANISHAVIDYAARYAKARUNHITESHr/r/r/r0r1asr1c@steZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZdZdZdZdZdZdZdZdZdS)SarvamTTSSpeakerV3zyAvailable speakers for bulbul:v3-beta model. Includes a wider variety of voices with different characteristics. adityaritupriyaneharahulpoojarohansimrankavyaamitdevishitashreyaratanvarunmanansumitroopakabiraayanshubhashutoshadvaitameliasophiaN)r(r)r*r+ADITYARITUPRIYANEHARAHULPOOJAROHANSIMRANKAVYAAMITDEVISHITASHREYARATANVARUNMANANSUMITROOPAKABIRAAYANSHUBHASHUTOSHADVAITAMELIASOPHIAr/r/r/r0r@qs6r@T)frozenc@sbeZdZUdZeed<eed<eed<eed<eed<ee e fed<eed<eed fed <d S) TTSModelConfigabImmutable configuration for a Sarvam TTS model. Attributes: supports_pitch: Whether the model accepts pitch parameter. supports_loudness: Whether the model accepts loudness parameter. supports_temperature: Whether the model accepts temperature parameter. default_sample_rate: Default audio sample rate in Hz. default_speaker: Default speaker voice ID. pace_range: Valid range for pace parameter (min, max). preprocessing_always_enabled: Whether preprocessing is always enabled. speakers: Tuple of available speaker names for this model. supports_pitchsupports_loudnesssupports_temperaturedefault_sample_ratedefault_speaker pace_rangepreprocessing_always_enabled.speakersN) r(r)r*r+bool__annotations__intstrr floatr/r/r/r0rts  rtFi"Vr2)333333?@cc|]}|jVqdSNvalue.0sr/r/r0 r)rurvrwrxryrzr{r|i]rU)g?g@ccrrrrr/r/r0rrccrrrrr/r/r0rr)r%r&r'TTS_MODEL_CONFIGSmodelreturncCs$|tvr tt|jSttdjS)zGet the list of available speakers for a given model. Args: model: The model name (e.g., "bulbul:v2" or "bulbul:v3-beta"). Returns: List of speaker names available for the model. r%)rlistr|)rr/r/r0get_speakers_for_models rlanguagec Csitjdtjdtjdtjdtjdtjdtjdtjdtj dtj dtj dtj dtj dtjdtjdtjdtjd tjd tjd tjd tjd tjd i}t||d d S)zConvert Pipecat Language enum to Sarvam AI language codes. Args: language: The Language enum value to convert. Returns: The corresponding Sarvam AI language code, or None if not supported. zbn-INen-INzgu-INzhi-INzkn-INzml-INzmr-INzod-INzpa-INzta-INzte-INF) use_base_code)rBNBN_INENEN_INGUGU_INHIHI_INKNKN_INMLML_INMRMR_INOROR_INPAPA_INTATA_INTETE_INr )r LANGUAGE_MAPr/r/r0language_to_sarvam_languagesT      rc@seZdZUdZedddZedBeBed<edddZ e dBeBed<ed ddZ e dBeBed <ed ddZ e dBeBed <ed ddZ e dBeBed<dS)SarvamHttpTTSSettingsaSettings for SarvamHttpTTSService. Parameters: enable_preprocessing: Whether to enable text preprocessing. Defaults to False. **Note:** Always enabled for bulbul:v3-beta (cannot be disabled). pace: Speech pace multiplier. Defaults to 1.0. - bulbul:v2: Range 0.3 to 3.0 - bulbul:v3-beta: Range 0.5 to 2.0 pitch: Voice pitch adjustment (-0.75 to 0.75). Defaults to 0.0. **Note:** Only supported for bulbul:v2. Ignored for v3 models. loudness: Volume multiplier (0.3 to 3.0). Defaults to 1.0. **Note:** Only supported for bulbul:v2. Ignored for v3 models. temperature: Controls output randomness for bulbul:v3-beta (0.01 to 1.0). Lower values = more deterministic, higher = more random. Defaults to 0.6. **Note:** Only supported for bulbul:v3-beta. Ignored for v2. cCtSrrr/r/r/r0zSarvamHttpTTSSettings.default_factoryNenable_preprocessingcCrrrr/r/r/r0rrpacecCrrrr/r/r/r0rrpitchcCrrrr/r/r/r0rrloudnesscCrrrr/r/r/r0rr temperature)r(r)r*r+rrr}rr~rrrrrr/r/r/r0rs "rc@sjeZdZUdZddiZeeeefed<e dddZ e dBe Bed <e d ddZ e dBe Bed <dS) SarvamTTSSettingsaSettings for SarvamTTSService. Extends :class:`SarvamHttpTTSService.Settings` with WebSocket-specific buffering parameters. Parameters: min_buffer_size: Minimum characters to buffer before generating audio. Lower values reduce latency but may affect quality. Defaults to 50. max_chunk_length: Maximum characters processed in a single chunk. Controls memory usage and processing efficiency. Defaults to 150. target_language_coder_aliasescCrrrr/r/r/r0r*rzSarvamTTSSettings.rNmin_buffer_sizecCrrrr/r/r/r0r+rmax_chunk_length)r(r)r*r+rrrrr~rrrrrr/r/r/r0rs  "rcseZdZUdZeZeed<GdddeZdddddddde d e j d e e d e e d e d e e de ede effddZdefddZdede e fddZdeffdd Zede de deedffddZZS)SarvamHttpTTSServiceaText-to-Speech service using Sarvam AI's API. Converts text to speech using Sarvam AI's TTS models with support for multiple Indian languages. Provides control over voice characteristics. **Model Differences:** - **bulbul:v2** (default): - Supports: pitch (-0.75 to 0.75), loudness (0.3 to 3.0), pace (0.3 to 3.0) - Default sample rate: 22050 Hz - Speakers: anushka, abhilash, manisha, vidya, arya, karun, hitesh - **bulbul:v3-beta**: - Does NOT support: pitch, loudness (will be ignored) - Supports: pace (0.5 to 2.0), temperature (0.01 to 1.0) - Default sample rate: 24000 Hz - Preprocessing is always enabled - Speakers: aditya, ritu, priya, neha, rahul, pooja, rohan, simran, kavya, amit, dev, ishita, shreya, ratan, varun, manan, sumit, roopa, kabir, aayan, shubh, ashutosh, advait, amelia, sophia Example:: # Using bulbul:v2 (default) tts = SarvamHttpTTSService( api_key="your-api-key", aiohttp_session=session, settings=SarvamHttpTTSService.Settings( voice="anushka", model="bulbul:v2", language=Language.HI, pitch=0.1, pace=1.2, loudness=1.5, ), ) # Using bulbul:v3-beta with temperature control tts_v3 = SarvamHttpTTSService( api_key="your-api-key", aiohttp_session=session, settings=SarvamHttpTTSService.Settings( voice="aditya", # Use v3 speaker model="bulbul:v3-beta", language=Language.HI, pace=1.2, # Range: 0.5-2.0 for v3 temperature=0.8, ), ) _settingsc@seZdZUdZejZeeed<e dddddZ ee ed<e d d d d dZ ee ed <e d d d ddZ ee ed<e dddZeeed<e ddd ddZee ed<dS)z SarvamHttpTTSService.InputParamsaInput parameters for Sarvam TTS configuration. .. deprecated:: 0.0.105 Use ``SarvamHttpTTSService.Settings`` directly via the ``settings`` parameter instead. Parameters: language: Language for synthesis. Defaults to English (India). pitch: Voice pitch adjustment (-0.75 to 0.75). Defaults to 0.0. **Note:** Only supported for bulbul:v2. Ignored for v3 models. pace: Speech pace multiplier. Defaults to 1.0. - bulbul:v2: Range 0.3 to 3.0 - bulbul:v3-beta: Range 0.5 to 2.0 loudness: Volume multiplier (0.3 to 3.0). Defaults to 1.0. **Note:** Only supported for bulbul:v2. Ignored for v3 models. enable_preprocessing: Whether to enable text preprocessing. Defaults to False. **Note:** Always enabled for bulbul:v3-beta (cannot be disabled). temperature: Controls output randomness for bulbul:v3-beta (0.01 to 1.0). Lower values = more deterministic, higher = more random. Defaults to 0.6. **Note:** Only supported for bulbul:v3-beta. Ignored for v2. r?+Voice pitch adjustment. Only for bulbul:v2.defaultgele descriptionr?rr&Speech pace. v2: 0.3-3.0, v3: 0.5-2.0.r&Volume multiplier. Only for bulbul:v2.rFz rNzhttps://api.sarvam.ai)voice_idrbase_url sample_rateparamssettingsapi_keyaiohttp_sessionrrrrrrc sp|jddddddddd} |dur|dd|| _|dur'|d d || _|durh|d |sh|jdur;|j| _|jdurD|j| _|jdurM|j| _|jdurV|j| _|jdur_|j| _|j durh|j | _ |durq| || j} | t vrd t t } td | d| dt | |_|dur|jj}|dur|dus|jtur|jj| _| j} |jj\}}| dur| |ks| |krtd| d|d|dt|t|| | _|jjrd| _|jjs| jdvrtd| d| _|jjs | jdvr td| d| _|jjs| j dvrtd| d| _ tjd|dd| d| ||_||_ ||_!dS)adInitialize the Sarvam TTS service. Args: api_key: Sarvam AI API subscription key. aiohttp_session: Shared aiohttp session for making requests. voice_id: Speaker voice ID. If None, uses model-appropriate default. .. deprecated:: 0.0.105 Use ``settings=SarvamHttpTTSService.Settings(voice=...)`` instead. model: TTS model to use. Options: - "bulbul:v2" (default): Standard model with pitch/loudness support - "bulbul:v3-beta": Advanced model with temperature control .. deprecated:: 0.0.105 Use ``settings=SarvamHttpTTSService.Settings(model=...)`` instead. base_url: Sarvam AI API base URL. Defaults to "https://api.sarvam.ai". sample_rate: Audio sample rate in Hz (8000, 16000, 22050, 24000). If None, uses model-specific default. params: Additional voice and preprocessing parameters. If None, uses defaults. .. deprecated:: 0.0.105 Use ``settings=SarvamHttpTTSService.Settings(...)`` instead. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. **kwargs: Additional arguments passed to parent TTSService. r%r2rFrN)rvoicerrrrrrrrrr, Unsupported model ''. Allowed values: .Pace  is outside model range (- ). Clamping.TNrpitch parameter is ignored for Nr"loudness parameter is ignored for Nr%temperature parameter is ignored for )rpush_stop_framespush_start_framerr/)"Settings"_warn_init_param_moved_to_settingsrrrrrrrr apply_updaterjoinsortedkeys ValueError_configrxrryrzr warningmaxminr{rurvrwsuper__init___api_key _base_url_session)selfrrrrrrrrkwargsdefault_settingsresolved_modelallowedrpace_minpace_max __class__r/r0rs+              zSarvamHttpTTSService.__init__rcCdSzCheck if this service can generate processing metrics. Returns: True, as Sarvam service supports metrics generation. Tr/rr/r/r0can_generate_metrics!z)SarvamHttpTTSService.can_generate_metricsrcCt|SzConvert a Language enum to Sarvam AI language format. Args: language: The language to convert. Returns: The Sarvam AI-specific language code, or None if not supported. rrrr/r/r0language_to_service_language) z1SarvamHttpTTSService.language_to_service_languageframecst|IdHdSz~Start the Sarvam TTS service. Args: frame: The start frame containing initialization parameters. N)rstartrr rr/r0r4szSarvamHttpTTSService.starttext context_idc Cst|d|dz;z||jj|jj|j|jj|jj|jjdur)|jjndd}|j j r?|jj dur;|jj nd|d<|j j rQ|jj durM|jj nd|d<|j jrc|jjdur_|jjnd |d <|jd d t}|jd }|jj|||d4IdH<}|jdkr|IdH}td|dV WdIdHWW|IdHdS|IdH}WdIdHn 1IdHswY||IdHd|vs|dstddVWW|IdHdS|dd} t| } t| dkr | dr td| dd} t| |jd|d} | VWnt y4} ztd| | dVWYd} ~ nd} ~ wwW|IdHdSW|IdHdS|IdHw)aGenerate speech from text using Sarvam AI's API. Args: text: The text to synthesize into speech. context_id: The context ID for tracking audio frames. Yields: Frame: Audio frames containing the synthesized speech. z: Generating TTS []Nr)rrspeakerrrrrrrrrrzapplication/json)api-subscription-keyz Content-Typez/text-to-speech)jsonheaderszSarvam API error: erroraudioszNo audio data receivedr,sRIFFz+Stripping WAV header from Sarvam audio data)audior num_channelsrzError generating TTS: )r exception)!r debugrrrrrrrrrurrvrrwrrrrrpoststatusrrstop_ttfb_metricsrstart_tts_usage_metricsbase64 b64decodelen startswithr Exception) rrrpayloadrurlresponse error_text response_data base64_audio audio_datar er/r/r0run_tts<sv    $(      "zSarvamHttpTTSService.run_tts)r(r)r*r+rrr~r rraiohttp ClientSessionr rrr}rrr rrr!rrr3 __classcell__r/r/rr0r.sD 39    (rcseZdZUdZeZeed<GdddeZdddddddddde d e e d e e d e d e e d e e de e de ede effddZde fddZdede e fddZdeffdd Zdeffdd Zdeffdd ZdBd e e fd!d"Zejfded#effd$d% Zded#effd&d' Zd(edee e fffd)d* Z!fd+d,Z"fd-d.Z#d/d0Z$d1d2Z%d3d4Z&d5d6Z'd7d8Z(d9d:Z)d;d<Z*d=e fd>d?Z+e,d=e d e de-edffd@dAZ.Z/S)CSarvamTTSServiceaJWebSocket-based text-to-speech service using Sarvam AI. Provides streaming TTS with real-time audio generation for multiple Indian languages. Uses WebSocket for low-latency streaming audio synthesis. **Model Differences:** - **bulbul:v2** (default): - Supports: pitch (-0.75 to 0.75), loudness (0.3 to 3.0), pace (0.3 to 3.0) - Default sample rate: 22050 Hz - Speakers: anushka, abhilash, manisha, vidya, arya, karun, hitesh - **bulbul:v3-beta** / **bulbul:v3**: - Does NOT support: pitch, loudness (will be ignored) - Supports: pace (0.5 to 2.0), temperature (0.01 to 1.0) - Default sample rate: 24000 Hz - Preprocessing is always enabled - Speakers: aditya, ritu, priya, neha, rahul, pooja, rohan, simran, kavya, amit, dev, ishita, shreya, ratan, varun, manan, sumit, roopa, kabir, aayan, shubh, ashutosh, advait, amelia, sophia **WebSocket Protocol:** The service uses a WebSocket connection for real-time streaming. Messages include: - config: Initial configuration with voice settings - text: Text chunks for synthesis - flush: Signal to process remaining buffered text - ping: Keepalive signal Example:: # Using bulbul:v2 (default) tts = SarvamTTSService( api_key="your-api-key", settings=SarvamTTSService.Settings( voice="anushka", model="bulbul:v2", language=Language.HI, pitch=0.1, pace=1.2, loudness=1.5, ), ) # Using bulbul:v3-beta with temperature control tts_v3 = SarvamTTSService( api_key="your-api-key", settings=SarvamTTSService.Settings( voice="aditya", # Use v3 speaker model="bulbul:v3-beta", language=Language.HI, pace=1.2, # Range: 0.5-2.0 for v3 temperature=0.8, ), ) See https://docs.sarvam.ai/api-reference-docs/text-to-speech/stream for API details. rc@s eZdZUdZedddddZeeed<edd d d dZ eeed <edd d d dZ eeed<edddZ ee ed<edddZ eeed<edddZeeed<edddZeeed<edddZeeed<ejZeeed<ed d!dd"dZeeed#<d$S)%zSarvamTTSService.InputParamsaeConfiguration parameters for Sarvam TTS WebSocket service. .. deprecated:: 0.0.105 Use ``SarvamTTSService.Settings`` directly via the ``settings`` parameter instead. Parameters: pitch: Voice pitch adjustment (-0.75 to 0.75). Defaults to 0.0. **Note:** Only supported for bulbul:v2. Ignored for v3 models. pace: Speech pace multiplier. Defaults to 1.0. - bulbul:v2: Range 0.3 to 3.0 - bulbul:v3-beta: Range 0.5 to 2.0 loudness: Volume multiplier (0.3 to 3.0). Defaults to 1.0. **Note:** Only supported for bulbul:v2. Ignored for v3 models. enable_preprocessing: Enable text preprocessing. Defaults to False. **Note:** Always enabled for bulbul:v3-beta. min_buffer_size: Minimum characters to buffer before generating audio. Lower values reduce latency but may affect quality. Defaults to 50. max_chunk_length: Maximum characters processed in a single chunk. Controls memory usage and processing efficiency. Defaults to 150. output_audio_codec: Audio codec format. Options: linear16, mulaw, alaw, opus, flac, aac, wav, mp3. Defaults to "linear16". output_audio_bitrate: Audio bitrate (32k, 64k, 96k, 128k, 192k). Defaults to "128k". language: Target language for synthesis. Supports Indian languages. temperature: Controls output randomness for bulbul:v3-beta (0.01 to 1.0). Lower = more deterministic, higher = more random. Defaults to 0.6. **Note:** Only supported for bulbul:v3-beta. Ignored for v2. **Speakers by Model:** bulbul:v2: - Female: anushka (default), manisha, vidya, arya - Male: abhilash, karun, hitesh bulbul:v3-beta: - aditya (default), ritu, priya, neha, rahul, pooja, rohan, simran, kavya, amit, dev, ishita, shreya, ratan, varun, manan, sumit, roopa, kabir, aayan, shubh, ashutosh, advait, amelia, sophia rrrrrrrrrrrrrFz8Enable text preprocessing. Always enabled for v3 models.rr2z3Minimum characters to buffer before TTS processing.rz&Maximum length for sentence splitting.rlinear16z>Audio codec: linear16, mulaw, alaw, opus, flac, aac, wav, mp3.output_audio_codec128kz)Audio bitrate: 32k, 64k, 96k, 128k, 192k.output_audio_bitraterrrrrN)r(r)r*r+rrr rr~rrrr}rrrr;rr=rrrrr/r/r/r0rs^ (rNz%wss://api.sarvam.ai/text-to-speech/ws)rrr,aggregate_sentencestext_aggregation_moderrrrrrr,r>r?rrrc  s|jddddddddddd } |dur|d d || _|dur)|d d || _d } d} |dur|d| s|jdurA|j| _|jdurJ|j| _|jdurS|j| _|jdur\|j| _|jdurd|j} |j durl|j } |j duru|j | _ |j dur~|j | _ |j dur|j | _ |j dur|j | _ | dur| | | j}|tvrdtt}td|d|dt||_|dur|jj}|dur| dus| jtur|jj| _| j }|jj\}}|dur||ks||krtd|d|d|dt|t||| _ |jjr d| _|jjs | j dvr td|d| _ |jjs6| j dvr6td|d| _ |jj sL| j dvrLtd|d| _ t!j"d!||dddd|| d| t#||_$| |_%| |_&|d ||_'||_(d|_)d|_*dS)"a{Initialize the Sarvam TTS service with voice and transport configuration. Args: api_key: Sarvam API key for authenticating TTS requests. model: TTS model to use. Options: - "bulbul:v2" (default): Standard model with pitch/loudness support - "bulbul:v3-beta": Advanced model with temperature control .. deprecated:: 0.0.105 Use ``settings=SarvamTTSService.Settings(model=...)`` instead. voice_id: Speaker voice ID. If None, uses model-appropriate default. .. deprecated:: 0.0.105 Use ``settings=SarvamTTSService.Settings(voice=...)`` instead. url: WebSocket URL for the TTS backend (default production URL). aggregate_sentences: Deprecated. Use text_aggregation_mode instead. .. deprecated:: 0.0.104 Use ``text_aggregation_mode`` instead. text_aggregation_mode: How to aggregate text before synthesis. sample_rate: Output audio sample rate in Hz (8000, 16000, 22050, 24000). If None, uses model-specific default. params: Optional input parameters to override defaults. .. deprecated:: 0.0.105 Use ``settings=SarvamTTSService.Settings(...)`` instead. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. **kwargs: Arguments forwarded to InterruptibleTTSService. See https://docs.sarvam.ai/api-reference-docs/text-to-speech/stream r%r2rFr8r9rN) rrrrrrrrrrrrrr:r<rrrrrrrrrTrrrrrr)r>r?push_text_framespause_frame_processingrrrrz?model=r/)+rrrrrrrrr;r=rrrrrrrrrrrrxrryrzr rrrr{rurvrwrrr_speech_sample_rate_output_audio_codec_output_audio_bitrate_websocket_urlr _receive_task_keepalive_task)rrrrr,r>r?rrrrrr;r=rrrrrrr/r0r%s3                     zSarvamTTSService.__init__rcCrrr/rr/r/r0rrz%SarvamTTSService.can_generate_metricsrcCrrr r r/r/r0r r z-SarvamTTSService.language_to_service_languager cs2t|IdHt|j|_|IdHdSr)rrrrrB_connectrrr/r0rs zSarvamTTSService.startc&t|IdH|IdHdS)zVStop the Sarvam TTS service. Args: frame: The end frame. N)rstop _disconnectrrr/r0rJzSarvamTTSService.stopcrI)z[Cancel the Sarvam TTS service. Args: frame: The cancel frame. N)rcancelrKrrr/r0rMrLzSarvamTTSService.cancelrc svz|jrddi}|jt|IdHWdSWdSty:}z|jd||dIdHWYd}~dSd}~ww)z;Flush any pending audio synthesis by sending flush command.typeflushNzError sending flush to Sarvam:  error_msgr ) _websocketsendrdumpsr* push_error)rrmsgr2r/r/r0 flush_audios(zSarvamTTSService.flush_audio directioncst||IdHdS)zPush a frame downstream with special handling for stop conditions. Args: frame: The frame to push. direction: The direction to push the frame. N)r push_framerr rXrr/r0rY szSarvamTTSService.push_framecs:t||IdHt|ttfr|IdHdSdS)zCProcess a frame and flush audio if it's the end of a full response.N)r process_frame isinstancerrrWrZrr/r0r[s zSarvamTTSService.process_framedeltacs*t|IdH}|r|IdH|S)z:Apply a settings delta and resend config if voice changed.N)r_update_settings _send_config)rr]changedrr/r0r^s z!SarvamTTSService._update_settingscshtIdH|IdH|jr |js |||j|_|jr0|js2|| |_dSdSdS)z7Connect to Sarvam WebSocket and start background tasks.N) rrH_connect_websocketrRrF create_task_receive_task_handler _report_errorrG_keepalive_task_handlerrrr/r0rH$s   zSarvamTTSService._connectcs`tIdH|jr||jIdHd|_|jr'||jIdHd|_|IdHdS)z4Disconnect from Sarvam WebSocket and clean up tasks.N)rrKrF cancel_taskrG_disconnect_websocketrrr/r0rK2szSarvamTTSService._disconnectc sz7|jr|jjtjurWdSd|jit}t|j|dIdH|_t d| IdH| dIdHWdSt ye}z!|j d||dIdHd|_| d|IdHWYd}~dSd}~ww) z-Establish WebSocket connection to Sarvam API.Nr)additional_headersz!Connected to Sarvam TTS Websocket on_connectedz*Error connecting to Sarvam TTS Websocket: rPon_connection_error)rRstater#OPENrrwebsocket_connectrEr r!r__call_event_handlerr*rU)rws_additional_headersr2r/r/r0ra@s.   "z#SarvamTTSService._connect_websocketc s |jstd|jj|jj|j|jj|jj|jj|j |j |jj |jj d }|jj dur2|jj |d<|jjdur>|jj|d<|jjdurJ|jj|d<td|d|d }z|jt|IdHtd WdSty}z|jd ||d IdHd}~ww) z#Send initial configuration message.zWebSocket not connected) rrspeech_sample_raterrrr;r=rrNrrrzConfig being sent is configrNdatazConfiguration sent successfullyUnknown error occurred: rP)rRr*rrrrBrrrrCrDrrrrrr r!rSrrTrU)r config_dataconfig_messager2r/r/r0r_Zs<      zSarvamTTSService._send_configc szUz|IdH|jrtd|jIdHWnty:}z|jd||dIdHWYd}~nd}~wwWd|_|dIdHdSWd|_|dIdHdSd|_|dIdHw)z.Close WebSocket connection and clean up state.NzDisconnecting from SarvamzError closing websocket: rPon_disconnected)stop_all_metricsrRr r!closer*rUrn)rr2r/r/r0rg{s& &z&SarvamTTSService._disconnect_websocketcCs|jr|jStd)NzWebsocket not connected)rRr*rr/r/r0_get_websocketszSarvamTTSService._get_websocketcs|2zs3dHW}t|trxt|}|ddkr@|IdHt|dd}t ||j d| d}| |IdHq|ddkrx|dd}|j d |d IdHd |vsed |vrjtd | td |dIdHq6dS)z3Receive and process messages from Sarvam WebSocket.NrNrrsrrrmessagez TTS Error: )rQztoo longtimeoutz5Connection timeout detected, service may need restartr)rzr\rrloadsgetr$r&r'rrget_active_audio_context_idrYrUlowerr rr)rr|rVrr rQr/r/r0_receive_messagess&    z"SarvamTTSService._receive_messagescs(d} t|IdH|IdHq)z;Handle keepalive messages to maintain WebSocket connection.TN)asynciosleep_send_keepalive)rKEEPALIVE_SLEEPr/r/r0res z(SarvamTTSService._keepalive_task_handlercsB|jr|jjtjkrddi}|jt|IdHdSdSdS)z.Send keepalive message to maintain connection.rNpingN)rRrkr#rlrSrrT)rrVr/r/r0rs z SarvamTTSService._send_keepalivercsN|jr |jjtjkr dd|id}|jt|IdHdStddS)z,Send text to Sarvam WebSocket for synthesis.rrrNz%WebSocket not ready, cannot send text) rRrkr#rlrSrrTr r)rrrVr/r/r0 _send_texts zSarvamTTSService._send_textc Cstd|dz[|jr|jjtjur|IdHz||IdH||IdHWn1t y_}z%t d|dVt |dV| IdH|IdHWYd}~WdSd}~wwdVWdSt y}zt d|dVWYd}~dSd}~ww)aGenerate speech audio frames from input text using Sarvam TTS. Sends text over WebSocket for synthesis and yields corresponding audio or status frames. Args: text: The text input to synthesize. context_id: The context ID for tracking audio frames. Yields: Frame objects including TTSStartedFrame, TTSAudioRawFrame(s, context_id=context_id), or TTSStoppedFrame. zGenerating TTS: [rNrtrr{) r r!rRrkr#CLOSEDrHrr%r*rrrK)rrrr2r/r/r0r3s*    zSarvamTTSService.run_ttsr)0r(r)r*r+rrr~r rrr r}rrrrrr rrrrJrrMrWr DOWNSTREAMrrYr[rdictrr^rHrKrar_rgrzrrerrr!rr3r6r/r/rr0r7sl :[   ,       !(r7)Hr+rr&r dataclassesrrenumrtypingrrrrr r r r4logurur pydanticr rpipecat.frames.framesrrrrrrrr"pipecat.processors.frame_processorrpipecat.services.sarvam._sdkrpipecat.services.settingsrrrpipecat.services.tts_servicerrrpipecat.transcriptions.languagerr (pipecat.utils.tracing.service_decoratorsr!websockets.asyncio.clientr"rmwebsockets.protocolr#ModuleNotFoundErrorr2rr*rr$r1r@rttuplerr~rrrrrr7r/r/r/r0s! $ (    !  "%d