o i6 @s*dZddlZddlZddlmZddlmZmZmZddl m Z ddl m Z ddl mZmZmZmZmZmZmZddlmZdd lmZdd lmZzdd lmZdd lmZdd l m!Z!Wn e"y~Z#ze $de#e $de%de#dZ#[#wwdZ&eGdddeZ'GdddeZ(dS)z.Gradium Text-to-Speech service implementation.N) dataclass)AnyAsyncGeneratorOptional)logger) BaseModel) CancelFrameEndFrame ErrorFrameFrame StartFrameTTSAudioRawFrameTTSStoppedFrame) TTSSettings)WebsocketTTSService) traced_tts)ConnectionClosedOK)connect)Statez Exception: zGIn order to use Gradium, you need to `pip install pipecat-ai[gradium]`.zMissing module: ic@seZdZdZdS)GradiumTTSSettingszSettings for GradiumTTSService.N)__name__ __module__ __qualname____doc__rrP/home/ubuntu/.local/lib/python3.10/site-packages/pipecat/services/gradium/tts.pyr(srcseZdZUdZeZeed<GdddeZdddddddde d e e d e d e e d e e d e ede effddZ de fddZ dedee efffdd Zd7de de defddZdeffdd Zdeffdd Zdeffd!d" Zfd#d$Zfd%d&Zd'd(Zd)d*Zd+d,Zd8de e fd-d.Zde fd/d0Zde fd1d2Z d3d4Z!e"de de de#e$dffd5d6Z%Z&S)9GradiumTTSServicez5Text-to-Speech service using Gradium's websocket API. _settingsc@s"eZdZUdZdZeeed<dS)zGradiumTTSService.InputParamsaConfiguration parameters for Gradium TTS service. .. deprecated:: 0.0.105 Use ``GradiumTTSService.Settings`` directly via the ``settings`` parameter instead. Parameters: temp: Temperature to be used for generation, defaults to 0.6. g333333?tempN)rrrrrrfloat__annotations__rrrr InputParams5s  r!Nz&wss://eu.api.gradium.ai/api/speech/tts)voice_idurlmodel json_configparamssettingsapi_keyr"r#r$r%r&r'c s|jdddd} |dur|dd|| _|dur"|dd|| _|dur+|d|dur4| |tjd d d d d t| d |||_||_ ||_ d|_ dS) aInitialize the Gradium TTS service. Args: api_key: Gradium API key for authentication. voice_id: the voice identifier. .. deprecated:: 0.0.105 Use ``settings=GradiumTTSService.Settings(voice=...)`` instead. url: Gradium websocket API endpoint. model: Model ID to use for synthesis. .. deprecated:: 0.0.105 Use ``settings=GradiumTTSService.Settings(model=...)`` instead. json_config: Optional JSON configuration string for additional model settings. params: Additional configuration parameters. .. deprecated:: 0.0.105 Use ``settings=GradiumTTSService.Settings(...)`` instead. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. **kwargs: Additional arguments passed to parent class. defaultYTpq7expH9539ERJN)r$voicelanguager$r"r+r&TF)push_stop_framespush_start_framepush_text_framespause_frame_processing sample_rater'r) Settings"_warn_init_param_moved_to_settingsr$r+ apply_updatesuper__init__ SAMPLE_RATE_api_key_url _json_config _receive_task) selfr(r"r#r$r%r&r'kwargsdefault_settings __class__rrr6As:&      zGradiumTTSService.__init__returncCsdS)zCheck if this service can generate processing metrics. Returns: True, as Gradium service supports metrics generation. Trr<rrrcan_generate_metricssz&GradiumTTSService.can_generate_metricsdeltacsJt|IdH}d|vr|IdH|IdH|S|||S)zApply a settings delta and reconnect if voice changed. Args: delta: A :class:`TTSSettings` (or ``GradiumTTSService.Settings``) delta. Returns: Dict mapping changed field names to their previous values. Nr+)r5_update_settings _disconnect_connect _warn_unhandled_updated_settings)r<rDchangedr?rrrEs  z"GradiumTTSService._update_settingstext context_idcCs|d|d}|S)z#Build JSON message for Gradium API.rK)rKtype client_req_idr)r<rKrLmsgrrr _build_msgs zGradiumTTSService._build_msgframec&t|IdH|IdHdS)zStart the service and establish websocket connection. Args: frame: The start frame containing initialization parameters. N)r5startrGr<rQr?rrrSzGradiumTTSService.startcrR)z`Stop the service and close connection. Args: frame: The end frame. N)r5stoprFrTr?rrrVrUzGradiumTTSService.stopcrR)zcCancel current operation and clean up. Args: frame: The cancel frame. N)r5cancelrFrTr?rrrWrUzGradiumTTSService.cancelcstIdHt|d|jdus|jjtjur,|jr,| |jIdHd|_| IdH|jrM|jsOt|d| | |j |_dSdSdS)z6Establish websocket connection and start receive task.Nz : connectingz: setting receive task)r5rGrdebug _websocketstaterOPENr; cancel_task_connect_websocket create_task_receive_task_handler _report_errorrBr?rrrGs zGradiumTTSService._connectcsRtIdHt|d|jr ||jIdHd|_|IdHdS)z.Close websocket connection and clean up tasks.Nz: disconnecting)r5rFrrXr;r\_disconnect_websocketrBr?rrrFszGradiumTTSService._disconnectc sDzs|jr|jjtjurWdS|jdd}t|j|dIdH|_dd|jjdd}|j dur3|j |d <|j t |IdH|j IdH}t |}|d d kr[td |d |d dkrjtd|d |dIdHWdSty}z!|jd||dIdHd|_|d|IdHWYd}~dSd}~ww)z:Connect to Gradium websocket API with configured settings.Npipecat)z x-api-keyz x-api-source)additional_headerssetuppcmF)rM output_formatr"close_ws_on_eosr%rMerrorzreceived error messagereadyzunexpected first message type on_connectedUnknown error occurred:  error_msg exceptionon_connection_error)rYrZrr[r8websocket_connectr9rr+r:sendjsondumpsrecvloads Exception_call_event_handler push_error)r<headers setup_msg ready_msgerrrr]s6      "z$GradiumTTSService._connect_websocketc sz^z|IdH|jr|jIdHWnty5}z|jd||dIdHWYd}~nd}~wwW|IdHd|_|dIdHdSW|IdHd|_|dIdHdS|IdHd|_|dIdHw)z+Close websocket connection and reset state.Nrlrmon_disconnected)stop_all_metricsrYcloserwryremove_active_audio_contextrx)r<r}rrrras*&z'GradiumTTSService._disconnect_websocketcCs|jr|jStd)z3Get active websocket connection or raise exception.zWebsocket not connected)rYrwrBrrr_get_websocketsz GradiumTTSService._get_websocketc s|p|}|r |jsdSzd|d}|jt|IdHWdSty4t|dYdStyP}zt |d|WYd}~dSd}~ww)z"Flush any pending audio synthesis.N end_of_stream)rMrNz): connection closed normally during flushz exception: ) get_active_audio_context_idrYrrrsrtrrrXrwrh)r<rLflush_idrOr}rrr flush_audios    "zGradiumTTSService.flush_audiocs|IdHdS)uCalled when an audio context is cancelled due to an interruption. No WebSocket message is needed — audio from the interrupted ``client_req_id`` will be silently dropped by the base class once the audio context no longer exists. N)rr<rLrrron_audio_context_interrupted%sz.GradiumTTSService.on_audio_context_interruptedcsdS)aCalled after an audio context has finished playing all of its audio. No close message is needed: Gradium signals completion with an ``end_of_stream`` message (handled in ``_receive_messages``), after which the server-side context is already closed. Nrrrrron_audio_context_completed.sz,GradiumTTSService.on_audio_context_completedcsx|jr|jjtjurtdd|2z3dHW}t|}|d}|ddkrJ|r1| |s2qt t |d|j d|d}|||IdHq|ddkrh|rg| |rg||d|dfg|IdHq|dd kr|r| |r|d d g|IdH||IdH|IdHq|dd kr|t|d IdH|IdH|jd|d|dIdHq6dS)zEProcess incoming websocket messages, demultiplexing by client_req_id.NrNrMaudio)rr1 num_channelsrLrKstart_sr)rr)ResetrrhrLzError: ri)rn)rYrZrCLOSEDrrrsrvgetaudio_context_availabler base64 b64decoder1append_to_audio_contextadd_word_timestampsremove_audio_contextr push_framerry)r<rirOctx_idrQrrr_receive_messages7s>          z#GradiumTTSService._receive_messagesc Cs&t|d|dzj|jr|jjtjur!d|_|IdHz|j||d}| t |IdH| |IdHWn1t yp}z%td|dVt|dV|IdH|IdHWYd}~WdSd}~wwdVWdSt y}ztd|dVWYd}~dSd}~ww)aGenerate speech from text using Gradium's streaming API. Args: text: The text to convert to speech. context_id: Unique identifier for this TTS context. Yields: Frame: Audio frames containing the synthesized speech. z: Generating TTS []N)rKrLrl)rhr)rrXrYrZrrrGrPrrrrsrtstart_tts_usage_metricsrwr rrF)r<rKrLrOr}rrrrun_tts\s.    zGradiumTTSService.run_tts)rJrJ)N)'rrrrrr2r rr!strrr6boolrCrdictrrErPr rSr rVrrWrGrFr]rarrrrrrrr r __classcell__rrr?rr/sV  O       %(r))rrrs dataclassesrtypingrrrlogururpydanticrpipecat.frames.framesrr r r r r rpipecat.services.settingsrpipecat.services.tts_servicer(pipecat.utils.tracing.service_decoratorsr websocketsrwebsockets.asyncio.clientrrqwebsockets.protocolrModuleNotFoundErrorr}rhrwr7rrrrrrs2   $