o i+; @sPdZddlZddlZddlmZddlmZmZm Z ddl m Z ddl m Z mZmZmZmZmZmZmZddlmZddlmZdd lmZdd lmZdd lmZdd lm Z dd l!m"Z"zddl#m$Z%ddl&m'Z'Wn e(yZ)ze *de)e *de+de)dZ)[)wweGdddeZ,GdddZ-GdddeZ.dS)zCartesia Speech-to-Text service implementation. This module provides a WebSocket-based STT service that integrates with the Cartesia Live transcription API for real-time speech recognition. N) dataclass)AnyAsyncGeneratorOptional)logger) CancelFrameEndFrameFrameInterimTranscriptionFrame StartFrameTranscriptionFrameVADUserStartedSpeakingFrameVADUserStoppedSpeakingFrame)FrameDirection) STTSettings)CARTESIA_TTFS_P99)WebsocketSTTService)Language)time_now_iso8601) traced_stt)connect)Statez Exception: zIIn order to use Cartesia, you need to `pip install pipecat-ai[cartesia]`.zMissing module: c@seZdZdZdS)CartesiaSTTSettingsz Settings for CartesiaSTTService.N)__name__ __module__ __qualname____doc__rrQ/home/ubuntu/.local/lib/python3.10/site-packages/pipecat/services/cartesia/stt.pyr/src @sjeZdZdZdejjddddededed efd d Z d d Z ddZ dddZ e deddfddZdS)CartesiaLiveOptionszConfiguration options for Cartesia Live STT service. .. deprecated:: 0.0.105 Use ``settings=CartesiaSTTService.Settings(...)`` for model/language and direct ``__init__`` parameters for encoding/sample_rate instead. ink-whisper pcm_s16lei>modellanguageencoding sample_rater#r$r%r&cKs"||_||_||_||_||_dS)aInitialize CartesiaLiveOptions with default or provided parameters. Args: model: The transcription model to use. Defaults to "ink-whisper". language: Target language for transcription. Defaults to English. encoding: Audio encoding format. Defaults to "pcm_s16le". sample_rate: Audio sample rate in Hz. Defaults to 16000. **kwargs: Additional parameters for the transcription service. N)r#r$r%r&additional_params)selfr#r$r%r&kwargsrrr__init__>s  zCartesiaLiveOptions.__init__cCs2|jt|jtr |jn|jj|jt|jd}|S)zConvert options to dictionary format. Returns: Dictionary containing all configuration parameters. r")r# isinstancer$strvaluer%r&)r(paramsrrrto_dictVs zCartesiaLiveOptions.to_dictcCs |S)zGet configuration items as key-value pairs. Returns: Iterator of (key, value) tuples for all configuration parameters. )r/itemsr(rrrr0es zCartesiaLiveOptions.itemsNcCs"t||r t||S|j||S)zGet a configuration value by key. Args: key: The configuration parameter name to retrieve. default: Default value if key is not found. Returns: The configuration value or default if not found. )hasattrgetattrr'get)r(keydefaultrrrr4ms zCartesiaLiveOptions.getjson_strreturncCs|dit|S)zCreate options from JSON string. Args: json_str: JSON string containing configuration parameters. Returns: New CartesiaLiveOptions instance with parsed parameters. Nr)jsonloads)clsr7rrr from_json{s zCartesiaLiveOptions.from_jsonN)rrrrrENr-r,intr*r/r0r4 classmethodr<rrrrr6s(   rcspeZdZUdZeZeed<dddddeddeded ed e e d e e d e ed e e ffddZ defddZdeffdd Zdeffdd Zdeffdd ZddZdedeffdd Zdedeedffd d!Zfd"d#Zfd$d%Zd&ede ee!fffd'd( Z"d)d*Z#d+d,Z$d-d.Z%d/d0Z&d1d2Z'e( d:d3ed4ed5e e)fd6d7Z*d8d9Z+Z,S);CartesiaSTTServicea+Speech-to-text service using Cartesia Live API. Provides real-time speech transcription through WebSocket connection to Cartesia's Live transcription service. Supports both interim and final transcriptions with configurable models and languages. Cartesia disconnects WebSocket connections after 3 minutes of inactivity. The timeout resets with each message (audio data or text command) sent to the server. Silence-based keepalive is enabled by default to prevent this. See: https://docs.cartesia.ai/api-reference/stt/stt _settingsr!N)base_urlr%r& live_optionssettingsttfs_p99_latencyapi_keyrDr%r&rErFrGc  s|jdtjjd} |dur<|d|s<|jr|dur|j}|jr$|j}|jr+|j| _|jr<|j} t | tr9| jn| | _|durE| |t j d ||dd| d|||_ |pZd|_d|_||_dS) a5Initialize CartesiaSTTService with API key and options. Args: api_key: Authentication key for Cartesia API. base_url: Custom API endpoint URL. If empty, uses default. encoding: Audio encoding format. Defaults to "pcm_s16le". sample_rate: Audio sample rate in Hz. If None, uses the pipeline sample rate. live_options: Configuration options for transcription service. .. deprecated:: 0.0.105 Use ``settings=CartesiaSTTService.Settings(...)`` for model/language and direct init parameters for encoding/sample_rate instead. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. ttfs_p99_latency: P99 latency from speech end to final transcript in seconds. Override for your deployment. See https://github.com/pipecat-ai/stt-benchmark **kwargs: Additional arguments passed to parent STTService. r )r#r$NrEx)r&rGkeepalive_timeoutkeepalive_intervalrFzapi.cartesia.air)Settingsrr>r-"_warn_init_param_moved_to_settingsr&r%r#r$r+ apply_updatesuperr*_api_key _base_url _receive_task _encoding) r(rHrDr%r&rErFrGr)default_settingslang __class__rrr*s>!    zCartesiaSTTService.__init__r8cCsdS)zCheck if the service can generate processing metrics. Returns: True, indicating metrics are supported. Trr1rrrcan_generate_metricssz'CartesiaSTTService.can_generate_metricsframec&t|IdH|IdHdS)zStart the STT service and establish connection. Args: frame: Frame indicating service should start. N)rPstart_connectr(rZrWrrr\zCartesiaSTTService.startcr[)z{Stop the STT service and close connection. Args: frame: Frame indicating service should stop. N)rPstop _disconnectr^rWrrr`r_zCartesiaSTTService.stopcr[)zCancel the STT service and close connection. Args: frame: Frame indicating service should be cancelled. N)rPcancelrar^rWrrrbr_zCartesiaSTTService.cancelcs|IdHdS)zBStart performance metrics collection for transcription processing.N)start_processing_metricsr1rrr_start_metricssz!CartesiaSTTService._start_metrics directioncsrt||IdHt|tr|IdHdSt|tr3|jr5|jjtj ur7|j dIdHdSdSdSdS)zProcess incoming frames and handle speech events. Args: frame: The frame to process. direction: Direction of frame flow in the pipeline. Nfinalize) rP process_framer+r rdr _websocketstaterOPENsend)r(rZrerWrrrgs  z CartesiaSTTService.process_frameaudiocCs@|jr |jjtjur|IdH|j|IdHdVdS)zProcess audio data for speech-to-text transcription. Args: audio: Raw audio bytes to transcribe. Yields: None - transcription results are handled via WebSocket responses. N)rhrirCLOSEDr]rk)r(rlrrrrun_stts   zCartesiaSTTService.run_sttcsL|IdHtIdH|jr"|js$|||j|_dSdSdSr=)_connect_websocketrPr]rhrS create_task_receive_task_handler _report_errorr1rWrrr]'s  zCartesiaSTTService._connectcsBtIdH|jr||jIdHd|_|IdHdSr=)rPrarS cancel_task_disconnect_websocketr1rWrrra/s zCartesiaSTTService._disconnectdeltacs"t|IdH}|||S)zApply a settings delta. Args: delta: A :class:`STTSettings` (or ``CartesiaSTTService.Settings``) delta. Returns: Dict mapping changed field names to their previous values. N)rP_update_settings _warn_unhandled_updated_settings)r(ruchangedrWrrrv8s z#CartesiaSTTService._update_settingsc szI|jr|jjtjurWdStd|jj|jj|j t |j d}d|j dt j|}d|jd}t||dIdH|_|dIdHWdStyj}z|jd ||d IdHWYd}~dSd}~ww) NzConnecting to Cartesia STTr"zwss://z/stt/websocket?z 2025-04-16)zCartesia-Versionz X-API-Key)additional_headers on_connectedzUnknown error occurred:  error_msg exception)rhrirrjrdebugrBr#r$rTr,r&rRurllibparse urlencoderQwebsocket_connect_call_event_handler Exception push_error)r(r.ws_urlheaderserrrroMs$  (z%CartesiaSTTService._connect_websocketc szUz|jr|jjtjurtd|jIdHWnty:}z|jd||dIdHWYd}~nd}~wwWd|_| dIdHdSWd|_| dIdHdSd|_| dIdHw)NzDisconnecting from Cartesia STTzError closing websocket: r{on_disconnected) rhrirrjrr~closerrr)r(rrrrrtas$ &z(CartesiaSTTService._disconnect_websocketcCs|jr|jStd)NzWebsocket not connected)rhrr1rrr_get_websocketlsz!CartesiaSTTService._get_websocketc s|2z@3dHW}zt|}||IdHWqtjy,td|YqtyE}ztd|WYd}~qd}~ww6dS)z$Process incoming WebSocket messages.NzReceived non-JSON message: zError processing message: ) rr9r:_process_responseJSONDecodeErrorrwarningrerror)r(messagedatarrrr_receive_messagesqs z$CartesiaSTTService._receive_messagescs`d|vr,|ddkr||IdHdS|ddkr.|dd}|j|dIdHdSdSdS)Ntype transcriptrrz Unknown error)r|)_on_transcriptr4r)r(rr|rrrr|s   z$CartesiaSTTService._process_responseris_finalr$csdS)z+Handle a transcription result with tracing.Nr)r(rrr$rrr_handle_transcriptionsz(CartesiaSTTService._handle_transcriptionc sd|vrdS|dd}|dd}d}d|vr-zt|d}Wn ttfy,Ynwt|dkrl|rY|t||jt||dIdH| |||IdH| IdHdS|t ||jt||dIdHdSdS)NtextrCrFr$r)result) r4r ValueErrorKeyErrorlen push_framer _user_idrrstop_processing_metricsr )r(rrrr$rrrrsF     z!CartesiaSTTService._on_transcriptr=)-rrrrrrM__annotations__rr,rr?rfloatr*boolrYr r\rr`rrbrdr rrgbytesrrnr]rardictrrvrortrrrrrrr __classcell__rrrWrrAsd   H          rA)/rr9 urllib.parser dataclassesrtypingrrrlogururpipecat.frames.framesrrr r r r r r"pipecat.processors.frame_processorrpipecat.services.settingsrpipecat.services.stt_latencyrpipecat.services.stt_servicerpipecat.transcriptions.languagerpipecat.utils.timer(pipecat.utils.tracing.service_decoratorsrwebsockets.asyncio.clientrrwebsockets.protocolrModuleNotFoundErrorrrrrrrArrrrs6  (        R