o i@szdZddlZddlZddlmZmZmZddlmZddl m Z m Z m Z ddl mZmZmZmZmZmZGdddZdS) z Spark TTS Model Loader Loads Spark TTS model with vLLM engine and validates speakers/emotions. Migrated from Veena3/Orpheus to Spark TTS architecture. N)OptionalDictAny) AutoTokenizer)AsyncLLMEngineAsyncEngineArgsSamplingParams)INDIC_EMOTION_TAGSINDIC_SPEAKERS SPEAKER_MAPDEFAULT_MODEL_PATHDEFAULT_MAX_MODEL_LEN VLLM_CONFIGc@s\eZdZdZ   ddededefddZd d Zd d Zd efddZddZ ddZ dS) SparkTTSModelu Spark TTS Model with vLLM inference engine and BiCodec audio tokenizer. Model: BayAreaBoys/spark_tts_4speaker Architecture: Qwen2ForCausalLM with BiCodec audio tokenization Speakers: 12 predefined (mapped to speaker_0-11 as per training) Emotions: 10 tags in [bracket] format CRITICAL REQUIREMENTS: - Load tokenizer with special Spark TTS tokens - Configure vLLM with optimizations (prefix caching, CUDA graphs) - Support speaker mapping (lipakshi → speaker_0, etc.) Nindic_speakers model_path model_typehf_tokenc Ksd|_|durtjdt}||_||_tdtd|tdtdtdd d i}|r5||d <d ti}t j |fi||_ |j |td t |j d||tdt}|||d|rs|tjd<||td|dtd|dtd|dtd|ddtd|dd tdi|}t||_tdtddS) a Initialize Spark TTS model with vLLM. Args: model_path: Path to model directory (local or HF). If None, uses env var or default. model_type: Model type (kept for compatibility, always uses indic_speakers) hf_token: HuggingFace token for private models **engine_kwargs: Additional vLLM engine arguments (override defaults from VLLM_CONFIG) rNSPARK_TTS_MODEL_PATHu!🚀 Initializing Spark TTS Modelu📁 Model path: u{🗣️ Speakers: 12 predefined (lipakshi, vardan, reet, Nandini, krishna, anika, adarsh, Nilay, Aarvi, Asha, Bittu, Mira)u*🎭 Emotions: 10 tags in [bracket] formatu% 📝 Loading tokenizer from model...trust_remote_codeTtokenadditional_special_tokensu✅ Tokenizer loaded:  tokensu4 🔧 Initializing vLLM engine with optimizations...)model tokenizerHUGGING_FACE_HUB_TOKENz - dtype: dtypez - max_model_len: max_model_lenz - gpu_memory_utilization: gpu_memory_utilizationz - enable_prefix_caching: enable_prefix_cachingFz) - enforce_eager (disable CUDA graphs): enforce_eageru)✅ vLLM engine initialized successfully!u+ 🎉 Spark TTS Model ready for inference! )rosenvirongetr rrprintr rfrom_pretrainedradd_special_tokenslen_validate_speakers_validate_emotion_tagsrcopyupdaterrfrom_engine_argsengine) selfrrr engine_kwargstokenizer_kwargsspecial_tokensengine_kwargs_dict engine_argsr!r!8/home/ubuntu/veenaModal/veena3modal/core/model_loader.py__init__'s\     zSparkTTSModel.__init__cCstdttdtD]}|jj|dd}|s td|dq tdttdtd ttd d D]\}}|jj|dd}td |d t|dq7ttd kr]tdd Sd S)z Validate that emotion tags are properly configured for Spark TTS. For Spark TTS, emotion tags use [bracket] format and should be added as special tokens to the tokenizer.  🔍 Validating z emotion tags for Spark TTS...Fr'u⚠️ Warning: Emotion tag z produced no tokens✅ All z emotion tags validatedu 📋 Sample emotion tags:N : rz ...)r%r(r rencode enumerate)r/tag token_idsir!r!r5r*s  z$SparkTTSModel._validate_emotion_tagsc CstdttdtD]1}|tvrtd|dq t|}d|d}|jj|dd}td |d |d t|d q td ttddS)z Validate that all speakers are properly mapped for Spark TTS. Spark TTS uses speaker tokens like <|speaker_0|> to <|speaker_7|>. User-facing names (lipakshi, vardan, etc.) are mapped to these IDs. r7z speakers for Spark TTS...u⚠️ Warning: Speaker z not in SPEAKER_MAPz <|speaker_z|>Fr8r;u → r<rr9z speakers validated with mappingN)r%r(r r rr=)r/ speaker_name speaker_id speaker_tokenr@r!r!r5r)s "z SparkTTSModel._validate_speakersreturncC|jS)z;Get the model type (always 'indic_speakers' for Spark TTS).)rr/r!r!r5get_model_typezSparkTTSModel.get_model_typecCrF)zGet the tokenizer.)rrGr!r!r5 get_tokenizerrIzSparkTTSModel.get_tokenizercCrF)zGet the vLLM engine.)r.rGr!r!r5 get_enginerIzSparkTTSModel.get_engine)NrN) __name__ __module__ __qualname____doc__strr6r*r)rHrJrKr!r!r!r5rs" ^ r)rOr"torchtypingrrr transformersrvllmrrrveena3modal.core.constantsr r r r r rrr!r!r!r5s