Output:
Chunk ID: 1fc19b
Wall time: 1.2011 seconds
Process running with session ID 20809
Original token count: 1057
Output:
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://mcache-dsm.massedcompute.com/simple, https://pypi.org/simple
Collecting torch==2.9.1
  Using cached torch-2.9.1-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (30 kB)
Collecting torchaudio==2.9.1
  Using cached torchaudio-2.9.1-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (6.9 kB)
Collecting torchvision==0.24.1
  Using cached torchvision-0.24.1-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (5.9 kB)
Requirement already satisfied: filelock in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (3.24.2)
Requirement already satisfied: typing-extensions>=4.10.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (4.15.0)
Requirement already satisfied: sympy>=1.13.3 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (1.14.0)
Requirement already satisfied: networkx>=2.5.1 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (3.4.2)
Requirement already satisfied: jinja2 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (3.1.6)
Requirement already satisfied: fsspec>=0.8.5 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (2026.2.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.93 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (12.8.93)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.90 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (12.8.90)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.90 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (12.8.90)
Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (9.10.2.21)
Requirement already satisfied: nvidia-cublas-cu12==12.8.4.1 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (12.8.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.83 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (11.3.3.83)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.90 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (10.3.9.90)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.3.90 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (11.7.3.90)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.8.93 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (12.5.8.93)
Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (0.7.1)
Requirement already satisfied: nvidia-nccl-cu12==2.27.5 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (2.27.5)
Collecting nvidia-nvshmem-cu12==3.3.20 (from torch==2.9.1)
  Using cached nvidia_nvshmem_cu12-3.3.20-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.1 kB)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.90 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (12.8.90)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.93 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (12.8.93)
Requirement already satisfied: nvidia-cufile-cu12==1.13.1.3 in /home/ubuntu/.local/lib/python3.10/site-packages (from torch==2.9.1) (1.13.1.3)
Collecting triton==3.5.1 (from torch==2.9.1)
  Using cached triton-3.5.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (1.7 kB)
Requirement already satisfied: numpy in /home/ubuntu/.local/lib/python3.10/site-packages (from torchvision==0.24.1) (2.2.6)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from torchvision==0.24.1) (12.1.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from sympy>=1.13.3->torch==2.9.1) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from jinja2->torch==2.9.1) (3.0.3)
Using cached torch-2.9.1-cp310-cp310-manylinux_2_28_x86_64.whl (899.8 MB)


# Collaboration Mode: Default

You are now in Default mode. Any previous instructions for other modes (e.g. Plan mode) are no longer active.

Your active mode changes only when new developer instructions with a different `<collaboration_mode>...</collaboration_mode>` change it; user requests or tool descriptions do not change mode by themselves. Known mode names are Default and Plan.

## request_user_input availability

The `request_user_input` tool is unavailable in Default mode. If you call it while in Default mode, it will return an error.

If a decision is necessary and cannot be discovered from local context, ask the user directly. However, in Default mode you should strongly prefer executing the user's request rather than stopping to ask questions.

Summary: auto

## Skills
A skill is a set of local instructions to follow that is stored in a `SKILL.md` file. Below is the list of skills that can be used. Each entry includes a name, description, and file path so you can open the source for full instructions when using a specific skill.
### Available skills
- skill-creator: Guide for creating effective skills. This skill should be used when users want to create a new skill (or update an existing skill) that extends Codex's capabilities with specialized knowledge, workflows, or tool integrations. (file: /home/ubuntu/.codex/skills/.system/skill-creator/SKILL.md)
- skill-installer: Install Codex skills into $CODEX_HOME/skills from a curated list or a GitHub repo path. Use when a user asks to list installable skills, install a curated skill, or install a skill from another repo (including private repos). (file: /home/ubuntu/.codex/skills/.system/skill-installer/SKILL.md)
### How to use skills
- Discovery: The list above is the skills available in this session (name + description + file path). Skill bodies live on disk at the listed paths.
- Trigger rules: If the user names a skill (with `$SkillName` or plain text) OR the task clearly matches a skill's description shown above, you must use that skill for that turn. Multiple mentions mean use them all. Do not carry skills across turns unless re-mentioned.
- Missing/blocked: If a named skill isn't in the list or the path can't be read, say so briefly and continue with the best fallback.
- How to use a skill (progressive disclosure):
  1) After deciding to use a skill, open its `SKILL.md`. Read only enough to follow the workflow.
  2) When `SKILL.md` references relative paths (e.g., `scripts/foo.py`), resolve them relative to the skill directory listed above first, and only consider other paths if needed.
  3) If `SKILL.md` points to extra folders such as `references/`, load only the specific files needed for the request; don't bulk-load everything.
  4) If `scripts/` exist, prefer running or patching them instead of retyping large code blocks.
  5) If `assets/` or templates exist, reuse them instead of recreating from scratch.
- Coordination and sequencing:
  - If multiple skills apply, choose the minimal set that covers the request and state the order you'll use them.
  - Announce which skill(s) you're using and why (one short line). If you skip an obvious skill, say why.
- Context hygiene:
  - Keep context small: summarize long sections instead of pasting them; only load extra files when needed.
  - Avoid deep reference-chasing: prefer opening only files directly linked from `SKILL.md` unless you're blocked.
  - When variants exist (frameworks, providers, domains), pick only the relevant reference file(s) and note that choice.
- Safety and fallback: If a skill can't be applied cleanly (missing files, unclear instructions), state the issue, pick the next-best approach, and continue.


Output:
Chunk ID: 5dc86b
Wall time: 5.0004 seconds
Process running with session ID 20809
Original token count: 202
Output:
Using cached torchaudio-2.9.1-cp310-cp310-manylinux_2_28_x86_64.whl (2.1 MB)
Using cached torchvision-0.24.1-cp310-cp310-manylinux_2_28_x86_64.whl (8.0 MB)
Using cached nvidia_nvshmem_cu12-3.3.20-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (124.7 MB)
Using cached triton-3.5.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (170.3 MB)
Installing collected packages: triton, nvidia-nvshmem-cu12, torch, torchvision, torchaudio
  Attempting uninstall: triton
    Found existing installation: triton 3.6.0
    Uninstalling triton-3.6.0:
      Successfully uninstalled triton-3.6.0
  Attempting uninstall: nvidia-nvshmem-cu12
    Found existing installation: nvidia-nvshmem-cu12 3.4.5
    Uninstalling nvidia-nvshmem-cu12-3.4.5:
      Successfully uninstalled nvidia-nvshmem-cu12-3.4.5


Summary: auto


Output:
Chunk ID: df795a
Wall time: 5.0010 seconds
Process running with session ID 20809
Original token count: 38
Output:
  Attempting uninstall: torch
    Found existing installation: torch 2.10.0
    Uninstalling torch-2.10.0:
      Successfully uninstalled torch-2.10.0


Output:
Chunk ID: 8d0821
Wall time: 5.0012 seconds
Process running with session ID 20809
Original token count: 0
Output:


I’m still installing compatible runtime packages. I’ll wait for completion and then verify versions before attempting server startup again.


Output:
Chunk ID: 5bfdef
Wall time: 5.0007 seconds
Process running with session ID 20809
Original token count: 0
Output:


Output:
Chunk ID: fb8190
Wall time: 0.0552 seconds
Process exited with code 0
Original token count: 146
Output:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
vllm 0.15.1 requires ray[cgraph]>=2.48.0, which is not installed.
vllm 0.15.1 requires tiktoken>=0.6.0, which is not installed.
vllm 0.15.1 requires lark==1.2.2, but you have lark 1.3.1 which is incompatible.
vllm 0.15.1 requires numba==0.61.2, but you have numba 0.63.1 which is incompatible.
Successfully installed nvidia-nvshmem-cu12-3.3.20 torch-2.9.1 torchaudio-2.9.1 torchvision-0.24.1 triton-3.5.1


python3 - <<'PY'
import torch, vllm
print('torch',torch.__version__)
print('torch cuda',torch.version.cuda)
print('vllm import ok', vllm.__version__)
PY


Output:
Chunk ID: 3807ea
Wall time: 2.8352 seconds
Process exited with code 0
Original token count: 14
Output:
torch 2.9.1+cu128
torch cuda 12.8
vllm import ok 0.15.1


python3 -m veena3modal.local_server --skip-download --port 8000


Output:
Chunk ID: 8bbf26
Wall time: 1.2008 seconds
Process running with session ID 94110
Original token count: 454
Output:
2026-02-17 00:12:02 | INFO     | veena3.local | Auth bypass enabled (local mode). Use --auth to require API keys.
2026-02-17 00:12:02 | INFO     | veena3.local | Resolved model paths:
2026-02-17 00:12:02 | INFO     | veena3.local |   LLM (vLLM):    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:02 | INFO     | veena3.local |   BiCodec:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:02 | INFO     | veena3.local | ============================================================
2026-02-17 00:12:02 | INFO     | veena3.local | Initializing Veena3 TTS Runtime (local)
2026-02-17 00:12:02 | INFO     | veena3.local |   Model:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:02 | INFO     | veena3.local |   LLM path:    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:02 | INFO     | veena3.local |   BiCodec:     /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:02 | INFO     | veena3.local |   Device:      cuda
2026-02-17 00:12:02 | INFO     | veena3.local |   GPU Memory:  25% (total)
2026-02-17 00:12:02 | INFO     | veena3.local |   Engines:     1
2026-02-17 00:12:02 | INFO     | veena3.local |   SR:          disabled
2026-02-17 00:12:02 | INFO     | veena3.local | ============================================================
2026-02-17 00:12:02 | INFO     | veena3modal.services.tts_runtime | Initializing TTS runtime...
2026-02-17 00:12:02 | INFO     | veena3modal.services.tts_runtime |   Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:02 | INFO     | veena3modal.services.tts_runtime |   BiCodec path: /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:02 | INFO     | veena3modal.services.tts_runtime |   SR enabled: False, path: None


Output:
Chunk ID: 1e75df
Wall time: 4.0784 seconds
Process exited with code 1
Original token count: 1197
Output:
2026-02-17 00:12:08 | ERROR    | veena3modal.services.tts_runtime | ❌ Failed to initialize TTS runtime: No module named 'tiktoken'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 146, in initialize_runtime
    from veena3modal.core.model_loader import SparkTTSModel
  File "/home/ubuntu/veenaModal/veena3modal/core/model_loader.py", line 12, in <module>
    from vllm import AsyncLLMEngine, AsyncEngineArgs, SamplingParams
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/__init__.py", line 74, in __getattr__
    module = import_module(module_name, __package__)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 4, in <module>
    from vllm.v1.engine.async_llm import AsyncLLM
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/async_llm.py", line 19, in <module>
    from vllm.engine.protocol import EngineClient
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/engine/protocol.py", line 18, in <module>
    from vllm.v1.engine.input_processor import InputProcessor
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/input_processor.py", line 35, in <module>
    from vllm.tokenizers.mistral import MistralTokenizer
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/tokenizers/mistral.py", line 15, in <module>
    from mistral_common.tokens.tokenizers.instruct import InstructTokenizerV13
  File "/home/ubuntu/.local/lib/python3.10/site-packages/mistral_common/tokens/tokenizers/instruct.py", line 50, in <module>
    from mistral_common.tokens.tokenizers.tekken import Tekkenizer
  File "/home/ubuntu/.local/lib/python3.10/site-packages/mistral_common/tokens/tokenizers/tekken.py", line 11, in <module>
    import tiktoken
ModuleNotFoundError: No module named 'tiktoken'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 146, in initialize_runtime
    from veena3modal.core.model_loader import SparkTTSModel
  File "/home/ubuntu/veenaModal/veena3modal/core/model_loader.py", line 12, in <module>
    from vllm import AsyncLLMEngine, AsyncEngineArgs, SamplingParams
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/__init__.py", line 74, in __getattr__
    module = import_module(module_name, __package__)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 4, in <module>
    from vllm.v1.engine.async_llm import AsyncLLM
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/async_llm.py", line 19, in <module>
    from vllm.engine.protocol import EngineClient
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/engine/protocol.py", line 18, in <module>
    from vllm.v1.engine.input_processor import InputProcessor
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/input_processor.py", line 35, in <module>
    from vllm.tokenizers.mistral import MistralTokenizer
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/tokenizers/mistral.py", line 15, in <module>
    from mistral_common.tokens.tokenizers.instruct import InstructTokenizerV13
  File "/home/ubuntu/.local/lib/python3.10/site-packages/mistral_common/tokens/tokenizers/instruct.py", line 50, in <module>
    from mistral_common.tokens.tokenizers.tekken import Tekkenizer
  File "/home/ubuntu/.local/lib/python3.10/site-packages/mistral_common/tokens/tokenizers/tekken.py", line 11, in <module>
    import tiktoken
ModuleNotFoundError: No module named 'tiktoken'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 465, in <module>
    main()
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 426, in main
    initialize_local_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 224, in initialize_local_runtime
    runtime = initialize_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 272, in initialize_runtime
    raise RuntimeError(f"TTS runtime initialization failed: {e}") from e
RuntimeError: TTS runtime initialization failed: No module named 'tiktoken'


Server now gets past vLLM import but fails on missing `tiktoken`. I’ll install the missing runtime dependencies next and retry startup so we can run the real benchmark.


python3 -m pip install tiktoken lark==1.2.2 numba==0.61.2 ray==2.48.0


Output:
Chunk ID: 5a03fc
Wall time: 1.2010 seconds
Process running with session ID 85621
Original token count: 122
Output:
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://mcache-dsm.massedcompute.com/simple, https://pypi.org/simple
Collecting tiktoken
  Downloading tiktoken-0.12.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (6.7 kB)
Collecting lark==1.2.2
  Using cached lark-1.2.2-py3-none-any.whl.metadata (1.8 kB)
Collecting numba==0.61.2
  Using cached numba-0.61.2-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.8 kB)


Output:
Chunk ID: 3f631f
Wall time: 5.0015 seconds
Process running with session ID 85621
Original token count: 924
Output:
Collecting ray==2.48.0
  Downloading ray-2.48.0-cp310-cp310-manylinux2014_x86_64.whl.metadata (19 kB)
Requirement already satisfied: llvmlite<0.45,>=0.44.0dev0 in /home/ubuntu/.local/lib/python3.10/site-packages (from numba==0.61.2) (0.44.0)
Requirement already satisfied: numpy<2.3,>=1.24 in /home/ubuntu/.local/lib/python3.10/site-packages (from numba==0.61.2) (2.2.6)
Requirement already satisfied: click>=7.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from ray==2.48.0) (8.3.1)
Requirement already satisfied: filelock in /home/ubuntu/.local/lib/python3.10/site-packages (from ray==2.48.0) (3.24.2)
Requirement already satisfied: jsonschema in /home/ubuntu/.local/lib/python3.10/site-packages (from ray==2.48.0) (4.26.0)
Requirement already satisfied: msgpack<2.0.0,>=1.0.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from ray==2.48.0) (1.1.2)
Requirement already satisfied: packaging in /home/ubuntu/.local/lib/python3.10/site-packages (from ray==2.48.0) (26.0)
Requirement already satisfied: protobuf!=3.19.5,>=3.15.3 in /home/ubuntu/.local/lib/python3.10/site-packages (from ray==2.48.0) (6.33.5)
Requirement already satisfied: pyyaml in /usr/lib/python3/dist-packages (from ray==2.48.0) (5.4.1)
Requirement already satisfied: requests in /home/ubuntu/.local/lib/python3.10/site-packages (from ray==2.48.0) (2.32.5)
Requirement already satisfied: regex>=2022.1.18 in /home/ubuntu/.local/lib/python3.10/site-packages (from tiktoken) (2026.1.15)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/ubuntu/.local/lib/python3.10/site-packages (from requests->ray==2.48.0) (3.4.4)
Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests->ray==2.48.0) (3.3)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/ubuntu/.local/lib/python3.10/site-packages (from requests->ray==2.48.0) (2.6.3)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests->ray==2.48.0) (2020.6.20)
Requirement already satisfied: attrs>=22.2.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from jsonschema->ray==2.48.0) (25.4.0)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/ubuntu/.local/lib/python3.10/site-packages (from jsonschema->ray==2.48.0) (2025.9.1)
Requirement already satisfied: referencing>=0.28.4 in /home/ubuntu/.local/lib/python3.10/site-packages (from jsonschema->ray==2.48.0) (0.37.0)
Requirement already satisfied: rpds-py>=0.25.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from jsonschema->ray==2.48.0) (0.30.0)
Requirement already satisfied: typing-extensions>=4.4.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from referencing>=0.28.4->jsonschema->ray==2.48.0) (4.15.0)
Using cached lark-1.2.2-py3-none-any.whl (111 kB)
Using cached numba-0.61.2-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.8 MB)
Downloading ray-2.48.0-cp310-cp310-manylinux2014_x86_64.whl (69.9 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69.9/69.9 MB 22.9 MB/s  0:00:03
Downloading tiktoken-0.12.0-cp310-cp310-manylinux_2_28_x86_64.whl (1.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 77.9 MB/s  0:00:00
Installing collected packages: numba, lark, tiktoken, ray
  Attempting uninstall: numba
    Found existing installation: numba 0.63.1
    Uninstalling numba-0.63.1:
      Successfully uninstalled numba-0.63.1
  Attempting uninstall: lark
    Found existing installation: lark 1.3.1
    Uninstalling lark-1.3.1:
      Successfully uninstalled lark-1.3.1


Output:
Chunk ID: bca75e
Wall time: 0.7741 seconds
Process exited with code 0
Original token count: 19
Output:

Successfully installed lark-1.2.2 numba-0.61.2 ray-2.48.0 tiktoken-0.12.0


Output:
Chunk ID: 594042
Wall time: 1.2004 seconds
Process running with session ID 98657
Original token count: 454
Output:
2026-02-17 00:12:23 | INFO     | veena3.local | Auth bypass enabled (local mode). Use --auth to require API keys.
2026-02-17 00:12:23 | INFO     | veena3.local | Resolved model paths:
2026-02-17 00:12:23 | INFO     | veena3.local |   LLM (vLLM):    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:23 | INFO     | veena3.local |   BiCodec:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:23 | INFO     | veena3.local | ============================================================
2026-02-17 00:12:23 | INFO     | veena3.local | Initializing Veena3 TTS Runtime (local)
2026-02-17 00:12:23 | INFO     | veena3.local |   Model:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:23 | INFO     | veena3.local |   LLM path:    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:23 | INFO     | veena3.local |   BiCodec:     /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:23 | INFO     | veena3.local |   Device:      cuda
2026-02-17 00:12:23 | INFO     | veena3.local |   GPU Memory:  25% (total)
2026-02-17 00:12:23 | INFO     | veena3.local |   Engines:     1
2026-02-17 00:12:23 | INFO     | veena3.local |   SR:          disabled
2026-02-17 00:12:23 | INFO     | veena3.local | ============================================================
2026-02-17 00:12:23 | INFO     | veena3modal.services.tts_runtime | Initializing TTS runtime...
2026-02-17 00:12:23 | INFO     | veena3modal.services.tts_runtime |   Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:23 | INFO     | veena3modal.services.tts_runtime |   BiCodec path: /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:23 | INFO     | veena3modal.services.tts_runtime |   SR enabled: False, path: None


Output:
Chunk ID: a3e7d0
Wall time: 4.0415 seconds
Process exited with code 1
Original token count: 1574
Output:
2026-02-17 00:12:28 | ERROR    | veena3modal.services.tts_runtime | ❌ Failed to initialize TTS runtime: No module named 'interegular'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 146, in initialize_runtime
    from veena3modal.core.model_loader import SparkTTSModel
  File "/home/ubuntu/veenaModal/veena3modal/core/model_loader.py", line 12, in <module>
    from vllm import AsyncLLMEngine, AsyncEngineArgs, SamplingParams
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/__init__.py", line 74, in __getattr__
    module = import_module(module_name, __package__)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 4, in <module>
    from vllm.v1.engine.async_llm import AsyncLLM
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/async_llm.py", line 19, in <module>
    from vllm.engine.protocol import EngineClient
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/engine/protocol.py", line 18, in <module>
    from vllm.v1.engine.input_processor import InputProcessor
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/input_processor.py", line 44, in <module>
    from vllm.v1.structured_output.backend_lm_format_enforcer import (
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/structured_output/backend_lm_format_enforcer.py", line 42, in <module>
    class LMFormatEnforcerGrammar(StructuredOutputGrammar):
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/structured_output/backend_lm_format_enforcer.py", line 43, in LMFormatEnforcerGrammar
    token_enforcer: lmformatenforcer.TokenEnforcer
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/utils/import_utils.py", line 385, in __getattr__
    self._module = self._load()
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/utils/import_utils.py", line 375, in _load
    raise err from None
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/utils/import_utils.py", line 369, in _load
    module = importlib.import_module(self.__name__)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/lmformatenforcer/__init__.py", line 14, in <module>
    from .regexparser import RegexParser
  File "/home/ubuntu/.local/lib/python3.10/site-packages/lmformatenforcer/regexparser.py", line 2, in <module>
    import interegular
ModuleNotFoundError: No module named 'interegular'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 146, in initialize_runtime
    from veena3modal.core.model_loader import SparkTTSModel
  File "/home/ubuntu/veenaModal/veena3modal/core/model_loader.py", line 12, in <module>
    from vllm import AsyncLLMEngine, AsyncEngineArgs, SamplingParams
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/__init__.py", line 74, in __getattr__
    module = import_module(module_name, __package__)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 4, in <module>
    from vllm.v1.engine.async_llm import AsyncLLM
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/async_llm.py", line 19, in <module>
    from vllm.engine.protocol import EngineClient
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/engine/protocol.py", line 18, in <module>
    from vllm.v1.engine.input_processor import InputProcessor
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/input_processor.py", line 44, in <module>
    from vllm.v1.structured_output.backend_lm_format_enforcer import (
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/structured_output/backend_lm_format_enforcer.py", line 42, in <module>
    class LMFormatEnforcerGrammar(StructuredOutputGrammar):
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/structured_output/backend_lm_format_enforcer.py", line 43, in LMFormatEnforcerGrammar
    token_enforcer: lmformatenforcer.TokenEnforcer
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/utils/import_utils.py", line 385, in __getattr__
    self._module = self._load()
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/utils/import_utils.py", line 375, in _load
    raise err from None
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/utils/import_utils.py", line 369, in _load
    module = importlib.import_module(self.__name__)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/lmformatenforcer/__init__.py", line 14, in <module>
    from .regexparser import RegexParser
  File "/home/ubuntu/.local/lib/python3.10/site-packages/lmformatenforcer/regexparser.py", line 2, in <module>
    import interegular
ModuleNotFoundError: No module named 'interegular'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 465, in <module>
    main()
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 426, in main
    initialize_local_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 224, in initialize_local_runtime
    runtime = initialize_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 272, in initialize_runtime
    raise RuntimeError(f"TTS runtime initialization failed: {e}") from e
RuntimeError: TTS runtime initialization failed: No module named 'interegular'


Output:
Chunk ID: bfb36c
Wall time: 1.2000 seconds
Process exited with code 0
Original token count: 100
Output:
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://mcache-dsm.massedcompute.com/simple, https://pypi.org/simple
Collecting interegular
  Using cached interegular-0.3.3-py37-none-any.whl.metadata (3.0 kB)
Using cached interegular-0.3.3-py37-none-any.whl (23 kB)
Installing collected packages: interegular
Successfully installed interegular-0.3.3


I’m one dependency at a time through vLLM init errors (it now got past `tiktoken` and is complaining `interegular`). I’ll install it and immediately retry startup; if there are further dependency blockers, I’ll continue until runtime boots.


Output:
Chunk ID: cd33ec
Wall time: 1.2013 seconds
Process running with session ID 2845
Original token count: 454
Output:
2026-02-17 00:12:35 | INFO     | veena3.local | Auth bypass enabled (local mode). Use --auth to require API keys.
2026-02-17 00:12:35 | INFO     | veena3.local | Resolved model paths:
2026-02-17 00:12:35 | INFO     | veena3.local |   LLM (vLLM):    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:35 | INFO     | veena3.local |   BiCodec:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:35 | INFO     | veena3.local | ============================================================
2026-02-17 00:12:35 | INFO     | veena3.local | Initializing Veena3 TTS Runtime (local)
2026-02-17 00:12:35 | INFO     | veena3.local |   Model:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:35 | INFO     | veena3.local |   LLM path:    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:35 | INFO     | veena3.local |   BiCodec:     /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:35 | INFO     | veena3.local |   Device:      cuda
2026-02-17 00:12:35 | INFO     | veena3.local |   GPU Memory:  25% (total)
2026-02-17 00:12:35 | INFO     | veena3.local |   Engines:     1
2026-02-17 00:12:35 | INFO     | veena3.local |   SR:          disabled
2026-02-17 00:12:35 | INFO     | veena3.local | ============================================================
2026-02-17 00:12:35 | INFO     | veena3modal.services.tts_runtime | Initializing TTS runtime...
2026-02-17 00:12:35 | INFO     | veena3modal.services.tts_runtime |   Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:35 | INFO     | veena3modal.services.tts_runtime |   BiCodec path: /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:35 | INFO     | veena3modal.services.tts_runtime |   SR enabled: False, path: None


Output:
Chunk ID: 4041a2
Wall time: 3.2582 seconds
Process exited with code 1
Original token count: 918
Output:
2026-02-17 00:12:40 | ERROR    | veena3modal.services.tts_runtime | ❌ Failed to initialize TTS runtime: No module named 'omegaconf'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 17, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 24, in <module>
    from sparktts.utils.file import load_config
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/utils/file.py", line 31, in <module>
    from omegaconf import OmegaConf, DictConfig
ModuleNotFoundError: No module named 'omegaconf'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 148, in initialize_runtime
    from veena3modal.core.bicodec_decoder import BiCodecDecoder
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 28, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 24, in <module>
    from sparktts.utils.file import load_config
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/utils/file.py", line 31, in <module>
    from omegaconf import OmegaConf, DictConfig
ModuleNotFoundError: No module named 'omegaconf'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 17, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 24, in <module>
    from sparktts.utils.file import load_config
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/utils/file.py", line 31, in <module>
    from omegaconf import OmegaConf, DictConfig
ModuleNotFoundError: No module named 'omegaconf'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 148, in initialize_runtime
    from veena3modal.core.bicodec_decoder import BiCodecDecoder
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 28, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 24, in <module>
    from sparktts.utils.file import load_config
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/utils/file.py", line 31, in <module>
    from omegaconf import OmegaConf, DictConfig
ModuleNotFoundError: No module named 'omegaconf'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 465, in <module>
    main()
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 426, in main
    initialize_local_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 224, in initialize_local_runtime
    runtime = initialize_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 272, in initialize_runtime
    raise RuntimeError(f"TTS runtime initialization failed: {e}") from e
RuntimeError: TTS runtime initialization failed: No module named 'omegaconf'


Output:
Chunk ID: bc43fa
Wall time: 4.6058 seconds
Process exited with code 0
Original token count: 389
Output:
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://mcache-dsm.massedcompute.com/simple, https://pypi.org/simple
Collecting omegaconf
  Downloading omegaconf-2.3.0-py3-none-any.whl.metadata (3.9 kB)
Collecting antlr4-python3-runtime==4.9.* (from omegaconf)
  Downloading antlr4-python3-runtime-4.9.3.tar.gz (117 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: PyYAML>=5.1.0 in /usr/lib/python3/dist-packages (from omegaconf) (5.4.1)
Downloading omegaconf-2.3.0-py3-none-any.whl (79 kB)
Building wheels for collected packages: antlr4-python3-runtime
  Building wheel for antlr4-python3-runtime (pyproject.toml): started
  Building wheel for antlr4-python3-runtime (pyproject.toml): finished with status 'done'
  Created wheel for antlr4-python3-runtime: filename=antlr4_python3_runtime-4.9.3-py3-none-any.whl size=144591 sha256=a91b6bcd30c4571b87ac12b89fac28155834bc6c1595d8e20ac641d39b46c9a4
  Stored in directory: /home/ubuntu/.cache/pip/wheels/12/93/dd/1f6a127edc45659556564c5730f6d4e300888f4bca2d4c5a88
Successfully built antlr4-python3-runtime
Installing collected packages: antlr4-python3-runtime, omegaconf

Successfully installed antlr4-python3-runtime-4.9.3 omegaconf-2.3.0


Output:
Chunk ID: 3fbac8
Wall time: 1.2006 seconds
Process running with session ID 10694
Original token count: 454
Output:
2026-02-17 00:12:50 | INFO     | veena3.local | Auth bypass enabled (local mode). Use --auth to require API keys.
2026-02-17 00:12:50 | INFO     | veena3.local | Resolved model paths:
2026-02-17 00:12:50 | INFO     | veena3.local |   LLM (vLLM):    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:50 | INFO     | veena3.local |   BiCodec:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:50 | INFO     | veena3.local | ============================================================
2026-02-17 00:12:50 | INFO     | veena3.local | Initializing Veena3 TTS Runtime (local)
2026-02-17 00:12:50 | INFO     | veena3.local |   Model:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:50 | INFO     | veena3.local |   LLM path:    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:50 | INFO     | veena3.local |   BiCodec:     /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:50 | INFO     | veena3.local |   Device:      cuda
2026-02-17 00:12:50 | INFO     | veena3.local |   GPU Memory:  25% (total)
2026-02-17 00:12:50 | INFO     | veena3.local |   Engines:     1
2026-02-17 00:12:50 | INFO     | veena3.local |   SR:          disabled
2026-02-17 00:12:50 | INFO     | veena3.local | ============================================================
2026-02-17 00:12:50 | INFO     | veena3modal.services.tts_runtime | Initializing TTS runtime...
2026-02-17 00:12:50 | INFO     | veena3modal.services.tts_runtime |   Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:12:50 | INFO     | veena3modal.services.tts_runtime |   BiCodec path: /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:12:50 | INFO     | veena3modal.services.tts_runtime |   SR enabled: False, path: None


Output:
Chunk ID: 175919
Wall time: 3.1008 seconds
Process exited with code 1
Original token count: 880
Output:
2026-02-17 00:12:55 | ERROR    | veena3modal.services.tts_runtime | ❌ Failed to initialize TTS runtime: No module named 'soxr'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 17, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 25, in <module>
    from sparktts.utils.audio import load_audio
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/utils/audio.py", line 22, in <module>
    import soxr
ModuleNotFoundError: No module named 'soxr'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 148, in initialize_runtime
    from veena3modal.core.bicodec_decoder import BiCodecDecoder
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 28, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 25, in <module>
    from sparktts.utils.audio import load_audio
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/utils/audio.py", line 22, in <module>
    import soxr
ModuleNotFoundError: No module named 'soxr'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 17, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 25, in <module>
    from sparktts.utils.audio import load_audio
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/utils/audio.py", line 22, in <module>
    import soxr
ModuleNotFoundError: No module named 'soxr'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 148, in initialize_runtime
    from veena3modal.core.bicodec_decoder import BiCodecDecoder
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 28, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 25, in <module>
    from sparktts.utils.audio import load_audio
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/utils/audio.py", line 22, in <module>
    import soxr
ModuleNotFoundError: No module named 'soxr'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 465, in <module>
    main()
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 426, in main
    initialize_local_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 224, in initialize_local_runtime
    runtime = initialize_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 272, in initialize_runtime
    raise RuntimeError(f"TTS runtime initialization failed: {e}") from e
RuntimeError: TTS runtime initialization failed: No module named 'soxr'


Output:
Chunk ID: 28ed90
Wall time: 1.7371 seconds
Process exited with code 0
Original token count: 140
Output:
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://mcache-dsm.massedcompute.com/simple, https://pypi.org/simple
Collecting soxr
  Downloading soxr-1.0.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (5.6 kB)
Requirement already satisfied: numpy in /home/ubuntu/.local/lib/python3.10/site-packages (from soxr) (2.2.6)
Downloading soxr-1.0.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (242 kB)
Installing collected packages: soxr
Successfully installed soxr-1.0.0


Dependency bootstrap is now almost complete; only `soxr` was missing from the vendored SparkTTS path. I’m rerunning startup to verify whether we can get a fully live server for benchmark capture.


Output:
Chunk ID: 4b8a5f
Wall time: 1.2011 seconds
Process running with session ID 11786
Original token count: 454
Output:
2026-02-17 00:13:03 | INFO     | veena3.local | Auth bypass enabled (local mode). Use --auth to require API keys.
2026-02-17 00:13:03 | INFO     | veena3.local | Resolved model paths:
2026-02-17 00:13:03 | INFO     | veena3.local |   LLM (vLLM):    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:03 | INFO     | veena3.local |   BiCodec:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:03 | INFO     | veena3.local | ============================================================
2026-02-17 00:13:03 | INFO     | veena3.local | Initializing Veena3 TTS Runtime (local)
2026-02-17 00:13:03 | INFO     | veena3.local |   Model:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:03 | INFO     | veena3.local |   LLM path:    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:03 | INFO     | veena3.local |   BiCodec:     /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:03 | INFO     | veena3.local |   Device:      cuda
2026-02-17 00:13:03 | INFO     | veena3.local |   GPU Memory:  25% (total)
2026-02-17 00:13:03 | INFO     | veena3.local |   Engines:     1
2026-02-17 00:13:03 | INFO     | veena3.local |   SR:          disabled
2026-02-17 00:13:03 | INFO     | veena3.local | ============================================================
2026-02-17 00:13:03 | INFO     | veena3modal.services.tts_runtime | Initializing TTS runtime...
2026-02-17 00:13:03 | INFO     | veena3modal.services.tts_runtime |   Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:03 | INFO     | veena3modal.services.tts_runtime |   BiCodec path: /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:03 | INFO     | veena3modal.services.tts_runtime |   SR enabled: False, path: None


Output:
Chunk ID: 53dce3
Wall time: 3.3231 seconds
Process exited with code 1
Original token count: 1256
Output:
2026-02-17 00:13:08 | ERROR    | veena3modal.services.tts_runtime | ❌ Failed to initialize TTS runtime: No module named 'einx'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 17, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 26, in <module>
    from sparktts.models.bicodec import BiCodec
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/bicodec.py", line 24, in <module>
    from sparktts.modules.speaker.speaker_encoder import SpeakerEncoder
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/modules/speaker/speaker_encoder.py", line 20, in <module>
    from sparktts.modules.fsq.residual_fsq import ResidualFSQ
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/modules/fsq/residual_fsq.py", line 10, in <module>
    from einx import get_at
ModuleNotFoundError: No module named 'einx'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 148, in initialize_runtime
    from veena3modal.core.bicodec_decoder import BiCodecDecoder
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 28, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 26, in <module>
    from sparktts.models.bicodec import BiCodec
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/bicodec.py", line 24, in <module>
    from sparktts.modules.speaker.speaker_encoder import SpeakerEncoder
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/modules/speaker/speaker_encoder.py", line 20, in <module>
    from sparktts.modules.fsq.residual_fsq import ResidualFSQ
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/modules/fsq/residual_fsq.py", line 10, in <module>
    from einx import get_at
ModuleNotFoundError: No module named 'einx'
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 17, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 26, in <module>
    from sparktts.models.bicodec import BiCodec
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/bicodec.py", line 24, in <module>
    from sparktts.modules.speaker.speaker_encoder import SpeakerEncoder
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/modules/speaker/speaker_encoder.py", line 20, in <module>
    from sparktts.modules.fsq.residual_fsq import ResidualFSQ
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/modules/fsq/residual_fsq.py", line 10, in <module>
    from einx import get_at
ModuleNotFoundError: No module named 'einx'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 148, in initialize_runtime
    from veena3modal.core.bicodec_decoder import BiCodecDecoder
  File "/home/ubuntu/veenaModal/veena3modal/core/bicodec_decoder.py", line 28, in <module>
    from sparktts.models.audio_tokenizer import BiCodecTokenizer
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/audio_tokenizer.py", line 26, in <module>
    from sparktts.models.bicodec import BiCodec
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/models/bicodec.py", line 24, in <module>
    from sparktts.modules.speaker.speaker_encoder import SpeakerEncoder
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/modules/speaker/speaker_encoder.py", line 20, in <module>
    from sparktts.modules.fsq.residual_fsq import ResidualFSQ
  File "/home/ubuntu/veenaModal/external/sparktts/sparktts/modules/fsq/residual_fsq.py", line 10, in <module>
    from einx import get_at
ModuleNotFoundError: No module named 'einx'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 465, in <module>
    main()
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 426, in main
    initialize_local_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 224, in initialize_local_runtime
    runtime = initialize_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 272, in initialize_runtime
    raise RuntimeError(f"TTS runtime initialization failed: {e}") from e
RuntimeError: TTS runtime initialization failed: No module named 'einx'


Output:
Chunk ID: 8ac9bd
Wall time: 0.0512 seconds
Process exited with code 0
Original token count: 115
Output:
# Veena3 TTS Core Requirements
# PyTorch and ML dependencies
torch>=2.0.0
torchaudio>=2.0.0
transformers>=4.30.0
accelerate>=0.20.0

# vLLM for efficient inference
vllm>=0.6.0

# Audio processing
soundfile>=0.12.0
librosa>=0.10.0
scipy>=1.10.0
numpy>=1.24.0

# Hugging Face Hub for model downloads
huggingface-hub[cli]>=0.24.0  # Includes huggingface-cli command

# Tokenizers
tiktoken>=0.5.0
sentencepiece>=0.1.99

# Utilities
tqdm>=4.65.0
pydantic>=2.0.0


We’re now in dependency setup mode for the vendored SparkTTS package; I found another missing dependency (`einx`). I’ll install SparkTTS requirements from the vendored package directly to avoid chasing modules one-by-one.


Output:
Chunk ID: 5491d4
Wall time: 0.0511 seconds
Process exited with code 0
Original token count: 13
Output:
cli
models
modules
requirements.txt
sparktts
utils


sed -n '1,260p' external/sparktts/requirements.txt


Output:
Chunk ID: 038f57
Wall time: 0.0513 seconds
Process exited with code 0
Original token count: 52
Output:
einops==0.8.1
einx==0.3.0
numpy==2.2.3
omegaconf==2.3.0
packaging==24.2
safetensors==0.5.2
soundfile==0.12.1
soxr==0.5.0.post1
torch==2.5.1
torchaudio==2.5.1
tqdm==4.66.5
transformers==4.46.2
gradio==5.18.0


Output:
Chunk ID: f2b4f0
Wall time: 1.7558 seconds
Process exited with code 0
Original token count: 256
Output:
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://mcache-dsm.massedcompute.com/simple, https://pypi.org/simple
Collecting einx
  Downloading einx-0.3.0-py3-none-any.whl.metadata (6.9 kB)
Requirement already satisfied: numpy in /home/ubuntu/.local/lib/python3.10/site-packages (from einx) (2.2.6)
Requirement already satisfied: sympy in /home/ubuntu/.local/lib/python3.10/site-packages (from einx) (1.14.0)
Collecting frozendict (from einx)
  Downloading frozendict-2.4.7-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (23 kB)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/ubuntu/.local/lib/python3.10/site-packages (from sympy->einx) (1.3.0)
Downloading einx-0.3.0-py3-none-any.whl (102 kB)
Downloading frozendict-2.4.7-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (120 kB)
Installing collected packages: frozendict, einx

Successfully installed einx-0.3.0 frozendict-2.4.7


Output:
Chunk ID: 68e7dc
Wall time: 1.2010 seconds
Process running with session ID 18010
Original token count: 454
Output:
2026-02-17 00:13:21 | INFO     | veena3.local | Auth bypass enabled (local mode). Use --auth to require API keys.
2026-02-17 00:13:21 | INFO     | veena3.local | Resolved model paths:
2026-02-17 00:13:21 | INFO     | veena3.local |   LLM (vLLM):    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:21 | INFO     | veena3.local |   BiCodec:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:21 | INFO     | veena3.local | ============================================================
2026-02-17 00:13:21 | INFO     | veena3.local | Initializing Veena3 TTS Runtime (local)
2026-02-17 00:13:21 | INFO     | veena3.local |   Model:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:21 | INFO     | veena3.local |   LLM path:    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:21 | INFO     | veena3.local |   BiCodec:     /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:21 | INFO     | veena3.local |   Device:      cuda
2026-02-17 00:13:21 | INFO     | veena3.local |   GPU Memory:  25% (total)
2026-02-17 00:13:21 | INFO     | veena3.local |   Engines:     1
2026-02-17 00:13:21 | INFO     | veena3.local |   SR:          disabled
2026-02-17 00:13:21 | INFO     | veena3.local | ============================================================
2026-02-17 00:13:21 | INFO     | veena3modal.services.tts_runtime | Initializing TTS runtime...
2026-02-17 00:13:21 | INFO     | veena3modal.services.tts_runtime |   Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:21 | INFO     | veena3modal.services.tts_runtime |   BiCodec path: /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:21 | INFO     | veena3modal.services.tts_runtime |   SR enabled: False, path: None


Output:
Chunk ID: 4c4e1f
Wall time: 5.0011 seconds
Process running with session ID 18010
Original token count: 1283
Output:
2026-02-17 00:13:26 | INFO     | veena3modal.services.tts_runtime | Loading SparkTTS model with vLLM...
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
🚀 Initializing Spark TTS Model
📁 Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
🗣  Speakers: 12 predefined (lipakshi, vardan, reet, Nandini, krishna, anika, adarsh, Nilay, Aarvi, Asha, Bittu, Mira)
🎭 Emotions: 10 tags in [bracket] format

📝 Loading tokenizer from model...
✅ Tokenizer loaded: 165168 tokens

🔍 Validating 12 speakers for Spark TTS...
  lipakshi → <|speaker_0|>: 7 tokens
  vardan → <|speaker_1|>: 7 tokens
  reet → <|speaker_2|>: 7 tokens
  Nandini → <|speaker_3|>: 7 tokens
  krishna → <|speaker_4|>: 7 tokens
  anika → <|speaker_5|>: 7 tokens
  adarsh → <|speaker_6|>: 7 tokens
  Nilay → <|speaker_7|>: 7 tokens
  Aarvi → <|speaker_8|>: 7 tokens
  Asha → <|speaker_9|>: 7 tokens
  Bittu → <|speaker_10|>: 8 tokens
  Mira → <|speaker_11|>: 8 tokens
✅ All 12 speakers validated with mapping

🔍 Validating 10 emotion tags for Spark TTS...
✅ All 10 emotion tags validated

📋 Sample emotion tags:
  [angry]: 1 tokens
  [curious]: 1 tokens
  [excited]: 1 tokens
  [giggle]: 1 tokens
  [laughs harder]: 1 tokens
  ...

🔧 Initializing vLLM engine with optimizations...
  - dtype: bfloat16
  - max_model_len: 4096
  - gpu_memory_utilization: 0.25
  - enable_prefix_caching: True
  - enforce_eager (disable CUDA graphs): False
INFO 02-17 00:13:27 [model.py:541] Resolved architecture: Qwen2ForCausalLM
INFO 02-17 00:13:27 [model.py:1561] Using max model len 4096
INFO 02-17 00:13:28 [scheduler.py:226] Chunked prefill is enabled with max_num_batched_tokens=4096.
INFO 02-17 00:13:28 [vllm.py:624] Asynchronous scheduling is enabled.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
(EngineCore_DP0 pid=3697600) INFO 02-17 00:13:28 [core.py:96] Initializing a V1 LLM engine (v0.15.1) with config: model='/home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM', speculative_config=None, tokenizer='/home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.bfloat16, max_seq_len=4096, download_dir=None, load_format=auto, tensor_parallel_size=1, pipeline_parallel_size=1, data_parallel_size=1, disable_custom_all_reduce=False, quantization=None, enforce_eager=False, enable_return_routed_experts=False, kv_cache_dtype=auto, device_config=cuda, structured_outputs_config=StructuredOutputsConfig(backend='auto', disable_fallback=False, disable_any_whitespace=False, disable_additional_properties=False, reasoning_parser='', reasoning_parser_plugin='', enable_in_reasoning=False), observability_config=ObservabilityConfig(show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, kv_cache_metrics=False, kv_cache_metrics_sample=0.01, cudagraph_metrics=False, enable_layerwise_nvtx_tracing=False, enable_mfu_metrics=False, enable_mm_processor_stats=False, enable_logging_iteration_details=False), seed=0, served_model_name=/home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM, enable_prefix_caching=True, enable_chunked_prefill=True, pooler_config=None, compilation_config={'level': None, 'mode': <CompilationMode.VLLM_COMPILE: 3>, 'debug_dump_path': None, 'cache_dir': '', 'compile_cache_save_format': 'binary', 'backend': 'inductor', 'custom_ops': ['none'], 'splitting_ops': ['vllm::unified_attention', 'vllm::unified_attention_with_output', 'vllm::unified_mla_attention', 'vllm::unified_mla_attention_with_output', 'vllm::mamba_mixer2', 'vllm::mamba_mixer', 'vllm::short_conv', 'vllm::linear_attention', 'vllm::plamo2_mamba_mixer', 'vllm::gdn_attention_core', 'vllm::kda_attention', 'vllm::sparse_attn_indexer', 'vllm::rocm_aiter_sparse_attn_indexer', 'vllm::unified_kv_cache_update'], 'compile_mm_encoder': False, 'compile_sizes': [], 'compile_ranges_split_points': [4096], 'inductor_compile_config': {'enable_auto_functionalized_v2': False, 'combo_kernels': True, 'benchmark_combo_kernel': True}, 'inductor_passes': {}, 'cudagraph_mode': <CUDAGraphMode.FULL_AND_PIECEWISE: (2, 1)>, 'cudagraph_num_of_warmups': 1, 'cudagraph_capture_sizes': [1, 2, 4, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96, 104, 112, 120, 128, 136, 144, 152, 160, 168, 176, 184, 192, 200, 208, 216, 224, 232, 240, 248, 256], 'cudagraph_copy_inputs': False, 'cudagraph_specialize_lora': True, 'use_inductor_graph_partition': False, 'pass_config': {'fuse_norm_quant': False, 'fuse_act_quant': False, 'fuse_attn_quant': False, 'eliminate_noops': True, 'enable_sp': False, 'fuse_gemm_comms': False, 'fuse_allreduce_rms': False}, 'max_cudagraph_capture_size': 256, 'dynamic_shapes_config': {'type': <DynamicShapesType.BACKED: 'backed'>, 'evaluate_guards': False, 'assume_32_bit_indexing': True}, 'local_cache_dir': None, 'static_all_moe_layers': []}


Output:
Chunk ID: c6b674
Wall time: 2.5039 seconds
Process exited with code 1
Original token count: 4182
Output:
(EngineCore_DP0 pid=3697600) INFO 02-17 00:13:31 [parallel_state.py:1212] world_size=1 rank=0 local_rank=0 distributed_init_method=tcp://216.81.248.184:57197 backend=nccl
(EngineCore_DP0 pid=3697600) INFO 02-17 00:13:31 [parallel_state.py:1423] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, PCP rank 0, TP rank 0, EP rank N/A
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946] EngineCore failed to start.
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946] Traceback (most recent call last):
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core.py", line 937, in run_engine_core
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     engine_core = EngineCoreProc(*args, engine_index=dp_rank, **kwargs)
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core.py", line 691, in __init__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     super().__init__(
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core.py", line 105, in __init__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     self.model_executor = executor_class(vllm_config)
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/executor/abstract.py", line 101, in __init__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     self._init_executor()
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/executor/uniproc_executor.py", line 47, in _init_executor
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     self.driver_worker.init_device()
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/worker/worker_base.py", line 326, in init_device
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     self.worker.init_device()  # type: ignore
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/worker/gpu_worker.py", line 258, in init_device
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     from vllm.v1.worker.gpu_model_runner import (
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/worker/gpu_model_runner.py", line 153, in <module>
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     from vllm.v1.spec_decode.ngram_proposer import NgramProposer
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/spec_decode/ngram_proposer.py", line 170, in <module>
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     def batch_propose_numba(
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/decorators.py", line 221, in wrapper
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     disp = dispatcher(py_func=func, locals=locals,
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/dispatcher.py", line 772, in __init__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     self.targetctx = self.targetdescr.target_context
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/registry.py", line 30, in target_context
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     return self._toplevel_target_context
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/utils.py", line 741, in __get__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     return super().__get__(*args, **kwargs)
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/usr/lib/python3.10/functools.py", line 981, in __get__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     val = self.func(instance)
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/registry.py", line 18, in _toplevel_target_context
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     return cpu.CPUContext(self.typing_context, self._target_name)
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/cpu.py", line 42, in __init__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     super().__init__(typingctx, target)
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/base.py", line 254, in __init__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     self.init()
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/compiler_lock.py", line 35, in _acquire_compile_lock
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     return func(*args, **kwargs)
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/cpu.py", line 51, in init
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     self._internal_codegen = codegen.JITCPUCodegen("numba.exec")
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/codegen.py", line 1172, in __init__
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     initialize_llvm()
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/codegen.py", line 1434, in initialize_llvm
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     ll.initialize()
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]   File "/home/ubuntu/.local/lib/python3.10/site-packages/llvmlite/binding/initfini.py", line 17, in initialize
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946]     raise RuntimeError(
(EngineCore_DP0 pid=3697600) ERROR 02-17 00:13:31 [core.py:946] RuntimeError: llvmlite.binding.initialize() is deprecated and will be removed. LLVM initialization is now handled automatically. Please remove calls to this function from your code and check for other behavioral changes that may have occurred due to LLVM updates.
(EngineCore_DP0 pid=3697600) Process EngineCore_DP0:
(EngineCore_DP0 pid=3697600) Traceback (most recent call last):
(EngineCore_DP0 pid=3697600)   File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
(EngineCore_DP0 pid=3697600)     self.run()
(EngineCore_DP0 pid=3697600)   File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run
(EngineCore_DP0 pid=3697600)     self._target(*self._args, **self._kwargs)
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core.py", line 950, in run_engine_core
(EngineCore_DP0 pid=3697600)     raise e
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core.py", line 937, in run_engine_core
(EngineCore_DP0 pid=3697600)     engine_core = EngineCoreProc(*args, engine_index=dp_rank, **kwargs)
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core.py", line 691, in __init__
(EngineCore_DP0 pid=3697600)     super().__init__(
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core.py", line 105, in __init__
(EngineCore_DP0 pid=3697600)     self.model_executor = executor_class(vllm_config)
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/executor/abstract.py", line 101, in __init__
(EngineCore_DP0 pid=3697600)     self._init_executor()
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/executor/uniproc_executor.py", line 47, in _init_executor
(EngineCore_DP0 pid=3697600)     self.driver_worker.init_device()
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/worker/worker_base.py", line 326, in init_device
(EngineCore_DP0 pid=3697600)     self.worker.init_device()  # type: ignore
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/worker/gpu_worker.py", line 258, in init_device
(EngineCore_DP0 pid=3697600)     from vllm.v1.worker.gpu_model_runner import (
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/worker/gpu_model_runner.py", line 153, in <module>
(EngineCore_DP0 pid=3697600)     from vllm.v1.spec_decode.ngram_proposer import NgramProposer
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/spec_decode/ngram_proposer.py", line 170, in <module>
(EngineCore_DP0 pid=3697600)     def batch_propose_numba(
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/decorators.py", line 221, in wrapper
(EngineCore_DP0 pid=3697600)     disp = dispatcher(py_func=func, locals=locals,
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/dispatcher.py", line 772, in __init__
(EngineCore_DP0 pid=3697600)     self.targetctx = self.targetdescr.target_context
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/registry.py", line 30, in target_context
(EngineCore_DP0 pid=3697600)     return self._toplevel_target_context
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/utils.py", line 741, in __get__
(EngineCore_DP0 pid=3697600)     return super().__get__(*args, **kwargs)
(EngineCore_DP0 pid=3697600)   File "/usr/lib/python3.10/functools.py", line 981, in __get__
(EngineCore_DP0 pid=3697600)     val = self.func(instance)
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/registry.py", line 18, in _toplevel_target_context
(EngineCore_DP0 pid=3697600)     return cpu.CPUContext(self.typing_context, self._target_name)
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/cpu.py", line 42, in __init__
(EngineCore_DP0 pid=3697600)     super().__init__(typingctx, target)
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/base.py", line 254, in __init__
(EngineCore_DP0 pid=3697600)     self.init()
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/compiler_lock.py", line 35, in _acquire_compile_lock
(EngineCore_DP0 pid=3697600)     return func(*args, **kwargs)
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/cpu.py", line 51, in init
(EngineCore_DP0 pid=3697600)     self._internal_codegen = codegen.JITCPUCodegen("numba.exec")
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/codegen.py", line 1172, in __init__
(EngineCore_DP0 pid=3697600)     initialize_llvm()
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/codegen.py", line 1434, in initialize_llvm
(EngineCore_DP0 pid=3697600)     ll.initialize()
(EngineCore_DP0 pid=3697600)   File "/home/ubuntu/.local/lib/python3.10/site-packages/llvmlite/binding/initfini.py", line 17, in initialize
(EngineCore_DP0 pid=3697600)     raise RuntimeError(
(EngineCore_DP0 pid=3697600) RuntimeError: llvmlite.binding.initialize() is deprecated and will be removed. LLVM initialization is now handled automatically. Please remove calls to this function from your code and check for other behavioral changes that may have occurred due to LLVM updates.
2026-02-17 00:13:31 | ERROR    | veena3modal.services.tts_runtime | ❌ Failed to initialize TTS runtime: Engine core initialization failed. See root cause above. Failed core proc(s): {}
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 167, in initialize_runtime
    model = SparkTTSModel(
  File "/home/ubuntu/veenaModal/veena3modal/core/model_loader.py", line 128, in __init__
    self.engine = AsyncLLMEngine.from_engine_args(engine_args)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/async_llm.py", line 257, in from_engine_args
    return cls(
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/async_llm.py", line 155, in __init__
    self.engine_core = EngineCoreClient.make_async_mp_client(
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core_client.py", line 122, in make_async_mp_client
    return AsyncMPClient(*client_args)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core_client.py", line 819, in __init__
    super().__init__(
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core_client.py", line 479, in __init__
    with launch_core_engines(vllm_config, executor_class, log_stats) as (
  File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
    next(self.gen)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/utils.py", line 933, in launch_core_engines
    wait_for_engine_startup(
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/utils.py", line 992, in wait_for_engine_startup
    raise RuntimeError(
RuntimeError: Engine core initialization failed. See root cause above. Failed core proc(s): {}
Traceback (most recent call last):
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 167, in initialize_runtime
    model = SparkTTSModel(
  File "/home/ubuntu/veenaModal/veena3modal/core/model_loader.py", line 128, in __init__
    self.engine = AsyncLLMEngine.from_engine_args(engine_args)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/async_llm.py", line 257, in from_engine_args
    return cls(
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/async_llm.py", line 155, in __init__
    self.engine_core = EngineCoreClient.make_async_mp_client(
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core_client.py", line 122, in make_async_mp_client
    return AsyncMPClient(*client_args)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core_client.py", line 819, in __init__
    super().__init__(
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/core_client.py", line 479, in __init__
    with launch_core_engines(vllm_config, executor_class, log_stats) as (
  File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
    next(self.gen)
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/utils.py", line 933, in launch_core_engines
    wait_for_engine_startup(
  File "/home/ubuntu/.local/lib/python3.10/site-packages/vllm/v1/engine/utils.py", line 992, in wait_for_engine_startup
    raise RuntimeError(
RuntimeError: Engine core initialization failed. See root cause above. Failed core proc(s): {}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 465, in <module>
    main()
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 426, in main
    initialize_local_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/local_server.py", line 224, in initialize_local_runtime
    runtime = initialize_runtime(
  File "/home/ubuntu/veenaModal/veena3modal/services/tts_runtime.py", line 272, in initialize_runtime
    raise RuntimeError(f"TTS runtime initialization failed: {e}") from e
RuntimeError: TTS runtime initialization failed: Engine core initialization failed. See root cause above. Failed core proc(s): {}


VLLM_USE_V1=0 python3 -m veena3modal.local_server --skip-download --port 8000


Output:
Chunk ID: d37266
Wall time: 1.2013 seconds
Process running with session ID 67123
Original token count: 454
Output:
2026-02-17 00:13:36 | INFO     | veena3.local | Auth bypass enabled (local mode). Use --auth to require API keys.
2026-02-17 00:13:36 | INFO     | veena3.local | Resolved model paths:
2026-02-17 00:13:36 | INFO     | veena3.local |   LLM (vLLM):    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:36 | INFO     | veena3.local |   BiCodec:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:36 | INFO     | veena3.local | ============================================================
2026-02-17 00:13:36 | INFO     | veena3.local | Initializing Veena3 TTS Runtime (local)
2026-02-17 00:13:36 | INFO     | veena3.local |   Model:       /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:36 | INFO     | veena3.local |   LLM path:    /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:36 | INFO     | veena3.local |   BiCodec:     /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:36 | INFO     | veena3.local |   Device:      cuda
2026-02-17 00:13:36 | INFO     | veena3.local |   GPU Memory:  25% (total)
2026-02-17 00:13:36 | INFO     | veena3.local |   Engines:     1
2026-02-17 00:13:36 | INFO     | veena3.local |   SR:          disabled
2026-02-17 00:13:36 | INFO     | veena3.local | ============================================================
2026-02-17 00:13:36 | INFO     | veena3modal.services.tts_runtime | Initializing TTS runtime...
2026-02-17 00:13:36 | INFO     | veena3modal.services.tts_runtime |   Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
2026-02-17 00:13:36 | INFO     | veena3modal.services.tts_runtime |   BiCodec path: /home/ubuntu/veenaModal/models/spark_tts_4speaker
2026-02-17 00:13:36 | INFO     | veena3modal.services.tts_runtime |   SR enabled: False, path: None


Output:
Chunk ID: 1eca45
Wall time: 5.0013 seconds
Process running with session ID 67123
Original token count: 1283
Output:
2026-02-17 00:13:41 | INFO     | veena3modal.services.tts_runtime | Loading SparkTTS model with vLLM...
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
🚀 Initializing Spark TTS Model
📁 Model path: /home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM
🗣  Speakers: 12 predefined (lipakshi, vardan, reet, Nandini, krishna, anika, adarsh, Nilay, Aarvi, Asha, Bittu, Mira)
🎭 Emotions: 10 tags in [bracket] format

📝 Loading tokenizer from model...
✅ Tokenizer loaded: 165168 tokens

🔍 Validating 12 speakers for Spark TTS...
  lipakshi → <|speaker_0|>: 7 tokens
  vardan → <|speaker_1|>: 7 tokens
  reet → <|speaker_2|>: 7 tokens
  Nandini → <|speaker_3|>: 7 tokens
  krishna → <|speaker_4|>: 7 tokens
  anika → <|speaker_5|>: 7 tokens
  adarsh → <|speaker_6|>: 7 tokens
  Nilay → <|speaker_7|>: 7 tokens
  Aarvi → <|speaker_8|>: 7 tokens
  Asha → <|speaker_9|>: 7 tokens
  Bittu → <|speaker_10|>: 8 tokens
  Mira → <|speaker_11|>: 8 tokens
✅ All 12 speakers validated with mapping

🔍 Validating 10 emotion tags for Spark TTS...
✅ All 10 emotion tags validated

📋 Sample emotion tags:
  [angry]: 1 tokens
  [curious]: 1 tokens
  [excited]: 1 tokens
  [giggle]: 1 tokens
  [laughs harder]: 1 tokens
  ...

🔧 Initializing vLLM engine with optimizations...
  - dtype: bfloat16
  - max_model_len: 4096
  - gpu_memory_utilization: 0.25
  - enable_prefix_caching: True
  - enforce_eager (disable CUDA graphs): False
INFO 02-17 00:13:42 [model.py:541] Resolved architecture: Qwen2ForCausalLM
INFO 02-17 00:13:42 [model.py:1561] Using max model len 4096
INFO 02-17 00:13:42 [scheduler.py:226] Chunked prefill is enabled with max_num_batched_tokens=4096.
INFO 02-17 00:13:42 [vllm.py:624] Asynchronous scheduling is enabled.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
(EngineCore_DP0 pid=3697835) INFO 02-17 00:13:43 [core.py:96] Initializing a V1 LLM engine (v0.15.1) with config: model='/home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM', speculative_config=None, tokenizer='/home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.bfloat16, max_seq_len=4096, download_dir=None, load_format=auto, tensor_parallel_size=1, pipeline_parallel_size=1, data_parallel_size=1, disable_custom_all_reduce=False, quantization=None, enforce_eager=False, enable_return_routed_experts=False, kv_cache_dtype=auto, device_config=cuda, structured_outputs_config=StructuredOutputsConfig(backend='auto', disable_fallback=False, disable_any_whitespace=False, disable_additional_properties=False, reasoning_parser='', reasoning_parser_plugin='', enable_in_reasoning=False), observability_config=ObservabilityConfig(show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, kv_cache_metrics=False, kv_cache_metrics_sample=0.01, cudagraph_metrics=False, enable_layerwise_nvtx_tracing=False, enable_mfu_metrics=False, enable_mm_processor_stats=False, enable_logging_iteration_details=False), seed=0, served_model_name=/home/ubuntu/veenaModal/models/spark_tts_4speaker/LLM, enable_prefix_caching=True, enable_chunked_prefill=True, pooler_config=None, compilation_config={'level': None, 'mode': <CompilationMode.VLLM_COMPILE: 3>, 'debug_dump_path': None, 'cache_dir': '', 'compile_cache_save_format': 'binary', 'backend': 'inductor', 'custom_ops': ['none'], 'splitting_ops': ['vllm::unified_attention', 'vllm::unified_attention_with_output', 'vllm::unified_mla_attention', 'vllm::unified_mla_attention_with_output', 'vllm::mamba_mixer2', 'vllm::mamba_mixer', 'vllm::short_conv', 'vllm::linear_attention', 'vllm::plamo2_mamba_mixer', 'vllm::gdn_attention_core', 'vllm::kda_attention', 'vllm::sparse_attn_indexer', 'vllm::rocm_aiter_sparse_attn_indexer', 'vllm::unified_kv_cache_update'], 'compile_mm_encoder': False, 'compile_sizes': [], 'compile_ranges_split_points': [4096], 'inductor_compile_config': {'enable_auto_functionalized_v2': False, 'combo_kernels': True, 'benchmark_combo_kernel': True}, 'inductor_passes': {}, 'cudagraph_mode': <CUDAGraphMode.FULL_AND_PIECEWISE: (2, 1)>, 'cudagraph_num_of_warmups': 1, 'cudagraph_capture_sizes': [1, 2, 4, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96, 104, 112, 120, 128, 136, 144, 152, 160, 168, 176, 184, 192, 200, 208, 216, 224, 232, 240, 248, 256], 'cudagraph_copy_inputs': False, 'cudagraph_specialize_lora': True, 'use_inductor_graph_partition': False, 'pass_config': {'fuse_norm_quant': False, 'fuse_act_quant': False, 'fuse_attn_quant': False, 'eliminate_noops': True, 'enable_sp': False, 'fuse_gemm_comms': False, 'fuse_allreduce_rms': False}, 'max_cudagraph_capture_size': 256, 'dynamic_shapes_config': {'type': <DynamicShapesType.BACKED: 'backed'>, 'evaluate_guards': False, 'assume_32_bit_indexing': True}, 'local_cache_dir': None, 'static_all_moe_layers': []}