<retrieval_status>not_ready</retrieval_status>

<task_id>bkorg4884</task_id>

<task_type>local_bash</task_type>

<status>running</status>

<output>
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
WARNING 03-21 17:56:29 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:30,804 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:31,416 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:32,013 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:32,617 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:33,194 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:33,793 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:34,389 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:34,980 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:35,564 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:36,149 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:36,729 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:37,294 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:37,873 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:38,443 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:39,033 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.

[ENGINE] vLLM-Omni (sequential, batch_size=1)
  Loading model...
INFO 03-21 17:56:39 [weight_utils.py:50] Using model weights format ['*']
INFO 03-21 17:56:39 [omni.py:181] Initializing stages for model: Qwen/Qwen3-TTS-12Hz-0.6B-Base
INFO 03-21 17:56:39 [omni.py:313] No omni_master_address provided, defaulting to localhost (127.0.0.1)
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:39 [initialization.py:270] Loaded OmniTransferConfig with 1 connector configurations
INFO 03-21 17:56:39 [factory.py:46] Created connector: SharedMemoryConnector
INFO 03-21 17:56:39 [initialization.py:60] Created connector for 0 -> 1: SharedMemoryConnector
INFO 03-21 17:56:39 [omni.py:347] [Orchestrator] Loaded 2 stages
INFO 03-21 17:56:39 [omni.py:458] [Orchestrator] Waiting for 2 stages to initialize (timeout: 300s)
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
[Stage-0] WARNING 03-21 17:56:48 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
[Stage-1] WARNING 03-21 17:56:48 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:48,847 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,061 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,409 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,633 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,976 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,187 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,524 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,749 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,071 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,306 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,629 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,872 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,189 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,439 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,739 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,997 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:441] code_predictor_config is N
</output>

Run vLLM-Omni RTF benchmark for Qwen3-TTS

Output:
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
WARNING 03-21 17:56:29 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:30,804 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:31,416 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:32,013 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:32,617 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:33,194 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:33,793 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:34,389 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:34,980 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:35,564 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:36,149 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:36,729 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:37,294 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:37,873 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:38,443 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:39,033 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.

[ENGINE] vLLM-Omni (sequential, batch_size=1)
  Loading model...
INFO 03-21 17:56:39 [weight_utils.py:50] Using model weights format ['*']
INFO 03-21 17:56:39 [omni.py:181] Initializing stages for model: Qwen/Qwen3-TTS-12Hz-0.6B-Base
INFO 03-21 17:56:39 [omni.py:313] No omni_master_address provided, defaulting to localhost (127.0.0.1)
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:39 [initialization.py:270] Loaded OmniTransferConfig with 1 connector configurations
INFO 03-21 17:56:39 [factory.py:46] Created connector: SharedMemoryConnector
INFO 03-21 17:56:39 [initialization.py:60] Created connector for 0 -> 1: SharedMemoryConnector
INFO 03-21 17:56:39 [omni.py:347] [Orchestrator] Loaded 2 stages
INFO 03-21 17:56:39 [omni.py:458] [Orchestrator] Waiting for 2 stages to initialize (timeout: 300s)
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
[Stage-0] WARNING 03-21 17:56:48 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
[Stage-1] WARNING 03-21 17:56:48 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:48,847 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,061 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,409 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,633 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,976 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,187 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,524 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,749 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,071 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,306 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,629 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,872 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,189 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,439 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,739 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,997 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:441] code_predictor_config is N


Model is initializing with its 2-stage pipeline. Let me wait for it to progress further.


Run vLLM-Omni RTF benchmark for Qwen3-TTS

Output:
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
WARNING 03-21 17:56:29 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:30 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:30,804 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:31 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:31,416 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:32,013 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:32 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:32,617 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:33,194 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:33 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:33,793 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:34,389 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:34 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:34,980 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:35 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:35,564 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:36,149 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:36 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:36,729 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:37,294 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:37 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:37,873 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:38 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:38,443 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
INFO 03-21 17:56:39 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:39,033 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.

[ENGINE] vLLM-Omni (sequential, batch_size=1)
  Loading model...
INFO 03-21 17:56:39 [weight_utils.py:50] Using model weights format ['*']
INFO 03-21 17:56:39 [omni.py:181] Initializing stages for model: Qwen/Qwen3-TTS-12Hz-0.6B-Base
INFO 03-21 17:56:39 [omni.py:313] No omni_master_address provided, defaulting to localhost (127.0.0.1)
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
INFO 03-21 17:56:39 [initialization.py:270] Loaded OmniTransferConfig with 1 connector configurations
INFO 03-21 17:56:39 [factory.py:46] Created connector: SharedMemoryConnector
INFO 03-21 17:56:39 [initialization.py:60] Created connector for 0 -> 1: SharedMemoryConnector
INFO 03-21 17:56:39 [omni.py:347] [Orchestrator] Loaded 2 stages
INFO 03-21 17:56:39 [omni.py:458] [Orchestrator] Waiting for 2 stages to initialize (timeout: 300s)
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
[Stage-0] WARNING 03-21 17:56:48 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
=================================================================
  vLLM-Omni RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================
[Stage-1] WARNING 03-21 17:56:48 [envs.py:94] No Flash Attention backend found, using pytorch SDPA implementation
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:48 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:48,847 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.

Building inputs...
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,061 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,409 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,633 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:49 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:49,976 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,187 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,524 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:50 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:50,749 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,071 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,306 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,629 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:51 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:51,872 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,189 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,439 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-0] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,739 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
[Stage-1] INFO 03-21 17:56:52 [configuration_qwen3_tts.py:441] code_predictor_config is None. Initializing code_predictor model with default values
2026-03-21 17:56:52,997 WARNING Prompt length estimation failed, using fallback 2048: Base in-context voice cloning requires either `voice_clone_prompt.ref_code` or a readable `ref_audio` that can be mapped to a codec frame length.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:489] talker_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:492] speaker_encoder_config is None. Initializing talker model with default values
[Stage-0] INFO 03-21 17:56:53 [configuration_qwen3_tts.py:441] code_predictor_config is N


The 2-stage pipeline (Talker + Code2Wav) is still initializing. The prompt length estimation warnings are harmless — it falls back to 2048 which works fine. Let me wait longer for the model to load and start generating.


Run vLLM-Omni RTF benchmark for Qwen3-TTS