Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

or open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

or open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

or open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

or open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

or open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.


Output:
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
`torch_dtype` is deprecated! Use `dtype` instead!

`eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
`torch_dtype` is deprecated! Use `dtype` instead!


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]

n-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
`torch_dtype` is deprecated! Use `dtype` instead!
  Running full batch of 15 sentences x 3 runs...
    Run 1/3: gen=13.28s  audio=86.7s  RTF=0.1531
    Run 2/3: gen=13.69s  audio=85.4s  RTF=0.1603
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Output:
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]


Command running in background with ID: bo1k2aurk. Output is being written to: /tmp/claude-1001/-home-ubuntu/tasks/bo1k2aurk.output


Run RTF benchmark: baseline vs batch vs CUDA graphs


<task-notification>
<task-id>bo1k2aurk</task-id>
<tool-use-id>toolu_vrtx_01TQ35Qd7zK3RTM4gRSZ7twp</tool-use-id>
<output-file>/tmp/claude-1001/-home-ubuntu/tasks/bo1k2aurk.output</output-file>
<status>completed</status>
<summary>Background command "Run RTF benchmark: baseline vs batch vs CUDA graphs" completed (exit code 0)</summary>
</task-notification>
Read the output file to retrieve the result: /tmp/claude-1001/-home-ubuntu/tasks/bo1k2aurk.output


<retrieval_status>success</retrieval_status>

<task_id>bo1k2aurk</task_id>

<task_type>local_bash</task_type>

<status>completed</status>

<exit_code>0</exit_code>

<output>
=================================================================
  Qwen3-TTS RTF Benchmark — English Only
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================

[ENGINE 1] qwen_tts (baseline, sequential)

********
Warning: flash-attn is not installed. Will only run the manual PyTorch version. Please install flash-attn for faster inference.
********

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 55370.35it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
`torch_dtype` is deprecated! Use `dtype` instead!
  Running full batch of 15 sentences x 3 runs...
    Run 1/3: gen=13.28s  audio=86.7s  RTF=0.1531
    Run 2/3: gen=13.69s  audio=85.4s  RTF=0.1603
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]

  Warmup (2 sentences)...
Warming up predictor (3 runs)...
Capturing CUDA graph for predictor...
CUDA graph captured!
Warming up talker graph (3 runs)...
Capturing CUDA graph for talker decode...
Talker CUDA graph captured!
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=0.3335  gen=1.45s  audio=4.3s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=0.3248  gen=2.04s  audio=6.3s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=0.3245  gen=2.03s  audio=6.2s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=0.3277  gen=1.78s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=0.3229  gen=1.81s  audio=5.6s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=0.3256  gen=1.98s  audio=6.1s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=0.3199  gen=2.17s  audio=6.8s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=0.3220  gen=1.86s  audio=5.8s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=0.3187  gen=2.09s  audio=6.6s  | International cooperation is essential for address...
    [10/15] RTF=0.3216  gen=1.94s  audio=6.0s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=0.3217  gen=2.38s  audio=7.4s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=0.3188  gen=2.04s  audio=6.4s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=0.3220  gen=2.11s  audio=6.6s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=0.3229  gen=1.81s  audio=5.6s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=0.3193  gen=2.27s  audio=7.1s  | Global temperatures have risen significantly over ...

=================================================================
  RTF BENCHMARK RESULTS — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | English Only
=================================================================

  Engine                               RTF  Gen/sample  Note
  ------------------------------  --------  ----------  --------------------
  qwen_tts (sequential)             1.7395       9.96s  baseline
  qwen_tts (batch x15)              0.1587      0.911s  batched
  faster-qwen3-tts (CUDA graphs)    0.3227       1.98s  CUDA graphs

  BEST ENGINE: baseline_batch with RTF = 0.1587
  Speedup over sequential baseline: 10.96x

  RTF < 1.0 = faster than real-time
  Results saved to: /home/ubuntu/quench_0.6b/results/rtf_benchmark.json
=================================================================
</output>

Run RTF benchmark: baseline vs batch vs CUDA graphs

Output:
=================================================================
  Qwen3-TTS RTF Benchmark — English Only
  GPU: NVIDIA A100-SXM4-80GB | dtype: bfloat16
=================================================================

[ENGINE 1] qwen_tts (baseline, sequential)

********
Warning: flash-attn is not installed. Will only run the manual PyTorch version. Please install flash-attn for faster inference.
********

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 55370.35it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.

  Warmup (2 sentences)...
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=1.7414  gen=6.78s  audio=3.9s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=1.7324  gen=9.84s  audio=5.7s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=1.7330  gen=10.03s  audio=5.8s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=1.7361  gen=9.35s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=1.7386  gen=8.44s  audio=4.9s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=1.7312  gen=9.79s  audio=5.7s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=1.7446  gen=10.89s  audio=6.2s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=1.7504  gen=9.85s  audio=5.6s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=1.7350  gen=10.55s  audio=6.1s  | International cooperation is essential for address...
    [10/15] RTF=1.7362  gen=10.56s  audio=6.1s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=1.7413  gen=12.26s  audio=7.0s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=1.7479  gen=10.39s  audio=5.9s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=1.7430  gen=10.09s  audio=5.8s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=1.7447  gen=9.26s  audio=5.3s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=1.7399  gen=11.27s  audio=6.5s  | Global temperatures have risen significantly over ...

[ENGINE 1b] qwen_tts (batch generation)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 59918.63it/s]
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2150 for open-end generation.
`torch_dtype` is deprecated! Use `dtype` instead!
  Running full batch of 15 sentences x 3 runs...
    Run 1/3: gen=13.28s  audio=86.7s  RTF=0.1531
    Run 2/3: gen=13.69s  audio=85.4s  RTF=0.1603
    Run 3/3: gen=14.03s  audio=86.2s  RTF=0.1628

[ENGINE 2] faster-qwen3-tts (CUDA graphs)

Fetching 4 files:   0%|          | 0/4 [00:00<?, ?it/s]
Fetching 4 files: 100%|██████████| 4/4 [00:00<00:00, 4014.65it/s]

  Warmup (2 sentences)...
Warming up predictor (3 runs)...
Capturing CUDA graph for predictor...
CUDA graph captured!
Warming up talker graph (3 runs)...
Capturing CUDA graph for talker decode...
Talker CUDA graph captured!
  Running 15 sentences x 3 runs...
    [ 1/15] RTF=0.3335  gen=1.45s  audio=4.3s  | The quick brown fox jumps over the lazy dog near t...
    [ 2/15] RTF=0.3248  gen=2.04s  audio=6.3s  | Artificial intelligence is transforming how we app...
    [ 3/15] RTF=0.3245  gen=2.03s  audio=6.2s  | The Massachusetts Institute of Technology announce...
    [ 4/15] RTF=0.3277  gen=1.78s  audio=5.4s  | She couldn't believe it and then whispered this ch...
    [ 5/15] RTF=0.3229  gen=1.81s  audio=5.6s  | Beautiful weather today with clear skies and a gen...
    [ 6/15] RTF=0.3256  gen=1.98s  audio=6.1s  | The orchestra performed a magnificent symphony tha...
    [ 7/15] RTF=0.3199  gen=2.17s  audio=6.8s  | Renewable energy sources such as solar and wind po...
    [ 8/15] RTF=0.3220  gen=1.86s  audio=5.8s  | The philosopher argued that consciousness emerges ...
    [ 9/15] RTF=0.3187  gen=2.09s  audio=6.6s  | International cooperation is essential for address...
    [10/15] RTF=0.3216  gen=1.94s  audio=6.0s  | The restaurant serves traditional Mediterranean cu...
    [11/15] RTF=0.3217  gen=2.38s  audio=7.4s  | Machine learning algorithms can identify patterns ...
    [12/15] RTF=0.3188  gen=2.04s  audio=6.4s  | The astronaut described the view of Earth from spa...
    [13/15] RTF=0.3220  gen=2.11s  audio=6.6s  | Quantum computing promises to revolutionize crypto...
    [14/15] RTF=0.3229  gen=1.81s  audio=5.6s  | The ancient library contained thousands of manuscr...
    [15/15] RTF=0.3193  gen=2.27s  audio=7.1s  | Global temperatures have risen significantly over ...

=================================================================
  RTF BENCHMARK RESULTS — Qwen3-TTS-12Hz-0.6B-Base
  GPU: NVIDIA A100-SXM4-80GB | English Only
=================================================================

  Engine                               RTF  Gen/sample  Note
  ------------------------------  --------  ----------  --------------------
  qwen_tts (sequential)             1.7395       9.96s  baseline
  qwen_tts (batch x15)              0.1587      0.911s  batched
  faster-qwen3-tts (CUDA graphs)    0.3227       1.98s  CUDA graphs

  BEST ENGINE: baseline_batch with RTF = 0.1587
  Speedup over sequential baseline: 10.96x

  RTF < 1.0 = faster than real-time
  Results saved to: /home/ubuntu/quench_0.6b/results/rtf_benchmark.json
=================================================================


Here are the results:

## RTF Benchmark — Qwen3-TTS-12Hz-0.6B-Base on A100-80GB

| Engine | RTF | Gen/sample | Speedup vs baseline |
|--------|-----|------------|-------------------|
| **qwen_tts (sequential)** | 1.7395 | 9.96s | 1x |
| **faster-qwen3-tts (CUDA graphs)** | **0.3227** | 1.98s | **5.4x** |
| **qwen_tts (batch x15)** | **0.1587** | 0.91s | **11.0x** |

### Key takeaways:

- **Batch generation wins** — RTF **0.159**, generating speech **6.3x faster than real-time**. 15 sentences in ~13.5s producing ~86s of audio.
- **CUDA graphs (faster-qwen3-tts)** — RTF **0.323**, **3.1x faster than real-time** per single sentence. Great for low-latency single requests.
- **Sequential baseline** — RTF 1.74, slower than real-time without batching.

**Best strategy depends on use case:**
- High throughput → **batch generation** (RTF 0.16)
- Low latency single request → **CUDA graphs** (RTF 0.32, ~2s per sentence)


Already got those results above. Here's the quick recap:

| Engine | RTF | Speed |
|--------|-----|-------|
| Sequential baseline | 1.74 | 0.57x real-time |
| **CUDA graphs** | **0.32** | **3.1x real-time** |
| **Batch x15** | **0.16** | **6.3x real-time** |

All results saved in `/home/ubuntu/quench_0.6b/results/rtf_benchmark.json`.


status


The user wants a status update on everything done so far.


## Status — Qwen3-TTS-12Hz-0.6B-Base on A100-80GB

### Done

**1. Model Setup**
- Downloaded `Qwen/Qwen3-TTS-12Hz-0.6B-Base` (596M params, bfloat16)
- Installed `qwen-tts`, `faster-qwen3-tts` (CUDA graphs), Whisper large-v2
- Everything in `/home/ubuntu/quench_0.6b/`

**2. Accuracy Evaluation (21 sentences, 7 languages)**
- **18/21 perfect** (0% WER + CER)
- English/Japanese/Korean/German/French/Spanish: **0% error**
- Chinese: 3 samples with errors — all caused by Whisper outputting traditional characters, not TTS errors
- Evaluated with Whisper large-v2 (beam=5, best_of=5)

**3. RTF Benchmark (15 English sentences, 3 runs each)**

| Engine | RTF | Per-sample | vs Baseline |
|--------|-----|-----------|-------------|
| qwen_tts sequential | 1.74 | 9.96s | 1x |
| faster-qwen3-tts (CUDA graphs) | **0.32** | 1.98s | **5.4x** |
| qwen_tts batch (x15) | **0.16** | 0.91s | **11x** |

### Files

```
/home/ubuntu/quench_0.6b/
├── eval_tts.py              # accuracy eval script
├── bench_rtf.py             # RTF benchmark script
├── ref_audio.wav            # reference audio for voice cloning
└── results/
    ├── evaluation_results.json   # full accuracy results
    ├── rtf_benchmark.json        # full RTF results
    └── *.wav                     # 21 generated audio files
```

### Bottom line
- **Max accuracy: 100% on English** (0% WER/CER)
- **Max speed: RTF 0.16** (batch) or **0.32** (single, CUDA graphs)
- **6.3x faster than real-time** at peak throughput


what is concurrency


In this context, **concurrency** = running multiple TTS generations at the same time instead of one after another.

**What I did:**
- **Sequential**: Generate sentence 1, wait, generate sentence 2, wait... (RTF 1.74)
- **Batch**: Send all 15 sentences to the GPU at once, generate in parallel (RTF 0.16)
- **CUDA graphs**: Single-sentence but with pre-compiled GPU execution paths, eliminating CPU overhead (RTF 0.32)

The batch approach is the concurrency win — the GPU processes multiple sequences simultaneously, keeping all its cores busy instead of idling between sentences. That's why it went from 9.96s/sample down to 0.91s/sample.


fuck brotehr u need to check concecuenry alonmg eith ttfb .. if i use this as tts to my voicegagent in prof where 10000 people using my voice agnet how fuck i know wghat is the capability fo this model


The user wants a real-world load test - simulating concurrent users hitting the TTS model simultaneously, measuring:
1. TTFB (Time To First Byte) - how fast the first audio chunk comes back
2. Concurrency - how many simultaneous users the model can handle
3. Throughput under load - what happens when 10, 50, 100+ concurrent requests hit it

This is a production capacity planning test. Let me build a proper stress test with concurrent requests using threading/asyncio, measuring TTFB, latency percentiles, throughput, and finding the breaking point.


You're right. Let me build a proper **production load test** — concurrent users, TTFB, latency percentiles, throughput ceiling. Find out how many simultaneous voice agent users this A100 can actually handle.