NepTTS-Bench · 205 sentences · one take per system
The lowest pronunciation error on NepTTS-Bench.
NepTTS-Bench is the public Nepali text-to-speech benchmark by Ampixa: minimal pairs, questions, tongue twisters and short phrases built to trip a TTS up. A speech recogniser writes down what each system said. Pronunciation error counts only the mistakes a listener would hear. Lower is better.
| System | Pronunciation error | Character error |
|---|---|---|
| Swar | 2.92% | 6.19% |
| OmniVoice (same voice prompt) | 4.32% | 6.68% |
| Indic-Speak Srijana | 8.12% | 10.25% |
| IndicF5 (the model Swar started from) | 9.37% | 12.82% |
| Indic Parler-TTS | 9.51% | 11.70% |
| ElevenLabs v3 | 12.91% | 15.70% |
| Gemini | 15.03% | 15.31% |
| Piper | 17.00% | 18.68% |
Scored with the benchmark's own recogniser (Meta MMS), identically for every system. Swar rows use the studio voice (AI4Bharat Rasa, CC BY 4.0). Our Nepali training cut IndicF5's pronunciation error by more than two thirds.
