Malayalam voice assistant, on CPU only
Ask a question in Malayalam. Small models answer it on this CPU, with no GPU and no external API:
- Speech to text: pick a recogniser. Both score about the same on my leakage-free test set (Whisper v2 int8 32.7% WER, IndicConformer 30.1%), but the CTC model is much faster on CPU.
- Reply:
gemma-4-E2B-it-Q4_0.gguf, a small open model run with llama.cpp - Text to speech: my fine-tuned MMS-VITS voice
Hands-free listens on your device and answers when you pause; press Stop reply to cut an answer short. Push to talk shows how long each stage takes. On this shared Space, requests are answered one at a time; run it on your own computer for the best experience.
Press Start talking, allow the microphone, then ask a question in Malayalam and pause. It answers aloud and listens again.