Malayalam voice assistant, on CPU only

Ask a question in Malayalam. Small models answer it on this CPU, with no GPU and no external API:

  1. Speech to text: pick a recogniser. Both score about the same on my leakage-free test set (Whisper v2 int8 32.7% WER, IndicConformer 30.1%), but the CTC model is much faster on CPU.
  2. Reply: gemma-4-E2B-it-Q4_0.gguf, a small open model run with llama.cpp
  3. Text to speech: my fine-tuned MMS-VITS voice

Hands-free listens on your device and answers when you pause; press Stop reply to cut an answer short. Push to talk shows how long each stage takes. On this shared Space, requests are answered one at a time; run it on your own computer for the best experience.

Speech recogniser
Press Start talking, allow the microphone, then ask a question in Malayalam and pause. It answers aloud and listens again.