Universal Speech Translator
Universal Speech Translator (Hokkien)
Translating a language with no standard written form
Latest: Hokkien speech-to-speech system (Oct 2022)
First AI speech-to-speech translation system for a primarily oral language: Hokkien, spoken by millions in the Chinese diaspora but lacking a standard written form. Built with clever pivots through Mandarin text and released open-source (October 2022) as the first milestone of Meta's Universal Speech Translator program — a direct ancestor of Seamless.
Why it matters
The first AI speech-to-speech translation for a language with no standard written form, pivoting through Mandarin text and scored with syllable-level Tai-lo BLEU. Nearly half of the world's 7,000+ languages are primarily oral, so it broke the text-first assumption in machine translation and directly seeded the Seamless program.
Facts
- Because Hokkien has no widely used writing system, the team could not use standard text-based pipelines — they trained on speech directly, using Mandarin as a pivot and working with native speakers to evaluate.
Try it yourself
Model on Hugging Face (English to Hokkien) ↗ Code and recipes (fairseq, ust branch) ↗ Meta AI blog post ↗