frame_flutter_translate_host (offline speech-to-text, live captioning, offline translation, subtitles)
Connects to Frame, streams audio from the Host (phone) microphone (for now - streaming from Frame mic coming), which is sent through a local (on Host device) Vosk speech-to-text engine (Flutter package is Android only), translates the text into a target language on-device using ML Kit (Android, iOS only), and displays the translated text on the Frame display.
Drop in an alternative Vosk model to perform speech-to-text in a language other than Chinese (vosk-model-small-cn-0.22 included). The model name appears in main.dart and pubspec.yaml.
Specify an alternative targetLanguage in lib/main.dart to translate to an ML Kit supported language other than English. Frame only displays languages in a latin character set, so text might need to be tweaked before sending to Frame.
Frameshots, Screenshots
https://github.com/user-attachments/assets/40f675dd-8f12-42d6-9555-fc4108d0f8a6
Architecture
