A downloadable game for Windows

In this demo, we run a Speech-to-text model directly in Unity using Unity Sentis, a neural network inference library where you can run AI models directly inside your game without relying on APIs.

We wrote a tutorial to explain how it works and how to make your own version of this demo : https://www.simoninithomas.com/jammo-sentis-whisper

The model used: https://huggingface.co/unity/sentis-whisper-tiny

If you're interested to see an example of usage of STT model in games check our demo of a smart robot that can understand player voice orders and perform them: https://singularite.itch.io/jammo-the-robot-with-unity-sentis-whisper-version

Download

Download
Speech Recognition with Sentis and Whisper.zip 152 MB

Comments

Log in with itch.io to leave a comment.

(1 edit)

Hey Thank you for this demo! Very interesting. Currently it seems it's doesn't seem to have multilingual support (despite the OpenAI whisper-tiny model has a multilingual model). Do you happen to know if this sentis model can be swapped with a multilingual model?