Unity Sentis Whisper
A downloadable game for Windows
In this demo, we run a Speech-to-text model directly in Unity using Unity Sentis, a neural network inference library where you can run AI models directly inside your game without relying on APIs.
We wrote a tutorial to explain how it works and how to make your own version of this demo : https://www.simoninithomas.com/jammo-sentis-whisper
The model used: https://huggingface.co/unity/sentis-whisper-tiny
If you're interested to see an example of usage of STT model in games check our demo of a smart robot that can understand player voice orders and perform them: https://singularite.itch.io/jammo-the-robot-with-unity-sentis-whisper-version
Status | Released |
Platforms | Windows |
Author | Thomas Simonini (Singularite) |
Tags | artificial-intelligence, sentis, Unity, whisper |
Download
Download
Speech Recognition with Sentis and Whisper.zip 152 MB
Comments
Log in with itch.io to leave a comment.
Hey Thank you for this demo! Very interesting. Currently it seems it's doesn't seem to have multilingual support (despite the OpenAI whisper-tiny model has a multilingual model). Do you happen to know if this sentis model can be swapped with a multilingual model?