Keyword spotting

Examples & Tutorials
1

Hi all,
In the keyword spotting example, is it possible to connect the speaker with Nengo GUI since I would like to record voice and run demo real-time? If yes, how can I do that? In this example, the data is already recorded.
Do we have any demos work with the camera or similar to that?
https://www.nengo.ai/nengo-loihi/examples/keyword_spotting.html

Thank you,
CNguyen

2

Hi!
It’s great to hear that you’re interested in experimenting with the keyword spotter using real-time audio input. It is definitely possible to connect the GUI to an microphone to capture realtime audio and pass it to a Nengo model. Roughly, you’ll need to (1) buffer the incoming audio signal, (2) compute standard audio features (MFFCs) on the buffered signal, and (3) stream these features into the model.

We do have a preliminary GUI interface doing these things, but it is in an unsupported and unreleased state. We’re looking at making it publicly available to experiment with on a “no-guarantees” basis, so I’ll post back here shortly once I’ve got more information for you on this front.

Let me know if you have any other questions!
Best,
Peter

3

Hi Peter,

Thank you for your information. If I understand correctly, buffer, MFFCs are from Nengo lib packages ? Do we need any extra hardware other than headphone?
Yes, please keep me posted, if you have more information

Thank you,
Chinh Nguyen