Snipek

Submitted by mkiol on Sun, 12/16/2018 - 19:08

Rating:

Your rating: None Average: 5 (4 votes)

Converts phone into remote microphone and speaker for Snips voice assistant system.

Snips (https://snips.ai/) provides voice assistant system that doesn’t require external cloud service. All processing (including voice) is entirely done locally, on device where Snips is installed.

Snipek acts as remote microphone and speaker. It connects to Snips as an additional audio server. It sends audio stream captured from the microphone and plays audio files received from the Snips system.

At this moment, Snips supports installation on Raspberry Pi and Debian system. App was tested on both configurations and it works with almost zero configuration effort.

Snipek is a free application. Source code can be download from: https://github.com/mkiol/Snipek

=> Snipek doesn't work on Jolla 1. I'm investigating how to fix it. <=

Screenshots:

Keywords:

Application versions:

Attachment	Size	Date
harbour-snipek-1.0.0-1.armv7hl.rpm	138.73 KB	16/12/2018 - 19:08
harbour-snipek-1.0.0-1.i486.rpm	145.7 KB	16/12/2018 - 19:08

Changelog:

version 1.0.0

* Support for multiple Snipek instances connected to single Snips system

Comments

toxip

Mon, 12/17/2018 - 19:57

Permalink

I had trouble setting this up. My raspbi doesn't have any speakers or mic and this doesn't work either. What am I doing wrong?

mkiol

Mon, 12/17/2018 - 21:41

Permalink

Speaker and mic attached to a raspberrypi device are not needed because your phone (powered with Snipek) will provide both. Of course, you can use Snipek and raspberrypi's mic in the one system - they are not mutually exclusive. Snips can handle multiple audio sources.

Maybe your Snips installation is not properly setup? Did you follow Quick Start Raspberry Pi guide? What "sam status" command shows? Here is my output:

mkiol@rubi:~> sam status
Connected to device x.x.x.x
OS version ................... Raspbian GNU/Linux 9 (stretch)
Installed assistant .......... Test
Language ..................... en
Hotword ...................... hey_snips
ASR engine ................... snips
Status ....................... Live

Service status:
snips-analytics .............. 0.60.1 (not running)
snips-asr .................... 0.60.1 (running)
snips-audio-server ........... 0.60.1 (not running)
snips-dialogue ............... 0.60.1 (running)
snips-hotword ................ 0.60.1 (running)
snips-nlu .................... 0.60.1 (running)
snips-skill-server ........... 0.60.1 (running)
snips-tts .................... 0.60.1 (running)

toxip

Tue, 12/18/2018 - 06:37

Permalink

So the problem was my custom hotword. I couldn't get it to work at all but by switching to hey snips I could manage to get the thing respond. Also the Xperia X microphone didn't even work for the record (probably too much noise?) so I was using a headset mic for that. Still, even with the headset it didn't recognise the hotword. I would like to use a personal hotword as it'd be much cooler but that's a minor compromise.

Now the app is working great on my Xperia X but unfortunately the mic and speakers didn't work with Jolla 1 at all despite being connected. I would've wanted to repurpose my Jolla 1 as an always on station for the system but unfortunately couldn't do it because of this bug. Perhaps you're using some weird setup to get the mic data that it doesn't work for J1? Anyway, thanks for this app and introducing me to this wonderful platform. Had a great deal of fun playing around with it ^^

mkiol

Tue, 12/18/2018 - 23:53

Permalink

You are 100% right. Snipek doesn't work on Jolla 1. My fault, I've tested it only on Jolla C and XperiaX. The problem with Jolla 1 is a very slow audio processing. Accually, it works but there is huge delay ~20-30s. I'm investigating it and maybe will be able to fix it. Many thanks for detecting this bug.

toxip

Wed, 01/09/2019 - 03:54

Permalink

Need to wait until I get my Jolla C from other side of the world. Meanwhile I would like to ask, is there any chance to build the desktop app on Windows? I'm trying myself but I don't know how to. Some paho-mqtt things seem to give me an error. Any chance you could help me or crossbuild for windows? I'd love to get this running on my Windows PC which has my headset plugged in. Thanks!

mkiol

Sun, 01/13/2019 - 19:57

Permalink

Right, so currently on a desktop only Linux is supported because it was trival to port SFOS code. To be honest I don't have much experience with Windows and is is more important I don't have any Windows-running machine or VM. In theory I could install one but is it would be quite a big effort...