Snipek

Rating: 
5
Your rating: None Average: 5 (4 votes)

Converts phone into remote microphone and speaker for Snips voice assistant system.

Snips (https://snips.ai/) provides voice assistant system that doesn’t require external cloud service. All processing (including voice) is entirely done locally, on device where Snips is installed.

Snipek acts as remote microphone and speaker. It connects to Snips as an additional audio server. It sends audio stream captured from the microphone and plays audio files received from the Snips system.

At this moment, Snips supports installation on Raspberry Pi and Debian system. App was tested on both configurations and it works with almost zero configuration effort.

Snipek is a free application. Source code can be download from: https://github.com/mkiol/Snipek

=> Snipek doesn't work on Jolla 1. I'm investigating how to fix it. <=

Screenshots: 
Application versions: 
AttachmentSizeDate
File harbour-snipek-1.0.0-1.armv7hl.rpm138.73 KB16/12/2018 - 19:08
File harbour-snipek-1.0.0-1.i486.rpm145.7 KB16/12/2018 - 19:08
Changelog: 

version 1.0.0

* Support for multiple Snipek instances connected to single Snips system

Comments

jollex's picture

Wow that would be amazing!! Everything embeded

lutinotmalin's picture

I really don't understand how to use that app that seems wonderful. How do I connect to Snips ? What should I write for the IP, the port, the site ID ? Shall I create an account somewhere ?

mkiol's picture

To make this app works you have to have Snips server somewhere in your local network. The easiest way is to use Raspberry Pi because it is officially supported platform. The guide how to do it is here: https://docs.snips.ai/getting-started/quick-start-raspberry-pi (relatively easy but not trivial). Alternatively you can also install Snips on any Debian box.

My installation is based on Raspberry Pi 2 and it works great.

mkiol's picture

Just a info. I'm also investigating how to port Snips server to SFOS and provide standalone voice assistant that works without any network connectivity. Maybe it will be included in the next Snipek version... Right now server side (installed on RPi) is needed.

toxip's picture

I had trouble setting this up. My raspbi doesn't have any speakers or mic and this doesn't work either. What am I doing wrong?

mkiol's picture

Speaker and mic attached to a raspberrypi device are not needed because your phone (powered with Snipek) will provide both. Of course, you can use Snipek and raspberrypi's mic in the one system - they are not mutually exclusive. Snips can handle multiple audio sources.

Maybe your Snips installation is not properly setup? Did you follow Quick Start Raspberry Pi guide? What "sam status" command shows? Here is my output:

mkiol@rubi:~> sam status
Connected to device x.x.x.x
OS version ................... Raspbian GNU/Linux 9 (stretch)
Installed assistant .......... Test
Language ..................... en
Hotword ...................... hey_snips
ASR engine ................... snips
Status ....................... Live

Service status:
snips-analytics .............. 0.60.1 (not running)
snips-asr .................... 0.60.1 (running)
snips-audio-server ........... 0.60.1 (not running)
snips-dialogue ............... 0.60.1 (running)
snips-hotword ................ 0.60.1 (running)
snips-nlu .................... 0.60.1 (running)
snips-skill-server ........... 0.60.1 (running)
snips-tts .................... 0.60.1 (running)
toxip's picture

So the problem was my custom hotword. I couldn't get it to work at all but by switching to hey snips I could manage to get the thing respond. Also the Xperia X microphone didn't even work for the record (probably too much noise?) so I was using a headset mic for that. Still, even with the headset it didn't recognise the hotword. I would like to use a personal hotword as it'd be much cooler but that's a minor compromise.

Now the app is working great on my Xperia X but unfortunately the mic and speakers didn't work with Jolla 1 at all despite being connected. I would've wanted to repurpose my Jolla 1 as an always on station for the system but unfortunately couldn't do it because of this bug. Perhaps you're using some weird setup to get the mic data that it doesn't work for J1? Anyway, thanks for this app and introducing me to this wonderful platform. Had a great deal of fun playing around with it ^^

mkiol's picture

You are 100% right. Snipek doesn't work on Jolla 1. My fault, I've tested it only on Jolla C and XperiaX. The problem with Jolla 1 is a very slow audio processing. Accually, it works but there is huge delay ~20-30s. I'm investigating it and maybe will be able to fix it. Many thanks for detecting this bug.

toxip's picture

Need to wait until I get my Jolla C from other side of the world. Meanwhile I would like to ask, is there any chance to build the desktop app on Windows? I'm trying myself but I don't know how to. Some paho-mqtt things seem to give me an error. Any chance you could help me or crossbuild for windows? I'd love to get this running on my Windows PC which has my headset plugged in. Thanks!

mkiol's picture

Right, so currently on a desktop only Linux is supported because it was trival to port SFOS code. To be honest I don't have much experience with Windows and is is more important I don't have any Windows-running machine or VM. In theory I could install one but is it would be quite a big effort...

jollex's picture

Many thx! I discovered snips with your apps!

Historyscholar's picture

Good