Serra

Rating: 
4
Your rating: None Average: 4 (2 votes)

The voice assistant for Sailfish OS.

+ Voice search in Google (images included)
+ Getting weather information with voice
+ Navigation with voice
+ Calling contacts with voice
+ Opening camera application with voice
+ Simple device control with voice
+ User commands
+ Support languages: Russian and English

GitHub: https://github.com/osanwe/harbour-serra

Screenshots: 
Application versions: 
AttachmentSizeDate
harbour-serra-0.2.1-3.armv7hl.rpm109.71 KB29/01/2017 - 21:40
harbour-serra-0.2.2-4.armv7hl.rpm110.04 KB30/01/2017 - 12:06
harbour-serra-0.2.3-5.armv7hl.rpm109.9 KB30/01/2017 - 17:18
harbour-serra-0.2.4-6.armv7hl.rpm111.21 KB31/01/2017 - 08:48
harbour-serra-0.3.0-8.armv7hl.rpm121.39 KB03/02/2017 - 22:41
harbour-serra-0.3.1-9.armv7hl.rpm121.38 KB04/02/2017 - 17:49
harbour-serra-0.4.0-10.armv7hl.rpm136.54 KB02/08/2017 - 21:11
harbour-serra-0.4.1-11.armv7hl.rpm136.27 KB03/08/2017 - 21:01
harbour-serra-0.5.0-12.armv7hl.rpm139.11 KB15/08/2017 - 00:21
harbour-serra-0.6.0-13.armv7hl.rpm144.55 KB04/10/2017 - 22:11
Changelog: 

v0.6.0:

  • Added command "Show agenda"
  • Added command "Create note"
  • Code improvements

v0.5.0:

v0.4.1:

  • GPS management temporarily unavailable

v0.4.0:

  • Added images search
  • Added calling contacts with voice capability
  • Fixed bluetooth module

v0.3.1:

  • Fixed bug with do-not-open mode
  • Fixed bug with clearing search results (text search)
  • Voice reply stops when recording is active

v0.3.0:

  • Added voice replies
  • Added do-not-open mode
  • Added user commands (available from `Commands list`)
  • Added voice navigation
  • Improved record process

v0.2.4:

  • Improved detecting English commands
  • Settings system language as default after first run
  • Small UI improvements

v0.2.3:

  • Fixed problem with default voice commands language

v0.2.2:

  • Fixed a problem with lots requests to Google
  • Standard time for voice command is 6 seconds (tap for search starting is not required any more)
  • "Tap-and-speak" mode (available in settings)

Comments

NikosAlexandris's picture

WoW! Nice work!

krishgcek's picture

Need English india support

rob_k's picture

Hi Osanwe, thank you for creating this. To me Serra is very promising, especially in the car. But for now I have no clue how to operate it while driving. Will it react to "OK Serra"? Even when the device is locked? Or do I have to touch the microphone? (Touching my phone is now officially forbidden in The Netherlands while driving.)

Furthermore, here at home, I tried to let Serra perform tasks like "Call Paul". At this point, it seems to be treated as a search command on Google. Should I teach Serra what to so (how?) or should I create a User command (and what would be the syntax for that?) I'm running v0.5.0.

Too many questions, undoubtedly. Thanks in advance for answering!

Osanwe's picture

Unfortunately now you have to touch the microphone icon.

For calling you should use full name from your address book.

parth007's picture

not open

PamNor's picture

0.4.1-11 --> confirmed working.
Thanks.

PamNor's picture

Ver. 0.4.0-10 not working
From terminal
| SailfishOS 2.1.1.24 (Jämsänjoki) (armv7hl)
'---
[nemo@Sailfish ~]$ harbour-serra
[D] unknown:0 - "nb-NO"
[D] unknown:0 - Using Wayland-EGL
[W] unknown:41 - file:///usr/share/harbour-serra/qml/harbour-serra.qml:41:30: Type SearchPage unavaila
ble
initialPage: Component { SearchPage { } }
^
[W] unknown:35 - file:///usr/share/harbour-serra/qm
l/pages/SearchPage.qml:35:5: Type GpsSwitcher unavailable
GpsSwitcher { id: gpsSwitcher }
^
[W] unknown:25 - file:///usr/share/harbour-serra/qml/utils/GpsSwitcher.qml:25:5: LocationSettings is not a type
LocationSettings {
^
No UI
Have to kill Serra.

Osanwe's picture

Fixed.

Caballlero's picture

Not work on 2.1.1.24

Pemek's picture

2.1.1.23, nothing happened...

TMavica's picture

Unable to start the apps.

Osanwe's picture

Thanks. When SFOS 2.1 will be public available I can fix it.

Pemek's picture

Hi,

SFOS 2.1.0.11, not able to start app properly, process exist (and does something basing on CPU consumption) but no UI has started.

Nothing valueable on the console...

DarkTuring's picture

Hey one more idea: i know this one will be tricky, but attenuate speaker volume when music is playing AND recording button is pushed OR recording is happening OR when SERRA is providing Audio feedback. That way music streaming/playing through speaker will continue uninterrupted but wont interefere with voice commamds or SERRA.

DarkTuring's picture

Bug: with talk as long as microphone is pushed action doesnt work well from cover when saying: turn on bluetooth, it will open app anyways, maybe highlighting simple.commands would help, or when in cover mode and upon first press record until you push the search button.from the cover view. So push short - record, keep recording, until another short push on microphone from cover.

Osanwe's picture

Thanks. Fixed.

DarkTuring's picture

I love the navigation function: a couple tweaks to improve UI and work flow:

1. auditory feedback with one sound when recording starts - a ding

2. auditory feedback when recording finished - a ding ding

This should be based on monitoring recording engine and verifying that button as been pushed, is no longer pushed (with push and record enabled, and voice is starting to be processed.

3.Turn-off voice response from Serra on successful voice command, as soon as record button is pushed again, that way when you do directions you can quickly record and say Start, and dont have to wait for Serra saying out loud the command.

Osanwe's picture

1-2. Thanks. I'll add this.

3. Fixed.

carmenfdezb's picture

Great app!! Thanks for developing it!!! I know that your app is only supported for Russian and English languages, but are there any possibility to support others languages?

Osanwe's picture

Maybe later. Now the prime task is adding new commands.

DarkTuring's picture

Search works, very nice! On Intex Aquafish when i say Turn on flashlight it wont turn on.

But when i say Turn on Torch it works.

Recommendation: Select default device language automatically, then provide message to user on screen if currently not supported, only english and russian is.

Osanwe's picture

Thanks. Fixed.

DarkTuring's picture

Osanwe thanks for the fixes. Couple more suggestions:

P1. provide haptic feedback when pressing microphone with case where it records as long as it is pressed,

 

2. I noticed when saying turn on torch quickly it works, but when stretching it out to Turn ....... On...... Torch... it only recognizes the last noun torch, even though it should start amd kepp recording as long as button is pushed. Acn you verify recordings of 10sec - to 20sec work if you dont immediatelly start talking?

Osanwe's picture

1. Okay, I'll add this.

2. Unfortunately this is a problem with speech recognition service. I changed records encoding. Maybe it'll help.

DarkTuring's picture

thanks for checking on it.

Ingvix's picture

A very nice start. Weather command actually works and the search in general but I couldn't get the other commands to work. They just made a search query and not what they were suppose to do. I hope you continue developing this.

Osanwe's picture

Other commands do not have voice answer yet and it is possible to think that they do not work. I will add this feature lately.

Please, check twice. Maybe you did not notice that command was done. 

P.S. Search is made every time when you say something.

Ingvix's picture

You were right. Some commands are just rather hard to input at least with english as the app likes to hear wi-fi as wife and also flash light it typed with a space and the command is without it so it won't work. Take a selfie -command was the only one that didn't seem to do anything even when it was heard right.

Also set the recording button's preventStealing property to true. Right now with the tap-and-talk-mode if the finger happens to move a bit while holding the button the pull-down menu activates and messes up the recording.

Osanwe's picture

Thanks. Fixed.