OSM Scout Server

rinigus's picture
Submitted by rinigus on Sun, 12/17/2017 - 23:13
Rating: 
5
Your rating: None Average: 5 (15 votes)

OSM Scout Server is a native offline maps provider. This server can be used as a drop-in replacement for online map services providing map tiles, search, and routing. As a result, together with the map client, a full offline solution is available for map search and navigation (car, bicycle, and walking).

The server can be used to provide:

  • map tiles for other applications;
  • search for locations and free text search;
  • search for POIs next to a reference;
  • calculate the route between two or more locations.

To use the server, you have to start it and configure the client to access it. Poor Maps and modRana have support for the server already with no additional configuration needed.

Starting from 0.7.0 release, maps are distributed online and should be downloaded through provided Map Manager interface.

NB! When a new backend is added, such as with the release of 0.9.0 and 0.10.0, please ensure that you have subscription information updated. For that, in Map Manager, click on "Check for updates", decline updates, and unsubscribe/subscribe each territory that you have subscribed. After that, proceed with the downloads. This is not needed if you don't want to use the added backend(s).

For detailed up-to-date description, please see https://github.com/rinigus/osmscout-server/blob/master/README.md

License: LGPL
Source code: https://github.com/rinigus/osmscout-server

User's guide: https://rinigus.github.io/osmscout-server

Official TMO thread: http://talk.maemo.org/showthread.php?t=97823

Donations: https://liberapay.com/rinigus

Screenshots show the running server and, as an example client application, Poor Maps accessing the map tiles and calculated route prior to navigation.

Maps are hosted by Natural Language Processing Centre (https://nlp.fi.muni.cz/en/ , Faculty of Informatics, Masaryk University, Brno, Czech Republic) through modRana (http://modrana.org)
data repository.

Map data from OpenStreetMap, Open Database License 1.0. Maps are converted to a suitable format from downloaded extracts and/or using polygons as provided by Geofabrik GmbH.

Screenshots: 

Category:

Keywords:

Application versions: 
AttachmentSizeDate
harbour-osmscout-server-1.0.1-1.i486.rpm10.87 MB15/08/2017 - 23:04
harbour-osmscout-server-1.0.1-1.armv7hl.rpm10.08 MB15/08/2017 - 23:04
harbour-osmscout-server-1.0.2-1.i486.rpm10.87 MB17/08/2017 - 20:42
harbour-osmscout-server-1.0.2-1.armv7hl.rpm10.08 MB17/08/2017 - 20:42
harbour-osmscout-server-1.1.0-1.i486.rpm10.89 MB31/08/2017 - 22:42
harbour-osmscout-server-1.1.0-1.armv7hl.rpm10.1 MB31/08/2017 - 22:42
harbour-osmscout-server-1.1.1-1.i486.rpm10.89 MB09/09/2017 - 22:24
harbour-osmscout-server-1.1.1-1.armv7hl.rpm10.1 MB09/09/2017 - 22:24
harbour-osmscout-server-1.2.0-1.i486.rpm11 MB10/12/2017 - 22:18
harbour-osmscout-server-1.2.0-1.armv7hl.rpm10.22 MB10/12/2017 - 22:18
harbour-osmscout-server-1.3.0-1.i486.rpm11 MB17/12/2017 - 23:13
harbour-osmscout-server-1.3.0-1.armv7hl.rpm10.23 MB17/12/2017 - 23:13
Changelog: 

1.3.0

  • Support for multiple map download servers
  • Ensure that Valhalla is started before starting HTTP service
  • Updated translations
  • Added donations link

1.2.0

  • Add support for MapboxGL
  • Updated translations of documentation and application

1.1.0, 1.1.1

  • Add automatic start via systemd socket activation
  • Updated translations

1.0.2

  • Normalize tile indexes if requested out of range

1.0.0, 1.0.1

  • Users Guide in Spanish
  • Addition of Finnish translation
  • Updated translations

0.15.0

  • Revert to older libosmscout
  • Updated translations

0.14.1

  • Geocoder-NLP update
  • Updated translations

0.14.0

  • Add support for English as a secondary language
  • Deleting files during cleanup in separate thread
  • Updated translations
  • Bugfixes

0.13.1

  • Updated translations
  • Bugfix in guide search

0.13.0

  • Introduction of profiles
  • Startup wizard
  • Updated translations
  • Other small changes

0.12.0

  • Add support for Mapnik style and daylight switching
  • Speedup Mapnik backend by removing double scaling of the buffer
  • Updated translations

0.11.1

  • Add guide search support for Geocoder-NLP
  • Guide search looks for type or name when using Geocoder-NLP
  • Support for V2 routing protocol by libosmscout backend
  • Updated translations
  • Other smaller changes

0.10.1

  • Updated translations

0.10.0

  • Valhalla added as a routing engine
  • Routing is supported between different territories when using Valhalla
  • Search is performed for all databases when using Geocoder-NLP
  • Server is distributed using modular approach
  • Two server modules introduced: Route and Fonts
  • Update libosmscout version, 20170521
  • Make storage of libosmscout databases optional
  • Mapnik uses Noto fonts by default
  • Other smaller changes

0.9.5, 0.9.6

  • Mapnik database schema changes to reduce size and speedup rendering
  • Mapnik renderer default style adjustments
  • Updated translations

0.9.0

  • Mapnik added as an alternative map rendering backend
  • Enhance Linux command line support for map subscription

0.8.1

  • Updated translations
  • Fix start error on i486

0.8.0

  • Optimization of geocoder-nlp, changes in geocoder data format
  • Updates from libosmscout upstream
  • Addition of command line options
  • Updated translations

0.7.5

  • Expose map updates to GUI
  • Propose to create a storage folder (suggested by @Feathers McGraw)
  • Updated translations

0.7.2

  • New transalations completed: French, Russian
  • New translations started: Polish, Norwegian
  • Fix buffer overflow during fast download and slow writing

0.7.1

  • Updated translations
  • Improved handling of some network errors during download

0.7.0

  • Maps are provided through CDN
  • Adding Map Manager to download and remove maps on the device
  • libosmscout backend changes, including rendering speedup by @Karry
  • Settings grouped by backend and available via Settings dialog
  • Small enhancements

0.6.2

  • German translation
  • Moving translations to Transifex
  • Start and target description are given when available

0.6.1

  • Updated Spanish and Swedish translations

0.6.0

  • Adding libpostal-based geocoder
  • Update to the latest libosmscout version
  • Updated Spanish and Swedish translation

0.5.3

  • Swedish translation

0.5.2

  • Czech translation
  • Minor update in search

0.5.1

  • Updated Spanish translation

0.5.0

  • Added file and directory selection dialog
  • Support for metric and imperial units
  • Built against libosmscout 0.0.git.20161207

0.4.1

  • Updated Spanish translation

0.4.0

  • Changes for better localization support
  • Spanish translation
  • GUI shows number of jobs in queue
  • Support for routing cost limits
  • Bugfixes in routing (libosmscout library)

0.3.0

  • Decoupling number of parallel processing threads and number of requests
  • Adding GPX output for router
  • Adding ability to log events into session log file
  • Using libmicrohttpd as a http server engine
  • Bugfixes in routing
  • Static linking of libosmscout, marisa, and libmicrohttpd
  • Used versions of the libraries: libosmscout (0.0.git.20161110), marisa (0.2.4), libmicrohttpd (0.9.50)

0.2.1

  • Bug fix in routing target description; small changes in route instructions text

0.2.0

  • Support for route calculation
  • Add settings for transport speed properties
  • Add ability to increase area processed for tile drawing
  • Small enhancements and bug fixes

0.1.0

  • Initial release
  • Support for map tiles
  • Support for location search
  • Support for free text search
  • Support for search of POIs next to a reference point

Comments

DarkTuring's picture

DarkTuring

Sun, 01/07/2018 - 23:20

How do you actually start the Scout server? Why doesnt it start with application start or when it is called upon by client?

rinigus's picture

rinigus

Sun, 01/07/2018 - 23:27

There are two ways to start:

* start OSM Scout Server as a regular SFOS application and then access it via map applications (Poor Maps, modRana, Poor Maps GL)

* enable auto-start in Settings and then just use map client

Note that we have documentation available that should get you up and running in no time at https://rinigus.github.io/osmscout-server/en/ . It includes setting up the server as well as Poor Maps and modRana.

DarkTuring's picture

DarkTuring

Mon, 12/04/2017 - 04:26

I am getting an error, it cant even download the list of countries, says host unreachable.

Countries_providex.json  error code 99

rinigus's picture

rinigus

Mon, 12/04/2017 - 11:59

It should all work now. Please let me know if you still have issues.

rinigus's picture

rinigus

Mon, 12/04/2017 - 04:33

the server providing maps is down again , unfortunately . I expect out will work tomorrow .

DarkTuring's picture

DarkTuring

Sun, 01/07/2018 - 23:19

It works now!

rinigus's picture

rinigus

Sun, 01/07/2018 - 23:25

Great. There is also redundancy in the latest version of the server allowing us to provide maps via two distribution servers. So, if the main server is down, the backup will be asked for the data - it may just take a bit longer for the first connection

naytsyrhc's picture

naytsyrhc

Wed, 11/29/2017 - 02:24

I always get an error: mapnik not available due to sqlite malformed disk image. Is there a way to repair? Downloaded maps freshly but still the same. Try to store maps on sd card. May that cause the error? Thx for help.

rinigus's picture

rinigus

Wed, 11/29/2017 - 07:22

I would need a bit more info to help. In particular, there are several SQLite databases involved and I want to be sure where does the error come from. So, here are the questions:

* does it happen to any new Mapnik database or only one in particular? Try to download some small country and see if that works.

* If there is one country in particular, please let me know which. Then I can test it as well

* If it happens to any country, try to make a new directory for maps and see if it helps. You would have to redownload all maps though. There is a "master" database that keeps versions of all downloaded files and if something happened to that (never heard of it though), it could have some strange results. With the new folder, you would start a new "master" database

I am also keeping all on SD card, so that should be fine.

naytsyrhc's picture

naytsyrhc

Wed, 11/29/2017 - 23:28

Seems to be a problem with all databases. As the directory is totally new an all maps have been downloaded freshly, it seems to be sonething in general. Any debugging possibilities?

rinigus's picture

rinigus

Wed, 11/29/2017 - 23:52

Its something new, haven't had this issue earlier. We can try to see your session log file:

* Go to Settings, scroll to the the end, enable "Log messages into session log file"

* Accept Settings

* Close OSM Scout Server

* Open OSM Scout Server again

* Close it again (I presume that the errors are logged)

* Copy session log file from .cache/harbour-osmscout-server/harbour-osmscout-server/session.log to somewhere (pastebin?) and send me a link

* Start OSM Scout Server and disable logging in Settings

Let's see if its also error on SD card. For that, enable "libosmscout" profile (this should have smallest files), setup a new folder on internal storage and download some smaller country. Do you get errors again?

To test maps with the smaller country, try to see this country with Poor Maps or modRana. For that, use first online basemap, navigate to country, and then switch over to OSM Scout Server basemap. It will not be as pretty as Mapnik, but should show something

naytsyrhc's picture

naytsyrhc

Thu, 11/30/2017 - 02:28

Thx for the response and offered help. It somehow healed itself. I removed (unsubscribed) all maps and performed  a cleaning. Afterwards I resubscribed and the map was available.

rinigus's picture

rinigus

Thu, 11/30/2017 - 23:32

Thank you very much for reporting back! Enjoy using it

naytsyrhc's picture

naytsyrhc

Fri, 12/01/2017 - 10:10

Thank you for providing this great tool. Another update: when.I installed a new map (that worked) that was only a part of germany. After that I again tried the whole germany map and that again causes the error. The map is quite large (9 GB) and I had two download failures and had to presume download. Maybe the error has something to do with it?

rinigus's picture

rinigus

Fri, 12/01/2017 - 11:21

In case of full Germany, the issue could be filesystem support for files larger than 4GB. In particular, Mapnik is done via single file which is 6.7GB in this case.

There is a way around it: download Germany by parts. If you use the default profile (mapnik.geocoder-nlp/valhalla), the server will show data from all datasets "glued" together.

In a bit longer term: wait till I release Mapbox GL support for OSM Scout Server. In this new approach, the biggest tile database is below 1GB (0.5GB to be more precise) and it would suit well for getting support of larger territories. I am making good progress with it, but its not ready yet

objectifnul's picture

objectifnul

Sun, 11/05/2017 - 12:34

Is modrana.org down permanently? If so, is there an alternative?

rinigus's picture

rinigus

Sun, 11/05/2017 - 12:51

Hi, no, its not permanently. However, since it gone down saturday night and its hosted by the research institution, we probably have to wait till monday. At present, there is no fallback server, unfortunately. I could upload to the cloud that I use, but it would probably take about 12 hours due to the partitioning of the datasets. Taking into account that modrana.org will be probably back tomorrow, I presume that its not worth it...

I will look for alternative servers to use as a fallback to make the map distribution more stable.

objectifnul's picture

objectifnul

Sun, 11/05/2017 - 12:55

Thx. By the way, congratulations for this awsome work.

ferlanero's picture

ferlanero

Fri, 09/01/2017 - 01:33

Thumbs up for new release. I'm absolute impressed with how this project is developed!

rinigus's picture

rinigus

Fri, 09/01/2017 - 09:52

Thank you!

Vilkz's picture

Vilkz

Fri, 08/04/2017 - 12:51

Hello, I want to get the osm.org stylesheet for mapnik. I have tried replacing "/usr/share/harbour-osmscout-server/mapnik/default/day/mapnik.xml" with osm.xml from https://trac.openstreetmap.org/browser/subversion/applications/rendering/mapnik, I then get the error message "Mapnik exception: failed to initialize projection with:[the path to mapnik.xml inside ~/.cache]". I guess this isn't the correct way to do this?

rinigus's picture

rinigus

Fri, 08/04/2017 - 12:56

Unfortunately, its not that easy. All mapnik styles are attached to some data source. In the case of osm.org, its attached to PostGIS database. I am using SQLite datasource as a backend for my mapnik styles to keep RAM consumption small. So, if you wish to adapt osm.org, you would have to maake a corresponding style as well. See https://github.com/rinigus/mapnik-styles-sqlite for  styles used by OSM Scout Server. If you are faamiliar with how to edit these styles, its not too hard to make one for yourself.

DrYak's picture

DrYak

Fri, 07/21/2017 - 14:17

Feature request:

- Whole Europe download in the GUI interface (for people with 128GB  uSD-cards), like navit.

BTW: great app, love it ! Big thanks!

rinigus's picture

rinigus

Fri, 07/21/2017 - 15:54

That's not very simple. One way would be to make a single import, but it would take large amount of time. Alternative is to have "batch" download, but the server doesn't exactly support it yet. Second alternative would be to generate countries_requested.json file and use it for subscription of the maps. This would allow to enter all European countries as the subscribed ones and use OSM Scout Server to download them.

Right now, I don't think I have time for it. If you would like to do that and know how to program in something that readw/writes JSON, you could try to make a hack for yourself :)

DrYak's picture

DrYak

Sat, 07/22/2017 - 12:44

Second alternative would be to generate countries_requested.json file and use it for subscription of the maps.

{....}

If you would like to do that and know how to program in something that readw/writes JSON, you could try to make a hack for yourself :)

I'm fluent in Perl (in addition to other stuff like C/C++) so cobbling together something like this shouldn't be difficult.

The only thing that bothers me is that currently OSM Scout has only one active map at one time, so this wouldn't allow me to just select "Europe" and be done with it.

rinigus's picture

rinigus

Fri, 07/21/2017 - 19:51

It has a single active map for libosmscout backend only. For Mapnik, Geocoder-NLP, and Valhalla, all maps are active. This is the default profile and you should be nicely covered.

The selected map on main GUI in the case of default profile (Mapnik, Geocoder-NLP, and Valhalla) is used only by the geocoder for the first preference of the search. Namely, when you search for something you would get hits from that country first (if they are as good as in the other countries).

DrYak's picture

DrYak

Sat, 07/22/2017 - 12:48

For Mapnik, Geocoder-NLP, and Valhalla, all maps are active.

Then this is definitely interesting for me !

rinigus's picture

rinigus

Sat, 07/22/2017 - 13:10

That's one of the main reasons why the Default profile enables these backends.

cybershaman's picture

cybershaman

Thu, 07/20/2017 - 14:50

rinigus: thank you for all your great work on this app, it has made my life easier numerous times when abroad.
Is there a technical reason why you opt to having the map server run in foreground (cover) mode only compared to letting it run in background (possibly on SFOS bootup) also?

rinigus's picture

rinigus

Thu, 07/20/2017 - 23:24

You are welcome! There are few reasons behind such design:

  • Jolla Store does not accept daemons. So, if I want to distribute in the both places, versions would differ and the code will have to be properly #ifdef'd
  • If I make it as a daemon, I would have to communicate changes in settings, maps, and so on. In one application its just a bit easier.

Its possible that I will add daemon mode, but that's not priority yet.

Pages