There were a number of comments on yesterday's 'You shall not remit OpenStreetMap':

• Richard Fairhurst points to quantity, coverage, scaling and 'less aggro' and the widely accepted fact that "OSM can be better than any other mainstream data source - whether OS or TA/NT"
• Dave comments on OSM's London homestead and the strong contribution from there
• Muki Haklay emphasises that "in the crowdsourcing way you can have good quality, reasonable and useful coverage and effective basis for GIS analysis without paying a lot for the data" and "not trying to have perfect accuracy and quality unless you need it"
• John McKerrell rightfully states that Muki's goal was to "quantify the levels of quality available from OSM data" and claims that CloudMade being mentioned appropriately.
• Well in the middle Steve Coast just yawns that "(...) Wikipedia will never work either!" (without taking up the argument).

So let's do all at once and add some spice.

Coincidentally Denis Zielstra from the University of Bonn provided first results of his diploma thesis, where he repeated Muki Haklay's comparison of OSM with data from Tele Atlas Multinet.

The poster is in German:

• OSM data from April '09 is compared to Tele Atlas Multinet 2008/01 covering Germany
  
• length and differences of street segments are calculated
• OSM data decreases in rural (less urban) areas
• OSM is better than TA in metropolitan areas and covers more pedestrian ways and smaller streets
• preliminary conclusions:
• heterogeneous data quality within OSM
• good OSM data within metropolitan regions
• OSM generally provides good positional accuracy
  

Without anticipating the final analysis: Muki Haklay's analysis seems to apply to Tele Atlas data in Germany.

Now let's shed some light on CloudMade and release some of Steve Coast yawning that "(...) Wikipedia will never work either!".

In mid '08, Sunstone Capital A/S invested a whopping 2.4m€ into CloudMade, the commercial venture run by OSM founders Nick Black and Steve Coast. CloudMade offers a set of free Mapping APIs, Tools and Services and seemingly intends to make money from paid professional services.

Counting from the Team page, there's well over 50 people working in the US, UK and Ukraine. Even by modest standards, Sunstone's injection should have gone quite a while ago.

Now "under the guidance" - or having taken over or extended the investment of Sunstone Capital A/S - by Progression Partners, a venture capital firm with Juha Christensen and Christian Petersen, who both serve on CloudMade's board, CloudMade's "commercial interests center on street map parity along with depth & breadth". As Marc Prioleau, CloudMade's recently appointed CEO, coming from deCarta is cited "Monetization will come eventually", one could wonder where the money should come from as long as the CC-SA-BY-licence effectively prohibits commercial use of OSM-data, the ODbL won't change much and free products don't add to a positive cash flow.

Even if OSM data will get better and cover flat world more quickly (I am the last one to doubt that) - How will CloudMade make money from volunteered contributions without violating OSM licencing schemes? Even if monetization will come eventually, investors like events of that sort. However - not my cup of tea.

The (admittedly provocative) statement "Is the active crowd made up of a handful of (paid?) CloudMade activists?" probably needs some clarification. At the Where 2.0, I talked to some OSM's "community ambassadors" trying to understand what they're up for. It seems to be a mix fixed salary and profit sharing: the more data volunteering contributors managed by a (CloudMade) community ambassador bring in, the better the payment. If it is handled alike, it smells a little bit.

If there's a community collecting data at no cost and business models will eventually emerge to support ad-based, donation-based revenues (quote Marc Prioleau), ‘Volunteered Geographical Information’ (VGI) is a nice leverage for CloudMade ... but still: it's far away from Wikipedia.

Ed Parsons recaps the SOTM '09, citing Muki Haklay's updated comparison of OSM (OpenStreetMap) vs UK OS (Ordnance Survey) Meridian 2 data. The original article from August 2008 was widely cited as a proof of feasibility for OSM and misleadingly shortened as "the quality of the [OSM] data is comparable and can be fit for many applications".

In terms of spatial accuracy Muki Haklay has made a specialism of accessing OSM data quality and his latest results presented at SOTM suggest that using the UK as an example, OSM data is better than the equivalent business geographics product produced by the OS, and in some cases comparable to OS MasterMap ITN data, a product that costs over £100,000 per year to license.

To make a long story short: OSM is getting better compared to 2008 but still OSM is far from professionally reliable.

(Beware, this is a long read.)

'You shouldn't bash the good guys'

Less exalted comments to fancy Web 2.0 phenomenons like collaboration, grass-roots actions and creative commons carries the harsh risk of being labeled as conterrevolutionary egghead. Or worse. So let's state that once and clearly: the achievements and dynamics of the Open Street Map Project are breathtaking, insanely great and probably the best single example of the Internets' usefulness. Mapping the world is a vision worth spreading.

United Maps - though being a commercially oriented venture - supports OSM projects and more is to be announced soon.

Nevertheless, there's quite some attributions to the brave new world of mash-ups and webtwosomethings that should't be trusted blindly. And: OSM ≠ Cloudmade.

cities ≠ coverage

I re-read Haklays excellent article with open eyes. I did so several times.

The conclusions the original paper draws are stunningly different from what is touted in PR releases. End of April, I called up Dr. Haklay and cleared some (of my) misconceptions.

In a nutshell, the result of the analysis is that OSM data is suitable for cartographic products that display central areas of cities. Not less, not much more.

By coverage, the centers of major UK cities are well mapped and covered, though, as you move from the centres to the edges, the quality of coverage deteriorates rapidly. In areas where OSM information is complete and with fully attributed – an area of about 20% of England – it is estimated that OSM quality is such that it can be a replacement for "Meridian 2".

The subsequent comparison with OSM also helps to clarify why a price tag of about £1300 for a licence for the Ordnance Survey's "Meridian 2" is reasonable in terms of quality and in explains why professional grade data has a professional price tag.

OSM ≠ Wikipedia

Unlike Wikipedia, where the majority of content is created at disparate locations and by "desk research", the OSM community also organises a series of local workshops (called ‘mapping parties’), which aim to create and annotate content for localised geographical areas. Interestingly, even OSM's frequent mapping parties don't bring much new data on a larger scale.

Again unlike the Wikipedia, mapping out there in the wild is not funny if it's windy, cold and getting dark. As it is most of time in central Europe. Wikipedia definitely has an advantage here.

incompleteness ≠ feature

As an end user, you probably will accept "imperfected, unfished work in progress" but whitepace is nothing you'd tolerate on a professional map with a distinct commercial use case.

As Steve Coast is cited to state ‘it’s important to let go of the concept of completeness’ in an interview (GIS professional, Issue 18, October 2007, pp. 20-23). Put this into a nasty perspective: "sure ... if one sacrifices completeness, every bug turns into a feature to be improved later on ..."

Or as Haklay puts it "As OSM relies on the decisions of contributors about the areas that they would like to collect, it is interesting to evaluate the level in which deprivation influences data collection." - or in other, my words: you cannot tell volunteer OSM folks where to map which features. They either do it because they feel an intrinsic motivation or it isn't done, resulting in eternal "imperfected, unfished work in progress".

You cannot direct the crowd

If volunteering contributers decide to leave white spaces open, then OSM coverage likely never will be completed as there is a natural bias in data gathering for nicer, more mainstream places. To take it to the negative: Is OSM then "shunning socially marginal places" - read as: only "cool and sunny places are mapped"?

(...) most of the data capture (80%) was carried out by 90 participants and a very large group of users disengaged from the project after minimal contribution.

Deductively this means that a tiny fraction of the 135.208 registered contributing users (as of July 14th 09) are actively mapping and contribute useful data.

The point is that the crowd doesn't work like professionals would, see p5 at this slideshare presentation "Beyond good enough? Spatial Data Quality and OpenStreetMap data":

• "We know little about the people that collect (the data), their skills, knowledge or patterns of data collection.
• Loose coordination and no top-down quality assurance processes - can't produce good data
• It is not complete and comprehensive - there are white areas."
  

Nevertheless it's stunning that ...

"OSM is better than Meridian 2 in terms of positional accuracy and less accurate than MasterMap."

Haklay comes up with an intersting hypothesis that couldn't be better formulated:

"When people buy geodata, they pay for the errors or the notion that the errors are well known and quantified."

I state this because this exactly this the argument we at United Maps have with both first and second tier suppliers and customers: providing data as good as technically and commercially feasible provides unseen commercial value if the confidence level is clearly labeled. But if confidence or error level is unknown (as it is at OSM), you're busted.

Is the active crowd made up of a handful of (paid?) Cloudmade activists?

So are we effecively talking about 99% of users doing nothing and 0.5% users doing extremely much. The contribution schemes also show a spatial distribution and, as expected, central areas where mapping parties regulary are organized show a higher number of active users.

Quote Haklay: 

"(...) the areas that were covered by very few users (up to 3) are 89.5% of the total area. (...) the fact that most of the area was covered by a single contributor means that very little quality assurance was carried out, if at all."

So the Pareto principle applies to ‘Volunteered Geographical Information’ (VGI) in a slightly modified flavor as it states "roughly 80% of the effects come from 20% of the causes".

For OSM and clearly dissected by Muki Haklay, the biggest share of contributions comes from a tiny fraction that obviously doesn't collaborate too much.

It will be most interesting to see what results a comparison of OSM data quality to Navteq or Tele Atlas datasets will reveal. Haklay's scrutiny is a welcome sober voice in a somehow hyperbolical discussion on user generated maps.

Viel Vergnügen dabei - holen Sie sich bitte einen Kaffee, nehmen sich eine Viertelstunde Zeit. Es folgt ein längeres (und hoffentlich aufschlußreiches) Lesestück:

• Was bisher geschah: Eine kurze Geschichte der Kartografie
  • Kartografische Produktion
  • Produktion von Navigationsdaten
  • Navigation und Routing für die Straße
  • Topologien für das Routing
  • Weshalb der Aufwand?
  • Vehicle Navigation wird always on
  • Navigationsgeräte sind "dumme Terminals"
  • Für neue Anforderungen der Automobilindustrie müssen Navis connected sein
  • ... und wenn schon online, dann gleich mit Nutzerinteraktion

• Heute: die mobile mapping revolution
  • Web Mapping: von Xerox, Mapquest zu ... Google
  • Mash-ups und KML als Standard
  • "Places are the new keywords"
  • Karten aller Dienste stammen von Navteq oder Tele Atlas
  • Suche und Geolocation

• Morgen: Mapping auf mobile connected devices
  • Der Werbemarkt auf dem "third screen"
  • locative media - relevante ortsbezogene Dienste machen nur auf dem Mobiltelefon Sinn
  • Große Player kaufen sich in Geodienste ein
  • Nokia/Navteq dominieren
  • Mobile Devices: Koexistenz statt Konvergenz
  • Mobile Navigation ist eine disruptive technology
  • Mobile Mapping braucht bessere Karten
  • Wer braucht wofür bessere Karten?

ctd' from "Map mash-ups are a game changer"

Zooming in onto the roof of your house and almost being able to discriminate objects the size of a shoe-box still is a jaw-dropper. Even real-time capabilities are attributed to mapping imagery ... well ... sort of. Diving deep into our lives.

Google’s Marissa Mayer recently announced the availability of two thirds of the earths’ landmass in „rooftop quality“ imagery. Inadvertently setting "rooftop" as today's best mass imagery resolution.

ctd' from "A brief history of online mapping"

In 2004 Google bought Keyhole, a company producing satellite imagery. Google Earth launched in January 2005 and immediately took off.

MapQuest was bought by AOL, making it the worlds first $1B dollar mapping company.
Though still popular, MapQuest lost it’s pool position to Google Maps which collects around 24% of all world-wide mapping traffic.

Still in 2004 all data was treamed from the mapping service to the user – until Paul Rademacher started the map mashup (he just wanted to show bay areas’ flats for-rent from craigslist.com on a simple map).

Continue reading "Map mash-ups are a game-changer" »