quakr phrase
quakr phrase
recycle symbol
Frowny

Quakr Where 2.0 29th May, 2007

Is it possible to build a virtual world from user-contributed photographic metadata?






Quakr Home


This document contains Embedded RDF

Quakr Where 2.0 29th May, 2007

Where 2.0, The Fairmont, San Jose

Who is Quakr?

Dave, Katie and Peter

This talk

  1. Laying the Foundations
    (The Plan)
  2. Bricks and Mortar
    (What We Built)
  3. What is a "Brick" anyway?
    (Semantic Web Issues)

Part 1

Laying the Foundations
(The Plan)

The Giants' Approach - Google Earth

Google Earth

Google Earth
google earth 3D © Hector Mila (cc by-nc/2.0)

The Giants' Approach - Microsoft Virtual Earth

Microsoft Virtual Earth

Microsoft Virtual Earth
virtualearth © Antonio Ortiz (cc by-nc/2.0)

Limitations (1)

Q. Where does that 3D image data come from?

A. Internally (basically)

That's a never ending task!

The Forth Bridge
The Forth Bridge © Steve Makin (cc by-nc-nd/2.0)

Limitations (2)

Q. How flexible are these worlds?

Arc De Triomphe By Night
Arc De Triomphe By Night
Arc De Triomphe In The Snow
Arc De Triomphe In The Snow
Arc De Triomphe In The Fog
Arc De Triomphe In The Fog
Arc De Triomphe Yesterday
Arc De Triomphe At Christmas

A. Not very.

Limitations (3)

The installation is taking longer than expected...

Virtual Earth Setup Dialog

An Alternative (1)

Geotagging

Geotagged _DSC6019 © youngrobv (cc by-nc-nd/2.0)

An Alternative (2)

The numbers speak for themselves - and make new projects viable...

Flickr Map

"Flat" Mashups

Photos positioned on maps: http://loc.alize.us

loc.alize.us

Quakr

A project to build a 3D world from user-contributed photographs

Metadata for photos in 3D (1)

Altitude

(height above sea level)
Altitude

Metadata for photos in 3D (2)

Rotation about y-axis

(compass bearing)
Compass Bearing

Metadata for photos in 3D (3)

Rotation about z-axis

(tilt)
Tilt

Metadata for photos in 3D (4)

Rotation about x-axis

(roll)
Roll

Why rely on user metadata anyway?

Quality of the renderable world dependent upon:

Quakr constraints

Quakr constraints

  1. Quakr should run in a browser.
  2. Quakr should be a thin client, consuming raw resources.
  3. Quakr should adapt to an ever changing semantic web.

Part 2

Bricks and Mortar
(What We Built)

Capturing the Data

We need to capture a pile of meta data...

Nokia (550/Sport?) Phone with "tilt" :
Nokia phone with tilt
Digital Compass and a 3-Axis orientation + compass :
Digital Compass 3 Axis + compass
Basically; we want a camera + a GPS device + a "gizmo" :
A camera plus a GPS device

Homemade - 7D Tiltometer (1)

Basic conclusion - nothing exists... so we built one...

Get a camera and some basic stationery items...

Camera, compass, string and white-tac

Homemade - 7D Tiltometer (2)

Stick protractors to a camera, add string and plumb bobs :

Camera, compass, string and white-tac

Homemade - 7D Tiltometer (3)

Add a compass and a GPS device :

And a GPS device

Homemade - 7D Tiltometer (4)

One person to take the photos, one to log the readings :

7D Tiltometer in use

What and how to tag

The choice of tags for the test data was guided by two principles:

Alternative image APIs

Require bounding box query and ability to add tagged meta data

Possibles include;

A fully tagged image on Flickr

Machine Tagged...

A fully tagged image on Flickr

Flickr API bounding box

Bounding Box API query

"http://api.flickr.com/services/rest/?method=flickr.photos.search
&api_key=XxXxXxXxXxXxXxXxXxXxXxXxXxXxXxXx&min_taken_date=1970-01-01%252000%3A00%3A00
&bbox=-1.3%2C51.754%2C-1.2%2C51.755&tags=quakr&extras=machine_tags"

A Flickr API response

Viewr technology options (1)

Java applet or VRML/X3D?

Java Applet - bust VRML plugin - bust

Viewr technology options (3)

Version "Just Works" - Flash + 3D API called Sandy

Sandy - 3D Flash API

http://www.flashsandy.org/

Adding context

Map tiles for floor

gmap tile

Altitude of floor (http://www.earthtools.org)

Earth Tools API response

There are other services...lets demo!

Part 3

What is a "Brick" anyway?
(Semantic Web Issues)

Using Tagging Metadata (1)

"Tagging: describing web content using whatever words seem right" [Beckett06]

milton_keynes_recycling_factory
Milton Keynes Recycling Factory © gavinandrewstewart (CC Attr 2.0)

Using Tagging Metadata (2)


Tagging is...

  • abundant
  • recycled
  • unhygenic
  • evolving
  • "emergent
    taxonomy"
  • "ontological
    chaos"

Philosophy of Data Tolerance

  1. Recycle everything
  2. Tolerate unhygenic data

Benefits of Data tolerance

We, the people..

crowd scene
Mexican Wave © ~Prescott (CC Attr-NC 2.0)

Costs of Data Tolerance

Synonyms and Homonyms (1)

Dual (competing) Specifications

screenshot of GEO vocabulary screenshot of KML vocabulary

Synonyms and Homonyms (2)

Different syntax - same semantics?

screenshot of flickr showing usage of geo:dir screenshot of flickr showing usage of ge:heading

Semantic Ambiguity (1)

Latitude and Longitude

http://www.makezine.com/ blog/archive/2005/07/how_to_gps_tag.html
screenshot of MAKE blog discussing how to geotag photographs

Semantic Ambiguity (2)

Or the place I was taking a photo of?

View from the Eiffel tower
France 1 © SqueakyMarmot (CC Attr 2.0)
View of the Eiffel tower
Evening At the Park © StuckInCustoms (CC Attr-Nc 2.0)

Inaccuracy (1)

Our 7D Tiltometer GPS device...

actual results...

quakr demonstrating inaccurate geo data

Inaccuracy (2)

The Quakr Taggr solution!

screenshot of quakr taggr tool

Sparseness (1)

It's good, but not quite good enough...

screenshot from flickr demonstrating sparse metadata set
P1030675 © cesargp (CC By-nc-sa/2.0

Sparseness (2)

Technical approaches:

  1. Defaulting - tilt
    ( ~= 90 = straight ahead)
  2. Enhancement - altitude
    ( ~= ground + 1.5 metres)

Abundance

An Image Jungle

quakr demonstrating image jungle

Conclusion 1 - What we Did

  1. Aim: 3D world built from community contributed metadata, which runs in a browser
  2. Saw and examined the emergence of Geotagging
  3. Considered what metadata would be needed
  4. Examined again what people are actually doing
  5. Built the prototypical 7d Tiltometer
  6. Built the Viewr Flash App - which is tolerant and recycles

Conclusion 2 - imminent work

  1. Alternative Map Tiles - OpenStreetMap
  2. Enhanced Altitude - for a "bumpy floor"
  3. Simplify our Flickr query - less data to sift
  4. Time Slider - shows 4th dimension
  5. Move away = reload - explore the world
  6. Build Community - that's our job...

http://www.quakr.co.uk

Sightseeing in Quakr

quakr sightseeing - cows over the river quakr sightseeing - crossroads in Utrecht quakr sightseeing - Broad Street, Oxford quakr sightseeing - pub by the side of the road