Design for Context logo
This is a Design for Context presentation

...a glimpse into the future
of Semantic Web Interaction

Duane Degler, Design for Context
www.designforcontext.com

-->
This is a Design for Context presentation

...a glimpse into the present?
of Semantic Web Interaction

Duane Degler, Design for Context
www.designforcontext.com

So today we explore...

 

Why now?




"As interface stands on the shoulders of infrastructure,
tomorrow's user experience will rest on the foundation of today's
Semantic Web technologies."

 

Peter Morville, Ambient Findability, 2005, p. 170

Why now?

... analogy thanks to Nathalie Barthe

Evolving understandings

The formal view of the Semantic Web (9.2006)

Semantic Web Layer Cake as of September 2006

Berners-Lee et al, September 2006. Fig. 3.2 The Semantic Web Stack c.2006. Page 22.
In "A Framework for Web Science." Foundations and Trends in Web Science. Vol. 1, No 1 (2006).
http://www.nowpublishers.com/product.aspx?product=WEB&doi=1800000001

Whoa! Jargon check!

Metadata
Metadata is an enabler
Metadata connects to business goals of productivity, quality, knowledge and discovery

The imperative for Usability and Interaction Design involvement



"Well, you said that for people to be able to handle data they need a lot of skill...
We do not yet have Semantic Web technology available which is that easily usable by grandparents and children. That is true."

Tim Berners-Lee, "The future of the Web as seen by its creator"
in an interview with Peter Moon, IDG Now, July 9, 2007
http://www.itworld.com/Tech/4535/070709future/pfindex.html



"After 10+ years of work into various aspects of the Semantic Web...
I am now fully convinced (read: no longer in denial) that most of the remaining challenges to realize the Semantic Web vision have nothing to do with the underlying technologies...
Instead, it all comes down to user interfaces and usability."

Ora Lassila, "Semantic Web Soul Searching"
Wilbur-and-O blog, March 19, 2007
http://www.lassila.org/blog/archive/2007/03/semantic_web_so_1.html

What problems are we trying to solve?

Some things to think about

Current web is about publishers Future web is user-centered

Some things to think about

SWUI vision from 2008 CHI workshop

From CHI2008 Workshop Semantic Web User Interaction: HCI Challenges, April 2008.

Some things to think about

Matrix of info need, from knowing your need to not knowing at all Matrix of info need, from knowing your need to not knowing at all Matrix of info need, from knowing your need to not knowing at all Matrix of info need, from knowing your need to not knowing at all Matrix of info need, from knowing your need to not knowing at all

Some things to think about

Themes

Navigating Information Landscapes

What is useful? What challenges exist?

Navigating information landscapes

IRS TaxMap

Created by InfoLoom

TaxMap architecture

Navigating information landscapes

Exploring facets

Navigating information landscapes

Exhibit: Simple faceted filtering

Created by the SIMILE group, MIT

Exhibit data model: triples

Navigating information landscapes

Exhibit: Simple faceted filtering

Created by the SIMILE group, MIT

basic Exhibit architecture Exhibit with database architecture Exhibit with RDF output

Navigating information landscapes

RDFizers: converting between formats to easily create structured data

Created by the SIMILE group, MIT

list of converters Simile group has created for RDF

Navigating information landscapes

mSpace and mSpace Mobile: facet browsing

Created by IAM Group, ECS, Southampton, UK

Navigating information landscapes

Multimedia eCulture: Rijksmuseum, Netherlands facet data for browsing

Created by CWI, Netherlands

Navigating information landscapes

Tag-based navigation

Thanks to Kate for letting me illustrate the del.icio.us challenge...

Navigating information landscapes

Adding visualization: AquaBrowser

Created by Medialab Solutions, Netherlands

Navigating information landscapes

SADIe: a unique use of SW technologies for accessibility

Created by Universities of Manchester and Aberdeen, UK

basic SADIe architecture SADIe possibilities

Search and the possible role for natural language interaction

Is there something other than "keywords"?

Searching information landscapes

Keywords, meaning, and natural language

Searching information landscapes

Complex search, where semantic data relationships play a role

Since I gave this talk in June 2008, PowerSet has been acquired by Microsoft, so I think it's fair to say that next generation tools have arrived once you attach names like Microsoft and Yahoo to the trends...

Searching information landscapes

Structured natural language search

Created by Dynamic & Distributed information Systems Group, University of Zurich

Ginseng semantic parsing of terms and results from triple store

Creating and sharing information...

What a difference a year makes!

Data entry and annotation
Sites that share information

Creating and sharing information

If you don't have the data, what do you have?

Creating and sharing information

LepTree, Splickr, and Spotter: biology community support

Created by Univ. Maryland Baltimore Campus (part of AToL project)

Creating and sharing information

Semantic Wiki: semantic extensions to the popular MediaWiki

Created by Ontoprise and Instititue AIFB, Universitat Kalrsruhe, Germany

Creating and sharing information

Semantic Wiki: semantic extensions to the popular MediaWiki

Created by Ontoprise and Instititue AIFB, Universitat Kalrsruhe, Germany

Semantic MediaWiki interface facts panel in wiki article Semantic MediaWiki interface annotation interface much more detailed and structured Semantic MediaWiki ontology browsing capability Semantic MediaWiki structured querying

Creating and sharing information

Personal Information Scraps

Simile Group, MIT and AIM Group, U. Southampton

Jourknow ethnographic examples

Creating and sharing information

Personal Information Scraps

Simile Group, MIT and AIM Group, U. Southampton

Jourknow scrap interfaces as of 2007

Creating and sharing information

Personal Information Scraps: Pidgin

Simile Group, MIT and AIM Group, U. Southampton

In order to facilitate people creating and managing scraps, they are looking at different levels of informal-to-formal syntax that might be used.

  sloppy pidgin   jane 3pm diesel cafe   "Sloppy parsed" to allow out-of-order matching and recursive nesting of typed templates.
  tame pidgin   Meet with Jane phone 617-555-1212 tomorrow at diesel cafe about SWUI submission   Hand-written grammars for common domains, with semi-open SW-KB defined lexicon, and support for nested expressions. Not user-extensible or re-orderable.
  clay pidgin   meet 3pm with jane smith about swui   User-defined N3 macro language using "means" templates written by the user. Support for nesting. No re-ordering clauses.
Template: "meet when with whom about what" means [ a :Meeting; vcal:start "when"; xcal:attendees "whom"; xcal:description "what"].
  n3+res pidgin   swui mtg a Meeting; starts at: 3pm tomorrow; with jane; location Diesel Cafe   N3 with entity and property and value resolution. Uses a colon or dash to delimit multi-word properties from their values, and semicolons to delimit clauses.

Creating and sharing information

Annotation

W3C Annotea data, raw RDF W3C Annotea data, RDF explained W3C Annotea data, HTML window of data

Creating and sharing information

PhotoStuff: archiving and annotating your photos

Created by MindLab, Univ. of Maryland

Creating and sharing information

FOAF: Friend of a Friend

Collaborative project started by Libby Miller and Dan Brickley, 2000

Vocabulary and Relationship Management

Vocabulary and relationships

Existing terminology sets

Vocabulary and relationships

Concept extraction and term indentifiers

Vocabulary and relationships

Extensions for content management systems

Calais

Vocabulary and relationships

Yahoo Pipes

Captured YahooPipes screen

Vocabulary and relationships

Ontology editing and viewing

Protege editor, U.Stanford; Crop Circles by MindLab, U.Maryland / U.Manchester; TopQuadrant

What are some of the issues?

Personal and Social Issues:

Provenance, transparency, shared data and privacy

Hot topics for longer-term consideration

Provenance, transparency, shared data and privacy

Tabulator: exploring existing data sets

Created by W3C (Tim Berners-Lee) and MIT CSAIL

Provenance, transparency, shared data and privacy

CS AktiveSpace: mashup of academic data, with provenance

Created by IAM, University of Southampton

CS AktiveSpace interface CS AktiveSpace person provenance CS AktiveSpace topic provenance

Provenance, transparency, shared data and privacy

Inference Web: explanation interfaces

Created by Stanford University

Provenance, transparency, shared data and privacy

Informed consent: what's unique about the Semantic Web?

From presentation/paper by Paul Shabajee, SWUI2006

Points about Semantic Web impact on informed consent

Provenance, transparency, shared data and privacy

Recommender systems and understanding "trust"

Jennifer Golbeck, MindLab, University of Maryland

For your consideration...

How do we make sure the Semantic Web is:

This is a Design for Context presentation

...a glimpse into the present
of Semantic Web Interaction

Duane Degler, Design for Context
www.designforcontext.com