Notube slides-120130071559-phpapp01

1. 1 New trendsin television: socialandsemantic
Project overviewandresults
© NoTubeprojectconsortium. Forre-useseenoticeatend.

2. 2 New trendsin television: socialandsemantic
TV on the Web: growing trend

3. 3 New trendsin television: socialandsemantic
TV on the Web: channel explosion

4. 4 New trendsin television: socialandsemantic
Source: Nielson Three Screen Report, March 2010

5. 5 New trendsin television: socialandsemantic
From „Mobile Shopping Framework: The role of mobile devices in the
shopping process” by Yahoo! and the Nielson company, January 2011
http://advertising.yahoo.com/industry-knowledge/mobile-shopping-insight.html

6. 6 New trendsin television: socialandsemantic
Including the Web in your TV
Yahoo! launches ConnectedTV platform for Web-
based widgets on TV (e.g. Flickr, YouTube,
facebook, twitter) –Jan 2009

7. 7 New trendsin television: socialandsemantic
Augmenting TV with the Web
Blinkx BBTV makes
video information
and its textual
transcript clickable,
and links to Web
sources such as
IMDB and Wikipedia
www.blinkxbbtv.com
Also Mozilla has a
project on showing
content around
videos using HTML5
www.drumbeat.org

8. 8 New trendsin television: socialandsemantic
Some Web-TV solutions today
Stand alone boxes such as
•TiVo–original DVR, added on-demand video,
YouTube, music and photos from the Web
•Boxee–STB offering its own store of apps
•AppleTV–relaunched as $99 product tied to
iTunes content, and iPhone/iPad integration
+ Hybrid boxes tied to specific IPTV providers
+ Games consoles (Sony, Microsoft, Nintendo)
also adding Internet and video services to TV!

9. 9 New trendsin television: socialandsemantic
Some Web-TV solutions today
First TVs with
integrated Web
and individual
app platforms
in 2011.
Future TVs will
be „connected“
as standard.
LG SmartTV, pic courtesy
http://www.wired.com/gadgetlab/2011/01/lg-smart-tv/

10. 10 New trendsin television: socialandsemantic
State of the art in TV
•TV content shifting to the Web as delivery
platform
–An explosion in available content at any time
•Web content shifting to the TV as
augmentation of the TV experience
–An explosion in additional content at any time

11. 11 New trendsin television: socialandsemantic
Limitations of today‘s TV
•Too much content in one place
–How to find what you want to watch? Sort
between live TV, TV on demand, archives, video
portals and P2P-TV
•Too much functionality at any one time
–The whole Internet while you watch TV. But what
do viewers really want to be able to do
additionally (parallel) to watching TV?

12. 12 New trendsin television: socialandsemantic
Social TV
•Integrate the TV experience with the so-called
Social Web
–Who are my friends and what do they watch?
–What do my friends like -> maybe I‘d like it too
–Where are my friends now -> connect via the
shared TV experience
•Key goal for social TV
–Enhance my TV experience through my friends‘ TV
experience

13. 13 New trendsin television: socialandsemantic
Semantic TV
•Add formal semantic descriptions for
–TV programmes
–TV schedules (EPGs)
•Link those descriptions to other semantic data
on the Web, cf. Linked Data
•Two key use cases for semantic TV:
–Filtering of TV content -> personalisation,
recommendation
–Augmentation of TV content with Web data

14. 14 New trendsin television: socialandsemantic
NoTube project
•Integrating TV & Web with help of semantics
–Open and interlink TV content in a Web fashion
with Linked Open Data
•Putting the user back in the driving seat
–Connect multitude of distributed personal data
with explicit semantics
•TV is not bound to the device
–Computer as TV & vice versa
–Mobile device as remote control

15. 15 New trendsin television: socialandsemantic
NoTube partners

16. 16 New trendsin television: socialandsemantic
Bridging Web and TV cultures

17. 17 New trendsin television: socialandsemantic
Rest ofthisslideset
•Technological background (Semantic Web,
Linked Data)
•Semantic annotations for TV data (semantic
TV)
•Extracting knowledge from my activities and
social graph (social TV)
•TV content recommendation (personalized TV)
•The further future: finally … interactive TV

18. 18 New trendsin television: socialandsemantic
“If computers can understand the
meaningbehind the information
they can
learn what we are interestedin
and
better help us findwhat we want.”*
* Source: http://www.slideshare.net/HatemMahmoud/web-30-the-semantic-web
(1) Semantic Web, Linked Data

19. 19 New trendsin television: socialandsemantic
The Semantic Web
The vision of what was termed the “Semantic Web“ first came to public
attention through an article in Scientific American in May 2001.
* Source: T. Berners-Lee, J. Hendler, O. Lassila; “The SemanticWeb”, Scientific American, 284(5):34–43, May 2001.
“The Semantic Web is not a separate
Web but an extension of the currentone,
in which information is given well-defined
meaning, better enabling computers and
people to work in cooperation.”*

20. 20 New trendsin television: socialandsemantic
HTML
HTML was too limited for Web documents –it is purely a presentation
format. The tags in HTML have no meaningoutside how content should be
rendered in the browser, and so the meaning of the content must be
interpreted by a human, hence excluding any possibility of machine
processing.
<u>James Bond</u>
<b>MI5</b><br>
Her Majesty's Secret
Service<br>
Secret HQ<br>
<i>007 England</i><br>
James BondMI5
Her Majesty's
Secret
Service
Secret HQ
007 England

21. 21 New trendsin television: socialandsemantic
XML
<name>James Bond</name>
<company>
<shortname>MI5</shortname>
<fullname>Her Majesty's Secret
Service</fullname>
<address><street>Secret HQ</street>
<postcode>007</postcode>
<country>England</country>
</address>
</company>
The core idea of XML –Extensible Markup Language –is to provide for
definitions of markupwhich allows self-describing tags, i.e. tags which
describe the meaning of the content they mark up rather than its
presentation
James BondMI5
Her Majesty's
Secret
Service
Secret HQ
007 England

22. 22 New trendsin television: socialandsemantic
RDF
RDF provides a graph structurefor making statements about things.
Individual things, and not just files, are given an URI identifier.
ThisiswheretheSemanticWeb begins.
fromis a child elementof flight
(syntactic structure)
http://my.org/flightAI288
:from http://my.org/Vienna
:to http://my.org/Innsbruck
:dep 01-01-2009T12:00
:arr 01-01-2009T12:55
:price „88“
:currency http://my.org/euro
<flight>Flight AI288
<from>Vienna</from>-
<to>Innsbruck</to>
dep <dep>1.1. 1200</dep>
arr <arr>1.1. 1255</arr>
price <price>88€</price>
</flight>
fromis a propertyof the resource
http://my.org/flightAI288

23. 23 New trendsin television: socialandsemantic
RDFS
RDF Schema begins to formalise the meaningof things spoken about in
RDF on the basis of computational logic. RDFS permits simple ontologies
(models about concepts and their properties) to be defined, which can be
used to conclude new knowledge.
http://my.org/Vienna
is a http://my.org/City
http://my.org/City
subClass of http://my.org/PopulatedPlace
http://my.org/Vienna
is a http://my.org/PopulatedPlace
http://my.org/flightAI288
:from http://my.org/Vienna
:to http://my.org/Innsbruck
:dep 01-01-2009T12:00
:arr 01-01-2009T12:55
:price „88“
:currency http://my.org/euro

24. 24 New trendsin television: socialandsemantic
OWL
OWL broadens the possible expressivity of the ontology. This makes
richer models of knowledge about things possible, but at the cost of those
models being more complex for a computer to process.
http://my.org/Vienna
isPlaceIn http://my.org/Austria
http://my.org/Austria
isPlaceIn http://my.org/Europe
isPlaceIn is a transitive property
http://my.org/Vienna
isPlaceIn http://my.org/Europe
http://my.org/flightAI288
:from http://my.org/Vienna
:to http://my.org/Innsbruck
:dep 01-01-2009T12:00
:arr 01-01-2009T12:55
:price „88“
:currency http://my.org/euro

25. 25 New trendsin television: socialandsemantic
SPARQL
The final block of the Semantic Web that we will cover in this introduction is
SPARQL, the query languagefor semantic data using the RDF data model
(which includes OWL).
http://my.org/flightAI288
:from http://my.org/Vienna
:to http://my.org/Innsbruck
:dep 01-01-2009T12:00
:arr 01-01-2009T12:55
:price „88“
:currency http://my.org/euro
Is there a flight from Vienna to
somewhere in Austria for a price
under 100 euros?
SELECT ?flight
WHERE
?flight :from http://my.org/Vienna
?flight :to ?place
?place :isPlaceIn
http://my.org/Austria
?flight :price ?price
?flight :currency http://my.org/euro
FILTER
(?price < 100)‏

26. 26 New trendsin television: socialandsemantic
Semantic Web principles
•Every concept can be identified with URIs
•Resources and relationships are typed semantically
•Partial informationis acceptable
•Absolute truth is not necessary
•Evolutionas a development principle

27. 27 New trendsin television: socialandsemantic
Linked Data principles
•Use URIs as names of things
•Use HTTP URIs so that people can look up those names
•When someone looks up an URI, provide useful information
•Include links to other URIs, so that they can discover more things

28. 28 New trendsin television: socialandsemantic
Semantic Web vs Linked Data
“In contrast to the full-fledged Semantic Web vision, linked
data is mainly about publishing structured data in RDF using
URIs rather than focusing on the ontological level or
inference. This simplification -just as the Web simplified the
established academic approaches of Hypertext systems -
lowers the entry barrier for data providers, hence fosters a
widespread adoption.”
vs
-Reference

29. 29 New trendsin television: socialandsemantic
Linked Data cloud

30. 30 New trendsin television: socialandsemantic
Linked Data for music & TV

31. 31 New trendsin television: socialandsemantic
DBPedia: Wikipedia as Linked Data

32. 32 New trendsin television: socialandsemantic
DBPedia Mobile
Pictures from revyu.com
Try yourself:
http://wiki.dbpedia.org/
DBpediaMobile

33. 33 New trendsin television: socialandsemantic
Resources and representations
http://dbpedia.org/resource/Berlin
.../page/Berlin .../data/Berlin
non-information resource
HTML representation RDF representation

34. 34 New trendsin television: socialandsemantic
Linking things, not documents
http://dbpedia.org/resource/ABBA
http://www.bbc.co.uk/music/artists/d87e52c5-
bb8d-4da8-b941-9f4928627dc8#artist
sameAs

35. 35 New trendsin television: socialandsemantic
Browsing things, not documents
http://dbpedia.org/resource/ABBA
http://dbpedia.org/resource/Knowing_Me%2C_
Knowing_You..._with_Alan_Partridge
themeMusicComposer

36. 36 New trendsin television: socialandsemantic
Asking for things, not documents
Which music
artists have
composed the
theme music
for a BBC
comedy
program?

37. 37 New trendsin television: socialandsemantic
(2) Semantic annotation for TV
•What can we annotate in TV?
–The program schedule
–The TV program
–TV program segments
•How can we annotate TV?
–Feature description (low level, analysis based)
–Metadata (date, creator, legal notice)
–Content description (title, summary, genre,
concepts)

38. 38 New trendsin television: socialandsemantic
Why have metadata?
Archives from where
content has to be
found and retrieved
have been the place
where the need for
accurate
documentation first
arose.

39. 39 New trendsin television: socialandsemantic
Broadcast metadata
•Data about data
–All digital resources (A/V, scripts, contracts, reports, pictures, etc.) are
data
–Metadata is created at all stages in broadcasting from commissioning
to playout
•Three main categories
–Administrative metadata
•Replacing project and asset management paperwork
–Technical metadata
•Format, processing, identification, location, database, network
–Descriptive metadata
•All asset related information, human readable

40. 40 New trendsin television: socialandsemantic
Need for common standards
Exchange of
information
hampered by lots
of proprietary
interfaces
TV Content
Creator2
TV Content
Creator3
TV Archive
1
TV Archive
2
n+1
NoTube
Broadcaster
1
Broadcaster
2
Broadcaster
3
TV Content
Creator1

41. 41 New trendsin television: socialandsemantic
EPGs
Screenshot http://www.ifanzy.nl

42. 42 New trendsin television: socialandsemantic
EPG data
•An EPG is composed of two parts: content descriptions and
broadcast description
•Content descriptions contain static data about television
programmes such as a brand name (e.g. EastEnders),
description or plot summary, type of programme, (e.g. series,
movie, news), genre(s) (e.g. drama) actors, directors,
recording data, etc.
•Broadcast description is expressed by variable data, such as
channel (e.g. BBC ONE), format (e.g. 16:9) and broadcast
media (e.g. digital television)

43. 43 New trendsin television: socialandsemantic
TVAnytime (1/2)
•Unique document structure
–Program description
–Program location
–Program segmentation
–User description & personalisation
–System aspects
–Content rights

44. 44 New trendsin television: socialandsemantic
TVAnytime (2/2)
•Advantages of TV-Anytime
–It is network and middleware independent
–Supports related material, segmentation, locators, group
information etc.
•Applications of TV-Anytime
–ARIB
–DVB (MHP, DVB GBS, DVB IPI, DVB CBMS)
–Asian User Groups, Korea
–US’ Consumer Electronic Association
–HbbTV

45. 45 New trendsin television: socialandsemantic
TVAnytime schema

46. 46 New trendsin television: socialandsemantic
Other models in use
•egtaMETA-a unique metadata exchange schema dedicated
for the exchange of ads between ads agencies and
broadcasters. NoTube was an early tester of the schema in its
personalised advertisements use case.
•BMF–an abstract semantic model designed for metadata
exchange in the professional media production domain. ARD
in Germany is starting to use BMF.
•Presto Space –format generated by the project of the same
name to provide for digital preservation of audiovisual
collections. Used by NoTube partner RAI.

47. 47 New trendsin television: socialandsemantic
Metadata interoperability via
NoTube
http://notube.tv/tv-metadata-interoperability/for more information

48. 48 New trendsin television: socialandsemantic
BBC /programmes
The BBC have made their EPG data machine-
readable and published it on the Web

49. 49 New trendsin television: socialandsemantic
BBC /programmes: add .rdf
http://www.bbc.co.uk/program
mes/b00rl5y1
http://www.bbc.co.uk/program
mes/b00rl5y1.rdf

50. 50 New trendsin television: socialandsemantic
BBC /programmes ontology
From http://purl.org/ontology/po/
This may the first TV content
ontology, but certainly not the
last!
Key organisations in the TV
standards domain are exploring
the publication of metadata in
RDF or SKOS:
•EBU (Core)
•TV-Anytime
•IPTC (NewsML)
The final step must be a
common shared ontology
integrating the different
schemas (cf.W3C Media
Ontology and API)

51. 51 New trendsin television: socialandsemantic
Channel identifiers
•Collected resolvable channel identifiers
together with relevant metadata in RDF, e.g.
1700+ channel identifiers of Freebase
http://www.cs.vu.nl/~ronny/notube/tv-channels.rdf

52. 52 New trendsin television: socialandsemantic
Genre taxonomies
•BBC, TV Anytime, YouTube, IMDB, tvgids.nl …
•Convert them into RDF concepts and define SKOS
relations between them, e.g. EBU has done this for
the TV Anytime Classification scheme

53. 53 New trendsin television: socialandsemantic
Concept extraction
•NLP tools identify named entities in text and attach
an unique identifier to them
e.g. OpenCalais, Zemanta
•Focus on key classes of entity such as person, place
or organisation
•Use of Linked Data for common concept identifiers
•Ontotext developed specifically for TV metadata the
tool LUPedia

54. 54 New trendsin television: socialandsemantic
LUPedia
(http://lupedia.ontotext.com)

55. 55 New trendsin television: socialandsemantic
Concept extraction for TV

56. 56 New trendsin television: socialandsemantic
Linking TV content to Web content
starring
David Dickinson
Tim Wonnacott
birthplace
Barnstaple

57. 57 New trendsin television: socialandsemantic
Pause

58. 58 New trendsin television: socialandsemantic
(3) Extracting knowledge about the
user
Idea: generating user profiles from data the user
creates on the Social Web, and in this way
facilitating a personalised TV experience
without an intrusive user profiling process.

59. 59 New trendsin television: socialandsemantic
Facebook, Twitter & co.

60. 60 New trendsin television: socialandsemantic
Activity Streams
•RSS/Atom feeds include a title, description,
link and some other metadata;
•Activity Streams extend this with a verband
an object type
–to allow expression of intent and meaning
–to provide a means to syndicate user activities
•Supported by Facebook, MySpace, Windows
Live, Google Buzz and…

61. 61 New trendsin television: socialandsemantic

62. 62 New trendsin television: socialandsemantic
Getting TV into the Social Network
„BBC iPlayer adds
Twitter and
Facebook to
socialise TV”
–Share what you are
watching on iPlayer
–Sync viewing with
friends
–Real time chat
Techcrunch Europe, May 26 2010

63. 63 New trendsin television: socialandsemantic
TV viewer actions
•Recorded
•Consumed
•Loved
•Bookmarked
•…

64. 64 New trendsin television: socialandsemantic
Twitter activity

65. 65 New trendsin television: socialandsemantic
Bringing it all together

66. 66 New trendsin television: socialandsemantic
Eurovision example
•Analyse tweets with the #eurovision tag over
a set time period (during the program)
•Extract countryand positive/negative remark

67. 67 New trendsin television: socialandsemantic
Getting the user‘s interests

68. 68 New trendsin television: socialandsemantic
Beancounter architecture

69. 69 New trendsin television: socialandsemantic
FOAF
•RDF based format
–Defines properties for describing a person and
their relations to other people and objects
http://xmlns.com/foaf/spec/

70. 70 New trendsin television: socialandsemantic
Weighted Interests
•Add weightingto the foaf:interest property
See http://xmlns.notu.be/wi/

71. 71 New trendsin television: socialandsemantic
FOAF as common vocabulary

72. 72 New trendsin television: socialandsemantic
Beancounterweb UI

73. 73 New trendsin television: socialandsemantic
Collecting user streams

74. 74 New trendsin television: socialandsemantic
Viewer profile (1/2)

75. 75 New trendsin television: socialandsemantic
Viewer profile (2/2)

76. 76 New trendsin television: socialandsemantic
(4) TV content recommendation
•Recommenderstrategy
–Collaborative recommendation
•Youshareinterestswithyourfriends
•Statistical analysis: whatcontentisliked/watched
quantitivelymorebyotherswithsimilarinterests/history
–Content-basedrecommendation
•An interestin X meansa potential interestin Y
•Pattern-basedanalysis: whatcontenthasrelatedconcepts
tothecontentliked/watchedbyyou
–Hybrid recommendation
•Best ofboth!

77. 77 New trendsin television: socialandsemantic
NoTuberecommendation
approach

78. 78 New trendsin television: socialandsemantic
Recommendation lifecycle
Graphic by Libby Miller, BBC

79. 79 New trendsin television: socialandsemantic
LinkedData recommendations
•The content-basedapproach:
–Identifyweightedsets(patterns) ofDBPedia
resourcesfromuseractivityobjects
–ComputedistancebetweenDBPediaconceptsin
theuserprofileandin theprogramschedule
throughitsSKOS-basedcategorisationscheme
–Choosethematchesabovea certainthresholdfor
TV programmerecommendation

80. 80 New trendsin television: socialandsemantic
User interests(DBPediaconcepts)

81. 81 New trendsin television: socialandsemantic
Match user interest and TV
subjects

82. 82 New trendsin television: socialandsemantic
N-Screen http://n-screen.notu.be

83. 83 New trendsin television: socialandsemantic
Getrecommendations

84. 84 New trendsin television: socialandsemantic
TV recommendation calculation

85. 85 New trendsin television: socialandsemantic
So, isthisthefutureoftelevision?
More: http://notube.tv/showcases/personalised-news/

86. 86 New trendsin television: socialandsemantic
Orthis?
More: http://notube.tv/showcases/tv-guide-and-adaptive-ads/

87. 87 New trendsin television: socialandsemantic
Orthis?
More: http://notube.tv/showcases/tv-and-the-social-web/

88. 88 New trendsin television: socialandsemantic
And in the farther future?

89. 89 New trendsin television: socialandsemantic
Interestedin theprojectresults?
Find out moreonline atwww.notube.tv
All contents© NoTubeproject2009-2012
Nore-useofanyslidesorcontentofslides
withoutexplicit acknowledgementof:
NoTubeproject, www.notube.tv&
thisslideset, www.notube.tv/slides