yama_interact2007.dvi

Transcription

1 Vol. 48 No. 12 Dec Synvie A Video Annotation System Based on Community Activities Daisuke Yamamoto, Tomoki Masuda, Shigeki Ohira and Katashi Nagao In this paper, we propose a mechanism which acquires semantics of video contents as annotations from related Web communities. In particular, we have implemented a Web-based tool which user can easily create a Weblog entry quoting video scenes. This tool can acquire relationships which associate multiple video scenes with a document structure of a Weblog entry from editing histories. We have developed an online video quotation system Synvie. Moreover, we have analyzed real annotation data which were accumulated using the public beta service which we are providing, and confirmed the usefulness of our system. As an example of applications based on these annotations, we present a video scene retrieval system. 1. Web SNS Wiki Web Graduate School of Information Science, Nagoya University EcoTopia Science Institute, Nagoya University Center for Information Media Studies, Nagoya University 8) 13) 4),12) 3624

2 Vol. 48 No Web 9) Synvie 19),20) Synvie 2. YouTube Google Video MPEG-7 7) MPEG-7 Web MPEG-7 ivas 18) SceneNavi 14) Web Web Dowman 5) CNN Web Google Image Labeler Synvie 3.

3 3626 Dec HTML 3.1 Permalink 1) Trackback 3) XML Feed 2),6) RSS Parker 11) Web 3.3 Permalink 1 Fig. 1 Definition of video scene and video shot. Permalink 16) Element Pointer Element Pointer URI URI Permalink ID URI ID] Permalink ID Permalink urn:aps:timeline(begin,end), urn:aps:timeline(begin,end),...) Permalink

4 Vol. 48 No Fig. 3 Scene region commentary annotation. 2 Fig. 2 Scene commentary annotation. ivas 18) Web Fig. 4 Scene button annotation. 4.3 ivas 18) nice boo 4 4.4

5 3628 Dec YouTube 5. URL Synvie Fig. 5 Continuous scene quotation interface. 5.2 Web ( 5) ( 6)

6 Vol. 48 No Fig. 6 Discrete scene quotation interface. HTML ) ) PageRank 10) PageRank

7 3630 Dec CG Web / / Web 1 Hyperlink 7 Fig. 7 Video scene annotation model. A Weblog B 8 Fig. 8 Annotation model based on quotation of video scenes. 7. Synvie , ,768 YouTube ivas 7.1

8 Vol. 48 No Table 1 Result of open experiment Table 2 Effective tag rate and accuracy in each type. ( ) ( ) % % % % % % 2 60% Synvie 21) 7.2 A B C D A B C X Y A X 100

9 3632 Dec % X 70% Y 60% 50% 40% 30% 20% 10% 0% A B C D A B C D A B C D A B C D A B C D 9 Fig. 9 Quality of annotation in each method. A Y Web B X B Y C X URL CG, C Y D 9 A X A >B>C>D X Y C MPEG-7 9 X 11% 59% D 36% 4.8%

10 Vol. 48 No % 80% 70% X Y 60% 50% 40% 30% 20% 10% 0% A B C D A B C D A B C D A B C D 10 Fig. 10 Quality of annotation in each user. 11 X 30% Fig. 11 Quality of annotation in each method and user X 30% 11 80% A X 45% 30% 22% Fig. 12 Relation between annotations and contents YouTube ivas

11 3634 Dec % 60% 50% 40% 30% 20% 10% X Y 0% A B C D A B C D A B C D A B C D 13 Fig. 13 Quality of annotation in each content. / Fig. 14 Video scene retrieval system. 14

12 Vol.48 No ) (IPA ) Aimeur,E.,Brassard,G.andPaquet,S.:Using Personal Knowledge Publishing to Facilitate Sharing Across Communities, Proceedings of the Twelfth International World Wide Web Conference (WWW2003) (2003). 2) Beged-Dov, G., Brickley, D., Dornfest, R., Davis, I., Dodds, L., Eisenzopf, J., Galbraith, D., Guha, R., MacLeod, K., Miller, E., Swartz, A. and van der Vlist, E.: RDF Site Summary (RSS) 1.0, RSS-DEV Working Group, rss/1.0/spec (2001). 3) Benjamin and Trott, M.: mttrackback - Track- Back Technical Specification, movabletype.org, mttrackback.html (2002). 4) Davis, M.: An Iconic Visual Language for Video Annotation., Proceedings of the IEEE Symposium on Visual Language, pp (1993). 5) Dowman, M., Tablan, V., Cunningham, H. and Popov, B.: Web-Assisted Annotation, Semantic Indexing and Search of Television and Radio News, Proceedings of the The 14th International World Wide Web Conference 2005 (WWW 2005), pp (2005). 6) Hoffman, P. and Bray, T.: Atom Publishing Format and Protocol (atompub), ietf.org/html.charters/atompub-charter. html (2005). 7) ISO: Information Technology - Multimedia Content Description Interface(MPEG-7), ISO/IEC 15938:2001, International Organization for Standardization(ISO) (2001). 8) Nagao, K., Ohira, S. and Yoneoka, M.: Annotation-Based Multimedia Summarization and Translation, Proceedings of the Nineteenth International Conference on Computational Linguistics (COLING-02), pp (2002). 9) Nagao, K., Shirai, Y. and Squire, K.: Semantic Annotation and Transcoding: Making Web Content More Accessible, IEEE MultiMedia, Vol.8, No.2, pp (2001). 10) Page, L., Brin, S., Motwani, R. and Winograd, T.: The PageRank Citation Ranking: Bringing Order to the Web (1998). 11) Parker, C. and Pfeiffer, S.: Video Blogging: Content to the Max, IEEE Multimedia, Vol.12,

13 3636 Dec No.2, pp.4 8 (2005). 12) Smith, J.R. and Lugeon, B.: A Visual Annotation Tool for Multimedia Content Description, Proceedings of the SPIE Photonics East, Internet Multimedia Management Systems, pp (2000). 13) Wactlar, H.D., Kanade, T., Smith, M.A. and Stevens, S. M.: Intelligent Access to Digital Video: Informedia Project, IEEE Computer, Vol.29, No.5, pp (1996). 14) Vol GN-43, pp (2001). 15) Vol.41, No.1, pp (2000). 16) Vol.48, No.1, pp (2007). 17) (2003). 18) Vol.20, No.1, pp (2005). 19) Synvie: 2007 pp (2007). 20) Synvie: 58 pp (2006). 21) 21 (2007). ( ) ( ) 2003, IPA 2006 CS. Web. 2007, , , , , , , 2002.