VOL. J98-A NO. 1 JANUARY 2015 本 PDFの 扱 いは 電 子 情 報 通 信 学 会 著 作 権 規 定 に 従 うこと なお 本 PDFは 研 究 教 育 目 的 ( 非 営 利 )に 限 り 著 者 が 第 三 者 に 直 接 配 布 すること ができる 著 者 以 外 からの 配 布 は 禁 じられている
ICT a) Caption Presentation Method with Speech Expression Utilizing Speech Bubble Shapes for Video Content Yuko KONYA a) and Itiro SIIO 1. Graduate School of Humanities and Science, Ochanomizu University, 2 1 1 Ootsuka, Bunkyo-ku, Tokyo, 112 8610 Japan a) E-mail: yuko.konya@is.ocha.ac.jp [1] 2. 3. 4. 5. 6. 2. [1] A Vol. J98 A No. 1 pp. 85 92 c 2015 85
2015/1 Vol. J98 A No. 1 2. 1 2. 2 [2] 1 Fig. 1 Illustrative example of our proposal caption presentation. 1 2. 3 2 2 1 20 50 8 2 3 3 4 3 3 2 86
2 Fig. 2 Speech bubble shape type; (left) circle type, (right) square type. 4 Fig. 4 An example of the movement of the balloon. Speaker in accordance to move to the upper left from the right side, the camera is moving to the left. To follow also balloon so as to follow the speaker. 3 Fig. 3 Speech bubble shape type; (left) spike type, (right) cloud type. 1 3 3 3. 3. 1 3 64px 48px 32px 32 32px 8px 40 50 3 3 3. 2 jquery Easing Plugin [3] 4 5 87
2015/1 Vol. J98 A No. 1 Table 1 1 Evaluation video variation. 5 Fig. 5 Example of upside speech bubble tail (marked by black circle on left upside of the screenshot). 3. 3 HTML5 [4] HTML5 HTML Chrome JavaScript SVG [5] HTML HTTP JavaScript 1920px*1080px CSS 4. 4. 1 20 50 4 3 HDMI 32 1 2 3 4 5 4 1 4 45 1 4 1 4 1 2 3 5 4 5 5 4. 2 2 1 3 3 4 5 6 88
2 Table 2 1 3 (n=7) Result of questionnaire Q1 Q3 (n=7). 3 4 5 (n=7) Table 3 Result of questionnaire Q4 5 (n=7). 4. 3 4. 3. 1 [6] 6 1 6 89
2015/1 Vol. J98 A No. 1 6 Fig. 6 Sample of speech bubble that has separated tail (left), and a speech bubble used in this system (right). 4. 3. 2 7 BGM 7 Fig. 7 The revised proposal about a motion of a speech bubble. Only the bubble tail moves following a speaker as a speaker moves from left side to the right. 4. 3. 3 4 45 116 3 7 A B 2.5 13 6 A B 4 4. 3. 4 HTML 90
4 (n=6) Table 4 Result of questionnaire (n=6). 5. Fels [7] Ohene-Djan [8] [1], [9] [10] Fels [11] [12] [13], [14] [15], [16] 6. [1] vol.14, no.4, pp.9 16, Nov. 2012. [2] vol.20, pp.53 75, March 2011. 91
2015/1 Vol. J98 A No. 1 [3] jquery Easing Plugin (version 1.3), http://gsgd.co. uk/sandbox/jquery/easing/ 2014 3 26 [4] W3C HTML5, http://www.w3.org/tr/2014/ CR-html5-20140204/ 2014 3 26 [5] W3C SCALABLE VECTOR GRAPHICS (SVG), http://www.w3.org/graphics/svg/ 2014 3 26 [6] http://shincomi. webshogakukan.com/school/2006/09/1 4.html 2014 8 6 [7] D.I. Fels, D.G. Lee, C. Branje, and M. Hornburg, Emotive captioning and access to television, Proceedings of the Eleventh Americas Conference on Information Systems, pp.2330 2337, Omaha, NE, USA, Aug. 2005. [8] J. Ohene-Djan, J. Wright, and K. Combie-Smith, Emotional subtitles: A system and potential applications for deaf and hearing impaired people, Conference and Workshop on Assistive Technologies for Vision and Hearing Impairment: (CVHI), Aug. 2007. [9] paralinguistic vol.2013-ec-29 (4), pp.1 6, Aug. 2013. [10] ( ) SLP-75, no.14, pp.75 82, Feb. 2009. [11] D vol.j96-d, no.1, pp.61 69, Jan. 2013. [12] vol.8, pp.1 8, March 2008. [13] H. Nambo, S. Seto, H. Arai, K. Sugimori, Y. Shimomura, and H. Kawabe, Visualization of nonverbal expressions in voice for hearing impaired, Computers Helping People with Special Needs, Lecture Notes in Computer Science, vol.7382, pp.492 499, 2012. [14] pp.31 33, 2013. [15] B.-K. Chun, D.-S. Ryu, W.-I. Hwang, and H.-G. Cho, An automated procedure for word balloon placement in cinema comics, Advances in Visual Computing, Lecture Notes in Computer Science, vol.4292, pp.576 585, 2006. [16] imap vol.42, no.3, pp.671 680, Sept. 2013. 26 4 7 8 17 1999 3 4 2004 NTT 2006 8 IPTV 2010 4 1979 3 1984 3 4 1997 4 2002 4 2001 4 2002 3 2005 4 ACM 92