1 2 2 3 4 2 Web A Multi-story e-picture Book with the Degree-of-interest Extraction Function Kunimichi Shibata, 1 Masakuni Moriyama, 2 Kazuhide Yukawa, 2 Koji Ueno, 3 Kazuo Takahashi 4 and Shigeo Kaneda 2 This paper proposes a new digital book Picture Book Drill which consists of a digital picture book as a main story, and digital drills as sub-stories. The main story and the sub-stories are connected by means of Characters which appears on the main-story. Also, the proposed Picture Book Drill has a web camera and the reader s line of sight is detected and fed back to the speaker in real time by using the video signal processing. The evaluation of the proposed system shows that the real-time feed-back is effective for the speaker. Also, the chracters in the main story are potently payed attention by the children who cannot understand the story. This observed results give some suggestions to the contemporary picture books, illustrated by using well-known characters and the commonly-used behavior of the characters. 1. PC PC 1) 2) 1) Web 1) 2) Web 1 Doshisha University 2 Graduate School of Enginerring, Doshisha University 3 Project Subjects, Doshisha University 4 Early Childhood Education, Tokiwakai College 1 c 2012 Information Processing Society of Japan
A 2 3 4 5 6 2. / / 3)4) Z-KAI Z-KAI 6) 1 7) 2 1 Z-KAI Web 6) 1 2) 8) 3. 3.1 ( 1 1 2 2 c 2012 Information Processing Society of Japan
3 5 6 OpenNI 1 WEB Kinect Logicool Inc., HD Pro Webcam C910 8fps, 640 480pixel MicroSoft 8fps, 640 480pixel I-O DATA DEVICE, INC., LCD-AD221FB-T 1920 1080pixel 272mm, 481mm I-O DATA DEVICE, INC., LCD-AD198GEW 1280 1080pixel 305mm, 376mm 2 4 3.2 1 2 2 / 1) Web 3 3 4 1 5) 2 3 9) Web Web 3 c 2012 Information Processing Society of Japan
7 4. 4.1 5 WEB Kinect 10) 1 1 WEB Kinect 7 1) WEB Kinect 2) 3) 1 Kinect WEB Kinect USB PC 1) 2) 2 4.2 3 Step1 Step2 Step3 WEB Kinect WEB Kinect Kinect Step2 4.2.1 Kinect 10) 11) PC SDK(Software Development Kit) SDK OpenKinect OpenNI [8] Kinect for Windows SDK 3 OpenNI 26 6 12 1) 6 2 4.2.2 OKAO Vision 13) OKAO Vision 20pixel ( 9) 4 c 2012 Information Processing Society of Japan
9 10 8 2 6 X X Y X Y X-Y-Z X-Y-Z X-Y-Z X-Y-Z X-Y Z Z X Y Z. ( 10) 2 ( 11) 3 STEP1 WEB OKAO Vision ( 11 12 Kinect Kinect ) STEP 2 STEP 3 Kinect Kinect θ 1(rad) Kinect 43 ( 13) 1 Kinect 480pixel (y=240) ( 12) (pixel) Kinect 1 (0,0) 5 c 2012 Information Processing Society of Japan
STEP4 STEP5 43 1 480 43(pixel) Kinect Kinect Kinect y (pixel) K.y θ 1 (rad) θ 1 = K.y 240 43 480 π/180 (1) WEB θ 2 [rad] WEB 44 (13) WEB y (pixel) W.y θ 2 = W.y 240 44 480 π/180 (2) WEB θ 3[rad] Kinect 60 ( 14) WEB x (pixel) W.x θ 3 = W.x 320 60 640 π/180 (3) Kinect D[mm] ( 13) Kinect (rad) γ Kinect (mm) k WEB Kinect (mm) a D = k cos(γ + θ 1 ) a (4) X, Y (rad) α (rad) β 0.25 pixel X = D (tan(β + θ 3 ) tan(θ 3 ))/0.25 + 960 (5) Y = D (tan(θ 2 + tan(α θ 2))/0.25 (6) OAKO Vision OKAO Vision 100 0 4.3 GUI 13 14 15 GUI 8fps GUI 15 6 OKAO Vision ±5 6 2 2 6 c 2012 Information Processing Society of Japan
3 A (2011 12 27 ) 5 5 5 1 (1) 1 (2) (1) (2) : 5 : 1 5 4 1 1 2 3 4 5 5. A 1 5 1 2 3 5.1 ( 1 ) ( 2 ) ( 3 ) ( 4 ) (1) (3) 4 5 5 1 6 6 () page 1 page 2 B page 3 (0.9) page 4 page 5 page 1 page 2 D page 3 (0.5) page 4 page 5 page 1 page 2 E page 3 (-0.4) page 4 page 5 B,D E A D 7 5.2 7 c 2012 Information Processing Society of Japan
7 8 x [mm] y [mm] z [mm] 5.4 18.0 8.3 60.3 2.6 18.6 15.6 66.6 1) 1 8 8 Kinect Kinect x y z 8 1 6. WEB Kinect 1 5 A OKAO Vision 1) et. al, 1 CDS) Vol.1, No.1, pp.12-21 2011 12 2). http://www.e-hon.jp/ 3), 11, 1998 4), 1999 5) 2011 1H2-OS1-8 2011 6 6) Z http://www.zkai.co.jp/pre/summary/point4.html 7) http://www.shimajiro.co.jp/ 8), :, 1987 9) QG-PLUS http://www.ditect.co.jp/ 10) Microsoft. Kinect - Xbox.com. http://www.xbox.com/ja-jp/kinec 11), KINECT :, 2011 12) OpenNI. http://75.98.78.94/default.aspx 13), OKAO Vision, 2004. 14) et. al, SIG-IS, 2011 3 8 c 2012 Information Processing Society of Japan