JAIST Reposi https://dspace.j Title 直感的身体動作を用いた VR アプリケーションに関する 研究 Author(s) 薮, 博史 Citation Issue Date 2006-03 Type Thesis or Dissertation Text version author URL http://hdl.handle.net/10119/266 Rights Description Supervisor: 宮田一乘, 知識科学研究科, 修士 Japan Advanced Institute of Science and
VR 450074 2006 2 Copyright 2006 by Hiroshi Yabu
1 1 2 VR - 4 2.1 4 2.2 Ver.1 4 2.2.1 5 2.2.2 5 2.3 Ver.1 6 2.3.1 Ver.1 6 2.3.2 7 2.3.3 8 2.3.4 9 2.3.5 10 2.3.6 12 2.3.7 13 2.3.8 14 2.4 Ver.1 15 2.5 Ver.1 16 2.6 Ver.2 17 2.6.1 Ver.1 17 2.6.2 Ver.2 18 2.7 Ver.2 18 2.7.1 Ver.2 18 2.7.2 19 i
2.7.3 20 2.7.4 21 2.7.5 22 2.7.6 22 2.8 Ver.2 23 2.9 Ver.2 25 2.10 26 3-28 3.1 28 3.2 28 3.3 30 3.4 31 3.4.1 31 3.4.2 32 3.4.3 34 3.4.4 36 3.4.5 40 3.4.6 42 3.4.7 44 3.5 44 3.6 45 447 49 50 51 ii
1 Ver.1 6 2 7, 8 3 8 4 9 5 10 6 11 7 11 8 13 9 Ver.1 14 10 Ver.1 15 11 Ver.2 19 12 Ver.2 20 13 WGC 21 14 22, 23 15 Ver.2 23 16 Ver.2 24 17 SIGGRAPH 25 18 31 19 32 20 33 21 35, 36 22 37 23 38 24 139 iii
25 240 26 40 27 41 28 143 29 2 43 30 343 31 44 32 45 33 45 iv
1 Ver.1 16 2 Ver.1 16 3 Ver.2 24 4 Ver.2 24, 25 v
1 2 IT 1970 1980 CUICharacter User Interfacecopy format CUI GUIGraphical User Interface GUI GUI CUI GUI GUI IT IT 1
PUIPerceptual User InterfacePUI PUI [25] [26] [27]CUI GUI PUI GUI [28] Dance Dance Revolution[2][3] PUI 2
VR VR PUI 3
2 VR - VR 2.1 1 Ver.1 [8] Ver.1 VR Ver.2[??] 2.2 Ver.1 VR 4
2.2.1 1 1 2.2.2 [1] Dance Dance Revolution[2] [3] Jam-O-Dru[45] 5
2.3 Ver.1 Ver.1 2.3.1 Ver.1 1 2 A/D 2 2 A/D 1 Ver.1 6
P1 P2 P3 P4 P5 2.3.2 2 125mm 92mm 15mm 250mm 90mm 2 SHARP GP2D120 4 530cm A/D PCI-313312 16 [9] a 4 7
b c 2 2.3.3 3 8
3 5V A/D 12bit 3 4 L w L H 4 H A H B H C H D 4 ABD BCD 3 t Vn Vn t An 2.3.4 2.3.3 Vn An 9
5 5 D B P 1 t P 1 P 2 = P 1 + Vn t 1 An 2.3.5 2 2 56 10 2 10
6 6 3 3 PQ (a) 1 7 (b) 2 11
77 7a 7b2 ab 900 2.3.6 8 2 2.3.5 8 X Y XY θ X 2 Y θ X X' V 1 V 2 V 1 V 2 2m 1 m 2 2e e ( V1 ' x V2 ' x) = ( V1" x V2" x) 3X Y 12
13 V 1 x V 2 x 45 x V m x V m x V m x V m ' ' " " 2 2 1 1 2 2 1 1 + = + 3 2 1 2 1 2 1 1 ' ) (1 ' ) ( " m m x V e x V e m m x V + + + = 4 2 1 2 1 2 1 2 ' ) ( ' ) (1 " m m x V e m m x V e x V + + + = 5 8 XY 2.3.7 3 J1
J2 0 J3 30 J1 J3 2.3.8 9 DirectX Graphics CG 1 2 2 9 Ver.1 14
2.4 Ver.1 4m 2m 10 PC DELL DimensionXPSPentium4 3GHz1G GeFORCE 6800 Ultra256MB 2 30fps 10 Ver.1 2004 8 31 IVRC 1 15
82 2 1 Ver.1 Ver.1 31.7 54.9 13.4 78.0 20.7 1.2 20.0 53.8 26.3 36.6 34.1 29.3 45.1 30.5 24.4 28.0 62.2 9.8 2 Ver.1 2.5 Ver.1 Ver.1 16
Ver.2 2.6 Ver.2 Ver.1 VR 2.6.1 Ver.2 Ver.1 CG Ver.1 Ver.1 Ver.1 Ver.2 17
VR 2.6.2 Ver.2 Ver.2 Ver.1 Ver.1 Ver.2 2.7 Ver.2 Ver.2 2.7.1 Ver.2 1 4 1 2 WGC 3 2 3 4 6 WGC 4A/D (3) PC 18
11 Ver.2 P1 6 WGC 4 P2WGC P3P2 P4 P5 2.7.2 12 1060mm 640mm 160mm 10 50mm 185mm 190mm 100mm WGC 6 600mm 600mm 5mm 11(3) 4 WGC 19
WGC 12 Ver.2 2.3.2 WGC 2.3.3 WGC 2.3.3 2.7.3 2 (1) WGC WGC 3 WGC WGC WGC W 1 W 2 V 1 V 2 20
13 2 W 1 W 2 V 1 V 2 13 W 1 W 2 W 1 W 2 C 1 C 2 P P 2 6 P = P + V P C ) + V ( P ) 6 2 1 1 ( 1 1 2 1 C2 (2) 2 (1) 2.3.4 13 WGC 2.7.4 2.3.52.3.6 1.0 21
2.7.5 2 (J1) (J2) 45 2.7.6 15 DirectX Graphics WGC 14a UV 14b 14a WGC WGC a b 22
c 14 15 Ver.2 2.8 Ver.2 2004 10 2930 IVRC 100 3 16 PC DELL DimensionXPS (Pentium4 3GHz1G ) GeFORCE 6800 Ultra (256MB) 23
16 Ver.2 IVRC 2 10 3 93 3 Ver.2 Ver.2 86.0 14.0 0.0 35.5 51.6 12.9 33.3 59.1 7.5 52.7 47.3 0.0 74.2 21.5 4.3 4 Ver.2 24
Ver.1 17 2005 7 31 8 4 SIGGRAPH2005 Emerging Technology 1300 SIGGRAPH 5 40 17SIGGRAPH 2.9 Ver.2 VR 25
Ver.2 Ver.1 2 Ver.2 1 WGC 2.10 VR 2 Ver.1 Ver.2 Ver.1 Ver.2 26
Ver.1 Ver.2 VR 27
3 - VR 3.1 CG 3.2 28
[11, 12, 16] [13, 14, 15, 17, 18] [23] [12]DCG [24] USB 1 1 29
3.3 Pinocchio, a virtual character[19] Pinocchio 18a VR Pinocchio CCD 2 2 Pinocchio Pinocchio the ATI interactive circus[20] Circus 18b VR Circus 5 1 Dance Dance Revolution[2] Circus [21] [22] 30
apinocchio, a virtual character bthe ATI interactive circus 18 3.4 3.4.1 19 USB USB 31
19 P1USB P2 P3(P2) P4(P3) P5(P4) P6(P5) P7(P6) 3.4.2 [9] RGB CIE L*a*b CIE L*a*b CPU 32
HSV ViewFrame[9]GPU RGB CIE L*a*b 7 ((R,G,B)=(255,255,255))((R,G,B)=(0,0,0)) 10 < L < 90 0 < a < 25 0 < b 5 < a b < 25 7 La, b GPU 18 20a USB 18b 2 a b 20 33
3.4.3 3.4.2 21a3.4.2 x 1 21a 20b 8 n 9 w(x) n x m 21 a 619 x 22 x 28 21b 28 x n = u( x) x 1: w( x) > 0 u( x) = 8 0 : otherwise w( x) x m = n wxx 9 21b9 x m 21b x 21b x 2 x SE S w(x)>m, w(x-1)<m x E w(x)>m, w(x+1)<m x 10 1 I C 11 x x 21b1 39 44 x 41 422 52 56 x 54 21b 34
720x480 21 x 3.4.4 12 C i y w(c i,y max ) xy Fi(x,y) i = I 1: S E > H I = 10 0 : otherwise C i Si + Ei = 11 2 H F ( x, y) Fi ( Ci, w( Ci, ymax)) i = 12 a 35
b 21 20 3.4.4 3.4.2 3.4.3 () CPU 22ac 3 1 0 2 4 1 0 1/4 22bd 1 4 36
0 a b c d 22 () 23a 23b 37
a b 23 () 3.4.2 24a 3 24b 0 24c 3 4 38
a b c 241 25 3 5 3 5 39
252 26 26a 26b a 26 b 3.4.5 27 2 Ch 40
13Ch 3 2 2 2 Ch F1 ( x, y) + F2 ( x, y) Ch( x, y) = 13 2 DirectX Graphics DirectX 143 z Ch( x) x' 0.416 0 0 149 Ch( y) P y' = 0 0.414 0 98 * 14 w( x) z' 0 0 0.0035 51.76 x 1 a 27 b 41
3.4.6 () 28a i 2 () 28b 2 2 2 () 29ab 2 2 () 30 2 2 42
a b 281 a b 292 303 43
3.4.7 31 DirectX Graphics 31 31 CG ab 31 3.5 32 4 USB 32 33 USB USB PC DELL INSPIRON8600 Pentium M 1.3GHz, 1G GeForce FX Go5650 44
(128MB) 10fps 32 33 3.6 CG 45
USB USB VR GPU CPU 10fps GPU 46
4 VR VR 2 VR Ver.1 VR Ver.2 VR USB 47
PUIPerceptual User Interface 48
[1], VR, 2005, 93-94, 2005/02/28. [2],,,,. VR - An Implementation of Virtual Reality Application using Displacement Data -Virtual Paper-Sumo "TonTon"-, Vol4. No.2, 20 NICOGRAPH, pp 36-46. [3],,,,, VR, NICOGRAPH2004, 101-106, 2004/11/05. [4],,,,. VR Ton2 -A VR Application With Novel Interaction Method Using Displacement Data-,, 2005/08/25-26. [5] Hiroshi Yabu, Yousuke Kamada, Yukihiko Kawarazuka, Kazunori Miyata, Masafumi Takahashi, Ton2 -A VR Application with Novel Interaction Method using Displacement Data-, ACM SIGGRAPH 2005, Emerging technologies. 49
50
[1] http://www.sega-am2.co.jp/vf.net/index.html [2] http://www.konami.co.jp/am/ddr/ [3] http://www.namco.co.jp/donderpage/index.php [4] http://www.jamodrum.net/ [5] T. Blaine T. Perkis "Jam-O-Drum A Study in Interaction Design" Proceedings of the ACM DIS 2000 Conference [6] R.Parent Computer Animation: Algorithms and Techniques Morgan Kaufmann Pub 2001 [7] E. Lengyel Mathematics for 3D Game Programming and Computer Graphics Charles River Media 2003 [8] VR NICOGRAPH2004 VR & Visualization pp. 101-106 [9] ViewFrame 2003-HI-106(7) pp.45-51 [10] Mark Deloura Game Programming Gems Charles River Media 2000 pp.390-402 [11] :" (MODAN)", [12] :" " [13] James W.Davis, Hui Gao:"Gender Recognition from Walking Movements using Adaptive Three-Mode PCA" [14] M.Unuma, K.Anjyo and R.Takeuchi:"Fourier Principles for Emotion-based Human Figure Animation" 51
[15] Nikolaus F.Troje:"Decomposing biological motion: A framework for analysis and synthesis of human gait patterns" [16] Matthew Stone, Doug DeCarlo, Insuk Oh, Christian Rodriguez, Adrian Stere, Alyssa Lees, Chris Bregler:Speaking with Hands: Creating Animated Conversational Characters from Recordings of Human Performance, SIGGRAPH 2004. [17] Eugene Hsu, Kari Pulli, Jovan Povic: Style Translation for Human Motion. SIGGRAPH2005. [18] Nikolaus F. Troje: Decomposing biological motion: A framework for analysis and synthesis of human gait patterns. [19] http://www.rbbtoday.com/column/gameint/20041101/page3.html [20] http://www.rbbtoday.com/column/gameint/20051107/page6.html [21] James M. Rehg, Takeo Kanade, Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking, Third European Conf. on Computer Vision, May 1994, pages 35-46. [22] Julien Letessier, Visual Tracking of Bare Fingers for Interactive Surfaces, UIST 04, October 24-27 2004, Volume 6 Issue 2. [23] +, 3DCG. [24] http://www.alias.co.jp/products-services/motionbuilder/new/demos.shtml [25] Andrew D. Wilson, TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction,SIGGRAPH2005 Emerging Technology. [26] ThermoPainter [27] koekaki 2005 [28] http://pinballpark.at.infoseek.co.jp/ 52