27 VR Interaction between visual and vestibular perception in VR environment 1160281 2015 2 26
VR,.,., (,HMD),..,. HMD,Virtual Reality(,VR). Simulator Sickness Questionnaire, SSQ),.,,HMD VR.,., VR,.,SSQ,, i
Abstract Interaction between visual and vestibular perception in VR environment Yukai Isobe We combine the information obtained from the five senses and other senses such as vestibular sense to know the outer world and ourselves. This process is called multimodal integration. Many studies have investigated the mechanisms of the integration process of the visual and vestibular perception, there are few studies manipulating each cue independently and examined the cue weight for the integration. In recent years, a head mounted display (HMD) has often been implemented with head tracking function. It has become easy to manipulate the visual and vestibular information independently. This manipulation may cause motion sickness by the inconsistency among multi-modal information. In this study, the visual stimuli were manipulated using the HMD, and how are the weights of the integration of visual and vestibular information under the virtual reality environment. Also subjective symptoms of motion sickness were obtained using simulator sickness questionnaire (SSQ) investigating the effect of the inconsistency of visual and vestibular information. As a result, weights for the integration varied depending on both the ratio and the amount of the rotation angle of the visual and vestibular stimulation. Moreover, the weight of vestibular information is relatively higher than visual information under the VR environment using HMD. In contrast, effects of the ratio and the amount of the rotation angle on motion sickness showed no significant difference. From these results, to present VR environment with vestibular stimuli, it is ii
important to take account to show the information correctly as well as visual information. Since SSQ scores were relatively small, it is necessary to examine in the condition which causes severer symptoms of the motion sickness. key words multimodal integration, vestibular sense, motion sickness iii
1 1 1.1...................................... 1 1.2...................................... 1 1.3 HMD..................................... 2 1.4................................... 2 1.5 SSQ............................... 2 2 4 2.1................................... 4 2.2.................................... 10 2.3................................... 10 2.4.................................... 12 3 14 3.1................................... 14 3.2 SSQ............................. 19 4 28 5 30 31 32 iv
2.1 RICOH THETA............................... 6 2.2 Oculus Rift DK2............................... 6 2.3.................................... 6 2.4 Oculus Rift DK2.......................... 6 2.5.................................... 7 2.6................................. 7 2.7............................... 7 2.8................................... 7 2.9 iphone 5s................................... 8 2.10.................................... 8 2.11 ipad Air2................................... 8 2.12................................ 9 2.13.................................... 13 3.1 1.................................... 15 3.2 2.................................... 15 3.3 3.................................... 15 3.4 4.................................... 15 3.5 5.................................... 16 3.6 6.................................... 16 3.7 7.................................... 16 3.8 8.................................... 16 3.9 9.................................... 17 3.10 10................................... 17 v
3.11.................................... 18 3.12 1( ).............................. 20 3.13 2( ).............................. 20 3.14 3( ).............................. 20 3.15 4( ).............................. 20 3.16 5( ).............................. 21 3.17 6( ).............................. 21 3.18 7( ).............................. 21 3.19 8( ).............................. 21 3.20 9( ).............................. 21 3.21 10( ).............................. 21 3.22 TotalScore( )............................. 22 3.23 Oculomotor( )............................ 22 3.24 Nausea( )............................... 22 3.25 TotalScore(, N = 7)......................... 22 3.26 Oculomotor(, N = 6)........................ 23 3.27 Nausea(, N = 6).......................... 23 3.28 1( )................................. 24 3.29 2( )................................. 24 3.30 3( )................................. 24 3.31 4( )................................. 24 3.32 5( )................................. 25 3.33 6( )................................. 25 3.34 7( )................................. 25 3.35 8( )................................. 25 3.36 9( )................................. 25 vi
3.37 10( )................................ 25 3.38 TotalScore( )............................... 26 3.39 Oculomotor( )............................... 26 3.40 Nausea( )................................. 26 3.41 TotalScore(, N = 9)........................... 26 3.42 Oculomotor(, N = 8).......................... 27 3.43 Nausea(, N = 7)............................. 27 vii
1.1 SSQ [6][7]............................. 3 2.1.......................... 11 viii
1 1.1,.., (,[1][2]).,HMD,..,. 1.2 HMD,VR, Simulator Sickness Questionnaire, SSQ),. 1
1.3 HMD 1.3 HMD HMD, 1. VR, VR.,HMD,..,,. 1.4 [5].,,. 0. 1.5 SSQ,,Simulator Sickness Questionnaire 1 [6]. SSQ 16,4 ( ).,SSQ 4 (TotalScore, Oculomotor, Nausea, Disorientation),.TotalScore 16, 3.74.Oculomotor( ) 7,7.58 2
1.5 SSQ.Nausea 7,9.54.Disorientation, 7,13.92. 1.1 SSQ. [7]. 1.1 SSQ [6][7] Nausea Oculomotor Disorientation TotalScore 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 9.54 7.58 13.92 3.74 3
2 2.1 (RICOH THETA, 2.1),Unity(Version 5.1.1f1 Personal).., Unity,., Unity.HMD Oculus Rift DK2(Oculusu VR, 2.2) HMD HMD,HMD ( 2.3) ( 2.4).Oculus Rift. Oculus Rift DK2,., ( 2.5), ( 2.7)..,, ( 2.6) 5, ( 2.8) 5.,..,,,. (iphone 5s, 2.9)., HMD ( 2.10). HMD 4
2.1. SSQ (ipad Air2, 2.11).,. OS: Windows8.1 Intel Core(TM) i5-4460 3.20GHz : 7.95GB 5
2.1 実験装置 図 2.1 図 2.2 Oculus Rift DK2 RICOH THETA 図 2.3 黒色の袋 図 2.4 6 実験時の Oculus Rift DK2
2.1 実験装置 図 2.5 図 2.7 図 2.6 回転椅子 角度指標確認用板 キャビネット 図 2.8 段ボール箱 7
2.1 実験装置 図 2.9 iphone 5s 図 2.10 ニット帽 図 2.11 ipad Air2 8
2.1 実験装置 図 2.12 実際の実験環境 9
2.2 2.2 10 ( 9, 1 ).,. 1000. 2.3 HMD,.,. 2.1,.,.,.., [8]. 10
2.3 2.1 45 deg 90 deg 1:0 45 deg 0 deg 90 deg 0 deg 2:1 90 deg 45 deg 180 deg 90 deg 1:2 45 deg 90 deg 90 deg 180 deg 2:1 0 deg 45 deg 0 deg 90 deg 1:0 45 deg 0 deg 90 deg 0 deg 2:1 90 deg 45 deg 180 deg 90 deg 1:2 45 deg 90 deg 90 deg 180 deg 2:1 0 deg 45 deg 0 deg 90 deg 11
2.4 2.4,,. 1 SSQ. 1. HMD,,.,., 2.1 1.,., 2.,.,HMD,. 1. 4 SSQ.,4 5., 2.3,. 4 1:0, 2:1, 1:2, 0:1 2 45 deg 90 deg 2 ( ) 16. 1 16 1. 3 3.16, 4, 2 2 4., 1:0, 4 45 deg : 0 deg, 90 deg : 0 deg, -45 deg : 0 deg, -90 deg : 0 deg ( ). 12
2.4 2.13 13
3 3.1, 1, 0. 3.1, 3.2. [11][12]. w 1. w 2. v i. v e. Y. Y = w 1 v i + w 2 v e (3.1) 1 = w 1 + w 2 (3.2), 2. 3.1 3.10., 3.11. 2, (F(3,27)=4.0075, p<.05).,, 1:0 0:1 p<.05, p<.01.,45,1:0 1:2, 1:0 0:1 p<.05, p<.05.,hmd VR,. 14
3.1 3.1 1 3.2 2 3.3 3 3.4 4 15
3.1 3.5 5 3.6 6 3.7 7 3.8 8 16
3.1 3.9 9 3.10 10 17
3.1 3.11 18
3.2 SSQ 3.2 SSQ 1:0, 2:1, 1:2, 0:1, 2 2.SSQ 4, 3.12 3.27., 3.12 3.21 SSQ.,3.22 3.24 TotalScore, Oculomotor, Nausea. 3.25 3.27,TotalScore, Oculomotor, Nausea 0.,,4 4. 3.28 3.37.,3.38 3.43 TotalScore, Oculomotor, Nausea. SSQ TotalScore, Oculomotor, Nausea 0,.(F(3,27)=0.8531, p>.05, F(3,27)=0.7122, p>.05, F(3,27)=0.5220, p>.05, F(3,18)=0.8468, p>.05, F(3,15)=0.6962, p>.05, F(3,15)=0.5028, p>.05,),4 4,.(F(3,27)=0.7682, p>.05, F(3,27)=0.3529, p>.05, F(3,27)=0.4909, p>.05, F(3,24)=0.7659, p>.05, F(3,21)=0.3465, p>.05, F(3,18)=0.7011, p>.05,),. 19
3.2 SSQ 3.12 1( ) 3.13 2( ) 3.14 3( ) 3.15 4( ) 20
3.2 SSQ 3.16 5( ) 3.17 6( ) 3.18 7( ) 3.19 8( ) 3.20 9( ) 3.21 10( ) 21
3.2 SSQ 3.22 TotalScore( ) 3.23 Oculomotor( ) 3.24 Nausea( ) 3.25 TotalScore(, N = 7) 22
3.2 SSQ 3.26 Oculomotor(, N = 6) 3.27 Nausea(, N = 6) 23
3.2 SSQ 3.28 1( ) 3.29 2( ) 3.30 3( ) 3.31 4( ) 24
3.2 SSQ 3.32 5( ) 3.33 6( ) 3.34 7( ) 3.35 8( ) 3.36 9( ) 3.37 10( ) 25
3.2 SSQ 3.38 TotalScore( ) 3.39 Oculomotor( ) 3.40 Nausea( ) 3.41 TotalScore(, N = 9) 26
3.2 SSQ 3.42 Oculomotor(, N = 8) 3.43 Nausea(, N = 7) 27
4 1:0 0:1.,., 2:1 1:2.,., 45,1:0 1:2, 1:0 0:1.1:0 0:1,,.1:0 1:2,.,90. 0.5. 1:1. 3.1, 3.2., 3.11, 1:1, 0.5.,,. SSQ.,SSQ 0,.,SSQ,, 28
.,,,.,, 180,.,., HMD VR,.,., VR,. VR,, VR., VR,.,,., VR. 29
5 HMD,VR.,SSQ,., HMD VR.,HMD VR,.,,.., SSQ 30
,.,,.,.. 31
[1] J. A. Saunders, Reliability and relative weighting of visual and nonvisual information for perceiving direction of self-motion during walking, Journal of Vision (2014) 14(3):24, 117 [2],,, IE97-156, 89-94 1977. [3] Reason, J. T., Motion sickness adaptation : A neural mismatch model, Journal of the Royal Society of Medicine, 71, pp. 819-829, (1978). [4] Oman, C. M., A heuristic mathematical model for the dynamics of sensory conflict and motion sickness, Acta Otolaryngologica, 44, pp. 392, (1982). [5] 2009 [6] Kennedy, R.S., Lane, N.E., Berbaum, K.S. Simulator sickness questionairre: an enhanced method for quantifying simulator sickness, The Infernafional Journal ofaviation Psychology, 3, 203-220, 1993. [7],,,,,,,,,,, 15, pp. 41-44, (2010). [8] Namba, S., Kuwano, S. & H. Fastl: Loudness of road traffic noise using the continuous judgment by category. Proceedings of the 5th International Congress on Noise as a Public Health Problem, 241-246, 1988. [9] 2011 [10], 3,,, 2000. [11] van Beers RJ, Sittig AC (1999) Integration of proprioceptive and visual position information: an experimentally supported model. J Neurophysiol 81:13551364 32
[12] Wu B, Klatzky RL, Shelton D, Stetten G (2008) Mental concatenation of perceptually and cognitively specified depth to represent locations in near space. Exp Brain Res 184:295305 33