28 Information selectivity in mixed reality environment

Size: px

Start display at page:

Download "28 Information selectivity in mixed reality environment"

ときこのえ
4 years ago
Views:

1 28 Information selectivity in mixed reality environment

2 AR AR AR AR AR HMD AR AR AR AR AR i

3 AR ii

4 Abstract Information selectivity in mixed reality environment Yoshitaka Sakamoto In the means of obtaining information of the outside world, the visual information occupies much. However, it is impossible to process all of the information projecting to the eyes. Since parallel processing of the visual system has limitations, it is necessary to select useful information within the limit. In the information selection, visual attention plays an important role. With the recent increase in the use of smart-phones, many applications using augmented reality (AR) technology appeared and AR has become more familiar. As AR technology develops, it is conceivable that more information by the AR will be additionally presented in the real world. At that time, we need to select useful information from the mixed reality environment where real objects and AR objects are presented. In this study, we constructed a mixed reality environment using head mounted display and examined the property of attention in information selection. A flanker task paradigm was used in this study. The task requires the observers to identify the target stimulus while ignoring the peripheral stimulus. In this paradigm, the difference of reaction time between the condition in which the target and peripheral stimulus was different and the conditions in which these stimuli were same, are considered to be the effect of the peripheral stimulus (flanker effect). When this value is small, the target stimulus is considered to be not influenced much by the peripheral stimulus and the target stimulus can be identified efficiently. The results showed different effects of the flanker on the first and second day in the iii

5 mixed reality condition in which real objects and AR objects are combined. On the first day, the condition that the target stimulus was a AR object and the flankers were real objects showed smaller flanker effect while on the second day, the condition that the target stimulus was a real object and flankers were AR objects showed smaller flanker effect. The real objects and the AR objects have different characteristics of reflection and shadows due to different illumination light. On the first day, when the real object was the target stimulus, the reaction time might be delayed as attention was captured to AR objects in peripheral, but on the second day the obstruction effect by the flankers decreased. Compared with the first day, the reaction time became faster. In addition, the effect of the day was also found in the condition that both the target and the flanker were both AR objects which had chromatic color. Unlike the condition of mixed reality, the effect of reaction time due to the day was also observed in the reaction time of the condition under which the target stimulus and the peripheral stimuli were same. On the first day, the object with high chromatic color saliency captured attention to the object itself and it might be hard to access the information of the symbol inside the object. key words Visual AttentionARMixed RealityInformation SelecivityFlanker Task iv

6 AR(Augmented Reality) VR(Virtual Reality) MR(Mixed Reality) Ovrvision Pro v

7 3.2.3 AR AR () vi

8 1.1 AR VR Microsoft HoloLens([5]) ARAVVRMR (Milgrame et al. (1994) [6] ) Ovrvision Caliblation Tool ARUco HMDOculus Rift DK Ovrvision Pro OvrvisionProhuzo HMD AR - R AR - R AR - R AR - R R - AR R - AR R - AR R - AR vii

9 3.9 R - R R - R R - R R - R AR - AR AR - AR AR - AR AR - AR AR - AR AR - AR AR - AR AR - AR HMD A B C D E F G viii

10 3.35 H I J AR - AR ix

11 [1] AR(Augmented Reality) AR AR 1.2 AR CG 2016 AR Pokemon GO Pokemon GO AR Pokemon GO 6 [2] AR AR AR AR AR MR : Mixed Reality) MR 1.4 MR CG 1

12 1.2 AR 1.2 ( 1.5 ) AR 1.6 [9] 1.3 AR(Augmented Reality) AR(Augmented Reality) AR GPS AR GPS 2

1.3 AR(Augmented Reality) などの情報を取得し付加情報を合成する座標が決定する GPS や各センサーはスマートフォンやタブレットに標準で搭載されているので比較的簡単に実現できるが GPS 精度の限界から表示のズレが起こるデメリットがあるマーカー型は AR マーカーという画像解析を容易にするマーカーを用いて現実世界と表示させる AR 物体の座標をリンクさせる方式

13 1.3 AR(Augmented Reality) などの情報を取得し付加情報を合成する座標が決定する GPS や各センサーはスマートフォンやタブレットに標準で搭載されているので比較的簡単に実現できるが GPS 精度の限界から表示のズレが起こるデメリットがあるマーカー型は AR マーカーという画像解析を容易にするマーカーを用いて現実世界と表示させる AR 物体の座標をリンクさせる方式である付加情報の表示位置を正確に指示できるのが最大のメリットであるしかし状況に応じて必要な数だけマーカーを準備しなくてはいけないなどのデメリットもあるマーカーレス型は AR マーカーを使わずに現実世界の物体や空間全体を把握することで付加情報の表示位置を決定する方式である大きな対象に対してもピンポイントで付加情報を合成できるが高度な画像処理が必要で技術的なハードルは高い [3] 本実験ではマーカー型 AR を使用した使用したマーカーは ARUco という BSD ライセンスで提供されている OpenCV をベースにした AR ライブラリである ARUco を用いて実際にオブジェクトを呈示した例を図 1.1 に示す AR 技術は昨年ヒットを起こした Pokmon GO やスマートフォンのカメラを用いてナビゲーションを行う道順案内アプリ [4] 医療分野における手術支援システムであるダヴィンチで使われるなど幅広い分野で使用されている図 1.1 AR のオブジェクト呈示例 3

14 1.4 VR(Virtual Reality) 1.4 VR(Virtual Reality) VR(Virtual Reality) VR 3 3 VR VR VR [3] HTC Valve Corporation HTC VIVE VR HMD VR HTC VIVE VR 4

15 1.5 MR(Mixed Reality) 1.5 MR(Mixed Reality) MRMixedReality) CG VRReality Microsoft MR HoloLens 1.3 AR (AV : Augmented Virtual) 1.4 ARAVVRMR 1.4 AR AV MR [7] 1.3 Microsoft HoloLens([5]) 1.4 ARAVVRMR (Milgrame et al. (1994) [6] ) 5

16 (Posner & Cohen, 1984) [8] Barbara A. Eriksen Charles W. Eriksen HHHHH SSHSS [9] 6

17 1.7 ( 1.5) Eriksen & Eriksen1974 H GJQHGJQ NWZHNWZ [10] [11] AR AR AR 7

19 1.8 Ovrvision Pro 1.8 Ovrvision Pro Ovrvision Pro Oculus Oculus Rift HTC VIVE AR.com Wizapply EEPROM GPIO.Unity Ovrvision Pro SDK Ovrvision Pro SDK MIT [12] Ovrvision SDK Ovrvision Cliblation Tool ( 1.6) Ovrvision Pro Ovrvision Caliblation Tool 9

20 2 2.1 AR PC OS : Windows8.1 CPU : Intel Core i GHz : 8GB Windows Visual Studio 2015 Unity5.3.6p2(64bit) Microsoft Excel 2013 R (3.3.2) 10

21 AR AR ARUco ( 2.1) 4.5cm ( 2.2) 8cm 60cm 3cm ( 2.3) (HMD) OculusRift DK2( 2.4) AR Ovrvision Pro ( 2.5) Ovrvision Pro HMD ARUco HMDOculus Rift DK2 11

22 Ovrvision Pro 2.6 OvrvisionProhuzo HMD 12

23 (ERE- COM TK-TCM011BK) ( 2.7)

24 AR <<<<<>>>>> <<><<>><>> AR AR- R ( ) AR R- AR ( ) 14

25 3.1 R- R ( ) AR AR- AR ( ) 4 AR ( AR - AR) AR - AR ( )AR x,y,z = 0.1 x,y,z = 0 x,y,z = 0,0.1,-0.1 AR - AR RGB AR - R AR - R AR - R AR - R 2 15

26 R - AR R - AR R - AR R - AR R - R R - R 2 16

27 R - R R - R AR - AR AR - AR AR - AR AR - AR 2 17

28 AR - AR AR - AR AR - AR AR - AR 2 18

29 AR 50cm ( 3.21) Ovrvision Pro HMD AR HMD HMD 30cm AR ms

30 3.1 HMD 3.23 AR AR AR 3.23 HMD 20

3.2 3.2 3.2.1 (SD) SD 2 AR - AR 3.21 3.22 3.24 1 (F (1,9) = 1.88p = 0.

31 (SD) SD 2 AR - AR (F (1,9) = 1.88p = F (1,9) = 2.86, p < 0.05 R - AR AR - AR p < 0.01p <

33 F (1,9) = , p < R - AR AR - R R - AR 3.25 AR - R R - AR p < 0.01 AR - R R - AR R- AR, AR AR AR

35 AR - R R - AR AR - R, AR 3.32 AR - R R - AR AR - R 3.28 A 3.29 B 25

36 C 3.31 D 3.32 E 3.33 F 26

37 G 3.35 H 3.36 I 3.37 J 27

38 AR AR - AR AR - AR 3.38 AR - AR AR - AR 2 F (1,9) = 7.48p < 0.05p < 0.05p < AR - AR 28

39 4 4.1 AR AR R - AR AR - R AR AR AR AR AR - R AR 4.2 AR () AR - AR R - AR AR AR - AR 29

40 4.2 AR () AR 2 AR - AR AR 30

41 5 HMD AR AR AR AR AR AR 31

42 ,,.,,.,.. 32

43 [1] [2] App Annie [3] VRAR pp [4], 2010 [5] Microsoft HoloLens [6] Paul MilgramHaruo TakemuraAkira UtsumiFumio Kishimo Augmented Reality: A class of displays on the reality-virtuality continuum Telemanipulator and Telepresence Technorogies SPIE Vol ,1994 [7] 1998 [8] Cognitive Psychology : Brain, Modeling and Evidence pp [9] Eriksen,B.A.& Eriksen,C.W.Effect of noise letters upon the identification of a target letter in a nonsearch task,p ercept& P sychophysics, [10] Vol [11] Ridderinkhof,K.R. & Band,G.P.& Logan,D. A study of adaptive behavior: effects of age and irrelevant information on the ability to inhibit one s actions. Acta 33

44 psychologica. 101: [12] Ovrvision Pro USB3.0 Open-Source Stereo Camerahttp://ovrvision.com/

25 AR 3 Property of three-dimensional perception in the wearable AR environment

25 AR 3 Property of three-dimensional perception in the wearable AR environment 1140378 2014 2 28 AR 3 AR.. AR,. AR. 2, [2]., [3]., AR. AR. 3D 3D,,., 3D..,,,,. AR,, HMD,, 3 i Abstract Property of three-dimensional