Åê¤²¸ë:¥¹¥�¥ë¤È»×¹Í¤òÊ»¤»»ý¤ÄVR¥²¡¼¥à¤Î¸¦µæ

Size: px

Start display at page:

Download "Åê¤²¸ë:¥¹¥�¥ë¤È»×¹Í¤òÊ»¤»»ý¤ÄVR¥²¡¼¥à¤Î¸¦µæ"

さやなくだら
7 years ago
Views:

1 : VR

2 1 VR Unity VR Leap Motion 4 0 Leap Motion Kinect VR

3 Hand gesture-based interactive puppetry system to assist storytelling for children Interaction with virtual objects in a natural way Multi-sensor Exercise-based Interactive Games for Fall Prevention and Rehabilitation Using virtual reality to analyze sports performance Leap Motion Unity Unity

4 Unity Leap Motion

6 Leap Motion Leap Motion

7 6 Listings 4.1 C# UnityScript

8 VR VR VR [9] VR VR 1

9 : 1.3 ( 1 )

11 Hand gesture-based interactive puppetry system to assist storytelling for children [3] Leap Motion Unity Serious Game 2.2 Interaction with virtual objects in a natural way Prazina [5] Leap Motion 3D 2.3 Multi-sensor Exercise-based Interactive Games for Fall Prevention and Rehabilitation Santos [6] Leap Motion Kinect 1 VR Using virtual reality to analyze sports performance Bideau [1] 2.5 [13] 1

12 [12] 2.7 [8] [10]

13 [11] : 1 3.2:

14 : 2 3.4: 2 3.5: 3 3.6: 3 3.7: 3.8:

15 : 3.10: = = 81

16 Leap Motion Leap Motion Leap Motion Unity 3.12 Unity 3.13

17 :

18 第 3 章提案システム 17 図 3.12: ゲーム上で碁石を擬似的に掴んでいる様子図 3.13: 壁と天井を表示した時のスクリーンショット

18 第4章実装環境実装には Unity Technorogies 社のゲームエンジンである Unity [2] を用いたまた機器として Leap Motion 社の VR 機器である Leap Motion [4] を用いた使用したコンピュータは MacBook Pro (Retina, 15-inch, Late 2013) である 4.

19 18 第4章実装環境実装には Unity Technorogies 社のゲームエンジンである Unity [2] を用いたまた機器として Leap Motion 社の VR 機器である Leap Motion [4] を用いた使用したコンピュータは MacBook Pro (Retina, 15-inch, Late 2013) である 4.1 Leap Motion 図 4.1: Leap Motion Leap Motion は赤外線 LED と 2 個の赤外線カメラを用いたハンドトラッキング 3D 入力デバイスの一つで高精度モードで 80fps 速度重視モードで 290fps ほど (USB3.0 接続時) のトラッキング速度を持つ両手十指に反応することができ最高精度で 10µm 程度の移動距離を取得することができる [7]

20 4 19 SDK Windows Orion Mac Linux Version2 C Orion C++ C# Objective-C Unity Java Python Javascript Unreal Engine 4 Leap Motion SDK version2.3.1 Unity Asset Unity 4.2 Unity Unity 3D 5.3.5f Unity Unity Unity Unity Unity 4.2: Unity Unity Javascript C# Boo Python

21 第 4 章実装環境 20 図 4.3: アセットストアの様子モザイク処理済み 1 2 using UnityEngine; using System.Collections; 3 4 public class UnityScript : MonoBehaviour { 5 // Use this for initialization void Start () { } 9 10 // Update is called once per frame void Update () { } } Listing 4.1: C#による基本になる UnityScript listing 4.1 は基本的な Unity におけるスクリプト (C#) であるスクリプトを生成すると Update(){} と Start(){}の 2 つのメソッドが初めから記述されている Update() このスクリプトが適用されているゲームオブジェクトが毎フレーム呼び出されるメソッドである Start() このスクリプトが適用されているゲームオブジェクトが初めて Update(){}を呼ぶ前に一度だけ呼び出されるメソッドであるこれらはイベントメソッドと呼ばれこれら 2 つ以外にも多くのメソッドが存在する

22 Unity

23 22 5 Unity : 3D Unity

5 23 5.2 5.2: Unity Directional Light 5.2 5.3 Unity Leap Motion 5.

24 : Unity Directional Light Unity Leap Motion 5.3 Unity x = 10, y = 10, z = 10

5 24 5.3: Leap Motion 5.4 The Texture Lab Grass 01 Game-Ready 1 Rispat Momit Simple Cloud System 2 5.

25 : Leap Motion 5.4 The Texture Lab Grass 01 Game-Ready 1 Rispat Momit Simple Cloud System void OnTriggerEnter(Collider other){ 2 Destroy(other.gameObject); 3 } Listing 5.1: DelObject.cs

26 OnTriggerEnter listing5.1 OnTriggerEnter(Collider other){} listing4.1 Update()Start() Destroy Destroy(other.gameObject) void Start () { 2 3 //generate box 4 GameObject parentobject = GameObject.FindGameObjectWithTag("Line"); 5 Vector3 linepos = new Vector3(5f,1.51f, 1f); 6 7 Quaternion q = new Quaternion(); 8 q = Quaternion.identity; 9 10 for(int i=0;i<9;i++){ 11 Instantiate(linePrefab,linePos,q); 12 linepos.z = 1f; 13 } q = Quaternion.Euler(0,90,0); 16 linepos = new Vector3(1f,1.51f, 5f); for(int i=0;i<9;i++){ 19 Instantiate(linePrefab,linePos,q); 20 linepos.x += 1f; 21 } } Listing 5.2: 8(m) Quaternion Quaternion 4 R 4 e

27 e = i j k (5.1) H q = a + bi + c j + dk (5.2) i, j, k i 2 = j 2 = k 2 = 1 (5.3) i j = k, jk = i, ki = j (5.4) ji = k, k j = i, ik = j (5.5) q = a bi c j dk (5.6) (α, β, γ) v θ q = cos θ 2 + α sin θ 2 i + β sin θ 2 j + γ sin θ 2 k v = qvq Quaternion.identify Static Instantiate Instantiate(Gameobject object,vector3 v,quaternion q){} public GameObject stoneblack; 2 public GameObject stonewhite; 3

28 bool black; 5 6 Quaternion q = new Quaternion(); 7 8 // Use this for initialization 9 void Start () { 10 q = Quaternion.identity; 11 black = true; 12 } // Update is called once per frame 15 void Update () { 16 if(input.getkeydown(keycode.h)){ try{ 19 GameObject stone = 20 GameObject.Instantiate(black?stoneBlack:stoneWhite, 21 this.transform.position, q)as GameObject; black = black?false:true; 24 } catch (System.NullReferenceException e){ 25 Debug.Log("Cannot generate a stone."); 26 } 27 } 28 } Listing 5.3: 1 2 public GameObject stonewhite; 3 public GameObject stoneblack; 4 5 public GameObject[] FingerObjects; 6 7 HandController handcontroller; 8 Finger finger; Quaternion q = new Quaternion(); 12 GameObject hand; bool black = true; const int SPEED = 100; // Use this for initialization 19 void Start () { q = Quaternion.identity; } // Update is called once per frame 27 //generate stone

29 void Update () { hand = GameObject.Find( 31 "/SaltLightFullRightHand(Clone)/HandContainer"); if(hand == null) 34 hand = GameObject.Find( 35 "/SaltLightFullLeftHand(Clone)/HandContainer"); if(input.getkeydown(keycode.z) 38 Input.GetKeyDown(KeyCode.Space)){ try{ 41 GameObject stone = GameObject.Instantiate( 42 black?stoneblack:stonewhite, 43 hand.transform.position,q) as GameObject; black = black?false:true; } catch (System.NullReferenceException e){ 48 Debug.Log("Cannot generate a stone."); 49 } 50 } } Listing 5.4: listing 5.3 listing 5.4 listing 5.3 H listing GameObject.Find(String pass) listing 5.4 GameObject.Find(String pass){} String pass GameObject 5.8

5 29 5.4: 1 void Update () { 2 3 if(input.getkeydown(keycode.w)){ 4 5 if(wallmode){ 6 7 Debug.Log("Dell Wall"); 8 9 foreach(gameobject delwall 10 in GameObject.

30 : 1 void Update () { 2 3 if(input.getkeydown(keycode.w)){ 4 5 if(wallmode){ 6 7 Debug.Log("Dell Wall"); 8 9 foreach(gameobject delwall 10 in GameObject.FindGameObjectsWithTag("Wall")) 11 Destroy(delWall); wallmode = false; }else{ Debug.Log("Gen wall"); 18 Instantiate(wall, 19 new Vector3(0,5, 5), 20 Quaternion.identity); Instantiate(wall, 23 new Vector3(10,5, 5), 24 Quaternion.identity); Instantiate(wall, 27 new Vector3(5,5,0), 28 Quaternion.Euler(0,90,0)); Instantiate(wall, 31 new Vector3(5,10, 5), 32 Quaternion.Euler(0,0,90)); wallmode = true;

31 } 36 } } Listing 5.5: 5.9 1(m) µ 0.3 e public Rigidbody rb; 2 3 Vector3 roundpos; 4 5 bool ongoban; 6 7 public bool destroymode; 8 9 static int LIMIT_SPEED = 2; bool frozen; 12 // Use this for initialization 13 void Start () { 14 rb = GetComponent<Rigidbody>(); 15 rb.constraints = RigidbodyConstraints.None; 16 ongoban = false; 17 destroymode = true; 18 frozen = false; 19 // destroymode = false; 20 Debug.Log("destroyMode:" + destroymode); } // Update is called once per frame 25 void Update () { } 28 void OnTriggerEnter(Collider other){ if (other.gameobject.comparetag("grid")) { 31 Debug.Log("StonePos" + other.gameobject.transform.position); 32 } 33

32 if(destroymode){ 35 Debug.Log("Collision! on " + 36 (other.gameobject.comparetag("stoneblack")?"stoneblack":"") 37 + (other.gameobject.comparetag("stonewhite")?"stonewhite":"") ); 38 if((other.gameobject.comparetag("stonewhite")) 39 other.gameobject.comparetag("stoneblack")) { 40 GameObject.Destroy(other.gameObject); 41 } 42 } } void OnCollisionStay(Collision other){ 48 if (!frozen & other.gameobject.comparetag("grid")){ 49 if (rb.velocity.sqrmagnitude == 0 ){ 50 roundpos = new Vector3(Mathf.RoundToInt(rb.position.x), 51 rb.position.y, 52 Mathf.RoundToInt(rb.position.z)); 53 this.transform.position = roundpos; 54 rb.constraints = RigidbodyConstraints.FreezeAll; 55 frozen = true; 56 } 57 if (!ongoban && rb.velocity.sqrmagnitude < LIMIT_SPEED) { 58 //Stop Stones 59 ongoban = true; 60 this.transform.rotation = Quaternion.identity; 61 rb.constraints = RigidbodyConstraints.FreezePositionX 62 RigidbodyConstraints.FreezePositionZ 63 RigidbodyConstraints.FreezeRotationX 64 RigidbodyConstraints.FreezeRotationZ ; 65 } } 68 } Listing 5.6:

33 Leap Motion 10 1

34 cm e 1 Leap Motion cm 5 3

35 e :

36 : : cm 9cm 10cm 2cm 4cm 2 10cm 15cm 17cm 7cm 3cm 1 4 2

37 ,2 0

38 37 8 Leap Motion Unity VR VR VR Leap Motion Kinect VR Oculus Rift Gear VR, HTC Vive (HMD) 8.3

39 OB.

40 39 [1] Benoit Bideau, Richard Kulpa, Nicolas Vignais, Sébastien Brault, Franck Multon, and Cathy Craig. Using virtual reality to analyze sports performance. IEEE Computer Graphics and Applications, Vol. 30, No. 2, pp , [2] Unity Tecnorogies Japan. Unity - game engine, tools and multiplatform [3] Hui Liang, Jian Chang, Ismail K Kazmi, Jian J Zhang, and Peifeng Jiao. Hand gesture-based interactive puppetry system to assist storytelling for children. The Visual Computer, pp. 1 15, [4] Leap Motion. Leap motion mac & pc motion controller for games, design, virtual reality & more [5] I Prazina, K Balic, K Prses, S Rizvic, and V Okanovic. Interaction with virtual objects in a natural way. In MIPRO th International Convention, pp , [6] António Santos, Vânia Guimarães, Nuno Matos, João Cevada, Carlos Ferreira, and Inês Sousa. Multi-sensor exercise-based interactive games for fall prevention and rehabilitation. In Proceedings of the 9th International Conference on Pervasive Computing Technologies for Healthcare, PervasiveHealth 15, pp ICST, [7] Frank Weichert, Daniel Bachmann, Bartholomäus Rudak, and Denis Fisseler. Analysis of the accuracy and robustness of the leap motion controller. Sensors, Vol. 13, No. 5, pp , [8],,.. (GI), Vol. 2007, No. 20 (2007-GI-017), pp , [9]. 2.., Vol. 60, No. 4, pp , [10],.. GI, Vol. 2000, No. 27, pp , mar [11] [12],,.. 21, pp , 2005.

41 8 40 [13],,.. (GI), Vol. 2014, No. 2, pp. 1 5, 2014.

Raspberry Pi BF BF BF Raspberry Pi PC USB HDMI OS SD SD OS Raspberry Pi Model B MicroUSB MicroSD OS SD GPIO HDMI USB LAN Raspberry Pi MicroUSB MicroSD

Raspberry Pi BF BF BF Raspberry Pi PC USB HDMI OS SD SD OS Raspberry Pi Model B MicroUSB MicroSD OS SD GPIO HDMI USB LAN Raspberry Pi MicroUSB MicroSD Raspberry Pi Arduino Arduino Raspberry Pi Arduino URL Raspberry Pi HDMI USB SD https://www.raspberrypi.org/ Python, Scratch Arduino PC USB https://www.arduino.cc/ Arduino SDK Processing Kinect for Windows,