Vol. 48 No. 1 Jan MR, MR A Sharing Method of Real Objects Differ in Syntax each other Based on a Virtual Sheet between Remote Mixed Reality Spac

Size: px

Start display at page:

Download "Vol. 48 No. 1 Jan MR, MR A Sharing Method of Real Objects Differ in Syntax each other Based on a Virtual Sheet between Remote Mixed Reality Spac"

しげじろうなつ
4 years ago
Views:

1 Vol. 48 No. 1 Jan MR, MR A Sharing Method of Real Objects Differ in Syntax each other Based on a Virtual Sheet between Remote Mixed Reality Spaces Kazuhiro Miyasa, Yuichi Bannai,, Yuji Suzuki, Hidekazu Tamaki, Hiroshi Shigeno and Ken-ichi Okada In remote collaboration based on real objects, the difference of the space structure between the remote real spaces should be considered. In conventional method it is difficult for users to collaborate based on the real objects which differ in syntax each other. To address this issue, we focus attention on a sticker or a sheet which can be attached on a physical object according to its surface. And as a method which Mixed Reality (MR) technology is combined with it, we propose an information sharing method of semantics which each remote user interacts with a real object, by using virtual sheet which can be attached to each real object according to its surface and can absorb the difference in syntax between these real objects. Then we implemented a prototype system which has pointing function and conducted experimentation. As a result it proved that it is possible to share the information of the interactions without losing the meaning between the real objects which differ in syntax each other. 1. 1) 2),3) Department of Information & Computer Science, Faculty of Science & Technology, Keio University Environment New Business Center, Canon Inc. 134

2 Vol. 48 No. 1 MR 135 4) MR MR Shared Surface 2. 2D GUI 5) Ishii 5),6) PsyBench 6) XY PsyBench InTouch 6) PsyBench 3 2 Lazy Susan 7) In- Touch

3 136 Jan ComAdapter 8) TV 2 2 TV TV 1 Sekiguchi RobotPHONE 9) MR 4) Table 1 Classification of a pair of real objects.

4 Vol. 48 No. 1 MR Yes 3 2 Yes 4 3 Yes 2D 3D 3D 2D 3.2 MR 3D 3D 2D MR MR

5 138 Jan MR (1) (2) (3) / V A V B V S A B X A X B

6 Vol. 48 No. 1 MR Fig. 1 Information sharing mechanism. P A A W A M A P B M A W A A V A X A X 1 A M A V S P B X B M A B V B W B W B M A P B P B B MR Shared Surface MR Shared Surface

7 140 Jan MR Shared Surface Fig. 2 MR Shared Surface. 3.3 (1) (2) 2 / 4.1 MR Shared Surface 2 MR Shared Surface MR Shared Surface MR MR MR 4.2 MR MR MR CANON MR Platform 10) MR- Platform MR HMD 4.3 CG L X X X X X L 4.3.2

5 y 1 1 h 6 h 7 1 1 h 0 h 7 λ 4 2 4 2 3 2 3

8 Vol. 48 No. 1 MR x 2 h 0 h 1 h 2 x 1 λ y 2 = h 3 h 4 h 5 y 1 1 h 6 h h 0 h 7 λ Fig. 3 MR Shared Xylophone X X R

9 142 Jan Fig. 4 Transformation from flat to cylinder. AB L A B X x x P P AP XP A P X P d l AB L A P θ θ θ = π l L A O x l P P y d X X d l X A ( R, 0, 0) y θ P P y d d l L R π X X X X 4 5 X X R CA L CA CX AB P P CX 5 Fig. 5 Transformation from flat to cone. C X d AB θ AP α A P β θ θ = π R L β β = (α π ) θ = α L R A C α P P CP C d X X d α X A( R, 0, 0) y β P P C P C d d α L R π X X X X

10 Vol. 48 No. 1 MR 143 2D 3D cm a b 6 3 Fig. 6 The type of painting motion. c 2D MR 3D

144 Jan. 2007 2 Table 2 The combination of virtual sheets. 3 Table 3 The population. 8 1 Fig. 8 Result 1.

11 144 Jan Table 2 The combination of virtual sheets. 3 Table 3 The population. 8 1 Fig. 8 Result Fig. 7 The scene of using evaluation system A B % 100% 2% /4 HMD

12 Vol. 48 No. 1 MR : Fig. 9 Result 2. 96% % 2 3D 2D 3D % MR MR

13 146 Jan MR Shared Surface 11) 13) 3.3 (3) 1) Watabe,K.,Sakata,S.,Maeno,K.,Fukuoka, H. and Ohmori, T.: Distributed Multiparty Desktop Conferencing System: MERMAID, Proc. CSCW 90, pp (1990). 2) Emmanuel,F.andMarten,S.:DIVE:Ascalable network architecture fordistiributedvirtual environments, Distributed Systems Engineering Journal (special issue on Distributed Virtual Environments), Vol.5, No.3, pp (1998). 3) Fukui, K., Miyata, A. and Okada, K.: Implementation of Avatar Mediated Communication Environment with Thinking Awareness, Joint 2nd International Conferenceon Soft Computing and Intelligent Systems and 5th International Symposiumon Advanced Intelligent Systems (SCIS&ISIS2004 ) THE-7, pp (2004). 4) MR 2006, pp (2006). 5) Ishii, H.: Tangible Bits: User Interface Design towards Seamless Integration of Digital and Physical Worlds (in Japanese), IPSJ Magazine, Vol.43, No.3, pp (2002). 6) Brave, S., Ishii, H. and Dahley, A.: Tangible Interfaces for Remote Collaborationand Communication, Proc.CSCW 98, pp , ACM Press (1998). 7) Vol.6, No.3, pp (2004). 8) ComAdapter VR Vol.9, No.2, pp (2004). 9) Sekiguchi,D.,Inami,M.,Kawakami,N.and Tachi, S.: The design of internet-based Robot- PHONE, Proc. ICAT 04, pp (2004). 10) Uchiyama, S., Takemoto, K., Satoh, K., Yamamoto, H. and Tamura, H.: MR Platform: A basic body on which mixed reality applications are built, Proc. IEEE and ACM Int. Symposium on Mixed and Augmented Reality (IS- MAR 2002 ), pp (2002). 11) Elber, G.: Model Fabrication using Surface Layout Projection, CAD, Vol.27, No.4, pp (1995). 12) Pottmann, H. and Farin, G.: Developable rational Bezier and Bspline surfaces, CAGD, Vol.12, No.5, pp (1995). 13) Hoschek, J.: Approximation of surfaces of revolution by developable surfaces, CAD, Vol.30, No.10, pp (1998). ( ) ( )

14 Vol. 48 No. 1 MR GN VR IEEE ACM CSCW MBL BCC VR CS VR IEEE SAINT 04 IEEE ACM 2006

IPSJ SIG Technical Report Vol.2009-DPS-141 No.20 Vol.2009-GN-73 No.20 Vol.2009-EIP-46 No /11/27 1. MIERUKEN 1 2 MIERUKEN MIERUKEN MIERUKEN: Spe

IPSJ SIG Technical Report Vol.2009-DPS-141 No.20 Vol.2009-GN-73 No.20 Vol.2009-EIP-46 No /11/27 1. MIERUKEN 1 2 MIERUKEN MIERUKEN MIERUKEN: Spe 1. MIERUKEN 1 2 MIERUKEN MIERUKEN MIERUKEN: Speech Visualization System Based on Augmented Reality Yuichiro Nagano 1 and Takashi Yoshino 2 As the spread of the Augmented Reality(AR) technology and service,