Vol. 48 No. 1 Jan. 2007 MR, MR A Sharing Method of Real Objects Differ in Syntax each other Based on a Virtual Sheet between Remote Mixed Reality Spaces Kazuhiro Miyasa, Yuichi Bannai,, Yuji Suzuki, Hidekazu Tamaki, Hiroshi Shigeno and Ken-ichi Okada In remote collaboration based on real objects, the difference of the space structure between the remote real spaces should be considered. In conventional method it is difficult for users to collaborate based on the real objects which differ in syntax each other. To address this issue, we focus attention on a sticker or a sheet which can be attached on a physical object according to its surface. And as a method which Mixed Reality (MR) technology is combined with it, we propose an information sharing method of semantics which each remote user interacts with a real object, by using virtual sheet which can be attached to each real object according to its surface and can absorb the difference in syntax between these real objects. Then we implemented a prototype system which has pointing function and conducted experimentation. As a result it proved that it is possible to share the information of the interactions without losing the meaning between the real objects which differ in syntax each other. 1. 1) 2),3) Department of Information & Computer Science, Faculty of Science & Technology, Keio University Environment New Business Center, Canon Inc. 134
Vol. 48 No. 1 MR 135 4) MR MR Shared Surface 2. 2D GUI 5) Ishii 5),6) PsyBench 6) XY PsyBench InTouch 6) PsyBench 3 2 Lazy Susan 7) In- Touch
136 Jan. 2007 ComAdapter 8) TV 2 2 TV TV 1 Sekiguchi RobotPHONE 9) MR 4) 3. 3.1 1 1 1 Table 1 Classification of a pair of real objects.
Vol. 48 No. 1 MR 137 2 1 Yes 3 2 Yes 4 3 Yes 2D 3D 3D 2D 3.2 MR 3D 3D 2D MR MR
138 Jan. 2007 2 MR 3.3 3 (1) (2) (3) / 3 3.4 2 1 1 V A V B V S A B X A X B
Vol. 48 No. 1 MR 139 1 Fig. 1 Information sharing mechanism. P A A W A M A P B M A W A A V A X A X 1 A M A V S P B X B M A B V B W B W B M A P B P B B 2 3.5 2 1 1 1 1 2 2 3.6 4. MR Shared Surface MR Shared Surface 2 2 2 2
140 Jan. 2007 2 MR Shared Surface Fig. 2 MR Shared Surface. 3.3 (1) (2) 2 / 4.1 MR Shared Surface 2 MR Shared Surface MR Shared Surface MR MR 2 2 2 2 MR 4.2 MR MR MR CANON MR Platform 10) MR- Platform MR HMD 4.3 CG 4.3.1 3.2 L X X X X X L 4.3.2
Vol. 48 No. 1 MR 141 4.3.3 3.5 1 2 3.1 2 2 x 2 h 0 h 1 h 2 x 1 λ y 2 = h 3 h 4 h 5 y 1 1 h 6 h 7 1 1 h 0 h 7 λ 4 2 4 2 3 2 3 Fig. 3 MR Shared Xylophone. 4.3.4 3 2 2 4.3.1 4 X X R
142 Jan. 2007 4 Fig. 4 Transformation from flat to cylinder. AB L A B X x x P P AP XP A P X P d l AB L A P θ θ θ = π l L A O x l P P y d X X d l X A ( R, 0, 0) y θ P P y d d l L R π X X X X 4 5 X X R CA L CA CX AB P P CX 5 Fig. 5 Transformation from flat to cone. C X d AB θ AP α A P β θ θ = π R L β β = (α π ) θ = α L R A C α P P CP C d X X d α X A( R, 0, 0) y β P P C P C d d α L R π X X X X 4.3.5 4.3.4
Vol. 48 No. 1 MR 143 2D 3D 5. 5.1 5.2 2 1 1 1 6cm 0 6 3 3 a b 6 3 Fig. 6 The type of painting motion. c 2D MR 3D 2 4.3 2 2 4 1 2
144 Jan. 2007 2 Table 2 The combination of virtual sheets. 3 Table 3 The population. 8 1 Fig. 8 Result 1. 15 14 1 21 25 7 Fig. 7 The scene of using evaluation system. 1 1 5 1 2 10 3 7 A B 5.3 8 1 8 98% 100% 2% 5.2 8 1/4 HMD 640 480
Vol. 48 No. 1 MR 145 9 2: Fig. 9 Result 2. 96% 15 10 5.2 6 150 6 9 2 9 100% 2 3D 2D 3D 1 1 0.92 92% 150 12 1 1 2 6. MR MR
146 Jan. 2007 MR Shared Surface 11) 13) 3.3 (3) 1) Watabe,K.,Sakata,S.,Maeno,K.,Fukuoka, H. and Ohmori, T.: Distributed Multiparty Desktop Conferencing System: MERMAID, Proc. CSCW 90, pp.27 38 (1990). 2) Emmanuel,F.andMarten,S.:DIVE:Ascalable network architecture fordistiributedvirtual environments, Distributed Systems Engineering Journal (special issue on Distributed Virtual Environments), Vol.5, No.3, pp.91 100 (1998). 3) Fukui, K., Miyata, A. and Okada, K.: Implementation of Avatar Mediated Communication Environment with Thinking Awareness, Joint 2nd International Conferenceon Soft Computing and Intelligent Systems and 5th International Symposiumon Advanced Intelligent Systems (SCIS&ISIS2004 ) THE-7, pp.116 120 (2004). 4) MR 2006, pp.140 133 (2006). 5) Ishii, H.: Tangible Bits: User Interface Design towards Seamless Integration of Digital and Physical Worlds (in Japanese), IPSJ Magazine, Vol.43, No.3, pp.222 229 (2002). 6) Brave, S., Ishii, H. and Dahley, A.: Tangible Interfaces for Remote Collaborationand Communication, Proc.CSCW 98, pp.169 178, ACM Press (1998). 7) Vol.6, No.3, pp.295 305 (2004). 8) ComAdapter VR Vol.9, No.2, pp.169 178 (2004). 9) Sekiguchi,D.,Inami,M.,Kawakami,N.and Tachi, S.: The design of internet-based Robot- PHONE, Proc. ICAT 04, pp.223 228 (2004). 10) Uchiyama, S., Takemoto, K., Satoh, K., Yamamoto, H. and Tamura, H.: MR Platform: A basic body on which mixed reality applications are built, Proc. IEEE and ACM Int. Symposium on Mixed and Augmented Reality (IS- MAR 2002 ), pp.246 253 (2002). 11) Elber, G.: Model Fabrication using Surface Layout Projection, CAD, Vol.27, No.4, pp.283 291 (1995). 12) Pottmann, H. and Farin, G.: Developable rational Bezier and Bspline surfaces, CAGD, Vol.12, No.5, pp.513 531 (1995). 13) Hoschek, J.: Approximation of surfaces of revolution by developable surfaces, CAD, Vol.30, No.10, pp.757 763 (1998). ( 18 5 29 ) ( 18 11 2 )
Vol. 48 No. 1 MR 147 2004 2006 2006 1978 1980 1988 1980 GN VR 2005 1990 1997 1998 IEEE ACM CSCW MBL BCC VR CS 1996 2001 40 VR IEEE SAINT 04 IEEE ACM 2006