1 1 2 2 DVD LED A Networked Home Appliance Control Method Using Augmented Reality Kenya Sato, 1 Akira Sakamoto, 1 Shinya Mihara 2 and Hideki Shimada 2 Many kinds of networked home appliances connected to each other with standardized control functions are recently appeared. As the number of appliances in a home increases, unlike general infrared remote control, it would be difficult to specify a certain device to be controlled because a user can simultaneously operate all devices with a wireless controller in a home. In this paper, we propose a network-connected home appliance cooperation method to control appliances (e.g. search and play contents on a home network) effectively with augmented reality technology using a smart phone that includes a camera, touch panel, and network functions, and verify its effectiveness. In addition, we discuss the current augmented reality technology issues, and propose a new visible marker method with blinking LED to address the issues. 1. Children s Room Children s Room Home Network Bed Room NetworkController Living Room Dining Room Bath Room 1 Fig. 1 Home Network Architecture. PC DVD DLNA 1) 1 1, Department of Information and Computer Science, Graduate School of Engineering, Doshisha University 2, Department of Information Systems Design, Faculty of Science and Engineering, Doshisha University 1
2) 2. DLNA DLNA (Version 1.5) 2 (DMC1) (SSDP) (DMS1, DMS2) (DMR1, DMR2, DMR3) (UDP) DMC1 3 DMS2 DMC1 DMS1 (HTTP) DMS1 DMR2 (RTP) DMR2 3. DLNA 4 DMC1 DMS1 DMS2 DMR1 DMR2 DMR3 Search device (SSDP multicast) 200 OK (UDP Unicast) GET service_description.xml (HTTP request) 200 OK (HTTP response) GET service_description.xml (HTTP request) 200 OK (HTTP response) GET content.lpcm (HTTP request) 200 OK (HTTP response) Content stream data (RTP) 2 DLNA Fig. 2 Message Seqeucne for DLNA Network. 4. 4.1 5 EVANS (Embodied 2
DMS (Digital Media Server) I m now in the living room. So contents should be displayed on this DMR. Is this DMR 1, 2, or 3? DMA1 DMR 1 in bed room DMR 2 in dining room System Architecture Control the Device, and Get the Device Information. Display the Device Information and User Interface using AR. DMA2 DMA3 Control Module AR Module DMC (Digital Media Controller) DMR 3 in living room UPnP 3 Home Appliance I / O Device User Fig. 3 Control Issue for Multi-devices. TV Speaker Touchscreen Display Control the Device HDD/DVD Recorder Webcam 5 Fig. 5 System Architecture. R Web AR AR 4 Fig. 4 Example of Controlling Device. Visualization with Augmented Reality for Networked Systems) 4) Web AR ( ) AR AR Web AR DLNA DLNA DLNA UPnP 3) UPnP DLNA 4.2 AR ARToolKit 5) 3
DLNA CyberLink for C++ 1 Simple Directmedia Layer (SDL) 2 Freetype Graphic Library (FTGL) 3 OS Microsoft Windows Vista Ultimate PC Intel Core2 Quad 2.33GHz, 4GB Memory 5. 5.1 PC 6 7 PC A (Let s note CF-R6) PC B (DELL Inspiron Mini 10) PC DMS DLNA Media Server (TVersity DiXiM) PC B AR PC A PC B AR DLNA AR Search PC A PC B DMS AR 7 PC B AR. AR 50 100 8 5.2 DMS DMS DLNA DMS 1 1 http://www.cybergarage.org/cgi-bin/twiki/view/main/cyberlinkforcc 2 http://www.libsdl.org/ 3 http://homepages.paradise.net.nz/henryj/code/index.html 6 AR 1(PCA) Fig. 6 Display of the Device Information using AR 1 (PC A). A R の合成表示 7 AR 2 (PC B) Fig. 7 Display of the Device Information using AR 2 (PC B). 音量調整 : パラメータ 50 音量調整 : パラメータ 100 8 AR Fig. 8 Volume Control using AR. 20 2 DMS 50 100 150 20 4
1 DMS Table 1 DMS Response Time. (msec) 0.33 0.39 on off LED Brink Patterns 2 Table 2 Elapsed Time for Contents Display. (kbyte) (msec) (msec) 50 42.85 2.08 150 120.5 4.2 200 223.8 5.65 6. 6.1 1 1 LED 1 1 AV (a) Image Marker for ARToolKit (b) LED Visible Marker 9 Fig. 9 Marker Samples for Augmented Reality. AR ARToolKit ID ( ) 9(a) ARToolKit 9(b) LED ID ( ) 6)7) 6.2 LED LED LED 6.3 6.4 5
ID LED ID MAC ( IP ) 6.5 2 0 3 LED 7. 1) DLNA: Digital Living Network Alliance, DLNA Networked Device Interoperability Guidelines (2006). 2) R. T. Azuma: A Survey of Augmented Reality, Teleoperators and Virtual Environments, Vol.6, No.4, pp.255 258 (1997). 3) UPnP: UPnP Forum(online), available from http://upnp.org/ (accessed 2010-05-16). 4) : EVANS:, pp.2085 2090 (2010). 5) H. Kato, M. Billinghurst, B. Blanding, and R. May: ARToolKit, Technical Report, Hiroshima City University (1999). 6),,,,, AR, 9, Vol.4, pp.361-362 (2010). 7) ( ):, 2010-174383 (2010). AR LED PC 6