1,a) 2 1,b) 2015 10 1, 2016 2 23 DLNA Digital Living Network Alliance ECHONET Lite ihac intuitive Home Appliance Control ihac AR Augmented Reality DLNA ECHONET Lite A Proposal of Intuitive Home Appliance Control System without Considering Differences in Protocols Rina Umeyama 1,a) Takeshi Masuda 2 Hidekazu Suzuki 1,b) Received: October 1, 2015, Accepted: February 23, 2016 Abstract: Recently a variety of information home appliances that can be controlled via a network are spreading widely. There are multiple communication standards for information home appliances, such as Digital Living Network Alliance (DLNA) and ECHONET Lite. Therefore, a user has to properly use control applications according to a device which is desired to be operated. Moreover, a user is capable of acquiring only model number information of devices found by their communication protocols. Consequently, it is difficult to intuitively select a device which a user wants to operate and distinguish the device from multiple devices of the same model number installed in a home network. This paper proposes the intuitive Home Appliance Control (ihac) system that can intuitively control these devices without being aware of the differences in protocols. By integrating the ihac framework that absorbs differences between communication standards into the control application, the user can control all home appliances which have different standards with only one control application. In addition, the proposed system provides intuitive control not depend on the character information with an augmented reality technology. Keywords: information home appliance, control, DLNA, ECHONET Lite 1 Graduate School of Science and Technology, Meijo University, Nagoya, Aichi 468 8502, Japan 2 Faculty of Science and Technology, Meijo University, Nagoya, Aichi 468 8502, Japan a) rina.umeyama@ucl.meijo-u.ac.jp b) hsuzuki@meijo-u.ac.jp 1. c 2016 Information Processing Society of Japan 84
DLNA Digital Living Network Alliance [1] ECHONET Lite [2] DLNA Bluray AV Audio Visual ECHONET Lite PUCC Peerto-peer Universal Computing Consortium [3], [4] AR Augmented Reality EVANS3 [5], [6] PUCC PUCC PUCC DLNA ECHONET Lite PUCC HGW EVANS3 LED AR AR EVANS3 LED 1 ihac intuitive Home Appliance Control ihac API HGW UI AR HTML5 UI HTML5 UI 2 3 4 5 6 2. 2.1 PUCC PUCC DLNA ECHONET Lite ZigBee DLNA ECHONET Lite PUCC 1 *1 PUCC Web HGW HGW HGW Web HGW PUCC Web HGW PUCC Web Web PUCC HGW Web 2.2 EVANS3 EVANS3 AR AR 1 PUCC Fig. 1 Overview of system using PUCC. *1 [4] c 2016 Information Processing Society of Japan 85
2 EVANS3 Fig. 2 Architecture of EVANS3. LED LED AR LED LED 2 *2 EVANS3 LED AR AR LED 1 3. 3.1 ihac 4 (1) 3 ihac *2 [6] (2) IP (3) UI UI HTML5 CSS Cascading Style Sheets UI [7] CSS (4) (2) (3) HTML AR UI AR AR AR 3.2 3 ihac ihac UI ihac 3.2.1 UI UI c 2016 Information Processing Society of Japan 86
HTML5 CSS HTML AR AR HTML AR AR AR UI ihac AR ihac AR ihac 3.2.2 ihac ihac API UI API API UI UI UI ihac TV AR UI UI API 3.2.3 ihac 3 ECHONET Lite DLNA ECHONET Lite DLNA ihac Fig. 3 3 Configuration of proposed system. 3.3 3.3.1 DLNA ECHONET Lite 4 ihac 4 Fig. 4 Device search sequence. c 2016 Information Processing Society of Japan 87
Fig. 5 5 Unregistered device registration sequence. 6 Fig. 6 Device control sequence. ihac UI ihac ihac ihac DLNA ECHONET Lite ihac UI AR HTML AR ihac AR 3.3.3 UI 3.3.2 3.3.2 5 ihac AR HTML UI DLNA TV ihac ihac AR HTML UI UI ihac ihac 3.3.3 DLNA 6 ihac HTML AR ihac UI ihac ihac DLNA 3.4 7 AR AR AR 7 c 2016 Information Processing Society of Japan 88
7 Fig. 7 Image of operation screen. DVD TV HTML 4.2 HTML DLNA DMS Digital Media Server DMR Digital Media Renderer DMS DMR 4. 4.1 ihac ihac ipad ihac UI HTML DLNA ECHONET Lite 8 ihac ihac API API API API API API API ON/OFF API API Objective-C++ API 8 Fig. 8 ihac Configuration of ihac application. DLNA Platinum * 3 ECHONET Lite KAIT-4S-EZ * 4 ihac SQLite FMDB *5 DLNA ECHONET Lite ID ID ihac UI UI ihac UI UI ihac ihac UI JSON UI JSON HTML5 CSS JSON HTML CSS Web ID 4.2 9 *3 http://www.plutinosoft.com/platinum *4 https://smarthouse-center.org/sdk/download/form/18 *5 https://github.com/ccgus/fmdb c 2016 Information Processing Society of Japan 89
ipad 1 5 ECHONET Lite ECHONET Lite MoekadenRoom [8] 9 Fig. 9 Environment of operation verification. 1 Table 1 Details of devices connected to the network. QNAP-NAS * 6 BDZ-EW1100 * 7 BRAVIA KDL-32W700B * 7 TV * 8 * 8 10 Fig. 10 Operation verification of device search. 1 10 5 UI DLNA ECHONET Lite 10 11 DLNA TV 3.1 1 23 HTML 5. 5.1 2 DLNA UI 5.1.1 DLNA DMS 5 DLNA DMR1 2 DMS 3 2 DMR 1 Linux PC MediaTomb [9] DMS 2 BDZ-EW1200 BDZ-EW1200 2 Table 2 Installation room and device type of controllable devices. Fig. 11 11 Operation verification of air conditioner. *6 QNAP *7 SONY *8 MoekadenRoom QNAP-NAS DMS BDZ-EW1100 DMS BDZ-EW1200 DMS BRAVIA KDL-32W700 DMR TwonkyMedia [QNAP-NAS] DMS BDZ-EW1200 DMS c 2016 Information Processing Society of Japan 90
12 Fig. 12 Average number of times of the application operations. 13 Fig. 13 Average operating time the application. BRAVIA KDL-32W700 20 10 5.1.2 12 13 11 6 22.6 14.6 45.5% 35.4% 5.1.3 5 25 11 1 AR 5.1.4 ihac (1) (2) ihac (1) (2) TV ON/OFF ihac 2 1 ibeacon [10] BLE Bluetooth Low Energy BLE 2 SLAM Simultaneous Localization and Mapping [11] AR SLAM c 2016 Information Processing Society of Japan 91
3 Table 3 Comparison with existing researches. ihac PUCC EVANS3 HGW UI ECHONET Lite 45.5% 35.4%AR JSPS 15K15987 5.2 3 ihac PUCC EVANS3 ihac PUCC PUCC PUCC PUCC HGW ihac API HGW ihac AR AR AR HTML5 CSS UI UI 6. ihac ihac HGW AR HTML5 UI DLNA [1] DLNA, Digital Living Network Alliance (online), available from http://jp.dlna.org/ (accessed 2014-05-01). [2] ECHONET CONSORTIUM, ECHONET CONSOR- TIUM (online), available from http://www.echonet.gr. jp/ (accessed 2014-05-01). [3] Ishikawa, N.: PUCC Activities on Overlay Networking Protocols and Metadata for Controlling and Managing Home Networks and Appliances, Proc. IEEE, Vol.101, No.11, pp.2355 2366 (2013). [4] Web & CDS Vol.2, No.1, pp.10 19 (2012). [5] Mihara, S., Kawai, K., Shimada, H. and Sato, K.: EVANS 3: Home Appliance Control System with Appliance Authentication Framework Using Augmented Reality Technology, Proc. 10th Annual IEEE Consumer Communications and Networking Conference (CCNC ), pp.849 850 (2013). [6] Mihara, S., Sakamoto, A., Shimada, H. and Sato, K.: Augmented Reality Marker for Operating Home Appliances, Proc. 9th IEEE/IFIP International Conference on Embedded and Ubiquitous Computing (EUC ), pp.372 377 (2011). [7] 27 No.A1-2 (2015). [8] MoekadenRoom Kadecot http://kadecot.net/blog/1479/ 2015-05-19 [9] Free UPnP MediaServer, MediaTomb (online), available from http://mediatomb.cc/ (accessed 2015-02-02). [10] ios: Understanding ibeacon, Apple Inc. (online), available from http://support.apple.com/kb/ht6048 (accessed 2015-05-19). [11] Davison, A.J.: Real-Time Simultaneous Localisation and Mapping with a Single Camera, Proc. 9th IEEE International Conference on Computer Vision (ICCV ), Vol.2, pp.1403 1410 (2003). c 2016 Information Processing Society of Japan 92
2015 2016 NTT 2004 2009 2008 2010 2015 IEEE ACM c 2016 Information Processing Society of Japan 93