PRMUMAR2000.dvi

Size: px

Start display at page:

Download "PRMUMAR2000.dvi"

たかとしのじま
4 years ago
Views:

1 y z y z y y, 305{8568 1{1{4 z, 169{8555 3{4{1 y fkurata, kurita, sakaueg@etl.go.jp, z fkourogi, muraokag@muraoka.info.waseda.ac.jp LAN PC Toward a Context-Aware Wearable Vision System: Implementation of Face Detection/Classication and Hand-Mouse Takeshi Kurata y, Masakatsu Kourogi z, Takio Kurita y, Yoichi Muraoka z and Katsuhiko Sakaue y y Electrotechnical Laboratory, 1{1{4 Umezono, Tsukuba, Ibaraki, JAPAN z School of Sci. & Eng., Waseda University, 3{4{1 Ohkubo, Shinjuku, Tokyo, 169{8555 JAPAN Abstract This paper describes a wearable vision system that we have been developing. In this system, a miniature camera is worn on the head of the wearer. Incoming images are transmitted by wireless LAN and processed by a PC-cluster, so the system enables us to implement various image processing modules. In addition, this paper introduces the implementation of a face detection/classication that is useful in applying this system to context-aware applications and also introduces a Hand-Mouse as a wearable input device. Key words wearable vision system, context-awareness, face detection, face classication, human interface

2 1 3 [18][20] ( )GPS PHS LAN [7][11][14][15] [18] [19][25] [6] ( ) [12] 1 2 [22] Bluetooth RF [26] [5][8] [19][23][27][28] 3 2 [14][15] 3 [16][17] PC LAN RWC [1] [14][15] CCD ( IK-SM43H f=4mm) (MicroOptical C1 Clip-On Display[3][24])

CCD camera Input video frames Output images 2000RWC [1] 3 5kg 3 Head Worn

11b LAN(11Mbps) LAN PC PC PC PC HWD RF )* +, 100M!

Windows98 CPU: Mobile PentiumIII- 500MHz) z PCMCIA ( LSI MSVCC03) IEEE802.

3 CCD camera Input video frames Output images 2000RWC [1] 3 5kg 3 Head Worn Display A remote PC-cluster A wearable headset 1: CCD PC JPEG IEEE b LAN(11Mbps) LAN PC PC PC PC HWD RF )* +, 100M!VGA"# RF VGA$NTSC % & '( 3: 2: y PC(DELL LATITUDE CPx- H500GT OS: Windows98 CPU: Mobile PentiumIII- 500MHz) z PCMCIA ( LSI MSVCC03) IEEE802.11b(11Mbps) LAN( NCR WaveLAN Turbo 11Mb) JPEG 1/10 PC 100M 5 PC(OS: Linux SMP CPU: Dual PentiumIII 500MHz(2 ) Dual PentiumII 450MHz(3 )) 1 y z Handkey Tweddler[2]) PC PC PC PVM [4] PC Win32 [ ] PC PC PC PC 67msec. 15fps) 300msec. 3 Log-Polar

4 JPEG? M ¹Ý û Î JPEGöW JPEG? Š at M z M z½) JPEG? Œ t ] r M 4: ¹Ý JPEG? 340 Gó0 M [9][10] 5 Log-Polar [9][10] y Input Image Log-Polar Image Spectral features ρ θ x Cartesian coordinates θ ( z,θ ) z = log( ρ) Log-Polar coordinates 5: Log-Polar I 1 I 2 I 3 [21] (1) RGB I 1 I 1 I 2 I 3 = R+G+B 3 = R0B 2 = 2G0R0B 4 (1) 7 I 2 I 3 I 2 ;I 3 Klinker [13]RGB 2 I 1 I 2 I 3 7 I 1 I 2 ;I (ii) (i) RGB I 1 I 2 I 3

5 6: (ii) (iii) i i 3 1 i 2 Matte cluster Highlight cluster 7: Log-Polar , 81%(287/353) (95%) msec.(8-10fps) msec. 1

x ft f1 f1 40% f1 ft 40% 70 10 9 bi bc 80%

6 8: bi bc bo ft f1 x bi bc bi bc bc bo bo x ft f1 f1 40% f1 ft 40% bi bc 80% bo 40% bc bi; bc; bo 16 ft f (bc 30,32,34,36 )

5 (614 67 0 ) 7 (624 616 68 0 ) 33msec.(30fps) 100msec. 10fps) 350msec. ft bi f1 bo bc 10: 5 RWC [1] 2000 RWC, http://www.rwcp.or.jp/events/rwc2000/. [2] Handykey, http://www.handykey.com.

7 5 ( ) 7 ( ) 33msec.(30fps) 100msec. 10fps) 350msec. ft bi f1 bo bc 10: 5 RWC [1] 2000 RWC, [2] Handykey, [3] MicroOptical, [4] PVM: Parallel Virtual Machine, [5] Wearable Hardware and Software: Keyboards, projects/wearables/keyboards.html. [6],,, :, PRMU97{196, pp. 1{6 (1998). [7] Aoki, H., Schiele, B. and Pentland, A.: Realtime Personal Positioning System for Wearable Computers, Proc. 3rd Int'l Symp. on Wearable Computers (ISWC'99), pp. 37{43 (1999). [8], : \ ",, Vol. 40, No. 2, pp. 389{398 (1999). [9],, : Log-Polar { {, PRMU99{110, pp. 69{76 (1999). [10] Hotta, K., Kurita, T. and Mishima, T.: Scale Invariant Face Recognition Method Using Spectral Features of Log-Polar Image, Proc. SPIE99, Applications of Digital Image Processing XXII (1999). [11],,, :, PRMU99{124, pp. 165{172 (1999). [12] Jebara, T., Schiele, B., Oliver, N. andpentland, A.: DyPERS: Dynamic Personal Enhanced Reality System, Technical Report 463, M.I.T Media Lab. Perceptual Computing Section (1998). [13] Klinker, G., Shafer, S. and Kanade, T.: Using a Color Reection Model to Separate Highlights from Object Color, Proc. ICCV87, pp. 145{150 (1987). [14] Kourogi, M., Kurata, T., Sakaue, K. and Muraoka, Y.: A Real-time Panorama-Based Technique for Annotation Overlay on Video Frames, Web Proc. 2nd Int'l Workshop on Augmented Reality (IWAR), WebProceedings/Kourogi/. [15],,, :, 5, pp. 17{24 (1999). [16] Kurata, T., Fujiki, J., Kourogi, M. and Sakaue, K.: A Fast and Robust Approach to Recovering Structure and Motion from Live Video Frames, Proc. CVPR 2000 (2000). (to appear). [17],,, : 3, 13, pp. 103{104 (1999). [18] Lamming, M. and Flynn, M.: \Forget-me-not" Intimate Computing in Support of Human Memory, Technical Report EPC , RXRC Cambridge Laboratory (1994).

9: [19] Mann, S.: Wearable Computing: A First Step Toward Personal Imaging, Computer, Vol.

13, pp. 224{241 (1980). [22] Rekimoto, J., Ayatsuka, Y. and Hayashi, K.

2nd Int'l Symp. on Wearable Computers (ISWC'98), pp. 68{75 (1998).

and Aquilino, P.: Eyeglass-Based Systems for Wearable Computaing, Proc. 1st Int'l Symp.

, Levine, J., Healey, J., Kirsch, D., Picard, W. R. and Pentland, A.

Perceptual Computing Section (1997). [26] Starner, T., Schiele, B. and Pentland, A.

on Wearable Computers (ISWC'98), pp. 50{57 (1998). [27] Starner, T., Weaver, J.

8 9: [19] Mann, S.: Wearable Computing: A First Step Toward Personal Imaging, Computer, Vol. 30, No. 2, pp. 25{ 32 (1997). [20],, :, RWC '95, pp. 230{238 (1995). [21] Ohta, Y., Kanade, T. and Sakai, T.: Color Information for Region Segmentation, Computer Graphics and Image Processing, Vol. 13, pp. 224{241 (1980). [22] Rekimoto, J., Ayatsuka, Y. and Hayashi, K.: Augment-able Reality: Situated Communication through Physical and Digital Spaces, Proc. 2nd Int'l Symp. on Wearable Computers (ISWC'98), pp. 68{75 (1998). [23],, : Wearable Computer, VR 4, pp. 415{416 (1999). [24] Spitzer, M. B., Rensing, N. M., McClelland, R. and Aquilino, P.: Eyeglass-Based Systems for Wearable Computaing, Proc. 1st Int'l Symp. on Wearable Computers (ISWC'97), pp. 48{51 (1997). [25] Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, W. R. and Pentland, A.: Augmented Reality Through Wearable Computing, Technical Report 397, M.I.T Media Lab. Perceptual Computing Section (1997). [26] Starner, T., Schiele, B. and Pentland, A.: Visual Contextual Awareness in Wrearable Computing, Proc. 2nd Int'l Symp. on Wearable Computers (ISWC'98), pp. 50{57 (1998). [27] Starner, T., Weaver, J. and Pentland, A.: A Wearable Computer Based American Sign Language Recognizer, Proc. 1st Int'l Symp. on Wearable Computers (ISWC'97), pp. 130{137 (1997). [28] Vardy, A., Robinson, J. and Cheng, L.-T.: The Wrist- Cam as Input Device, Proc. 3rd Int'l Symp. on Wearable Computers (ISWC'99), pp. 199{202 (1999).

IPSJ SIG Technical Report Vol.2012-HCI-149 No /7/20 1 1,2 1 (HMD: Head Mounted Display) HMD HMD,,,, An Information Presentation Method for Weara

IPSJ SIG Technical Report Vol.2012-HCI-149 No /7/20 1 1,2 1 (HMD: Head Mounted Display) HMD HMD,,,, An Information Presentation Method for Weara 1 1,2 1 (: Head Mounted Display),,,, An Information Presentation Method for Wearable Displays Considering Surrounding Conditions in Wearable Computing Environments Masayuki Nakao 1 Tsutomu Terada 1,2 Masahiko