顔認識の為のリアルタイム特徴抽出

Size: px

Start display at page:

Download "顔認識の為のリアルタイム特徴抽出"

かずきなかじゅく
8 years ago
Views:

4 DNA 1990 DNA 100 DNA NEC NTT [1][2] 100 WDM CCD 3

5 OS CPU : Pentium4 1.5GHz Memory : 512MB Camera : CMOS USB1.1 : CCD PCI : FinePix50i USB1.1 : BT878 PCI : IEEE1394 PCI Microsoft Visual Studio 6.0 Enterprise DirectX SDK 8.1 OS Microsoft Windows XP Professional OS Windows OS 4

6 DNA VoiceGATE FacePass DNA NTT DNA IC NEC SecureFinger 5

7 6 2.2 DNA 2.2 DNA...

8 ( 2.1) 2.1 7

9 .. RGB 3 RGB HSV USB CCD USB PC WDM CCD. 100% 8

10 . Windows Driver Model (WDM) [3].. WDM 1992 Video for Windows [4] WDM 32 DirectShow(3.13 ) DVD/MPEG ( ) (VBI) (VPE) Windows WDM WDM WDM DirectShow WDM DirectShow WDM DirectShow Windows (DDK) KsTune.ax KsXbar.ax KsCap.ax USB 1394 DV TV WDM DirectShow 3.2 9

11 3.2 WDM Video Capture Architecture 3.2 KsTune.ax KsXbar.ax KsCap.ax DirectShow KsTune.ax KsXbar.ax KsCap.ax ( 3 ).. DirectX Microsoft [5] SDK(Software Development Kit) DirectX DirectX COM(Component Object Model) COM DirectX Visual C++ Visual Basic DirectX DirectX

12 3.1 DirectX [5] DirectXGraphics API DirectX7 DirectDraw Direct3D DirectXAudio DirectInput DirectPlay DirectShow DirectSetup API DirectX7 DirectSound DirectMusic API DirectX API DirectShow.. DirectShow [5] DirectShow DirectShow 3 DirectShow DirectShow DirectShow DirectShow 3.3 DirectShow 11

13 3.3 DirectShow 3.3 TV SMPTE.. USB [6] 3.4 Pin Pin Pin

14 DirectShow 5 ( IGraphBuilder ) ( IBaseFilter ) ( IBaseFilter ) ( ISampleGrabber ) ( IMediaControl ) USB BYTE OnTimer USB DirectShow 3.2 DirectShow #include <dshow.h> #include <streams.h> #include <qedit.h> 5 DirectShow ( IGraphBuilder ) m_pgraph ( IBaseFilter ) psrc ( IBaseFilter ) pgrabber ( ISampleGrabber ) m_pgrabberinterface ( IMediaControl ) pmediacontrol 13

15 CoCreateInstance( CLSID_FilterGraph ) 2. ICreateDevNum, IEnumMoniker, IMoniker, IBaseFilter 3. ICaptureGraphBuilder CoCreateInstance( CLSID_CaptureGraphBuilder2 ) 3-2. ICaptureGraphBuilder2::SetFilterGraph((IFilterGraph)pGraph) 4. IFileSinkFilter 4-1. ICaptureGraphBuilder2::SetOutputFileName(...) 4-2. ICaptureGraphBuilder2::RenderStream(...) 5. IMediaControl::Run() ICreateDevEnum CoCreateInstance 2-2. IEnumMoniker ICreateDevEnum::CreateClassEnumerator (,...) 2-3. IMoniker IEnumMoniker::Next 2-4. IBaseFilter IMoniker::BindToObject(..., (void **)psrc) IEnumFilters IFilterGraph::EnumFilters 2. IBaseFilter IEnumFilters::Next(1, (IBaseFilter **), (ULONG *)) 3. FILTER_INFO IBaseFilter::QueryFilterInfo(FILTER_INFO *) DirectShow SampleGrabber ISampleGrabber ISampleGrabberCB ISampleGrabber::SetCallBack() 3.3 BufferCB BufferCB 14

16 3. 0. ISampleGrabberCB CoCreateInstance(CLSID_SampleGrabber,..., IID_IBaseFilter,...) IBaseFilter::QueryInterfase(IID_ISampleGrabber,...) 4-2. ISampleGrabber::SetMediaType(AM_MEDIA_TYPE *) 4-3. IFilterGraph::AddFilter(IBaseFilter *) SetBufferSample(FALSE), SetOneShot(FALSE) SetCallback() : 1 ISampleGrabberCB 2 0 SampleCB, 1 BufferCB 5. ISampleGrabber::GetCurrentBuffer(...) IEnumPins IBaseFilter::EnumPins 2. IPin IEnumPins::Next(1, (IPin **), 0) 3. (IN,,OUT) FILTER_INFO IPin::QueryDirection(PIN_DIRECTION *) IPin *GetPin(IBaseFilter *pfilter, PIN_DIRECTION PinDir) { } BOOL bfound = FALSE; IEnumPins *penum; IPin *ppin; pfilter->enumpins(&penum); while(penum->next(1, &ppin, 0) == S_OK) { PIN_DIRECTION PinDirThis; ppin->querydirection(&pindirthis); if (bfound = (PinDir == PinDirThis)) // break break; ppin->release(); } penum->release(); return (bfound? ppin : 0); 15

17 ISampleGrabberCB COM CUnknown IUnknown AddRef Release QueryInterface NonDelegatingQueryInterface

18 DirectShow CaptureGraphBuilder FilterGraph CaptureGraphBuilder CaptureGraphBuilder FilterGraph DIB [7]

20 (color specification system)[8] RGB nm (Blue) 546.1nm (Green) 700.0nm (Red) 3 3 RGB RGB 1. RGB R G B 2. RGB HSV HSV (Hue) (Saturation) (Intensity Value) 3.6 RGB HSV 19

21 RGB HSV RGB 3.8 HSV ( ) 20

22 RGB HSV RGB 3.10 RGB HSV HSV 21

23 RGB HSV [8] 3.11 RGB HSV max = max (r, g, b); min = min (r, g, b); if (g == max) { hue= (b - r) / ( max - min ) * ; } else if (b == max) { hue= (r - g) / ( max - min ) * ; } else if (g < b) { hue= (g - b) / ( max - min ) * ; } else { hue= (g - b) / ( max - min ) * 60; } max = max (r, g, b); min = min (r, g, b); Saturation = ( max - min ) / max * 100; Value = max (r, g, b) / 2.55 H = S = V =

24 .. (FinePix50i) RGB 3.12 RGB HSV R G B H S V RGB 3.12 RGB HSV HSV H V H H S [9] 23

25 3.12 H S H[0 359] 3 0 S[0 100] V[0 100] V H [9] H 6 38 H HSV RGB (#FFCC99) 3.13 RGB 2 (#FFFFFF) 3.13 RGB

26 .. RGB 3.11 H 0 30 (#FFFFFF) (#000000) HSV RGB 3.16 RGB 25

27 HSV.. X 3.18 X

28 3.20 No YES YES No No YES

29 3.21 ➁ ➀ 3.21 HSV Y X X Y

30 K.Ohba and K.Ikeuchi [10] L.Itti [11] 29

31 [8] fx = s(i+1,j) - s(i,j) fy = s(i,j+1) - s(i,j) y(i,j) = fx fx + fy fy y(i,j) = fx + fy θ = tan-1 (fy/fx)

32 .. (Laplacian) L(i,j) = x(i,j) 4 - { x(i-1,j)+x(i+1,j)+x(i,j-1)+x(i,j+1) } [12]

33 4.3 (i,j) f(i,j) i j (0,0) (i,j) 3 3 (i,j) g(i,j) 3 3 (i-1,j-1) f(i,j-1) f(i+1,j-1) f(i-1,j) f(i,j) f(i+1,j) f(i-1,j+1) f(i,j+1) f(i+1,j+1).. 2 [8] 32

35 f x f 2 y ) f = ( f x + f y f x f y 2 y ) f = ( f x + f

36 f x f y 2 y ) f = ( f x + f f x f y 2 y ) f = ( f x + f

37 .. (1 ) 4.11 X

38 ... ( 4.12) ( 4.13) ( 4.14) ( 4.15)

39 No YES No YES No YES 4.16 X X 7 38

40 No YES No YES YES YES No 4.17 Y 4 X Y 20 39

41 .. (a) (b) 2 95 (c) (d) (e) 4.18 (4.4.2 ) (a) (b) (e) 40

.. (a) (b) 2 150 (c)4 (d) (e) 4.19 (4.4.3 ) 4.

42 .. (a) (b) (c)4 (d) (e) 4.19 (4.4.3 ) 4.19(a) (b) (e) 41

43 .. (a) (b) (c)4 (d) (e) 4.20 (4.4.4 ) (4.4.3 ) 4.20(a) (b) (e) 42

.. (a) (b) 2 160 (c) (d) (e) 4.21 (4.4.5 ) 4.

44 .. (a) (b) (c) (d) (e) 4.21 (4.4.5 ) 4.21(a) (b) (e) 43

.. (a) (b) 2 130 (c)2 (d) (e) 4.22 (4.4.6 ) 2 4.

45 .. (a) (b) (c)2 (d) (e) 4.22 (4.4.6 ) (a) (d) 44

46 fps fps fps (a) ( (b) ( ) (c) ( )

47 . WDM HSV WDM 46

48 47

49 48

50 [1], 175, Vol.64, No.3, pp [2] Vol.56 No.7 pp [3] ChrisCant WDM 2000 [4] Microsoft Corporation, MSDN Library [5] Microsoft Corporation, DirectX 8.1 SDK Document [6] DirectX [7] Intel Corporation, Open Source Computer Vision Library Reference Manual [8] CG 1999 [9] Jamie Sherrah and Shaogang Gong, Skin Colour Analysis, University of Edinburgh, May, [10] K.Ohba and K.Ikeuchi, Detectability, uniqueness and veliability of eigen-windows for stable verification of partially occluded objects, IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.19, No.9, pp , Sep., [11] L.Itti, C.Koch, and ENiebur, A Model of saliency-based visual attention for rapid scene analysis, IEEE Trans. Pattern Analysis and Machine Intelligence,Vol.20, No.11, pp , Nov., [12] " " A, Vol. J84-A, No. 6, pp , Jun.,

ORiN CAO USB (3) CAO CAO USB ORiN CAO USB 1 2 (4) CAO 3 CAO USB 4 PC OS 1 CPU:Pentium IV 2. 8GHz :512MByte Windows XP SP2 Professional ORiN2 SDK USB D

ORiN FA ORiN USB ORiN 1 1 ORiN CAO 1 1 USB USB ORiN 2 3 2 ( ) 3 1 Web ORiN USB ( ) ( ) ( ) ORiN CAO USB (3) CAO CAO USB ORiN CAO USB 1 2 (4) CAO 3 CAO USB 4 PC OS 1 CPU:Pentium IV 2. 8GHz :512MByte Windows