ｽﾗｲﾄﾞﾀｲﾄﾙなし

Size: px

Start display at page:

Download "ｽﾗｲﾄﾞﾀｲﾄﾙなし"

ふじよしかやぬま
6 years ago
Views:

1 (1) - [email protected]

3 Y U V R G B (1/30 ) RGB / YUV = B G R V U Y RGB YUV

4 CCIR 601 4:4:4 4:2:2 4:2:0 Y Y Y U V U V U V YUVUV UV 4:2:0 4:2:2

5 (RGB8 ) TV TV HDTV 352x x x Mbit/s 83Mbit/s 498Mbit/s

6 MC+DCT (20 ) DCT DCT + MC ( motion compensation) DCT ( discrete cosine transform) Q:

7 DCT +

8 DCT ( : 0.9 ) DCT ( ) ( )

9 DCT ρ=0.95 KLT: DCT: KLT 8x8 DCT

10 Wavelet ( ) x(n) h 0 (n) 2 h 0 (n) h 1 (n) 2 2 h 0 (n) h 1 (n) 2 2 LLL LLH LH h 1 (n) 2 H 2 LLL LLH LH H LL 0 π LH H

11 DCT Wavelet ρ=0.95 Wavelet DCT ( ) Wavelet: (JPEG-2000)

12 IP I P P P P P P I: I ( ) ( : 0.9 ) P: P ( )

13 IPB I B B P B B P I: I ( ) P: P ( ) ( ) B: B ( )

14 I B B P B B P TV (MPEG-2) DCT: DCT

16 () 1/4 1/8 :

17 :

20 H kb/s2Mb/s ISDN ITU-T H kb/s H kb/s H kb/s MPEG Mb/s CD-ROM ISO MPEG-2 * 1995 Mb/s MPEG kb/s * MPEG-2/H.262H.264 (MPEG-4 Part 10) ISO ITU-T

21 MC DCT ( ) MC+DCT B ITU-T H.120 Sub-rate H.261 H.263 / H M 384K 64K - 1.5M ISDN, Internet, Joint (ITU-T & ISO) MPEG-2 / H.262 DVDHDTV H.264 Internet, ISO MPEG-1 MPEG-4 CD-ROM Internet,

22 MC+DCT 1/2IPB H H MPEG MPEG-2 - H MPEG-4 H ( )

23 ISO/IEC MPEG-4

24 MPEG-4 ( ) ( ) ( ) (Wavelet )

25 MPEG-4 ( ) Hello Hello () ( )

26 (CIF, QCIF, ) (x, y) VOP (w, h)

27 MB (1) (2) (3) MB (1) I- DCT (2) P-0 DCT

28 (1) 2 (0,1) (2) (0, 255) (DCT) ( ) (R, G, B, A) (Y, U, V, A) A: ( ) A = 0: (transparent) A = 255: (opaque) A = 1 254: ( )

29 ITU-T H.264 (MPEG-4 Part 10)

30 H.264 (MPEG-4 70%) ( ) (Sub-macroblock prediction) 1/4 1/8 (1/4, 1/8 pel interpolation) (Multiframe prediction) (SAT: sum of absolute transformed differences) (Adaptive intra prediction) DCT (Adaptive block-size transform) CABAC (Context-based Adaptive Binary Arithmetic Coding) VCL: Video Coding Layer NAL: Network Adaptation Layer RTP Packetization

31 mode 1 16x16 block 1 vector mode 2 8x16 block 2 vectors mode 3 16x8 block 2 vectors mode 4 8x8 block 4 vectors mode 5 4x8 block 8 vectors mode 6 8x4 block 8 vectors mode 7 4x4 block 16 vectors Sub-macroblock prediction

32 P P P P P P Multi-frame prediction

33 SAT ( ( SAD minimization ( ) DCT SAD minimization (SAD DCT ) SAT minimization ( ) DCT SAT minimization ( ) SAD: sum of absolute differences, SAT: sum of absolute transformed differences

34 I A B C D E a b c d F e f g h G i j k l H m n o p mode 0: DC prediction mode 1: Vertical/Diagonal prediction mode 2: Vertical prediction mode 3: Diagonal prediction mode 4: Horizontal prediction mode 5: Horizontal/Diagonal prediction I A B C D E a b c d F e f g h 5 G i j k l H m n o p mode 0: = (A+B+C+D+E+F+G+H) / 8 mode 1: a = (A+B) / 2 e = B b = i = (B+C) / 2 f = m = C c = j = (C+D) / 2 d = g = h = k = l = n = o = p = D

35 CABAC (Binarization) A B C Binarization (unary) index 0 1 binarization 1 01 A, B: C: vs. ( ) Context-based Adaptive Binary Arithmetic Coding

36 ( CABAC 1015% 5% 5% 5% R-D ( ) 1015% 30%

37 Rate-Distortion Optimization Multiple Distortion Coding Wyner-Zip Coding

38 R-D Lagrange (Rate-Constrained minimize J = D + λ R (D, R) ( ) INTRA/INTER ( ) INTRA/INTER/SKIP ( ) ( ) (FastStreaming) Rate-Distortion Optimization for Video Compression, IEEE Signal Processing Magazine, Nov.1998.

39 R-D (DCT ) (1) J dj dr dd = dr + λ λ MODE = dd dr (2) b R( D) = a log2 D 2 (2Q) D = = 12 Q 3 2 (H.263) MODE (3) λ = c Q 2 MODE c 2 Q 3 λ = ln 2 c = 3 a 0.85 (H.264)

40 R-D RD D motion min J motion = Dmotion + λmotion Rmotion min ( ) D mode min J mode = Dmode + λmode Rmode min ( )

41 Multiple Description Coding ( ) () Temporal scalability: I B B P B B Multiple Description Coding: (descriptions)

42 Wyner-Ziv Coding Input (X) encode decode Output (Y) Distributed Source Coding (Wyner-Ziv Coding): Input (X) encode decode Y (= X+) p subencode subdecode Reconstruction Output (Y ) MAP Y ' = arg max P( X Y, p) p (sub-information)

43 H.264 LSI Logic, VLE4000: Sand Video (Broadcom), SV-D011: H.264 SDTV encoder (FPGA) H.264 HDTV decoder (core) H.264 SDTV decoder: NECELMP211 (DSP & 3CPU/ARM) Sony: PSP (HW core)cell RenesasSH-Mobile4 (HW core)

44 Qualcomm: MSM7000 NTT DoCoMo 1 2 (OMAP, SH-Mobile) RF-CMOS Jul G/3G WLAN ( ) Brew 1 3D-CG (ATI core) + TI (OMAP ext.) Renesas (SH-Mobile ext.)

45 ViXS Systems Inc. (MPEG & ) LSI XCode II Matrix ABFM ( ) MPEG-2/4 LSI SDTV 4 8 HDTV 1 ( ) HDD IEEE a/e LSI a/e 2 (54 * 2 = 108Mb/s) LAN HDTV MAC ( ) AV (e.g. HDD to ) (Adaptive Bandwidth Footprint Management) Matrix XCode II LAN

2. CABAC CABAC CABAC 1 1 CABAC Figure 1 Overview of CABAC 2 DCT 2 0/ /1 CABAC [3] 3. 2 値化部コンテキスト計算部 2 値算術符号化部 CABAC CABAC

2. CABAC CABAC CABAC 1 1 CABAC Figure 1 Overview of CABAC 2 DCT 2 0/ /1 CABAC [3] 3. 2 値化部コンテキスト計算部 2 値算術符号化部 CABAC CABAC H.264 CABAC 1 1 1 1 1 2, CABAC(Context-based Adaptive Binary Arithmetic Coding) H.264, CABAC, A Parallelization Technology of H.264 CABAC For Real Time Encoder of Moving Picture YUSUKE YATABE 1 HIRONORI

ｽﾗｲﾄﾞ ﾀｲﾄﾙなし

ｽﾗｲﾄﾞﾀｲﾄﾙなし