17 Multiple video streams control for the synchronous delivery and playback 1085404 2006 3 10

Web IP 1 1 1 3,,, i

Abstract Multiple video streams control for the synchronous delivery and playback Yoshiyuki KOMATSU Recently, many kinds of video streaming services are provided by various providers on the internet. The internet can deliver multiple videos to multiple clients at the same time. In fact, the clients can combine various videos freely and watch them simultaneously. However, the videos simultaneously delivered must be synchronized with some playback timeline as to their simultaneity and relativity. They need the strict synchronization. Independent video sources asynchronized also must be accorded to their common clock when they are watched. Especially, it is important to absorb time-lag and jitter caused by differences of distance and paths from delivery servers when videos are delivered via the internet based on best effort policy. In this paper, a system which can make various video streams synchronized without any damage by network conditions during a playback is proposed. The client is able to see the streams delivered simultaneously via the internet. This system can develop a new way to have a fun in watching Internet video streaming services. key words streaming, braoadcasting, synchronization, multipoint, multi stream iii

1 1 1.1....................... 1 1.2....................... 3 1.3.............................. 4 1.4............................ 4 1.4.1......................... 4 1.4.2..................... 4 1.5................. 5 1.5.1 RTP(Real-time Transport Protocol)................ 5 1.5.2 RTCP(RTP Control Protocol)................... 5 1.5.3 RTSP(Real Time Streaming Protocol)............... 5 1.5.4.................... 6 Quick Time.............................. 6 Windows Media........................... 6 Real Player.............................. 6 1.6................................... 7 2 9 2.1...................................... 9 2.1.1.................................. 10 2.2............................. 11 2.2.1... 11.......... 12.............. 12 v

2.2.2......................... 12 2.2.3...................... 13 2.3............................. 13 2.3.1 RTP.......... 13 2.3.2 RTP............... 13 2.3.3 RTP................ 14 2.3.4 RTP.................. 14 2.3.5............. 14.................... 15 2.3.6......... 15.................... 15 2.4..................... 16 2.4.1.... 16 2.4.2... 18 2.4.3.............. 20 2.5........... 20 2.5.1.................... 21 2.5.2......................... 23 2.5.3................... 23 2.5.4.................... 24 2.6............................ 26 2.6.1......................... 26 2.6.2................................ 26 NTP (Network Time Protocol)................... 26 NTP.............................. 27 2.7......... 27 vi

2.7.1........................... 28 2.7.2................................. 29 2.7.3................................ 29............... 30 2.7.4............................. 30 2.7.5.......................... 31 2.8........................... 35 2.9.................................. 36 2.10...................... 36 2.11...................... 36 2.12.................................... 37 3 39 3.1........................ 39 3.1.1................................ 39 3.1.2................................ 40 3.1.3............................ 40........................... 40....................... 41 3.1.4................................ 41 3.1.5............................ 47 3.1.6............... 47 3.1.7.................................. 48 3.2.................................... 50 4 51 4.1.................................. 51 vii

53 55 viii

1.1................................. 2 1.2.............. 3 2.1............................... 10 2.2........................ 18 2.3.................... 20 2.4................ 21 2.5....................... 22 2.6.................... 25 2.7............. 32 2.8 2 4.... 32 2.9 3..... 33 2.10 3.......... 33 2.11 2 4..... 34 2.12............. 34 3.1.................................... 40 3.2 ( 100ms)...................... 44 3.3 ( -100ms)...................... 44 3.4 ( 300ms)...................... 45 3.5 ( -300ms)...................... 45 3.6 ( 500ms)...................... 46 3.7 ( -500ms)...................... 46 ix

3.8 ( 500ms).............. 49 3.9 ( -500ms).............. 49 x

2.1.......... 16 2.2................................. 29 3.1........................ 42 3.2.................. 48 xi

1 1.1 ISDN IP 1.1 1 1 IP F1 1

1 1.1 1.2 3 2

1.2 1.2 1.2 Web ISDN 10kbps ADSL 100kbps Mbps FTTH Mbps Mbps 3 1 1 3

1 1.3 ( ) 1.4 1.4.1 1.4.2 4

1.5 1.5 1.5.1 RTP(Real-time Transport Protocol) RTP UDP RTCP RTCP RTP 1996 QuickTime RealPlayer RTP 1.5.2 RTCP(RTP Control Protocol) RTCP RTP RTP RTCP RTP RTCP RTCP IP 1.5.3 RTSP(Real Time Streaming Protocol) RTSP (RFC 2326) / IP RTSP Web 1 5

1 1998 4 IETF 1.5.4 3 Quick Time QuickTime4.0 Mac OS X Server QuickTime Streaming Server QuickTime Player RTP RTSP Windows Media Windows 98 OS 750 MPEG-4 MPEG-4 Real Player RealPlayer RealAudio 6

1.6 1.6 7

2 2.1 2 2.1 (Delivery Server1, Delivery Server2, Delivery Server3) 3 9

2 2.1 2.1.1 10

2.2 2.2 2.2.1 1 11

2 1 5 NTP 2.2.2 12

2.3 2.2.3 2.3 2.2.1 2.3.1 RTP RTP 2.3.2 RTP RTP 16 1 16 13

2 2.3.3 RTP RTP 32 90kHz 13 2.3.4 RTP RTP RTP 2.3.5 14

2.3 64 NTP 1900 1 1 0 32 32 2.3.6 1 32 2.1 16 30fps 36 24 155 32 4 32 15

2 24 32 2.1 (30fps ) 16 65,536 36 24 16,777,216 155 32 4,294,967,296 4 2.4 2.3 2.3 2.4.1 16

2.4 1. S pmax 2. S pmax F pmax1 T base 3. S pmax S others T base 4. S others 3 F others1 5. F pmax1 T base 6. F others1 7. F pmax2 8. F others2 9. 7 8 S pmax S others 1 3 3 1 2.2 3 1 1 1 17

2 00:75 1 4 2 4 3 3 3 2.2 2.4.2 18

2.4 1. S pmax 2. S pmax F pmax1 N base 3. S pmax S others N base 4. S others 3 F others1 5. F pmax1 F others1 6. S pmax S pmax S others 7. 6 S pmax S others 1 3 3 1 2.3 1 1 1 3 3 19

2 2.3 2.4.3 2.5 20

2.5 2.5.1 IP 2.4 1 3 T 1, T 2, T 3 T 3 1 T 3 T 1 2 T 2 T 1 2.4 21

2 2.5 2.4 2.5 1 22

2.5 2.5.2 10 10 10 2.5.3 1 23

2 2.4 1 2 2.6 3 1 2 1 2 1 3 T 1 T 3 msec 1 2 3 T 2 T 3 msec 2 2 3 2.5.4 1. 2. 3. 4. 5. 4 6. 24

2.5 2.6 7. 8. 9. 10. 11. 9 10 25

2 2.6 2.6.1 30fps 1 1/30 (0.03333 33 ) 60fps 1 1/60 (0.01666 17 ) 1 1 5 1 10 1 3.4 1.7msec 2.6.2 IP NTP(Network Time Protocol) NTP (Network Time Protocol) RFC-1305 Version 3 NTP SNTP RFC-1769 26

2.7 NTP 1 stratum 1 1 GPS NTP LAN 1 NTP NTP NTP NTP NTP NTP LAN NTP NTP 2.6.1 3.4 1.7msec 2.7 2.8 27

2 2.7.1 3 1. 2. 3. 16 1 10 16 16 3 3 1 16 16 3 = 48 1 48 P c P r P t 3 P a P a = P c + P r + P t (2.1) P a 28

2.7 2.7.2 4 2.2 16, 12, 8, 4 640 480 12 320 240 8 160 120 4 2 16 1 30 12 20 4 1 4 36 12 44 28 2.2 1 2 3 4 (P c ) 12 4 16 8 320 240 160 120 640 480 320 240 (P r ) 8 4 12 8 2 20 2 1 30 (P t ) 16 4 16 12 (P a ) 36 12 44 28 2.7.3 29

2 2.7.4 1. 2. 3. 4. 2 5. 30

2.7 2.7.5 4 2.7 2.12 4 1 3 2 4 2.7 2.12 4 1 4 320 240 2 160 120 3 640 480 3 1 4 1 1 3 2.7 3 1 3 2 4 2.8 2 3 3 3 2.9 2 1 1 3 2.10 3 1 2 4 2.11 1 2.12 1 3 31

2 2.7 2.8 2 4 32

2.7 2.9 3 2.10 3 33

2 2.11 2 4 2.12 34

2.8 2.8 URL ID URL HTTP XML XML 35

2 2.9 2.10 2.11 1. 2. 3. 2.7.4 4. URL 5. 6. 36

2.12 7. 2.5.4 8. 9. 10. 2.4.1 2.4.2 11. 12. 2.12 3 37

3 3.1 2.5.3 3.1.1 2 dummynet[8] dummynet PC 960kbps 1 4000 30fps 33ms dummynet 39

3 3.1.2 3.1 2 1 PC Dummynet Bridge PC 100BASE-TX 3.1 3.1.3 1. 40

3.1 2. 3. 4. 5. 6. 1. 2. 3. 4. 5. 6. 3.1.4 3.2 3.7 3.1 33ms 10 41

3 3.1 33ms 10 100ms 3.2 33ms 10-100ms 3.3 33ms 10 300ms 3.4 33ms 10-300ms 3.5 33ms 10 500ms 3.6 33ms 10-500ms 3.7 100ms 3.2 90ms 15 20 0 6 103ms 33ms 10-100ms 3.3 100ms 15 18 0 4 154ms 33ms 10 300ms 3.4 300ms 18 30 42

3.1 0 13 113ms 33ms 10-300ms 3.5 300ms 21 29 0 12 563ms 33ms 10 500ms 3.6 460ms 28 0 60 180ms 0 149 122 3345ms 33ms 10-500ms 3.7 500ms 28 0 49 190ms 103 0 76 2875ms 43

3 3.2 ( 100ms) 3.3 ( -100ms) 44

3.1 3.4 ( 300ms) 3.5 ( -300ms) 45

3 3.6 ( 500ms) 3.7 ( -500ms) 46

3.1 3.1.5 10 1 0 10 100 500ms 3 2 10 5 3.1.6 3.8 3.9 3.2 3.6 10 3.8 500ms 27 10 47

3 3.2 33ms 10 500ms 3.8 33ms 10-500ms 3.9 120ms 56 0 30 814ms 3.7 3.8 3.9 480ms 10 27 120ms 42 0 16 969ms 3.1.7 500ms 1 10 48

3.1 3.8 ( 500ms) 3.9 ( -500ms) 49

3 3.2 2 10 0 10 50

4 1 3 1 10 10 4.1 51

4 52

4 MAV QoS 53

[1] Yoshiyuki KOMATSU Kazunori SHIMAMURA A synchronous fashion of playback timing to use multipoint and multi-angle video streams synchronously NEINE05 pp.56-61 [2] Yoshiyuki KOMATSU Kazunori SHIMAMURA A study of the path bandwidth measurement for the stable Audio-Visual stream distribution NEINE04 pp.88-96 [3] FIT2004 4 pp.79-82 [4] Colin Perkins,, TCP/IP RTP,, 2004 [5],, Content Delivery Networks, 2003 [6],, ICMP End-to-End, FIT2002 vol.1, 2002 [7],, CDN Relaycast, 2002 [8] dummynet, http://info.iet.unipi.it/ luigi/ip dummynet/, 2006 1 10 [9] Ethereal, http://www.ethereal.com/, 2005 11 9 [10] VideoLAN, http://www.videolan.org/, 2005 12 20 [11],,,,,,, GPS NTP, 12, 2000 [12],, NTP OS, 13, 2001 [13] Perl ++++[smart], http://www.rfs.jp/sb/perl/, 2006 1 9 55