¥¤¥ó¥¿¡¼¥Í¥Ã¥È·×Â¬¤È¥Ç¡¼¥¿²òÀÏ Âè1²ó

Size: px

Start display at page:

Download "¥¤¥ó¥¿¡¼¥Í¥Ã¥È·×Â¬¤È¥Ç¡¼¥¿²òÀÏ Âè1²ó"

ちとらすえたけ
5 years ago
Views:

lumeta internet mapping http://www.lumeta.com http://www.

2 lumeta internet mapping / 39

3 ( ) 3 / 39

4 (Internet measurement and data analysis) : <kjc@sfc.keio.ac.jp> TA: <sora@sfc.wide.ad.jp> SA: <iomz@sfc.wide.ad.jp> URL: sfc2013s-measurement/ ( TA SA ): <imda2013s@sfc.wide.ad.jp> : : 2 (20% ) (60%) 4 / 39

5 ( ) ( ) 5 / 39

6 最近 Big Data が騒がれている 6 / 39

7 big data by cloud computing big data 7 / 39

8 8 / 39

9 e- : ( ) ( ) 9 / 39

10 : WIDE / 39

11 ITS 3 (, ) 11 / 39

Google s Chief Economist Hal Varian on Statistics The McKinsey Quarterly, January 2009 I keep saying the sexy job in the next ten years will be statisticians.

12 Google s Chief Economist Hal Varian on Statistics The McKinsey Quarterly, January 2009 I keep saying the sexy job in the next ten years will be statisticians. People think I m joking, but who would ve guessed that computer engineers would ve been the sexy job of the 1990s? The ability to take data to be able to understand it, to process it, to extract value from it, to visualize it, to communicate it that s going to be a hugely important skill in the next decades, not only at the professional level but even at the educational level for elementary school kids, for high school kids, for college kids. Because now we really do have essentially free and ubiquitous data. So the complimentary scarce factor is the ability to understand that data and extract value from it. 12 / 39

13 (Kenjiro Cho) (2010-) (2002-) WIDE (2001-) 1984 ( ) OS ( ) (QoS ) 2001 ( ) 2004 ( ) 13 / 39

14 14 / 39

15 (1/5) 1 (4/10) : ruby 2 (4/17) ( ) : gnuplot 3 (4/24) : 15 / 39

16 (2/5) 4 (5/1) : 1 5 (5/8) Web : 6 (5/15) 5/22 : 16 / 39

17 (3/5) 7 (5/29) : 8 (6/5) : 2 9 (6/12) : 17 / 39

18 (4/5) 10 (6/19) : 11 (6/19?) : 12 (6/26) : 18 / 39

19 (5/5) 13 (7/3) : PageRank 14 (7/10) MapReduce : MapReduce 15 (7/17?) 19 / 39

20 ( ) 20 / 39

21 21 / 39

22 22 / 39

23 ( ) ( ) ( ) ( ) (web ) 23 / 39

24 : : TCP 24 / 39

25 25 / 39

26 (metric) 26 / 39

27 27 / 39

28 28 / 39

29 90 web 2000 P2P SNS 30 dst address Traffic (Mbps) :00:00 04/12 03:00:00 04/12 06:00:00 04/12 09:00:00 04/12 12:00:00 04/12 15:00:00 04/12 18:00:00 04/12 21:00:00 04/12 00:00:00 04/13 Time total / / / / / / / / / / / / /7 29 / 39

30 PC 30 / 39

31 (PageRank) ( ) SNS SPAM MapReduce Web 31 / 39

32 32 / 39

33 Ruby

34 Ruby 1993 : Ruby on Rails (Web ) Ruby Ruby official site: Ruby : Ruby : 34 / 39

35 Ruby : : ( ) : / Ruby : 35 / 39

36 Ruby commands irb: Ruby $ irb --simple-prompt >> puts "Hello" Hello ruby: Ruby $ ruby test.rb $ ruby -e puts "Hello".reverse olleh 36 / 39

37 : filename = ARGV[0] count = 0 file = open(filename) while text = file.gets count += 1 end file.close puts count count.rb $ ruby count.rb foo.txt Ruby #!/usr/bin/env ruby count = 0 ARGF.each_line do line count += 1 end puts count 37 / 39

38 2 (4/17) ( ) : gnuplot 38 / 39

39 [1] Ruby official site. [2] gnuplot official site. [3] Mark Crovella and Balachander Krishnamurthy. Internet measurement: infrastructure, traffic, and applications. Wiley, [4] Pang-Ning Tan, Michael Steinbach and Vipin Kumar. Introduction to Data Mining. Addison Wesley, [5] Raj Jain. The art of computer systems performance analysis. Wiley, [6] Toby Segaran. ( ) [7] Chris Sanders. ( ). 2 Wireshark [8] [9],.., [10],.., / 39

¥¤¥ó¥¿¡¼¥Í¥Ã¥È·×Â¬¤È¥Ç¡¼¥¿²òÀÏ Âè1²ó

¥¤¥ó¥¿¡¼¥Í¥Ã¥È·×Â¬¤È¥Ç¡¼¥¿²òÀÏ Âè1²ó 1 2014 4 7 lumeta internet mapping http://www.lumeta.com http://www.cheswick.com/ches/map/ 2 / 41 ( ) 3 / 41 (Internet measurement and data analysis) : TA: SA: