IIJ Technical WEEK Indexer Bullet によるビッグデータ解析

Size: px
Start display at page:

Download "IIJ Technical WEEK 2013 - Indexer Bullet によるビッグデータ解析"

Transcription

1 Indexer Bullet IIJ Techweek2013 IIJ

2

3 Indexer Bullet ibullet u u u u

4 Indexer Bullet RDBMS Indexer Bullet

5 Indexer Bullet HTML GET/PUT/DELETE OUTLINK GET/PUT/DELETE Indexer Bullet

6 Indexer Bullet u Wikipedia u Wikipedia ibullet u l l CompaireAndSwap u

7 Big data is like teenage sex: everyone talks about it, nobody really knows how to do it, everyone thinks everyone else is doing it, so every one claims they are doing it URL:

8 u u u u u

9

10 u u u u u

11 WorkSpace BigData CachedCopy BigData

12 WorkSpace Modeling Tool BigData CachedCopy BigData

13 WorkSpace BigData CachedCopy BigData Sampled Data Sampled Data Sampled Data

14 WorkSpace BigData CachedCopy BigData Modeling Tool Sampled Data Sampled Data Sampled Data

15 ibullet u u u u ibullet l

16 ibullet ibullet BigData CachedCopy BigData Modeling Tool co.jp/aaa/ HTTP Method A Method B Method C

17 ibullet ibullet BigData CachedCopy BigData co.jp/aaa/ A Modeling Tool a co.jp/bbb/ B Modeling Tool a b co.jp/ccc/ C Modeling Tool c a b

18 ibullet ibulleta BigDataA CachedCopy BigDataA ibulletc co.jp/aaa/ A Modeling Tool ibulletb BigDataB CachedCopy BigDataB

19 WikipediaPVC ibullet u Wikipedia u Wikipedia Wikipedia u Wikipedia Wikipedia Wikipedia Mediawiki u u Excel R

20 Wikipedia Count Page view statistics for Wikimedia projects u Wikimedia 2008 u Project> <PageTitle> HTTP <> <PageSize> u

21 Wikipedia Count Project: ja Namespace: 0

22 Wikipedia Page Data Wikimedia Downloads -- Database dump progress u u Wikipedia u XML Mediawiki TEXT> l jawiki-<date>-pages-articles.xml.bz2 jawiki /10/05 u 1,752,890 u 1,411, % u : 883, %

23 Wikipedia Wikipedia u u u l u u

24 Wikipedia u NHK u 20% l CHANGEJIN 15 20% l l or 10 15% l 5 10% l l or 5% l

25 Wikipedia

26 Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Drama Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia = Drama Drama Drama Drama

27 Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia Wikipedia

28 u u ts() or 168 u decompose(): u Trend seasonalrandom l l

29 r a t e Time

30 Decomposition of additive time series seasonal trend observed random Time

31 Decomposition of additive time series random seasonal trend observed Time

32 Decomposition of additive time series random seasonal trend observed Time

33 Decomposition of additive time series random seasonal trend observed Time

34 Decomposition of additive time series random seasonal trend observed Time

35 Decomposition of additive time series random seasonal trend observed Time

36

37 Indexer Bullet u u l l u ibullet

38 Wikipedia u l l u l l u l

39 Wikipedia u u Wikipedia Wikipedia l l l u l l Wikipedia

/27 (13 8/24) (9/27) (9/27) / / / /16 12

/27 (13 8/24) (9/27) (9/27) / / / /16 12 79 7 79 6 14 7/8 710 10 () 9 13 9/17 610 13 9/27 49 7 14 7/8 810 1 15 8/16 11 811 1 13 9/27 (13 8/24) (9/27) (9/27) 49 15 7/12 78 15 7/27 57 1 13 8/24 15 8/16 12 810 10 40 1 Wikipedia 13 8/18, 8/28 79

More information

アンケート2

アンケート2 / / / / / / 4/6 4/20 4/7 5/19 4/4 5/19 4/5 4/26 4/8 5/13 / / / / / / / / / / / / / / / / / / / / / / / / 7/6 10/12 6/7 11/29 7/13 9/28 5/22 10/2 6/3 10/7 5/24 10/4 5/30 9/12 6/2 7/21 6/1 7/27 6/13 9/5

More information

TOPIX30 2 / 37

TOPIX30 2 / 37 W707 [email protected] 1 / 37 TOPIX30 2 / 37 1 2 TOPIX30 3 / 37 2000 3000 4000 5000 6000 x 1992 1993 1994 1995 1996 1997 1998 Time 4 / 37 t {X t } t i.i.d. t 5 / 37 Definition ( ) {X t } t. t 1,...,

More information

Page 1

Page 1 Page 1 Page 2 Page 3 Page 4 620 628 579-41 -6.7-49 -7.9 71 41 47-24 -33.3 6 15.9 11.5 6.5 8.1 36 15 22-14 -38.9 7 43.4 Page 5 277 302 23 24 12/3Q 12/4Q 13/1Q 13/2Q 13/3Q 13/4Q 14/1Q 14/2Q 14/3Q 14/4Q 15/1Q

More information

1 発病のとき

1 発病のとき A A 1944 19 60 A 1 A 20 40 2 A 4 A A 23 6 A A 13 10 100 2 2 360 A 19 2 5 A A A A A TS TS A A A 194823 6 A A 23 A 361 A 3 2 4 2 16 9 A 7 18 A A 16 4 16 3 362 A A 6 A 6 4 A A 363 A 1 A A 1 A A 364 A 1 A

More information

NextWebBtoB_BtoC _suwa.pdf

NextWebBtoB_BtoC _suwa.pdf twitter ID: suwaws 29.3 Billion$ GAAP:8.5 Billion$ 2010 Google :7,200 HONDA : 5,340 NTT : 5,096 docomo : 4,904 mitsubishi corp. : 4,631 TOYOTA : 4,081 On the Internet, nobody knows you're

More information

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 http://www.moj.go.jp/press/090130-1.html 55 56 57

More information

* + Cable TV that is closely related to regional societies : Its e#ects on a community A case observed in Yonezawa City Naoko OTANI Akihiko SHIMAZAKI +, +, - - +, -. +, / * +,+ +0,**/ 55 ..-, (,**0 ) +

More information

324.pdf

324.pdf 50 50 10 30 11 26 12 27 14 16 27 18 20 21 22 22 22 22 23 24 24 1 No.324 JA 2 85 69 20 12 81 18 12 22 93 10 31 3 50 50 30 30 50 22 27 27 10 16 14 52 10 62 15 64 25 24 50 4 25 23 27 5 10 11 25 6 11 49 10

More information

テレビ番組による相互交流

テレビ番組による相互交流 Abstract: Import and Export of TV programs in Japan The TV programs for which contracts were concluded for export during fiscal 2001 included: Number of programs (number of titles) = 1,675 programs (series

More information

untitled

untitled -1- 12 3 7 8 3.5 ( ) 7 8 3 1 2 3 ( ) ( -2- 3 7 5 21 2 2-3- 2 2 18 ( 1) ( 1) ( ) 6. 9 ( 9 15 ) 7. 2 ( 9 ) ( 11 32 11 ) 11. 4 20. 10 ( 26 15 21 ) 23. 9 28. 4 ( 8 ) ( 34 ) 32. 9 ( 45 ) 32. 12 ( 10 13 ) 33.

More information

18 () 2,000 4,300 1,200 3,900 2,000 4,000 2,200 6,000 1,600 4,100 1,400 3,900 1,800 4,200 3,400 4,100 1,600 4,000 1,600 9,400 1,800 6,400 1,200 4,100 2,000 5,400 1,800 3,900 1,800 4,000 1,800 5,400 2,500

More information

紀要1444_大扉&目次_初.indd

紀要1444_大扉&目次_初.indd 1. Hi, How are you? / What s up? / How s it going? A / Nice talking to you. 2. Oh really? / That s great! / That s A, B interesting! / Are you serious? / Sounds good. / You too! / That s too bad. 3. Sorry?

More information

B B 10 7 581 10 8 582 10 9 583 B B 10 11 585 10 12 586 B 10 10 584 B

B B 10 7 581 10 8 582 10 9 583 B B 10 11 585 10 12 586 B 10 10 584 B 10 1 575 10 12 586 B B 10 1 575 10 2 576 B B 10 4 578 10 5 579 10 3 577 B 10 6 580 B B B 10 7 581 10 8 582 10 9 583 B B 10 11 585 10 12 586 B 10 10 584 B 11 1 587 11 12 598 B B 11 1 587 11 2 588 11 3 589

More information

(資料2)第7回資料その1(ヒアリング概要)

(資料2)第7回資料その1(ヒアリング概要) 2 3 4 5 6 7 8 9 10 11 12 13 1 1 1 1 5 1 6 533 4 505 722 13 3325 475 1 2 3 13 10 31 1 1 1 (1) 1 (2) 2 (3) 3 (4) 4 5 5 6 7 8 8 8 9 11 11 12 13 14 15 16 19 (1) (2) (3) (1) (5 ) 1 (10 ) ( ) (2) 2 4 (3) 3 3,100

More information

-------------------------- ----------------------------------------------------- -------------------------------------------------------------- ----------------------------------------------------- --------------------------------------------------------------

More information

<4D F736F F D DEC8BC A95BD90AC E A982BA81698AB A B B4790DF90AB8EBE8AB FC89408A4F816A82CC93AE8CFC82C98AD682B782E9838C837C815B D

<4D F736F F D DEC8BC A95BD90AC E A982BA81698AB A B B4790DF90AB8EBE8AB FC89408A4F816A82CC93AE8CFC82C98AD682B782E9838C837C815B D 27 29 2 IT 1,234 1,447 2,130 1,200 3,043 4 3 75 75 70-74 -10 J00 J101 J110 J111 J118 J300 J302-304 J301 26,475,118 155,290,311 1,234 14,472,130 75,784,748 12,003,043 79,505,563 1 1.00% 0.62% 1.31% 9 12

More information

, , ,210 9, ,

, , ,210 9, , 2006 5 642 7 2,671 35 732 1,727 602 489 386 74 373 533 305 1,210 9,786 2004 1,024 43.7 16.4 2004 978.6 40.2 2003 1 2006 5 1997 1998 1999 774 3,492 11 2,603 35 843 5,118 1,686 476 358 2000 738 3,534 11

More information

225 225 232528 152810 225 232513 -1- -2- -3- -4- -5- -6- -7- -8- -9- -10- -11- -12- -13- -14- -15- -16- -17- -18- -19- -20- -21- -22- -23- -24- -25- -26- -27- -28- -29- -30- -31- -32- -33- -34- -35- -36-

More information

232528 152810 232513 -1- -2- -3- -4- -5- -6- -7- -8- -9- -10- -11- -12- -13- -14- -15- -16- -17- -18- -19- -20- -21- -22- -23- -24- -25- -26- -27- -28- -29- -30- -31- -32- -33- -34- -35- -36- -37- -38-

More information

untitled

untitled 1 2 4 6 6 7 8 10 11 11 12 14 Page Page Page Page Page Page Page Page Page Hi everyone! My name is Martin Dusinberre, and I come from the UK. I first came to Iwaishima six years ago, when I taught English

More information

IC IC IC IC IC IC IC IC V IC IC IC https:// euphrates.andrew.ac.jp/ public / web / User / MOM / Syllabus / MOMwebGakuseiSyllabusSansho / UI / MOMwebWS

IC IC IC IC IC IC IC IC V IC IC IC https:// euphrates.andrew.ac.jp/ public / web / User / MOM / Syllabus / MOMwebGakuseiSyllabusSansho / UI / MOMwebWS IC * IC IC IC *.. http:// www.keidanren.or.jp / policy / 2012 / 058.html http:// www.meti.go.jp / policy / kisoryoku / index.htm IC IC IC IC IC IC IC IC IC V IC IC IC https:// euphrates.andrew.ac.jp/ public

More information

西川町広報誌NETWORKにしかわ2011年1月号

西川町広報誌NETWORKにしかわ2011年1月号 NETWORK 2011 1 No.657 平 成 四 年 四 の 開 校 に 向 け て 家 庭 教 育 を 考 え よ う! Every year around the winter holiday the Japanese custom of cleaning out your office space is performed. Everyone gets together and cleans

More information

揃 24 1681 0 20 40 60 80 100 0 21 42 63 84 Lag [hour] Lag [day] 35

揃 24 1681 0 20 40 60 80 100 0 21 42 63 84 Lag [hour] Lag [day] 35 Forecasting Model for Electricity Consumption in Residential House Based on Time Series Analysis * ** *** Shuhei Kondo Nobayasi Masamori Shuichi Hokoi ( 2015 7 3 2015 12 11 ) After the experience of electric

More information

¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡

¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡ - - - - - - - - - - - - - - - - - - - - - - H E L L O I N T E R N October 2007 Vol. 141 ----------------------------------------------------------- INTERN REPORT -----------------------------------------------------------

More information

C. S2 X D. E.. (1) X S1 10 S2 X+S1 3 X+S S1S2 X+S1+S2 X S1 X+S S X+S2 X A. S1 2 a. b. c. d. e. 2

C. S2 X D. E.. (1) X S1 10 S2 X+S1 3 X+S S1S2 X+S1+S2 X S1 X+S S X+S2 X A. S1 2 a. b. c. d. e. 2 I. 200 2 II. ( 2001) 30 1992 Do X for S2 because S1(is not desirable) XS S2 A. S1 S2 B. S S2 S2 X 1 C. S2 X D. E.. (1) X 12 15 S1 10 S2 X+S1 3 X+S2 4 13 S1S2 X+S1+S2 X S1 X+S2. 2. 3.. S X+S2 X A. S1 2

More information

101NEO資料

101NEO資料 Version 1.5 Tutorial PDF ... 1. PDF... 2 -.... 2 -. PDF... 2 -.... 4 -. HTML... 4 -. PDF... 5 -.... 7 -.... 8 Tutorial PDF Tutorial PDF - Page 1 Tutorial PDF - Page 2 Tutorial PDF - Page 3 Tutorial PDF

More information

nishi1502_01_24.ai

nishi1502_01_24.ai NETWORK NETWORK NETWORK No.707 2015 2 vol.93 Hello Everyone! Happy New Year! Today I am going to talk about my winter vacation. This year my family and I met in Hawaii for Christmas. It was very

More information

2

2 2011 8 6 2011 5 7 [1] 1 2 i ii iii i 3 [2] 4 5 ii 6 7 iii 8 [3] 9 10 11 cf. Abstracts in English In terms of democracy, the patience and the kindness Tohoku people have shown will be dealt with as an exception.

More information

To the Conference of District 2652 It is physically impossile for Mary Jane and me to attend the District Conferences around the world. As a result, we must use representatives for that purpose. I have

More information

”Лï‰IŠv47-1-13ŁÐ”RŸ_ٶ

”Лï‰IŠv47-1-13ŁÐ”RŸ_ٶ Kinds of news people like and dislike and the formation of social reality through their conversation Miyuki KATAYAMA, Yoshiro KAWAKAMI Yasuyuki KAWAURA, Shinkichi SUGIMORI Abstract Kinds of news

More information

商学 65‐6☆/15.陶

商学 65‐6☆/15.陶 1105 1992 1 20 20 2006 2 2007 1 8 IFRS 1992 1106 20 1 1992 1997 2 1992 1 1 2 7 1 3 3 4 1992 11 7 1 5 2 1998 2000 1 3 4 1998 1 6 1999 12 1992 1992 1992 18 1992 1107 3 2001 2006 8 2000 12 2001 1 4 2007 2007

More information

¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡

¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡-¡ - - - - - - - - - - - - - - - - - - - - - - H E L L O I N T E R N November 2007 Vol. 142 ----------------------------------------------------------- "I think you are a good teacher." INTERN REPORT -----------------------------------------------------------

More information

H1-2-3-4.indd

H1-2-3-4.indd 1 1 1 2 3 9 9 10 10 12 12 14 14 16 16 17 18 19 21 28 1 26 11 22 26 11 23 26 11 24 Web 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 4 4 8 2 2 4 20 4 4 8 4 4 8 2 2 4 4 4 32 4 4 12 4 4 4 4 4 4 4 4 8 2

More information