3 4 26 1980 1 WWW 26! 3,

ii 4 7!! 4 2010 8

1. 1.1... 1 1.2... 2 1.3... 3 1.4... 7 1.5... 9... 9 2. 2.1... 10 2.2... 13 2.3... 16 2.4... 18... 21 3. 3.1... 22 3.2... 24 3.3... 33... 38

iv 4. 4.1... 39 4.2... 41 4.3... 43 4.4 CKY... 48 4.5... 53 4.6... 61 4.7... 63 4.8... 66... 67 5. 5.1... 69 5.2... 73 5.3... 78 5.4... 81... 82 6. 6.1... 83 6.2... 84 6.2.1... 88 6.2.2... 89 6.2.3... 94

v 6.3... 95 6.3.1... 96 6.3.2... 101 6.3.3... 102 7. 7.1... 106 7.1.1... 106 7.1.2... 109 7.1.3... 110 7.2... 111 7.3... 113 7.3.1... 114 7.3.2... 116 7.3.3... 119 7.4... 122 7.5... 125 7.6... 133 7.7... 138 7.8... 139... 141... 142... 146... 153

1 1.1 natural language C, Ruby, Perl natural language processing artificial intelligence 1990

2 1. WWW 7 1.2 1940 1950 1970 1990 WWW

1.3 3 HDD 2 1.3 machine translation 7.1 Time flies like an arrow.

4 1. 1966 Joseph Weizenbaum ELIZA 56) 1 ELIZA 1.1 ELIZA ELIZA Turing test 2 1960 i am X how long have you been X?.... X i am unhappy how long have you been unhappy? ELIZA Emacs/Mule M-x doctor 1 2 Alan Turing 1950 Loebner prize http://www.loebner.net/prizef/loebner-prize.html URL

1.3 5 Men are all alike. IN WHAT WAY They re always bugging us about something or other. CAN YOU THINK OF A SPECIFIC EXAMPLE Well, my boyfriend made me come here. YOUR BOYFRIEND MADE YOU COME HERE He says I m depressed much of the time. I AM SORRY TO HEAR YOU ARE DEPRESSED It s true. I am unhappy. DO YOU THINK COMING HERE WILL HELP YOU NOT TO BE UNHAPPY I need some help, that much seems certain. WHAT WOULD IT MEAN TO YOU IF YOU GOT SOME HELP Perhaps I could learn to get along with my mother. TELL ME MORE ABOUT YOUR FAMILY My mother takes care of me. WHO ELSE IN YOUR FAMILY TAKES CARE OF YOU My father. YOUR FATHER Youarelikemyfatherinsomeways. WHAT RESEMBLANCE DO YOU SEE You are not very aggressive but I think you don t want me to notice that. WHAT MAKES YOU THINK I AM NOT VERY AGGRESSIVE You don t argue with me. WHY DO YOU THINK I DON T ARGUE WITH YOU You are afraid of me. DOES IT PLEASE YOU TO BELIEVE I AM AFRAID OF YOU My father is afraid of everybody. WHAT ELSE COMES TO MIND WHEN YOU THINK OF YOUR FATHER Bullies. DOES THAT HAVE ANYTHING TO DO WITH THE FACT THAT YOUR BOYFRIEND MADE YOU COME HERE 1.1 ELIZA 6) ELIZA Twitter bot 1972 Terry Winograd SHRDLU 57) SHRDLU ETAOINSHRDLU...

6 1. green red red blue green red green 1.2 blue SHRDLU 1.2 1.2 Pick up the blue box on the table. Put it on the green box on the red box. SHRDLU GoogleYahoo!

101 8 43 61 43 LR 47 84 7, 69 77 73 96 41 107 12, 77 43 71 96 11, 73 72 64 55 13 2, 23 18, 125 2, 3, 106 18 41 18 22 7, 22 29 20 103 18 23 106 111 15 103 107 104 54 108 7, 39 39 39 53 85 71, 80 26, 29 3, 14 127, 139 119, 125 121 44 88 28 114 37, 110 18 48 103 134 1 1 12, 77, 103 112, 138 114 96 96 41 135 117 84 84 89 2, 112, 113 112, 125 103 84 85 5

154 71 132 41 107 41 119, 125 8 103 37 8 84 89 77, 87 85 62 63 103 15 14 43, 55 63 63 22 10, 24 37 106 22, 24 83 85 102 95 85 101 33 53 53 20, 128 109 106, 109 4 122 48 101 22, 83 112, 122 139 84 95 102 112, 122 112 99, 112, 133 110 44 30 43, 55 16 106, 107 18 14 13 WordNet 13 71 40 40 16 39 135 14 41 30, 36 45 58 71 106 81, 139 71 22, 33 122 55 116 114 22 118 29 136 40 42 41 7, 83 41 18, 125 13 122 34

80 115 107 134 62 43, 55 111 106 Charniak Parser 67 CKY 48 Collins Parser 67 CSG 41 D DF 118 DP 30 E EBMT 109 107 133 109 75 116 43, 55 133 ELIZA 4 A extract 135 abstract 135 F, G, H B F 120 Balanced Contemporary Corpus for Written GETA Hyper Estraier 139 139 Japanese 15 BCCWJ 15 I, J, K BNC 15 IDF 118 British National Corpus 15 JUMAN 33 Brown Corpus 15 k 123 KNP 67 C k-nn 123 Cabocha 67 CFG 41 L, M Lucene 139 MeCab 33 N Namazu 139 N-best 32 n-gram 16 P PCFG 64 Penn Treebank 14 155 25 88 12, 75 24 R right association 63 Roget 13 RST 96 S SHRDLU 5 Sidner 90 SMT 110 SRL 73 SVM 18, 125 T TF 117 TF 117 TF-IDF 119 W WordNet 13 WSD 71 X Xerox Tagger 37

1984 1989 1989 1992 2000 2007 2009 Introduction to Natural Language Processing c Manabu Okumura 2010 2010 10 28 1 112 0011 4 46 10 CORONA PUBLISHING CO., LTD. Tokyo Japan 00140 8 14844033941 3131 :// ISBN 978 4 339 02451 7 Printed in Japan