[1] [1, 2, 3] [1, 4, 5] 6 7 3 (0.66) (0.65) 1 [6] 0
1 1 2 3 2.1................................ 3 2.1.1.................................. 3 2.1.2.................................. 3 2.2........................... 3 3 5 3.1.................................... 5 3.2............................ 5 3.3..................................... 6 3.4.................................... 7 3.4.1 1:.................... 8 3.4.2 2:.................... 10 3.4.3 3:....................... 12 3.4.4 4:....................... 12 3.4.5 5:......................... 13 3.5........................ 13 3.6.................................. 17 3.7............................... 19 4 22 4.1....................... 22 4.2............................... 22 4.2.1.............................. 22 4.2.2................................ 24 1
4.3............................ 25 4.3.1................................ 25 4.3.2........................ 25 4.3.3......................... 27 4.3.4.............................. 28 4.3.5.................................. 28 4.4...................................... 31 5 32 5.1.................................... 32 5.1.1........................ 32 5.1.2......................... 33 5.2.................................. 33 5.2.1 1( )...................... 33 5.2.2 2( )...................... 35 5.3...................................... 38 5.4...................................... 40 6 41 2
3.1 ( 1 )........... 17 3.2 ( 2 )........... 18 3.3 (2CV ).......... 18 3.4 ( 1 ).................. 18 3.5 ( 2 ).................. 19 3.6.......................... 19 3.7............................. 20 3.8............................... 21 4.1 (1 )............................... 28 4.2 (2 )............................... 29 4.3 (3 )............................... 29 4.4 (4 )............................... 29 4.5........................ 29 4.6....................... 30 4.7................ 30 5.1..................... 35 5.2................. 35 5.3 ( )................... 38 5.4 ( )..................... 39 5.5 ( )................... 39 5.6 ( )..................... 39 3
3.1 n......................... 6 3.2.................................. 7 3.3................................ 8 3.4................................. 9 3.5 SVM............................... 10 3.6.................................... 11 3.7................................. 14 3.8............................... 15 3.9........................... 21 4.1.......................... 23 5.1............................... 34 5.2................................ 36 5.3................................ 37 4
1 [1] [1, 2, 3] [1, 4, 5] 1 2 3 3 [6] 1. ( 4 ) 1
2. ( ) ( 5 ) 3. ( 6 ) [6] 1 [6] 1 7 3 2
2 2.1 [6] 2.1.1 [6] 2.1.2 1 0.52 ( ) F 0.7 0.8 F 2.2 3
[7] 1 1. 2.. 3.. 4.. 5. 1,.. [9] [2] [3] [4] [5] 4
3 [6] [6] 3.1 3.3 100 3.3 100 2 3.2 n 1 n 1 n n 3.1 5
3.1: n 3.3 1 2013 10 30 1. 2. 100 3. 100 100 ( ) 1 Wikipedia:http://ja.wikipedia.org/wiki/ 6
1 4. 100 300 3.2 3.2: 3.4 5 1: 2: 7
3: 4: 5: (SVM) SVM 3.5 3.4.1 1: 1 1. ChaSen 2 3.3 - - - - EOS 3.3: 2. diff [11] 3.4 2 ChaSen:http://ChaSen-legacy.sourceforge.jp/ 8
- EOS - EOS 3.4: 3. 1 4. 50 4 9
PT1 ( ) PT2 3.4.2 2: 2 [10] ( SVM) 3.5 1 3.5 3.5: SVM 10
1. ChaSen 2. diff [11] 3. 2 ML1 X Y X Y ML2 4. 3.6 1( ) X 2 X 2 : : : 2( ) X 2 3.6: X X, : 11
1: 2 + 1 + 1 + 2 + 2: 2 + 1 + 1 + 2 + + + + 2 2 2 2 3.4.3 3: BL1 BL2 BL1 2 ML1 BL2 ML2 3.4.4 4: [8] 4 1 3 2 {a,b,c} d {a b c 1 :d} 12
2 ST1 ML1 3.6 PT1 PT2 ML1 BL1 ST2 ML2 3.6 PT1 PT2 ML2 BL2 3.4.5 5: 1 4 2 3.7 1. 2 A B 2. A B 1 3. B A 2 4. 1 4 5. 4 3.5 2 2 13
3.7: 14
3.8: ( ) ( l ) f(x) = sgn α i y i K(x i,x) + b i=1 b = max i,y i = 1b i + min i,yi =1b i 2 l b i = α j y j K(x j,x i ) j=1 (3.1) x ( ) x i y i (i = 1,...,l,y i {1, 1}) sgn sgn(x) = 1 (x 0) (3.2) 1 (otherwise) 15
α i (3.4) (3.5) (3.3) L(α) L(α) = l α i 1 l α i α j y i y j K(x i,x j ) (3.3) 2 i=1 i,j=1 0 α i C (i = 1,...,l) (3.4) l α i y i = 0 (3.5) i=1 K K(x,y) = (x y + 1) d (3.6) C,d C 1 d 2 α i > 0 x i (3.1) 16
3.6 (PT1 PT2) (ML1 ML2) (BL1 BL2) (ST1 ST2) ( ) ( ) ( ) ( ) ( ) ( ) 3.1 3.3 3.1 2 (2CV) 1 3.2 2CV 2 3.1 3.2 3.3 3.1: ( 1 ) PT1 0.64(32/50) 0.50(25/50) 0.32(16/50) 0.49(73/150) PT2 0.50(25/50) 0.64(32/50) 0.56(28/50) 0.57(85/150) ML1 0.58(29/50) 0.70(35/50) 0.58(29/50) 0.62(93/150) BL1 0.26(13/50) 0.68(34/50) 0.32(16/50) 0.42(63/150) ST1 0.60(30/50) 0.82(41/50) 0.58(29/50) 0.67(100/150) 17
3.2: ( 2 ) PT1 0.64(32/50) 0.62(31/50) 0.32(16/50) 0.53(79/150) PT2 0.66(33/50) 0.68(34/50) 0.54(27/50) 0.63(94/150) ML1 0.58(29/50) 0.80(40/50) 0.54(27/50) 0.64(96/150) BL1 0.26(13/50) 0.64(32/50) 0.34(17/50) 0.41(62/150) ST1 0.52(26/50) 0.70(35/50) 0.60(30/50) 0.61(91/150) 3.3: 3 PT1 0.64(64/100) 0.56(56/100) 0.32(32/100) 0.51(152/300) PT2 0.58(58/100) 0.66(66/100) 0.55(55/100) 0.60(179/300) ML1 0.56(56/100) 0.75(75/100) 0.56(56/100) 0.62(187/300) BL1 0.26(26/100) 0.66(66/100) 0.33(33/100) 0.42(125/300) ST1 0.56(56/100) 0.76(76/100) 0.59(59/100) 0.64(191/300) 1 0.57(57/100) 0.70(70/100) 0.59(59/100) 0.62(186/300) 3.4 3.6 3.4 2CV 1 3.5 2CV 2 3.4 3.5 3.6 3.4: ( 1 ) PT1 0.74(37/50) 0.78(39/50) 0.34(17/50) 0.62( 93/150) PT2 0.52(26/50) 0.78(39/50) 0.58(29/50) 0.63( 94/150) ML2 0.66(33/50) 0.86(43/50) 0.66(33/50) 0.73(109/150) BL2 0.64(32/50) 0.82(41/50) 0.44(22/50) 0.63( 95/150) ST2 0.68(34/50) 0.88(44/50) 0.64(32/50) 0.73(110/150) 3.3 3.6 3 ML1 ML2 ST1 ST2 1 2 3.3 6 3.6 7 6 7 3.7 3.8 18
3.5: ( 2 ) PT1 0.72(36/50) 0.82(41/50) 0.32(16/50) 0.62( 93/150) PT2 0.68(34/50) 0.82(41/50) 0.56(28/50) 0.67(103/150) ML2 0.60(30/50) 0.78(39/50) 0.66(33/50) 0.68(102/150) BL2 0.70(35/50) 0.78(39/50) 0.42(21/50) 0.63( 95/150) ST2 0.62(31/50) 0.76(38/50) 0.62(31/50) 0.67(100/150) 3.6: 3 PT1 0.73(73/100) 0.80(80/100) 0.33(33/100) 0.62(186/300) PT2 0.60(60/100) 0.80(80/100) 0.57(57/100) 0.66(197/300) ML2 0.65(65/100) 0.81(81/100) 0.65(65/100) 0.70(211/300) BL2 0.67(67/100) 0.80(80/100) 0.43(43/100) 0.63(190/300) ST2 0.65(65/100) 0.82(82/100) 0.63(63/100) 0.70(210/300) 2 0.73(73/100) 0.76(76/100) 0.65(65/100) 0.72(216/300) 3.7 6 7 3.9 ( [6] ) 19
3.7: ( ) 100 ( ) ( ) ( ) ( ) ( ) ( ) 20
3.8: ( ) ( ) 3.9: 21
4 [6] 1 4.1 (4.2 ) (4.3 ) 4.2 4.2.1 2 4.1 500 1,000 2 A( ) B( ) 22
1 1 2 2 3 2 1 3 2 4 4 5 5 6 S T N 6 S T N 4.1: 23
4.2.2 3 1: 100 10 10 1 2: 3: 24
4.3 4.3.1 2 4.3.2 2 2 1( ) ChaSen : : 2( ) 3( ) x = N V [V : N ] (4.1) 1 x 0.1 5 25
1 1.0 x 1.1 2 1.1 x 1.2 3 1.2 x 1.3 4 1.3 x 1.4 5 1.4 x 4(2 ) 2 5(2 ) 2 4 6( ) 7( ) 8( ) ( ) 10 49 :40 50 :50, : 1: + + + 2: + + + + 3: + 1 4: 2 + 2 + 2 + 5: 2 + 2 + 2 + 26
6: +1 7: +2 8: +40 + + + + 1 2 + 2 2 + +1 +2 +40 10 4.3.3 3( ) 4.1 10 0.4 0.1 27
4.3.4 4.2.1 A B A B 4.3.5 10 1 4.1 5.1.1 4.1: (1 ) 1 0.536(268/500) 2 0.482(241/500) 3 0.616(308/500) 4 0.474(237/500) 5 0.494(247/500) 6 0.582(291/500) 7 0.598(299/500) 8 0.572(286/500) 4.1 3 4.2 4.3 4.4 4.4 [3,6,8,7] 0.634 4.3 [3,6,8] 0.648 [3,6,8] 4.5 0.542 0.648 28
4.2: (2 ) 3,1 0.570(285/500) 3,2 0.590(295/500) 3,3-3,4 0.522(261/500) 3,5 0.552(276/500) 3,6 0.620(310/500) 3,7 0.610(305/500) 3,8 0.584(292/500) 4.3: (3 ) 3,6,1 0.598(299/500) 3,6,2 0.626(313/500) 3,6,3-3,6,4 0.540(270/500) 3,6,5 0.548(274/500) 3,6,6-3,6,7 0.628(314/500) 3,6,8 0.648(324/500) 4.4: (4 ) 3,6,8,1 0.582(291/500) 3,6,8,2 0.626(313/500) 3,6,8,3-3,6,8,4 0.538(269/500) 3,6,8,5 0.568(284/500) 3,6,8,6-3,6,8,7 0.634(317/500) 3,6,8,8-4.5: 1,2,3,4,5,6,7,8 0.542(271/500) 29
4.6 1.4 ±0.1 1.4 0.620 1.3 1.5 1.4 4.6: 1.0 0.494(247/500) 1.3 0.590(295/500) 1.4 0.620(310/500) 1.5 0.610(305/500) 1.8 0.542(271/500) 2.2 0.504(252/500) 2.6 0.504(252/500) 3.0 0.504(252/500) [3,6,8] 1.4 [6,8]. 4.7 4.7: : [6,8] 0.584 (292/500) : [3,6,8] 0.660(330/500) 0.648(324/500) 30
SVM 1 n 2 1 2 4.4 4.1 0.616 4.3 ( 3) ( 6,7) ( 8) 4.7 (0.66) (0.65) 0.584 31
5 1 [6] 5.1 2 5.1.1 [6] 1( ) 2( ) 3(3 ) 3 4( ), : 1: + +... 2: + +... 3: + +... 32
4: + 1 + + + 3 + + 1 5.1.2 1 2 0.1 5.2 5.2.1 5.2.2 2 5.2.1 1( ) 1 (KNB ) 2 5.1 1. KNB 5.1 5.2 2. 100 ( ) 1 Wikipedia:http://ja.wikipedia.org/wiki/ 2 KNB http://nlp.kuee.kyoto-u.ac.jp/kuntt/ 33
5.1: 34
5.1: 1 5.2: 5.2 800 400 5.2.2 2( ) 5.3 650 650 1,300 500 35
1 1 2 2 3 3 4. 4. 5 5 6 6 7 7 8 8 9 9 5.2: 36
1 1 2 2 3 3 4 4 5 5 6 6 7 12 7 12 8 8 9 9 10 10 11 11 5.3: 37
5.3 10 4 2 0.1 F = (5.1) = (5.2) (5.1) (5.2) (5.3) F F = (5.3) F 5.3 5.4 5.3: ( ) F 1,2,3,4 0.573(229/400) 0.420( 68/162) 0.469( 68/145) 0.443 1,2,3 0.570(228/400) 0.395( 64/162) 0.464( 64/138) 0.427 5.5 5.6 [1,2,3,4] 0.573 F 0.443 (0.570) F (0.427) 5.4 5.6 1.5 0.620 1.2 0.568 1 38
5.4: ( ) F 1.0 0.405(162/400) 1.000(162/162) 0.405(162/400) 0.577 1.1 0.580(232/400) 0.469( 76/162) 0.481( 76/158) 0.475 1.2 0.595(238/400) 0.210( 34/162) 0.500( 34/ 68) 0.296 1.3 0.613(245/400) 0.105( 17/162) 0.630( 17/ 27) 0.180 1.4 0.620(248/400) 0.080( 13/162) 0.812( 13/ 16) 0.146 1.5 0.620(248/400) 0.068( 11/162) 0.917( 11/ 12) 0.126 1.6 0.620(248/400) 0.068( 11/162) 0.917( 11/ 12) 0.126 1.7 0.608(243/400) 0.037( 6/162) 0.857( 6/ 7) 0.071 1.8 0.600(240/400) 0.019( 3/162) 0.750( 3/ 4) 0.036 1.9 0.600(240/400) 0.012( 2/162) 1.000( 2/ 2) 0.024 2.0 0.598(239/400) 0.006( 1/162) 1.000( 1/ 1) 0.012 5.5: ( ) F 1,2,3,4 0.526(263/500) 0.420( 97/231) 0.485( 97/200) 0.450 1,2,3 0.516(258/500) 0.407( 94/231) 0.472( 94/199) 0.437 5.6: ( ) F 1.0 0.462(231/500) 1.000(231/231) 0.462(231/500) 0.632 1.1 0.550(275/500) 0.355( 82/231) 0.519( 82/158) 0.422 1.2 0.568(284/500) 0.139( 32/231) 0.653( 32/049) 0.229 1.3 0.542(271/500) 0.013( 3/231) 0.750( 3/ 4) 0.026 1.4 0.536(268/500) 0.000( 0/231) 0.000( 0/ 1) 0.000 : : : : : 1.9 0.536(268/500) 0.000( 0/231) 0.000( 0/ 1) 0.000 2.0 0.536(268/500) 0.000( 0/231) 0.000( 0/ 1) 0.000 39
5.4 1. [6] F 0.62. 40
6 6 7 7 3 (0.66) (0.65) 1 [6] 41
C C 42
[1], (2008),,, vol.29, No.1, pp.25-32 [2] Masaki Murata, Hitoshi Isahara(2002), Automatic detection of mis-spelled Japanese expressions using a new method for automatic extraction of negative examples based on positive examples, IEICE Transactions, VOL.E85-D, No.9, pp.1416-1424 [3], (2004),,, 3, pp.85-88 [4],,, (2000), Vol.7 No.4 pp.163-180 [5],,, (1999),,, Vol.6, No.7, pp.61-73 [6],, (2012), 18, pp.1114-1117 [7],, (1999),,, Vol.6, No.6, pp.45-64 [8],, (2006),,, Vol.5, pp.89-92 [9],,,, (2011),, (TL), Vol.111, No.98, pp.25-30 43
[10],,, (2002), SENSEVAL2J CRL, Vol.10, No.3 pp.115-132 [11] (2002) diff - mduff,, Vol.9, No.2, pp.91-110 44