2. HTML csh AWK AWK 1., 2., 3. 2 HTML HTML HyperText Markup Language WWW WWW (.html

Size: px

Start display at page:

Download "2. HTML 2 3. 1 1 100 6 4. csh AWK 4. 4. AWK 1., 2., 3. 2 HTML HTML HyperText Markup Language WWW WWW (.html"

なぎさつまがみ
7 years ago
Views:

1 1. 1 AWK HTML HTML Yahoo! 3 Yahoo! ( 1 Yahoo! : ( ) ( ) Netscape Netscape Yahoo!

jp/) 1 Yahoo! : http://headlines.yahoo.co.

2 2. HTML csh AWK AWK 1., 2., 3. 2 HTML HTML HyperText Markup Language WWW WWW (.html

3 2. HTML 3 ) HTML ( ) 2 HTML < > </ > < > 2 HTML : <html> <head> <title> </title> </head> <body> </body> </html> HTML HTML ( ) 4 < =" "...> 2 L A TEX 3 HTML HTML HTML 3 L A TEX 4 HTML

4 2. HTML 4 <html> </html>: HTML HTML 5 <head> </head>: HTML <title> </title>: HTML WWW <body> </body>: HTML HTML <br>: <hr>: + <b> </b>: <font> </font>: <small> </small>: <center> </center>: <h[n]> </h[n]>: ([n] ) <a> </a>: <div> </div>: <table> </table>: <tr> </tr>: <table> <td> </td>: <tr> 5 HTML xml DOCTYPE

<small> </small>: <center> </center>: <h[n]> </h[n]>: ([n] 1 6 1 ) <a> </a>:

5 3. YAHOO! 5 <script> </script>: Javascript <noscript> </noscript>: Javascript <form> </form>: <img>: : ( ) HTML HTML ([7], [8] ) HTML ([9] ) 3 Yahoo! Yahoo! HTML <table> ( <tr>, <td> ) WWW 6 <table> Yahoo! HTML <html> <head>  <title>yahoo! - XXXX - </title>... </head> <body marginheight=0 topmargin=0> <center>...  <table border=0 cellpadding=2 cellspacing=0 width=100%> <tr bgcolor="#9999cc"> <td nowrap> 6 table CSS

6 3. YAHOO! 6 <b><font size=+1> </font></b> <small> ( )12 00 </small> </td>...    <font size=5 class="s130"><b> </b></font> <br><br> ( )... <div align=right> XXXX </div><br> </td></tr>  <hr width=100% size=0> <small> <a href=" </a><br> Copyright (C) 2006 XXXX <br> Copyright (C) 2006 Yahoo Japan Corporation. All Rights Reserved. <br> </small> </center> </body> </html> <title> </title> 2.  <b><font size=+1>... </small> 3.  4.  Copyright (C) HTML

yahoo.co.jp/help/jp/news/"> </a><br> Copyright (C) 2006 XXXX <br> Copyright (C) 2006 Yahoo Japan Corporation. All Rights Reserved. <br> </small> </center> </body> </html>.

7 4. 7 AWK END <title> </title> 3 <title> </title> 3 <title>, </title> <title> </title> AWK getline 2. ( ) getline getline: $0 1, 0, 1 AWK ( ) getline : ($0 ~ /<title>/){ N=0 h[++n]=$0 while($0!~ /<\/title>/){

8 4. 8 getline h[++n]=$0 # h[1] ~ h[n] : ($0 ~ /<title>/){ flag=1; N=0 (flag==1){ h[++n]=$0 if($0 ~ /<\/title>/){ flag=0 # h[1] ~ h[n] $0 ~,!~ ~ / / :!~ / / : / / / \ \/ ( ) <title> </title> h[++n]=$0 str = str $0 AWK 2 getline </title> ( ) getline if(getline<=0){ errorexit=1; exit exit END errorexit ( ) END

$~ / / : / / / \ \/ ( ) <title> </title> h[++n]=$0 str = str $0 AWK 2 getline$

9 5. 9 END{ if(errorexit){ printf " (code = %d)\n",errorexit > "/dev/stderr" exit... END printf > "/dev/stderr" Unix AWK <title> </title> AWK 2 1. sub(), gsub() 2. substr() (match() index() ) sub(r,s,c): c ( $0) r s gsub(r,s,c): c ( $0) r s substr(s,n,len): s n len ( s ) index(s,c): s c (s ) ( 0 )

10 5. 10 match(s,r): s r (s ) ( 0 ) match() RSTART RLENGTH RSTART = r RLENGTH = r s="54321" match(s,/[2-4]*/) RSTART=2, RLENGTH=3 ( 432 ) [2-4] = 2,3,4 [2-4]* = 2,3,4 0 ( ) 432 c=substr(s,rstart,rlength) c 432 s="<title> </title>" 1. sub(), gsub() sub(/<title>/,"",s) sub(/<\/title>/,"",s)

11 5. 11 s= 2 sub() gsub() gsub(/<\/?title>/,"",s) \/? \/ <title> </title> gsub() ( ) 1 gsub() 2. substr() s <title> </title> n1=length("<title>") n2=length("</title>") s1=substr(s,n1+1,length(s)-n1-n2) length(s) s <title> </title> substr() match() index() if(match(s,/<title>[ \t]*/)) # [ \t] s=substr(s,rstart+rlength) # if(match(s,/[ \t]*<\/title>/)) s=substr(s,1,rstart-1) # sub() sub(/.*<title>[ \t]*/,"",s) #.* 0 sub(/[ \t]*<\/title>.*/,"",s) sub(), gsub() substr() + match() sub(), gsub()

$<title> </title> substr() match() index() if(match(s,/<title>[ \t]*/)) # [ \t] s=substr(s,rstart+rlength) # if(match(s,/[$

12 getline 5 sub(), gsub() 3 1. <title> </title> ##### ##### ($0 ~ /<title>/){ titlestr=$0 while(titlestr!~ /<\/title>/){ if(getline<=0){ errorexit=1; exit titlestr = titlestr $0 sub(/.*<title>[ \t]*/,"",titlestr) sub(/[ \t]*<\/title>.*/,"",titlestr) next 4, ##### ##### ($0 ~ / CONTENTS_TITLE_TABLE/){ # while($0!~ /<font size/) if(getline<=0){ errorexit=2; exit # headline headline=$0 while(headline!~ /<\/small>/){ if(getline<=0){ errorexit=3; exit headline = headline $0

$*<title>[ \t]*/,"",titlestr) sub(/[ \t]*<\/title>.*/,"",titlestr) next 4, 5 6.2 3 2.$

13 6. 13 # (font,small) gsub(/<\/?font[^>]*>/,"",headline) sub(/[ \t]*<small>[ \t]*/,"",headline) sub(/[ \t]*<\/small>.*/,"",headline) while($0!~ /\/CONTENTS_TITLE_TABLE/) if(getline<=0){ errorexit=4; exit next CONTENTS_TITLE_TABLE 1. while() <font size getline 2. headline </small> getline headline 3. headline (font, small) 4. /CONTENTS_TITLE_TABLE <font>, </font> gsub() <small>, </small> sub() font small <b>, </b> <font> <\/?font[^>]*> [^>] : > [^>]* : > 0 [^>]*> : > 0 > <font> <font size=+1> <font > >

$/CONTENTS_TITLE_TABLE <font>, </font> gsub() <small>, </small> sub() font small <b>, </b> <font> <\/?$

14 OUTLINE_TABLE HTML OUTLINE_TABLE ##### ##### # N_ot = OUTLINE_TABLE ($0 ~ / OUTLINE_TABLE/){ N_ot++ # OUTLINE_TABLE (N_ot==1 && $0 ~ / OUTLINE_TABLE/){ # while($0!~ /<font size/) if(getline<=0){ errorexit=5; exit # (body[1] ~ body[n_body]) N_body=0 do{ if($0 ~ /<\/?font/) gsub(/<\/?font[^>]*>/,"") body[++n_body]=$0 if(getline<=0){ errorexit=6; exit while($0!~ /<div/) # <div> (<br>) sub(/<div[^>]*>/,"<br>") body[++n_body]=$0 # </div> while($0!~ /<\/div/){ if(getline<=0){ errorexit=7; exit body[++n_body]=$0 # </div> sub(/<\/div>/,"",body[n_body]) next N_ot OUTLINE_TABLE OUTLINE_TABLE font div <div...> (<br>) </div>

$while($0!~ /<font size/) if(getline<=0){ errorexit=5; exit # (body[1] ~ body[n_body]) N_body=0 do{ if($0 ~ /<\/?font/) gsub(/<\/?$

15 6. 15 body 6.4 Copyright 3 4. Copyright ##### Copyright ##### ($0 ~ /\/YBB module/){ while($0!~ /Copyright/) if(getline<=0){ errorexit=8; exit N_tail=0 do{ gsub(/<\/?small>/,"") gsub(/<\/?center>/,"") tail[++n_tail]=$0 while($0!~ /<\/html>/ && getline>0) exit /YBB module Copyright </html> tail small center 6.5 END ##### ##### # function putheader(titlestr,headline) { print "<html>" print "<head>" printf "<title>%s</title>\n",titlestr print "</head>" print "<body>" printf "<h1>%s</h1>\n",titlestr

$center>/,"") tail[++n_tail]=$0 while($0!~ /<\/html>/ && getline>0) exit /YBB module Copyright </html> tail small center 6.$

16 6. 16 printf "%s<hr>\n",headline # function putbody(body,n, j) { for(j=1;j<=n;j++) print body[j] # function puttail(tail,n, j) { print "<hr>" for(j=1;j<=n;j++) print tail[j] putheader(): (titlestr) (<title> </title>) (<h1> </h1>) (headline) (<hr>) putbody(): puttail(): (<hr>) Copyright END ##### END ##### END{ if(errorexit){ printf " (code = %d)\n",errorexit > "/dev/stderr" exit putheader(titlestr,headline) putcontents(body,n_body) puttail(tail,n_tail)

$printf " (code = %d)\n",errorexit > "/dev/stderr" exit putheader(titlestr,headline) putcontents(body,n_body)$

17 ##### ##### ($0 ~ /<title>/){ titlestr=$0 while(titlestr!~ /<\/title>/){ if(getline<=0){ errorexit=1; exit titlestr = titlestr $0 sub(/.*<title>[ \t]*/,"",titlestr) sub(/[ \t]*<\/title>.*/,"",titlestr) next ##### ##### ($0 ~ / CONTENTS_TITLE_TABLE/){ # while($0!~ /<font size/) if(getline<=0){ errorexit=2; exit # headline headline=$0 while(headline!~ /<\/small>/){ if(getline<=0){ errorexit=3; exit headline = headline $0 # (font,small) gsub(/<\/?font[^>]*>/,"",headline) sub(/[ \t]*<small>[ \t]*/,"",headline) sub(/[ \t]*<\/small>.*/,"",headline) while($0!~ /\/CONTENTS_TITLE_TABLE/) if(getline<=0){ errorexit=4; exit next ##### ##### # N_ot = OUTLINE_TABLE ($0 ~ / OUTLINE_TABLE/){ N_ot++ # OUTLINE_TABLE (N_ot==1 && $0 ~ / OUTLINE_TABLE/){ # while($0!~ /<font size/)

$~ /<font size/) if(getline<=0){ errorexit=2; exit # headline headline=$0 while(headline!~ /<\/small>/){ if(getline<=0){ errorexit=3; exit headline = headline $0 # (font,small) gsub(/<\/?$

18 7. 18 if(getline<=0){ errorexit=5; exit # (body[1] ~ body[n_body]) N_body=0 do{ if($0 ~ /<\/?font/) gsub(/<\/?font[^>]*>/,"") body[++n_body]=$0 if(getline<=0){ errorexit=6; exit while($0!~ /<div/) # <div> (<br>) sub(/<div[^>]*>/,"<br>") body[++n_body]=$0 # </div> while($0!~ /<\/div/){ if(getline<=0){ errorexit=7; exit body[++n_body]=$0 # </div> sub(/<\/div>/,"",body[n_body]) next ##### Copyright ##### ($0 ~ /\/YBB module/){ while($0!~ /Copyright/) if(getline<=0){ errorexit=8; exit N_tail=0 do{ gsub(/<\/?small>/,"") gsub(/<\/?center>/,"") tail[++n_tail]=$0 while($0!~ /<\/html>/ && getline>0) exit ##### END ##### END{ if(errorexit){ printf " (code = %d)\n",errorexit > "/dev/stderr" exit putheader(titlestr,headline) putbody(body,n_body) puttail(tail,n_tail)

$~ /<\/div/){ if(getline<=0){ errorexit=7; exit body[++n_body]=$0 # </div> sub(/<\/div>/,"",body[n_body]) next ##### Copyright ##### ($0 ~ /\/YBB module/){ while($0!$

19 8. 19 ##### ##### # function putheader(titlestr,headline) { print "<html>" print "<head>" printf "<title>%s</title>\n",titlestr print "</head>" print "<body>" printf "<h1>%s</h1>\n",titlestr printf "%s<hr>\n",headline # function putbody(body,n, j) { for(j=1;j<=n;j++) print body[j] # function puttail(tail,n, j) { print "<hr>" for(j=1;j<=n;j++) print tail[j] 8 HTML AWK HTML HTML AWK AWK [1], [2], [3] [4], [5], [6] [1] AWK (2006) [2] AWK (2006) [3] AWK (2006)

$"%s<hr>\n",headline # function putbody(body,n, j) { for(j=1;j<=n;j++) print body[j] # function puttail(tail,n, j)$

20 8. 20 [4] A.V. B.W. P.J. ( ) AWK (2004) ( 1989) [5] D.Dougherty A.Robbins ( ) sed & awk (1997) [6] AWK 256 (1993) [7] HTML (1996) [8] HTML & XHTML & CSS (2002) [9] WWW

</ul> (XXX ) 15 ( )15 35 (XXX ) 15 ( ) [4] HTML HTML HTML HTML 1.  <b><font size=+1>xxx </font></b> <sm

</ul> (XXX ) 15 ( )15 35 (XXX ) 15 ( ) [4] HTML HTML HTML HTML 1.  <b><font size=+1>xxx </font></b> <sm 1. 1 2006 9 5 AWK HTML 2 1 [4] AWK Yahoo! : http://headlines.yahoo.co.jp/hl HTML HTML [4] HTML HTML ( ) HTML 3 2 Yahoo! Yahoo! ( ) (XXX ) - 15 ( )15 35