- PDF 無料ダウンロード

Size: px

Start display at page:

Download ""

いおりありたけ
5 years ago
Views:

1 MCMD Ruby Package Documentation NYSOL : Ver. 1.0 revise history: March 10, 2014 : nysol November 2, 2013 : first release Copyright c 2013 by NYSOL CORPORATION

3 Mcsvin CSV Mcsvout CSV Margs Mtable CSV meach mheader CSV mrecount CSV mkdir endlog errorlog messagelog

5 5 1

6 Ruby CSV CSV (Mcsvin) (Mcsvout) CSV (Mtable) CSV RFC4180 Hash Array 1.1 CSV #!/usr/bin/env ruby require "mcmd" # input.csv # customer,date # A, # A, MCMD::Mcsvin.new("i=input.csv -array"){ icsv MCMD::Mcsvout.new("o=output.csv f=customer,date"){ ocsv icsv.each{ flds ocsv.write(flds) 1.1 mcmd CSV Ruby CSV NYSOL Ruby mcmd Margs endmsg errormsg / Mtemp mcmd Ruby 1.9.2

7 nysol nysol nysol (

9 9 2

10 Mcsvin CSV CSV C++ key Hash Hash/Array (Array 2 ) RFC * MCMD::Mcsvin::new(arguments){block Mcsvin arguments i= (String) k= -nfn -array block each yield 1 each Array Hash Array Hash 2 ( ) (yield) * MCMD::Mcsvin::each{ val block * MCMD::Mcsvin::each{ val,top,bot block CSV 1) (k=) val 2) val top,bot val top bot Hash( Array) String k= true false k= true false * MCMD::Mcsvin::names() -nfn nil nfn Array Hash k= : MCMD::Mcsvin.new("i=input.dat k=key"){ csv

11 2.1 Mcsvin CSV 11 csv.each{ val,top,bot : bool top bot i = 1, 2,, n i ( key ) k i k 0 = k n+1 = ϕ k i (1 i n) ϕ { true, if ki k top = i 1 f alse, otherwise (2.1) { true, if ki k bot = i+1 f alse, otherwise (2.2) # dat1.csv,, A, ,10 B, ,40 MCMD::Mcsvin.new("i=dat1.csv"){ csv puts csv.names.join(",") csv.each{ val p val #,, [" "=>"A", " "=>" ", " "=>"10"] [" "=>"B", " "=>" ", " "=>"40"] 2 # dat1.csv, A, A, B, C, C, C, csv=mcmd::mcsvin.new("i=dat1.csv k= ") csv.each{ val,top,bot puts "#{val[ ],#{val[ ] top=#{top bot=#{bot" csv.close # A, top=true bot=false A, top=false bot=true B, top=true bot=true C, top=true bot=false

12 12 2 C, top=false bot=false C, top=false bot=true 3 -nfn Array # dat1.csv A, A, MCMD::Mcsvin.new("i=dat1.csv k=1 -nfn"){ csv puts csv.names # -> nil csv.each{ val p val # nil ["A"," "] ["A"," "] 4 Array # dat1.csv,, A, ,10 B, ,40 # -array Array MCMD::Mcsvin.new("i=dat1.csv -array"){ csv puts csv.names.join(",") csv.each{ val p val #,, ["A", " ", "10"] ["B", " ", "40"] Mcsvout : CSV Mtable : CSV Ruby 4 1 CSVScan LightCsv FasterCSV

13 2.1 Mcsvin CSV 13 CSV mcut M ( C++ ) Mcsvin CSVScan(C ) Ruby mcut Mcsvin mcut Mcsvin CSV parsing Array Ruby CSV ( : ) 10K 100K 1000K 2000K 3000K 4000K 5000K Mcsvin CSVScan LightCsv FasterCSV CSV mcut (real time) ( ) 10K K 25M 5 : CSVScan , FasterCSV 1.5.1, LightCsv CSV(Ruby 1.8.7) : Mac Book Pro, 2.66GHz Intel Core i7, 8GB, Mac OS X require rubygems require csv require fastercsv require lightcsv require csvscan require mcmd require benchmark puts Benchmark.measure{ (0...10).each{ i # Mcsvin csv=mcmd::mcsvin.new("i=data.csv -array"){ csv csv.each{ val # CSVScan File.open("data.csv","r"){ fp CSVScan.scan(fp){ row # LightCsv LightCsv.foreach("data.csv"){ row # FasterCSV FasterCSV.foreach("data.csv"){ row # CSV CSV.open("data.csv", r ){ row 2.1 ( ) Mcsvin ( 2.2) Array Hash 2

14 ( : ) 1000K 2000K 3000K 4000K 5000K Array Hash Array Hash

15 2.2 Mcsvout CSV Mcsvout CSV CSV C++ / RFC * MCMD::Mcsvout::new(arguments){block Mcsvout arguments o= (String) f= CSV ( ) (String Array) f= size= CSV size= CSV (Fixnum) precision= Float 10 C "%.ng" n 100/ bool= true false 1,0 * MCMD::Mcsvout::write(values) values (Array) CSV String, Fixnum, Bignum, Float, nil, true, false nil null CSV csv=mcmd::mcsvout.new("i=rsl.csv f=a,b,c"){ csv csv.write(["1",2,3.4]) csv.write([1,2,3,4,5]) csv.write([1,2]) # (rsl.csv) a,b,c 1,2,3.4

16 16 2 1,2,3 1,2, 2 CSV csv=mcmd::mcsvout.new("i=rsl.csv size=3"){ csv csv.write(["1",2,3.4]) csv.write([true,nil,false]) csv.write(["4\"5","","6,7"]) # (rsl.csv) 1,2,3.4 1,,0 "4""5",,"6,7" 3 (,bool ) MCMD::Mcsvout.new("i=rsl.csv size=3 precision=3 bools=t,f"){ csv csv.write([ , ]) # csv.write([123456,0]) # Fixnum csv.write([true,false]) # (rsl.csv) 0.123,1.23e ,0 T,F 4 # dat1.csv, A, B, MCMD::Mcsvin.new("i=dat1.csv -array"){ csvin MCMD::Mcsvout.new("i=rsl.csv f=#{csvin.names.join(",")){ csvout csvin.each{ val csvout.write(val) # rsl.csv, A, B, CSV Ruby 2 FasterCSV CSV

17 2.2 Mcsvout CSV ,10,100 null (/dev/null) 2.2 Mcsvout C++ Ruby 2.3 CSV ( : ) 10K 100K 1000K Mcsvout FasterCSV CSV (real time) 10K String, Fixnum, Float, true, false, nil 6 : FasterCSV CSV(Ruby 1.8.7) : Mac Book Pro, 2.66GHz Intel Core i7, 8GB, Mac OS X require rubygems require csv require fastercsv require mtools require benchmark $data = [" ", 10, 1.1, true, nil, false] puts Benchmark.measure{ (0...10).each{ i # Mcsvout MCMD::Mcsvout.new("o=/dev/null size=6){ csv ( ).each{ j csv.write($data) # FasterCSV FasterCSV.open("/dev/null", w ){ csv ( ).each{ j csv << $data # CSV CSV.open("/dev/null", w ){ csv ( ).each{ j csv << $data 2.2 ( ) Mcsvin : CSV

18 Margs keyword=value -keyword -keyword Bool (true/false) value Ruby String Fixnum Float --help help() --help * MCMD::Margs.new(ARGV[,allKeyWords][,mandatoryKeyWords][,helpFunction) Margs keyword= -keyword Hash Array ARGV allkeywords Ruby ARGV key=value -key ARGV allkeywords mandatorykeywords key=value mandatorykeywords helpfunction --help # $ ruby test.rb i=dat.csv -abc # test.rb args=margs.new(argv, "i=,v=,-abc") # OK args=margs.new(argv, "i=,v=") # -abc args=margs.new(argv, "i=,v=,-abc","i=,v=") # v= * MCMD::Margs.file(keyWord,mode): keyword key= (String) mode r (readable ) w (writable ) (String) keyword mode r mode w # $ ruby test.rb i=dat.csv # test.rb args=margs.new(argv)

19 2.3 Margs 19 puts args.file("i=","r") # dat.csv readable "dat.csv" puts args.file("i=","w") # writable "dat.csv" * MCMD::Margs.field(keyWord,fileName) keyword filename keyword filename "key=" (String) key=name 1 [:newname 1 %option 1 ],name 2 [:newname 2 %option 2 ],... (2.3) name i filename CSV "field name not found" name i newname i option i ( ) : % name i newname i option i Hash Hash names names (String Array) newnames newnames (String Array) nil options options (String Array) nil fld2csv "key=" CSV (filename) (0 )(String Array) csv2fld CSV "key=" (0 )(String Array) nil # test.csv fld1,fld2,fld3 1,2,3 4,5,6 # $ ruby test.rb f=fld1,fld3 # test.rb args=margs.new(argv) fld=args.field("f=","test.csv") p fld["names"] # -> ["fld1","fld3"] p fld["fld2csv"] # -> [0,2] fld1,fld3 test.csv 0 2 p fld["csv2fld"] # -> [0,nil,1] test.csv 0 f= 0 # $ ruby test.rb f=fld3:newfld3%n,fld2%nr # test.rb args=margs.new(argv) fld=args.field("f=","test.csv") p fld["names"] # -> ["fld3", "fld2"] p fld["newnames"] # -> ["newfld3", nil] p fld["options"] # -> ["n", "nr"] p fld["fld2csv"] # -> [2, 1] p fld["csv2fld"] # -> [nil, 1, 0]

20 20 2 * MCMD::Margs.str(keyWord[,default][,token1][,token2]) keyword default token1 token2 "key=" (String) nil token1 token2 keyword default default nil nil token1 token2 # $ ruby test.rb v=abc # test.rb args=margs.new(argv) puts args.str("v=") # ->"abc" puts args.str("w=") # -> nil puts args.str("w=","xyz") # -> "xyz" # $ ruby test.rb v=abc,efg:xyz,hij # test.rb args=margs.new(argv) puts args.str("v=") # ->"abc,efg:xyz,hij" puts args.str("v=",nil,",") # ->["abc", "efg:xyz", "hij"] puts args.str("v=",nil,",",":") # ->[["abc"], ["efg","xyz"], ["hij"]] * MCMD::Margs.float(keyWord[,default][,from][,to]): Float keyword default from to key= (String) (Float) nil (Float) (Float) keyword Float default # $ ruby test.rb v=0.12 # test.rb args=margs.new(argv) puts args.float("v=") # -> 0.12 puts args.float("v=",nil,0.2,0.3) # -> puts args.float("w=") # -> nil puts args.float("w=",0.1) # -> 0.1 * MCMD::Margs.int(keyWord[,default][,from][,to]) Fixnum

21 2.3 Margs 21 keyword default from to key= (String) (Float) nil (Float) (Float) keyword Float default # $ ruby test.rb v=10 # test.rb args=margs.new(argv) puts args.int("v=") # -> 10 puts args.int("v=",,20,30) # -> puts args.int("w=") # -> nil puts args.int("w=",15) # -> 15 * MCMD::Margs.bool(keyWord) Bool keyword -key (String) keyword true false # $ ruby test.rb -flag # test.rb args=margs.new(argv) puts args.bool("-flag") # -> true puts args.bool("-x") # -> false # $ ruby test.rb i=dat.csv v=value -abc # test.rb args=margs.new(argv, "i=,o=,w=,-flag,-x", "i=,w=") ifilename = args.file("i=") # -> "dat.csv" ofilename = args.str("o=","result.csv") # -> "result.csv" weight = args.float("w=",0.1,0.0,1.0) # -> 0.1 flag = args.bool("-abc") # -> true wflag = args.bool("-w") # -> false 2.3.3

22 Mtable CSV CSV (ex. to i) * MCMD::Mtable::new(arguments) Mtable arguments i= (String) -nfn 1 * MCMD::Mtable::cell(col=0, row=0) -> String row( ),col( ) row,col / 0 (Mcsvin 1 ) row,col nil row col col 0 col cell(col,0) col,row 0 0 cell(0,0) * MCMD::Mtable::names() -> String Array * MCMD::Mtable::name2num() -> String=>Fixnum Hash Hash * MCMD::Mtable::size() -> Fixnum # dat1.csv customer,date,amount A, ,10 B, ,40 tbl=mcmd::mtable.new("i=dat1.csv")

23 2.4 Mtable CSV 23 p tbl.names p tbl.name2num p tbl.size # -> 2 p tbl.cell(0,0) # -> "A" p tbl.cell(0,1) # -> "B" p tbl.cell(1,1) # -> " " p tbl.cell(1) # -> " " p tbl.cell # -> "A" # -> ["customer", "date", "amount"] # -> {"amount"=>2, "date"=>1, "customer"=>0 2 # dat1.csv customer,date,amount A, ,10 B, ,40 tbl=mcmd::mtable.new("i=dat1.csv -nfn") # p tbl.names # -> nil p tbl.name2num # -> nil p tbl.size # -> 3 p tbl.cell(0,0) # -> "customer" p tbl.cell(0,1) # -> "A" p tbl.cell(1,1) # -> " " p tbl.cell(1) # -> "date" p tbl.cell # -> "customer" Mcsvin : CSV

25 25 3

26 meach Array ) Array::meach(mpcount){ value block 2) Array::meach(mpcount){ value,count block value block count (0 ) mpcount # ( ) 2 # > [10,9,8,7,6].meach(2){ value,count > puts "#{value,#{count" > 10,0 9,1 8,2 7,3 6,

27 3.2 mheader CSV mheader CSV CSV ( ) MCMD::mheader(arguments) arguments i= (String) # dat1.csv #,, # A, ,10 # B, ,40 > p MCMD::mheader("i=dat1.csv") => [" ", " ", " "] 2 # dat1.csv # A, ,10 # B, ,40 > p MCMD::mheader("i=dat1.csv") => ["A", " ", "10"] Mcsvin : CSV Mtable : CSV

28 mrecount CSV CSV C++ (wc -l ) char MCMD::Mtable MCMD::mrecount(arguments) arguments i= (String) -nfn # dat1.csv,, A, ,10 B, ,40 p MCMD::mrecount("i=dat1.csv") # -> 2 p MCMD::mrecount("i=dat1.csv -nfn") # -> CSV CSV UNIX wc Mtable ,200,300,400, mrecount wc Mtable 5 6

29 3.3 mrecount CSV CSV ( : ) 1000K 2000K 3000K 4000K 5000K mrecount wc -l Mtable (real time) 1000K K 25M 5 : Mac Book Pro, 2.66GHz Intel Core i7, 8GB, Mac OS X require rubygems require mtools require benchmark puts Benchmark.measure{ (0...10).each{ i # mrecount p MCMD::mrecount("i=data.csv") # wc system "wc -l data.csv" # Mtable MCMD::Mtable("i=data.csv -array"){ tbl p tbl.recordsize 3.1 ( )

30 mkdir MCMD::mkDir(dirName[,rmExistingDir]) dirname rmexistingdir true dirname #./folder # > MCMD::mkDir("./folder") # true./folder > MCMD::mkDir("./folder",true) 3.4.3

31 3.5 endlog endlog MCMD #END# ; * MCMD::endLog(msg[,fileObject]) msg fileobject (STDERR) # > MCMD::endLog("mburst.rb ") #END# mburst.rb ; 2013/11/01 19:09: errorlog : messagelog :

32 errorlog MCMD #ERROR# ; MCMD::errorLog(msg[,fileObject]) msg fileobject (STDERR) # > MCMD::errorLog("mburst.rb ") #END# mburst.rb ; 2013/11/01 19:09: endlog : messagelog :

33 3.7 messagelog messagelog MCMD #MSG# ; * MCMD::messageLog(msg[,fileObject]) msg fileobject (STDERR) # > MCMD::messageLog("mburst.rb ") #END# mburst.rb ; 2013/11/01 19:09: errorlog : endlog :

35 35 4

36 MCMD MCMD KGMOD KGMOD Ruby MCMD KG_VerboseLevel Mcsvin error 2 + warning 3 + end 4 + msg ( ) $ irb > require mcmd # KG_Verbose=4 > MCMD::Mcsvin.new("i=dat.csv"){ csv csv.each{ flds #END# mcsvin i=dat.csv; ; 2013/08/08 15:18:52 > MCMD::Mcsvin.new("x=dat.csv"){ csv csv.each{ flds #ERROR# unknown parameter x= (mcsvin); mcsvin x=dat.csv; ; 2013/08/08 15:18:52 # KG_Verbose=1 > ENV["KG_VerboseLevel"] = "1" > MCMD::Mcsvin.new("i=dat.csv"){ csv csv.each{ flds > MCMD::Mcsvin.new("x=dat.csv"){ csv csv.each{ flds #ERROR# unknown parameter x= (mcsvin); mcsvin x=dat.csv; ; 2013/08/08 15:18:52 # KG_Verbose=0 > ENV["KG_VerboseLevel"] = "0" > MCMD::Mcsvin.new("i=dat.csv"){ csv csv.each{ flds > MCMD::Mcsvin.new("x=dat.csv"){ csv csv.each{ flds

ohp1.dvi

ohp1.dvi 2008 1 2008.10.10 1 ( 2 ) ( ) ( ) 1 2 1.5 3 2 ( ) 50:50 Ruby ( ) Ruby http://www.ruby-lang.org/ja/ Windows Windows 3 Web Web http://lecture.ecc.u-tokyo.ac.jp/~kuno/is08/ / ( / ) / @@@ ( 3 ) @@@ :!! ( )