1. 1 DBMS Unix (USP ) ( )[3] 20 UNIX [2] KISS UNIX 1. 2 (Tukubai ) Unix OS Unix USP Tukubai Tukubai 1. 3 Unix SQL Tukubai usp Tukubai Open usp Tukubai

Size: px

Start display at page:

Download "1. 1 DBMS Unix (USP ) ( )[3] 20 UNIX [2] KISS UNIX 1. 2 (Tukubai ) Unix OS Unix USP Tukubai Tukubai 1. 3 Unix SQL Tukubai usp Tukubai Open usp Tukubai"

なごみてらわ
5 years ago
Views:

1 34 (2017 ) Unix UNIX 20 RDBMS RDBMS Java Unix Unix Unix Unicage is a system development method based on UNIX philosophy and has been applied on business system integration for 20 years. In these days, almost all business system is based on RDBMS. All data is stored in RDBMS and processed by some programs written in programming language such like Java. In other hands, the systems developed by Unicage is based on only Unix functions, because Unicage can build database system. All data is tored in text files of Unix file system and processed by shell commands those are invoked by shell script and cooperating by Unix pipe. In this paper, the authors explain how to construct databese and operate the data bye Unicage, and about comparison between Unicage system and RDBMS based system. 1 Unicage : Database development method by Unix File System and Schellscript This is an unrefereed paper. Copyrights belong to the Author(s). Nakamura Kazutaka Tounaka Nobuaki,, Universal Shell Programming Laboratory Ltd.. RDBMS 1 Java 1 Relational DataBase Management System

2 1. 1 DBMS Unix (USP ) ( )[3] 20 UNIX [2] KISS UNIX 1. 2 (Tukubai ) Unix OS Unix USP Tukubai Tukubai 1. 3 Unix SQL Tukubai usp Tukubai Open usp Tukubai usp Tukubai 2 ( ) Unix

3 2. 1 Unix Unix Unix OS Unix Tukubai Unix Tukubai Unix Unix Unix crond sshd httpd Web RAM Unix NFS ( ) UTF ( ) ( )

4 () ( ) crond DATAMASTER L1: 1 L1( 1) L1 L1 L1 L1 L1 L1GET

5 L2: 2 L2( 2) L2 L1 L1 L2 L2 Tukubai L1 L2 Execl rexce L2 L2MAKE L3: 3 L3( 3) L3 L2 L3 L3 L3 L3 2 1 () L2 2 L2 L3 ( ) L3 ( ) L3 L3 L3 L3 L3 L3MAKE APPMASTER L5: 5 ( 4 ) L5( 5) L5 L5 L3 L1 L4 L5 L1

6 L5 L5 L5 Tukubai Execl wexce L5 L5MAKE L4: 4 L4( 4) L3 L5 L5 L3 L4 L5 L4 L4 ( ) L4 L4MAKE 3 () 3. 1 DATA : L1 : L1 ($lv1d) L2 : L2 ($lv2d) L3 : L3 ($lv3d) SCRIPT : APP : REPORT : L4 : L4 ($lv4d) SCRIPT : SHCED : 2 5 DATA APP/REPORT DATA/L1 lv1d $lv1d $lv1d $lv3d 3 TENPO URE $lv3d URE_TEN_MON

7 POS ID ID ID ID ID ID ID ID ID ( ) ID /11 3,068,087,304 ID YYYY/MM

8 L1GET: L1 Web L1GET 3. 2 L1 $ cat $lv1d/ure/0001/ ID <YYYYMMDDHHMMSS>.< ID> 3 3 L1 L1GET 3. 4 L2MAKE: L2 L1 L L1 L2 echo $lv1d/ure/????/ ??????.* xargs cat > $lv2d/ure/ L1 2 ID cat ID xargs L2MAKE L1 L2MAKE 3. 5 L3MAKE: L3 $lv3d/ure/ L L2 L3 L3 L2 L3

9 up3 key=1/2 $lv3d/ure/ \ $lv2d/ure/ > $lv3d/ure/ new mv $lv3d/ure/201704{.new,} 1 2 up3 key=1/2 1 ID 2 L3 L2 3 2 mv L2 L3 $lv3d/ure_ten_mon/2017 self $lv2d/ure/ up3 key=1/2 $lv3d/ure_ten_mon/ sm > $lv3d/ure_ten_mon/2017.new mv $lv3d/ure_ten_mon/2017{.new,} 1 self YYYYMMDDHHMMSS YYYYMM 2 up3 3 sm ID 2 $lv3d/tenpo/id_name : ID, $lv3d/tenpo/id_tel : ID, $lv3d/tenpo/id_name loopj $ loopj num=1 $lv3d/tenpo/id_{name,tel} loopj num= L3 L2 L3

10 3. 6 L4MAKE: L3 L3 L2 $lv2d/tenpo/tenpo_op L3 $ loopj num=1 $lv3d/tenpo/id_{name,tel} > up3 key=1 - $lv2d/tenpo/tenpo_op > getlast key=1 > delr 4 L L4 L5 2 > self 1/3 > $lv3d/tenpo/new self 1 2 $lv3d/tenpo/new > $lv3d/tenpo/id_name self 1 3 $lv3d/tenpo/new > $lv3d/tenpo/id_tel rm $lv3d/tenpo/new loopj 2 up3 key=1 1 3 getlast key=1 1 ( ) 4 delr 4 5 self(select Field) 1/3 1 3 $lv3d/tenpo/new L5 L3 L3 L join2 key=1 $lv3d/tenpo/id_name \ $lv3d/ure_ten_mon/2017 > $lv4d/ join2 $lv3d/ure_ten_mon/2017 $lv3d/tenpo/id_name key=1 1 $lv4d/ L5 L L4

11 L4 L4 keycut $lv4d/% $lv4d/ keycut $lv4d/2017 $lv4d/ ID $lv4d/0001/2017 L5 ID 1 500MBi 1 ID ID N 3. 7 L5MAKE: L4 L5 ID L5 selr $lv4d/ dayslash yyyy/mm 3 comma 4 1 selr ID /04 ID 2 dayslash 3 YYYYMM YYYY/MM 3 comma L1 L4 L4 L1 L ID { selr $lv4d/ cat $lv1d/ure/ ??????.* self join2 key=1 $lv3d/tenpo/id_name } sm dayslash yyyy/mm 3 comma L5 4 6 ID

12 4 2 L4 $lv4d/ sm RDBMS 4. 1 RDBMS OS Tukubai L1GET L2MAKE L3MAKE L4MAKE (L5MAKE ) OS L1 L5 L1 OS Unix rename(2) mv file.new file 4. 2 BASE BASE LV1 ACID 5 3

13 5. 1 time L1 L4 () L5 ( ) L2MAKE.URE : L2MAKE L3MAKE.URE_TEN_MON : L3MAKE L4MAKE.URE_TEN_MON : L4MAKE L5MAKE.URE_TEN_MON : L5MAKE( ) L5MAKE.URE_TEN_MON CPU : Intel(R) Xeon(R) 3.20GHz 8 Cores Mem : 47 GiB OS : CentOS Linux release (Core) MySQL : Ver Distrib , for Linux (x86 64) using EditLine wrapper UTF-8 yum Linux / / L1 L2MAKE L2MAKE L2MAKE L3 L1 0 time L4 1

14 12 L POSIX POSIX Unix version 7 join(1) SQL join cut(1) paste(1) sort(1) -k -m awk(1) Tukubai 6. 2 NYSOL 1970 [4] 2 (RPG ) NYSOL [1] NYSOL KDD(Knowledge Discovery in Database) POSIX POSIX UNIX POSIX [5] POSIX Unix OS POSIX POSIX USP InfiniBand usp BOA Hadoop

15 7. 2 NYSOL RDBMS NoSQL Java 7. 3 / RDBMS NoSQL UNIX UNIX [1] Cheung, S., Nakamoto, M., and Hamuro, Y.: NYSOL: A User-Centric Framework for Knowledge Discovery in Big Data, International Journal of Knowledge Engineering, Vol. 1, No. 3(2015). [2] Gancarz, M.,, and : UNIX :,, [3] :,, [4] :, 2020, [5],,, : POSIX,, 2016, Vol. 2016(2016), pp

Vol.55 No (Jan. 2014) saccess 6 saccess 7 saccess 2. [3] p.33 * B (A) (B) (C) (D) (E) (F) *1 [3], [4] Web PDF a m

Vol.55 No (Jan. 2014) saccess 6 saccess 7 saccess 2. [3] p.33 * B (A) (B) (C) (D) (E) (F) *1 [3], [4] Web PDF a m Vol.55 No.1 2 15 (Jan. 2014) 1,a) 2,3,b) 4,3,c) 3,d) 2013 3 18, 2013 10 9 saccess 1 1 saccess saccess Design and Implementation of an Online Tool for Database Education Hiroyuki Nagataki 1,a) Yoshiaki