21 21 KEK 2010/3/19 Yoshimi Iida, KEK 2 1
J-PARC Japan Proton Accelerator Research Complex (JAEA) JAEA) KEK @ J-PARC PB JAEA KEK (KEK) (J-PARC) 2010/3/19 Yoshimi Iida, KEK 3 KEKCC J-PARC GRID JPARC-FW KEK intra DMZ KEK-FW KEKCC-FW SINET3 2010/3/19 Yoshimi Iida, KEK 4 2
High Performance Storage System 3PB 3PB+10TB Tape Disk Core server Mover API pftp Kerberos-ftp CIFS/NFS server cifs Work server scp server irods client 2010/3/19 Yoshimi Iida, KEK 5 integrated Rule-Oriented Data System DB DB 1 2010/3/19 Yoshimi Iida, KEK 6 3
## ## 2010/3/19 Yoshimi Iida, KEK 7 User Interface Web GUI Server Storage Rule Engine icat Database 2010/3/19 Yoshimi Iida, KEK 8 4
Client Server Storage Server Storage icat Database 2010/3/19 Yoshimi Iida, KEK 9 KEK J-PARC GRID JPARC-FW KEKCC-FW KEK intra DMZ KEK-FW SINET3 2010/3/19 Yoshimi Iida, KEK 10 5
KEK DB server (ICAT) server - (Tape library) Postgres server IBM x3650 QX5460 (4 core) Memory 8GB HDD 293.6GB RHEL 5.2 Postgres 8.2.5 server 2 IBM x3650 QX5460 (4 core) Memory 8GB HDD 293.6GB + 600GB Scientific Linux 4 2.1 - client GPFS client TS3500 6.2.2.2p 3PB in maximum (3000 vols) 10TB cache disk 10 tape drives 5 movers 2 servers 2010/3/19 Yoshimi Iida, KEK 11 KEK J-PARC KEK 1GB KEK J-PARC pftp put: 26MB/s Client pftp get: 33MB/s work server scp: : 24MB/s scp: : 4MB/s ssh server iput: : 43MB/s iget: : 40MB/s 2010/3/19 Yoshimi Iida, KEK 12 6
J-PARC KEK ( ) KEKCC Server A Server B Storage A icat Storage A A ( ) Storage AA Storage A A J-PARC Storage A A 2010/3/19 Yoshimi Iida, KEK 13 KEK 1 10 10 1MB 10 1MB 2 1 Storage A A Storage A A 1 3 1 Storage A A 1 J-PARC 1 Storage AA 2010/3/19 Yoshimi Iida, KEK 14 7
KEK 1 () 10 1MB acgeticatresults(*action,*condition,* (*Action,*Condition,*GenQOut) (*Action == listtime) msimakequery("data_name,, COLL_NAME, DATA_PATH, DATA_SIZE, DATA_MODIFY_TIME",*Condition,*Query)##msiExecStrCondQ uery(*query, *GenQOut)* GenQOut) nop##nopnop##nop acjparcrepl (COLL_NAME LIKE /KEKZone/ KEKZone/home/JPARC) && RESC_NAME = japrcresc acgeticatresults acgeticatresults(listtime,,, *B)##foreEachExec(*B, msi_jparc_replicate_file(*b, 600, 6 0, 1000000, hpssresc), nop) nop ( ) mytestrule.ir actestrule delayexec(<ef>5m</ef>, acjparcrepl Repl, nop) nop irule $ irule F mytestrule.ir 2010/3/19 Yoshimi Iida, KEK 15 J-PARC KEK KEKCC Server A Server B Storage A icat Storage AA Storage A A icat 2010/3/19 Yoshimi Iida, KEK 16 8
KEK 3 i-commands (CLI) Linux JUX (GUI) Davis (Web) 2010/3/19 Yoshimi Iida, KEK 17 i-commands Linux Windows Windows Windows zip i Unix-like 2010/3/19 Yoshimi Iida, KEK 18 9
i-commands iinit iexit iput iget ilsresource irule ils,, icd, ipwd, imkdir, imv, irm, ichmod, ipasswd, unix 2010/3/19 Yoshimi Iida, KEK 19 JUX GUI JUX (Java Universal explorer) Linux, Windows, Mac JUX GUI irods, srb, gsiftp irods 2010/3/19 Yoshimi Iida, KEK 20 10
JUX GUI 2010/3/19 Yoshimi Iida, KEK 21 Davis Web Davis (A webdav-/srb) Linux, Windows, Mac Apache Davis https https 2010/3/19 Yoshimi Iida, KEK 22 11
Web Web Davis 2010/3/19 Yoshimi Iida, KEK 23 2010/3/19 J-PARC KEK - JPARC 43MB/ 43MB/s CLI, GUI, Web 2010/3/19 Yoshimi Iida, KEK 24 12
2010/3/19 Yoshimi Iida, KEK 25 URL https://www.irods.org/index.php JUX https://forge.in2p3.fr/wiki/jux/jux Davis https://projects.arcs.org.au/trac/davis/wiki/wiki Start KEK http://wiki.kek.jp/display/irods/home 2010/3/19 Yoshimi Iida, KEK 26 13
KEK 1000 1000 -iput -ils 2010/3/19 Yoshimi Iida, KEK 27 (1) Linux Tape Disk Core server Mover API pftp Kerberos-ftp Normal-ftp CIFS/NFS server cifs Work server scp server irods client 2010/3/19 Yoshimi Iida, KEK 28 14
(1) Linux API (ClientAPI, ) Request Request pftp Request Request Kerberos-ftp Kerberos ftp NAT Linux Linux 2010/3/19 Yoshimi Iida, KEK 29 (2) Linux, Window, Mac Tape Disk Core server Mover API pftp Kerberos-ftp Normal-ftp CIFS/NFS server cifs Work server scp server irods client 2010/3/19 Yoshimi Iida, KEK 30 15
(2) Linux, Window, Mac cifs Windows SMB CIFS/NFS Windows Unix OS scp Unix OS OS winscp GUI 2010/3/19 Yoshimi Iida, KEK 31 (3) Linux, Window, Mac Tape Disk Core server Mover API pftp Kerberos-ftp Normal-ftp CIFS/NFS server cifs Work server scp server irods client 2010/3/19 Yoshimi Iida, KEK 32 16
irods ( ) Linux, Window, Mac Web KEKCC 2010/3/19 Yoshimi Iida, KEK 33 17