Peter Arzberger, Philip Papadopoulos, PRAGMA PARTNERS Tele-science on Tomography Pacific Osaka U. SDSC Rim Application

Size: px

Start display at page:

Download "Peter Arzberger, Philip Papadopoulos, PRAGMA PARTNERS Tele-science on Tomography Pacific Osaka U. SDSC Rim Application"

わんどはなだて
5 years ago
Views:

1 (BioGrid Project) IT e-science in silico San Diego Supercomputer Center (USA) Nanyang Technological University Pharmaceutical (Singapore) Industry ( ) IT BioGrid network : NEC : : NEC : : ITBL BIRN (BioMedical Information Research Network) NC Biogrid BII@SINGAPORE /OBIGRID UK E-Science Project GGF/Semantic Grid RG Science is an intrinsically global activity MEG PRAGMA (Pacific Rim Application and Grid IVOA Middleware Assembly ) The grid is transforming computing and BIRN collaboration BII CAS GGF/Life Science WG Founding Motivations The problem remains that the grid is too hard to use Middleware software needs to interoperate Peter Arzberger, parzberg@ucsd.edu Philip Papadopoulos, phil@sdsc.edu

Peter Arzberger, parzberg@ucsd.edu Philip Papadopoulos, phil@sdsc.edu PRAGMA PARTNERS Tele-science on Tomography Pacific Osaka U.

2003 Affiliate Member 8 Goal Telecontrol System for UHVEM Improve throughput of observation facility providing the following functions by the introduction of Grid: Data analysis function Knowledge

2 Peter Arzberger, Philip Papadopoulos, PRAGMA PARTNERS Tele-science on Tomography Pacific Osaka U. SDSC Rim Application NCHC Grid Middleware Assembly igrid 02, joint demo, Sep SC 02, HPC Challenge, Nov NCHC will host 5th PRAGMA in Oct Affiliate Member 8 Goal Telecontrol System for UHVEM Improve throughput of observation facility providing the following functions by the introduction of Grid: Data analysis function Knowledge sharing function Telecontrol function Control Signals over TCP/IP Sun Ultra Solaris WS Server software with GUI Using OS dependent GUI library Developed by Hitachi High Technologies Shutter control for film camera Global Network Windows PC Control Client with knob box Visual Basic Developed by Hitachi High Technologies Over International Collaboration Windows PC CCD Control software EMMENU3 Developed by Tietz No control path between client and CCD PC Akiyama Data analysis function Progresses Image data analysis on UHVEM and High resolution CT (SPring-8) Real-time analysis of large scale data obtained from special devices Dataflow optimiaztion Adaptive visualization system for handling various environments GT3 enabled new architecture of telescience portal (NCMIR, SDSC) Telecontrol and analysis system for UHVEM (Cybermedia Center, NCHC) Pipelined image processing method (Cybermedia Center) New HDTV codec using JPEG2000 (KDDI R&D Laboratory) Provided by Dr. Naoko Yamada (NCMIR) Akiyama

3 Demonstration HDTV codec using JPEG2000 Telecontrol and image processing system prototype HDTV transfer system (demonstrated at NPACI booth) Image analysis web portal (demonstrated at BioGrid booth) Previous codec was using MPEG2 JPEG2000 enables us to Show clear image Control bandwidth to be required SC2003 Collaborations MoU among NCMIR (UCSD), CMC, UHVEM, (Osaka Univ), KDDI, KBSI Our Goals Develop telescience portal environment among Japan, Korea, US and other. International collaboration for Agriculture & Ecogrid Taiwan, US, Japan, Thailand, Australia, China and other Integration of Data and Computation on Grid GGF10 RG may be proposed for instruments on the Grid from synchrotrons to sensors - -

4 Collaboration with CAS ( ): China is a megadiversity country that is said to GUIDE (Grid User Interface to the Distributed Environment) GSI-SFS ( A Secure Filesystem on the Grid) have 70%+ species. CAS is moving towards the construction and integration : of databases of specimens and names (SDB, Scientific database project, Kai Nan, CAS) Osaka University and CAS team (currently, Juncai Ma s team) started building a proto-type BioGrid using Osaka s Grid technologies and CAS s database technologies and data resource of importance. GUIDE Grid User Interface to the Distributed Environment BLAST ( ) ( ) Gridified tool GUI Technical view of GUIDE (1) Web technologies JSP (JavaServer Pages) Tomcat Servlet Apache Web Grid technologies Java CoG Kit Java Globus Toolkit ver2.0 Grid MyProxy online credential repository Technical view of GUIDE (2) GUIDE in Action(1) Client WEB Page JSP Tomcat apache Servlet Web server Servlet Servlet Certificate MyProxy CoG Globus Toolkit 2.0 JavaGrid Grid Grid Network Blast Username Password blastjsp Tomcat apache Servlet Servlet CoG Globus Toolkit 2.0 Grid single sign-on Blast Grid Network credential MyProxy Client

GUIDE in Action(2) : 1 3 2 1) 2) 3) 4) SFS (Self-Certifying Filesystem) SDI (Single Disk Image): NFS Single Sign-on: NFS Server On-demand Remote Filesystem Access: SFS Server : on-demand SFS Client

5 GUIDE in Action(2) : ) 2) 3) 4) SFS (Self-Certifying Filesystem) SDI (Single Disk Image): NFS Single Sign-on: NFS Server On-demand Remote Filesystem Access: SFS Server : on-demand SFS Client /sfs Server A/ Server A Server B Server C Client A NFS Client filesystem Client B SFS (Self-Certifying Filesystem) GSI-SFS Server A Server B Server C NFS Server SFS Server Client A SFS sfsserver gsisfsd SFS Client filesystem NFS Client Client B GSI (Grid Security Infrastructure)SFS (Self- Certifying Filesystem) Server C Server B Server A gsisfsd sfsserver filesystem GSI /sfs proxy grid-proxy-init Server C/ Server A/ gsisfsagent filesystemsfsclient filesystem

GSI-SFS SDI (Single Disk Image) Single Sign-on On-demand Remote Filesystem Access Researchers Osaka University blast GUIDE Researchers Institute of Microbiology, CAS blast Osaka: PDB GSI-SFS SDI

6 GSI-SFS SDI (Single Disk Image) Single Sign-on On-demand Remote Filesystem Access Researchers Osaka University blast GUIDE Researchers Institute of Microbiology, CAS blast Osaka: PDB GSI-SFS SDI Globus (Grid middle ware) CAS: GRAM GSI GASS MDS IPv6 (Future Works) Biological Resource database /gsisfs Researchers Osaka University cas.host blast PDB Username password GUIDE In Action /gsisfs/cas.host/data Auto mount GSI-SFS Researchers /gsisfs Institute of Microbiology, CAS tokyo.host blast Biological Resource database Globus (Grid middle ware) GRAM GSI GASS MDS IPv6 (Future Works) A testbed on bioinformatics on sc2003 Connected data and computational resources Chinese valuable biological database Large computational resources provided by our cluster and PRAGMA collaborators Chinese Academy of Science, China File-based bio-db including much information of Chinese endemic species 32+ processors Applications Bioinformatics Institute, Singapore GUIDE Grid Portal control GSI-SFS secure access Parallelized BLAST,, user applications, etc WWW Applications Bio-scientists 156+ processors Osaka University, Japan Research Testbed CAS, BII GSI-SFS + GUIDE BLAST, Single sign-on

7 This slide was derived from the presentation materials Of Dr. Hatano, CAS, Beijing,China. This slide was derived from the presentation materials Of Dr. Hatano, CAS, Beijing,China. Web DNA 6Grid [ ] IPv6 IBM and 6net in UCL Grid, e-science IPv6 WIDE Project, 6Grid SDSC, Telescience Group CAS (China Academy of Sciences) KISTI(Korea Institute of Science and Technology Information) e-megadiversity Resources in China [ ] [~H14 ] IPv6 Globus grid toolkit1.1.3, Release IPv6/IPSec

8 6Grid Project over Korea-Japan 6Grid GridFTP: Korea Institute Science and NEC System Technology Technology Information Alpha Version, Release AM11:00, Nov. 14, 2003 (JST) Single Transfer : ( ) 7node - cluster Parallel Transfer : ( ) khryu Contact: Mr. Dongkyun Kim passive Active Contact: Mr. Shogo Fujii Listener 3 data pathway Striped Transfer : ( ) Active passive Active Listener Senri Biogrid R&D Center 2 data pathway Listener IPv6 over IPv4 IPv6 over IPv4 IPv6 network Osaka University takara depllot1 Contact: Mr. Ichiro Hasegawa exp-grid5 exp-grid6 Contact: Mr. Hongyu Shi 6Grid Project Demonstration: Performance measurement using Network over Korea and Japan NEC System Technology 7node - cluster Contact: Mr. Shogo Fujii IPv6 over IPv4 Senri Biogrid R&D Center IPv6 over IPv4 IPv6 network Korea Institute Science and Technology Information khryu Contact: Mr. Dongkyun Kim Osaka University GUIDE Grid User Interface to the Distributed Environment BLAST ( ) ( ) Gridified tool GUI takara depllot1 Contact: Mr. Ichiro Hasegawa exp-grid5 exp-grid6 Contact: Mr. Hongyu Shi CREC

9 APAN Honolulu

DataGrid Project 30MB/sec Digital Sky and the Grid WWW-DB DB enhance Image() Network Network

E-science -- IT -- www.biogrid.jp e-science DataGrid Project 30MB/sec Digital Sky and the Grid WWW-DB DB enhance Image() Network Network SDSS(Sloan Digital Sky Servey) http://skyserver.sdss.org/edr/jp/sdss/discoveries/disc