スライド 1

Size: px

Start display at page:

Download "スライド 1"

さやじゅふく
5 years ago
Views:

1 NAREGI2006

2 NAREGI NAREGI (VO) Multi-Grid GGF Open Source Sustainable) e-science NAREGI

3 m HPC...

4 - Mediator) )

5 -

6 PC AIX NAREGI PSE WFT DataGrid CA VOMS MyProxy Super Info. Info. Network Info. LoadLeveler AIX/p690 Info. PBSpro Linux Info. Mediator DataGrid Gfarm Info.

7 (Virtual Organization) SINET

8 CA/RA User cert. Proxy cert. (User DN, VO) a: Sign-on VOMS MyProxy 5: starts Server Portal MPI source b: Deployment c: Edit PSE Super 6: MPI job starts 7: MPI init. Application requirement definition Workflow WFT 1: Submission 3: Negotiation Agreement Co-Allocation SMP machine 64 CPUs Input files Output files PC cluster 128 CPUs 2: Resource discovery 4: Reservation Site Site Site ) Mediator Network monitor DataGrid Grid File System GVS MPI 8: Visualization Information 9: Accounting 2: Monitoring

9 VOMS VOMS VOMS VOMS (VO2) (VO1) (VO2) (VO1) voms-proxy proxy-init Certificate Management Server Server User Certificate Private Key Proxy Proxy cert. cert. with with VO VO attrib. attrib. ssh + Put Certificate Put Proxy cert. with VO attributes ssh + voms-myproxy myproxy-init sign-on Get delegated proxy cert. with VO attrib. Client Client Environment WFT Proxy Portal Proxy cert. cert. with with VO VO PSE MyProxy VOMS-ProxyGrid tool NAREGI (Virtual Organization Membership ) MyProxy Proxy Proxy cert. cert. with with VO VO attrib. attrib. attrib. attrib. GVM SS client Put Proxy cert. with VO attrib. Signed Description MyProxy+ Proxy Proxy cert. cert. with with VO VO attrib. attrib. Super Proxy Proxy cert. cert. with with VO VO attrib. attrib. Get delegated Proxy cert. with VO attrib. Proxy Proxy cert. cert. with with VO VO Query attrib. attrib. ( requirements +VO attributes) Resources in the VO VO Information Resources Info incl. VO attrib. Get User Certificate DataGrid IS globusrun-ws services Resource Info. (Incl. VO attributes) NAREGI CA CP/CPS APGridPMA Subset of WebTrust Programs for CA GRAM Resource local Info. incl. VO attrib. VO

10 CA a: Sign-on Portal Server MPI source b: Deployment 5: starts PSE Super 6: MPI job starts 7: MPI init. Application requirement definition c: Edit Workflow WFT 1: Submission 2: Resource discovery 3: Negotiation Agreement Co-Allocation Network monitor DataGrid SMP machine 64 CPUs Input files Output files 4: Reservation Site Site Site Grid File System GVS PC cluster 128 CPUs 8: Visualization Information 9: Accounting 2: Monitoring

11 b: PSE Server ACS (Application Contents ) OK! OK! NG! OK! Server#1 Server#2 Server#3

12 CA a: Sign-on Portal Server Input files b2: Data import 5: starts Data Grid Super 6: MPI job starts 7: MPI init. Application requirement definition c: Edit Workflow WFT 1: Submission 2: Resource discovery 3: Negotiation Agreement Co-Allocation Network monitor Data Grid SMP machine 64 CPUs Input files Output files 4: Reservation Site Site Site Grid File System GVS PC cluster 128 CPUs 8: Visualization Information 9: Accounting 2: Monitoring

13 b2: Grid Workflow 1 2 n Data Grid Components Import data into workflow Data 1 Data 2 Data n Data Access Management Metadata Management Data Resource Management Store data into distributed file nodes Assign metadata to data Place & register data on the Grid Grid-wide Data Sharing Metadata Metadata Metadata Data 1 Data 2 Data n 1 2 n Grid-wide File System

14 CA a: Sign-on Portal Server MPI source Input files b: Deployment b2:data import VOMS MyProxy 5: starts PSE DataGrid Super 6: MPI job starts 7: MPI init. Application requirement definition c: Edit Workflow WFT 1: Submission SMP machine 64 CPUs 3: Negotiation Agreement Co-Allocation Network monitor DataGrid Input files Output files GVS Site Site Site Grid File System PC cluster 128 CPUs 2: Resource discovery 8: Visualization 4: Reservation Information 9: Accounting 2: Monitoring

15 c: Submission Description Language /gfarm/.. applet https A tomcat Workflow Servlet By NAREGI-WFML NAREGI Manager I/F module DataGrid B PSE Information GridFTP (Stdout Stderr) Super BPEL <invoke name=eps-joba> -A <invoke name=bes-joba> -A.. BPEL+ Server

16 CA a: Sign-on Portal Server b: Deployment VOMS MyProxy 5: starts MPI source PSE Super 6: MPI job starts 7: MPI init. Application requirement definition c: Edit Workflow WFT 1: Submission 3: Negotiation Agreement Co-Allocation Network monitor DataGrid SMP machine 64 CPUs Site Site Site Grid File System Input files Output files GVS PC cluster 128 CPUs 2: Resource discovery 8: Visualization 4: Reservation Information 9: Accounting 2: Monitoring

17 - CPU 1 (MPI) 1 OS : AIX Mediator CPU 2 (MPI) 2 OS : LINUX 1: CPU 10 (MPI) 5 OS : LINUX CPU 32 1 OS : AIX CPU 6 3 OS : LINUX CPU 4 2 OS : LINUX CPU 10 5 OS : LINUX

18 CA a: Sign-on Portal Server b: Deployment VOMS MyProxy 5: starts MPI source PSE Super 6: MPI job starts 7: MPI init. Application requirement definition c: Edit Workflow WFT 1: Submission 3: Negotiation Agreement 4: Reservation Site Site Site 2: Resource discovery Information Co-Allocation Network monitor DataGrid Grid File System SMP machine 64 CPUs Input files Output files GVS PC cluster 128 CPUs 8: Visualization 9: Accounting 2: Monitoring

2: 資源探索異なる管理ドメインにわたる様々な種類のグリッド計算資源情報 CPU, メモリ, OS, ジョブキュー, アカウント情報資源利用記録等々について機種に依存しない形で統一的に表現(CIM schema) RDB 標準Grid (OGSA-DAI) として RDBに資源情報検索 WFT 利用者 VOの権限に応じた情報のみにアクセス Sub job要件分散情報サービス

19 2: 資源探索異なる管理ドメインにわたる様々な種類のグリッド計算資源情報 CPU, メモリ, OS, ジョブキュー, アカウント情報資源利用記録等々について機種に依存しない形で統一的に表現(CIM schema) RDB 標準Grid (OGSA-DAI) として RDBに資源情報検索 WFT 利用者 VOの権限に応じた情報のみにアクセス Sub job要件分散情報サービス Super Resource ジョブ - 資源マッチング OGSA -DAI Log Policy Account Performance User 互いの関連付けと属性が定義されたテーブル群 Budget Resource Linux Resource Policy Log User Account UNIX Budget Log AIX Linux Resource Solaris User Account Budget Policy

20 CA a: Sign-on Portal Server b: Deployment VOMS MyProxy 5: starts MPI source PSE Super 6: MPI job starts 7: MPI init. Application requirement definition c: Edit Workflow WFT 1: Submission 2: Resource discovery 3: Negotiation Agreement Co-Allocation Network monitor DataGrid SMP machine 64 CPUs Input files Output files Site Site Site Grid File System GVS PC cluster 128 CPUs 8: Visualization 4: Reservation Information 9: Accounting 2: Monitoring

21 WFML2BPEL OGSA-DAI RDB PostgreSQL 3,4: SelectResource From GenerateCandidate Set Generate SQL Query From SQL SQL CIM 2.10 is-query NAREGI-WP3 WorkFlowTool, PSE, GVS Submit Cancel NAREGI JM(SS) Java I/F module BPEL2WFST CES NAREGI JM (BPEL Engine) GNIS Submit Status Delete Cancel Status JM-Client MakeReservation CancelReservation NAREGI- NAREGI- WFML WFML GetGroups- OfNodes S R S CES SC(GVM-SC) GRAM4 specific SC PBS, LoadLeveler Delete R WS-GRAM CreateActivity(FromBPEL) GetActivityStatus RequestActivityStateChanges CES globusrun-ws Co-allocation BPEL (include ) BPEL (include ) S R Invoke EPS Invoke SC CES SC PBS, LoadLeveler CreateActivity(From) GetActivityStatus RequestActivityStateChanges S SC(GVM-SC) GRAM4 specific WS-GRAM globusrun-ws Abbreviation SS: Super : Submission Description Document JM: Manager EPS: Execution Planning CSG: Candidate Set Generator RS: Reservation IS: Information SC: Container AGG-SC: Aggregate SC GVM-SC: SC FTS-SC: File Transfer SC BES: Basic Execution I/F CES: Co-allocation Execution I/F (BES+) CIM: Common Information Model GNIS: Grid Network Information MakeReservation CancelReservation R CES FTS-SC S uber-ftp globus-url-copy FileTransfer GFarm server

22 NAREGI Super OGSA-EMS Execution Planning s Open Grid Architecture Execution Management GGF/OGSA EMS-WG Super NAREGI OGSA-EMS Manager Discover & Select NAREGI WFT NAREGI Super Submit Reservation Reserve Application Contents NAREGI PSE Deployment Register Accounting s NAREGI Information Information s Update Query Candidate Set Generator Provisioning Deployment Configuration Container NAREGI

23 CA a: Sign-on 5: starts Portal Server b: Deployment VOMS MyProxy MPI source PSE 7: MPI init. Application requirement definition c: Edit Super Workflow WFT 1: Submission 3: Negotiation Agreement Co-Allocation 6: MPI job starts Network monitor DataGrid SMP machine 64 CPUs Input files Output files 2: Resource discovery 4: Reservation Site Site Site Grid File System GVS PC cluster 128 CPUs 8: Visualization Information 9: Accounting 2: Monitoring

24 5,6: WorkFlow Tool 1 export _SERVER_IP=clusterX.naregi.org export _SERVER_PORT=5963 export _CLIENT_ID=1 export _YAMPII_CONFIG_FILE = export GRIDVM_GLOBAL_JOB_ID=XXX export GRIDVM_GLOBAL_USER_ID= /O=Grid/... export GRIDVM_SUBJOB_ID = YYY export GRIDVM_LAUNCHER=gvm_launch $GRIDVM_LAUNCHER lmpirun np 128./app A B MPI

25 : Super GT4 GRAM-integration and WSRF-based extension services submission based on and NAREGI extensions GRAM4 WSRF I/F Engine site Policy GRAM4 WSRF I/F Engine Information CIM-based resource info. provider site Policy xacml-like access control policy UR/RUS-based job accounting

26 CA a: Sign-on Portal 5: starts Server b: Deployment VOMS MyProxy MPI source PSE Super 6: MPI job starts 7: MPI init. Application requirement definition c: Edit Workflow WFT 1: Submission 3: Negotiation Agreement Co-Allocation SMP machine 64 CPUs Input files Output files 2: Resource discovery 4: Reservation Site Site Site Network monitoring GVS PC cluster 128 CPUs 8: Visualization Information 9: Accounting 2: Monitoring

27 7: ( 10Gbps, 10ms Metropolitan Area) YAMPII YAMPII

28 7 : & Network Middlebox Brokering hint request Super Grid Middleware Information CIM GUI IP Tunnel for Route Control Control Network Middlebox Monitoring Site Network Middlebox Network Middlebox Site

29 CA a: Sign-on Server Site A source source b: Deployment Portal PSE VOMS MyProxy 5: starts Super 6: MPI job starts 7: MPI init. Application requirement definition c: Edit Site B Workflow WFT 1: Submission 2: Resource discovery 3: Negotiation Agreement Co-Allocation Network monitor DataGrid Grid File System SMP machine 64 CPUs 4: Reservation Input files PC cluster 128 CPUs Output files GVS Site C 8: Visualization Information 9: Accounting 2: Monitoring

30 8: Client HTTP(S) Provider MPI Parallel Visualizer Provider MPI Parallel Visualizer PC

31 PC 9: Info. in Cell Domain RUS Info. Query in Cell Domain Query RUS : Resource Usage Query UR : Usage Record UR - XML () GGF(RUS,UR) Query RUS Portal _ usage usage usage _Engine _Engine _Engine Global User ID Global ID Global Resource ID time range Process

32 NAREGI M/W β版 :: 5月公開 GGF17 Tokyo メリット組織にまたがり計算資源をつないだ超大規模計算を実現異なる物理現象を組合せたシミュレーションを最適環境で実行各計算機の能力にあったジョブを割当てコストパフォーマンス向上利用者はポータルへのシングルサインオンデプロイジョブ記述実行可視化 Abstract要件記述汎用的科学技術計算 eインフラ NAREGIミドルウェア具象化最適配置実行 NAREGIミドルウェアは利用者の要求をみたす資源探索ヘテロ計算資源の仮想化 OGSA-EMSの参照実装をめざすサイト間MPI タスク並列RPC Global File Systemとの連携 VOメンバーシップ&資源管理広域ネットワーク計測と制御ナノアプリケーションのグリッド化 NAREGIテストベッドにて実証実験 15TF SuperSINET

untitled

untitled 1 6. 2 NAREGIWP5 3 Packaging Grid Programming (WP2) -Grid RPC -Grid MPI Grid-Enabled Nano-Applications (WP6) Grid Visualization Grid Workflow (WFML (Unicore+ WF)) Super Scheduler WP3 WP1 Grid PSE WSRF