IPSJ SIG Tchnicl Rpo OhHlp 1 2 3 2 3 OhHlp OhHlp Cyclic Lpfog I/O 256 241-456 Wk/Song Sclbiliy A Plllizion of Picl-Fluid Hybid Plm Simulion wih h OhHlp Lod Blnc Jun Akiym, 1 Mfumi Shoji, 2 Yohi Miyk, 3 Yohihu Omu 2 nd Hiohi Nkhim 3 Thi pp dcib plll implmnion of picl-fluid hybid plm imulion wih ou lod blncing mhod OhHlp. In hybid imulion, h co o imul h pog of lcomgnic fild i mo ignificn hn h in full-picl imulion who OhHlp d plllizion h ldy bn povd fficin. Thu in hi wok w viid h iu of h co blnc bwn compuion nd communicion, pcilly fo Cyclic Lpfog mhod nd h d-off bwn ducing h numb of communicion nd incing compuionl moun. W lo dignd nd implmnd plll- I/O fo npho nd dump, bing nil fo pcicl u of ou imulo, o concil plll pfomnc nd convninc of u. Ou vluion xhibid h h pdup wih 256 poc i 241- o 456-fold nd h upping compuionl co i h fi pioiy in Cyclic Lpfog. W lo obind vlubl inigh bou h lionhip bwn wk/ong clbiliy nd npho fquncy. 1. MHD Mgno-Hydo-Dynmic 1TB OhHlp 1) OhHlp OhHlp 1 Gdu School of Infomic, Kyoo Univiy 2 Rch Iniu fo Suinbl Humnoph, Kyoo Univiy 3 Acdmic Cn fo Compuing nd Mdi Sudi, Kyoo Univiy 1 c 21 Infomion Pocing Sociy of Jpn
IPSJ SIG Tchnicl Rpo OhHlp OhHlp OhHlp OhHlp OhHlp 2. ٢.١ E = B, (1) B = µ J, (2) n E + J B p =, (3) dv = q dx (E + v B), = v. d m d (4) (1) (2) Mxwll E B µ J (3) (4) (3), n, J, p p = p (n /n ) γ (5) p, n γ (4) x, v, q, m n + q n =. (6) n (6) (2) (3) E = J i B ρ i + ( B) B µ ρ i p ρ i. (7) E = E(ρ i, J i, B, p ) (7) J i = J J ρ i J i = q v, (8) x R ρ i = q. (9) x R 2 c 21 Infomion Pocing Sociy of Jpn
IPSJ SIG Tchnicl Rpo ٢.٢ fo(=;<imp;++){ } bfild(); pu(); vlociy(); poiion(); cun1(); chg(); pu(); bfild(); cun2(); 1 Fig. 1 Min Loop of Simulion 5) CAM-CL(Cun Advnc Mhod nd Cyclic Lpfog) 2) Bunmn-Boi 3) CAM-CL pdico-coco 3) CAM-CL ١ ٢ 2 bfild() B E (1) (7) pu() p x v B E J ρ p known 5 known 4 12 known 1 1 known 2 known known 6 + 2 11 known known 8 7 3 9 13 + + 2 Fig. 2 Tim Ch of Min Loop 3 2 (4) cun1() cun2() J i chg() ρ i (8) (9) bfild() Cyclic Lpfog Cyclic Lpfog bfild + /2 2k = /(2k) (1) (7) + B E B + = B E, (1) E + = E(ρ i, J i, B +, p ). (11) + p (1 p < k) (5) vlociy() poiion() v x 3 c 21 Infomion Pocing Sociy of Jpn
IPSJ SIG Tchnicl Rpo B E 1 5 9 3 7 2 4 6 8 3 + + + 8 4 8 + 2 (i,j,k+1) (i,j+1,k+1) (i+1,j+1,k+1) (i+1,j,k+1) (i+1/2,j+1/2,k+1/2) 3 Cyclic Lpfog Fig. 3 Tim Ch of Cyclic Lpfog (i,j+1,k) (i+1,j+1,k) B +(p+1) = B +(p 1) 2 E +p, (12) E +(p+1) = E(ρ i, J i, B +(p+1), p ). (13) (12) +k B +k +(k 1) + k B +k B +k = B +(k 1) E +k. (14) + /2 B + /2 = B+k + B +k 2 = B+ /2 + B + /2. (15) 2 = /8 ٣ ٢.٣ E B J i ρ i p ٤ (1) (7) E B E B PIC(Picl In Cll) (i,j,k) Fig. 5 (i+1,j,k) 4 Fig. 4 Ing nd Hlf-Ing Gid 3 13 23 33 2 3 12 11 22 2 32 2 3 1 31 33 1 11 1 21 13 31 21 23 32 1 2 22 3 5 OhHlp Spc Domin Piioning in OhHlp 3. OhHlp مبود ٣.١ ٥ OhHlp P 4 c 21 Infomion Pocing Sociy of Jpn
IPSJ SIG Tchnicl Rpo P (P/N)(1 + α) P limi (16) P N α P P/N 5 (16) 12 5 22 2 3 33 22 n n Q n n m Q m n n Q n (16) Q n = Q n n + Q m n (P/N)(1 + α) P limi (17) 22 2 1 poiion() ( 1 ) (16) ( 2 ) (16) n Q n P/N ( 1 ) (16) ( 2 ) (16) (17) ( 3 ) (16) (17) (17) 1) ٣.٢ OhHlp 3.1 (4) 2.2 bfild() (7) OhHlp oh3 bc fild(pim, c, fid) 2.3 5 c 21 Infomion Pocing Sociy of Jpn
IPSJ SIG Tchnicl Rpo oh3 duc fild(pim, c, fid) OhHlp oh3 xchng bod(pi, c, fid, p) 3.1 poiion() oh3 nbound(p,) ٣.٣ 2.3 OhHlp 2.2 bfild() (7) k ٣.٤ HDF 6) HDF PC HDF5 MPI I/O I/O OhHlp I/O 6 c 21 Infomion Pocing Sociy of Jpn
IPSJ SIG Tchnicl Rpo Mxwll OhHlp 4. ٤.١ OhHlp T2K HX6 HX6 AMD Opon 32GB DDR2-667 Fon9 OhHlp C (v. 3) -Kf 32 32 32 x MPI N = 2 n (n = 8) CPU p q = N, (p : q : ) {(1 : 1 : 1), (2 : 1 : 1), (2 : 2 : 1)} Wk Scling Song Scling Wk Scling 32 3 24 15 2 19 16 Song Scling 64 3 512 2 27 N 4 2N N > 4 16 (16) (17) α.2 ٤.٢ 3.3 k 8 w 1, 2, 4, 8 bfild() 64 w = 1 1 1 w = 8 8 8 w = 1 p J i ρ i w 1 (= ) 64 3 ٦ 6 w = 1 w = 2 w w 7 c 21 Infomion Pocing Sociy of Jpn
6 IPSJ SIG Tchnicl Rpo ] [ im n io u c x g v 1..9.8.7.6.5.4.3 圧 電流 電荷通信電磁場通信電磁場計算 / l 15 i c p 25 2 1 1 5 ong/blncd ong/unblncd wk/blncd wk/unblncd.2.1 5 1 15 2 25 3 # of poc. 1 2 4 8 # of wing 6 ( = 64 3 ) Fig. 6 Excuion Tim o Upd Elcomgnic Fild Vlu (ubdomin iz = 64 3 ) 64 3 w 2 KB w > 1 w 1 w w w w = 1 ٤.٣ ه ى فكس ه س/ فمط Wk/Song Scling 1 2 ٧ / [# of picl] [# of im p] [xc. im xcluding iniilizion] Wk Scling.88 Mpicl/ 1 7 256 242 261 256 Tbl 1 7 Fig. 7 Pfomnc of Simulion 1 Wk Scling Pfomnc of Wk Scling Simulion #poc blnc unblnc Tbl 2 1.72/.82.72/.81 2 2.8/ 2.35 1.96/ 2.22 4 3.87/ 4.38 3.55/ 4.1 8 7.6/ 8.6 7.2/ 7.94 16 14.74/ 16.66 13.75/ 15.54 32 29.35/ 33.18 27.4/ 3.98 64 58.43/ 66.7 54.4/ 61.51 128 113.11/ 127.89 17.93/ 122.4 256 231.19/ 261.39 214./ 241.96 2 Song Scling Pfomnc of Song Scling Simulion #poc blnc unblnc 1.37/.7.37/.7 2 1.15/ 2.17 1.8/ 3.4 4 2.81/ 5.31 3.35/ 6.32 8 7.66/ 14.45 6.98/ 13.17 16 16.42/ 3.99 15.22/ 28.72 32 34.52/ 65.15 31.84/ 6.1 64 69.62/ 131.39 64.22/ 121.2 128 13.97/ 247.18 118.66/ 223.93 256 241.66/ 456.7 216.2/ 47.68 8 c 21 Infomion Pocing Sociy of Jpn
IPSJ SIG Tchnicl Rpo Fig. 8 1% l n io o p o p im n io u c x 9% 8% 7% 6% 5% 4% 3% 2% 1% % 粒 移送 & 負荷均衡電磁場計算 & 通信粒 計算 64 256 # of poc 8 Song Scling Excuion Tim Bkdown in Song Scling Simulion 7% 2 16 18 Song Scling.53 Mpicl/ 2 7 256 48 456 2 64 64 256 3.5 3.4 ٨ 8 64 84% OhHlp 256 61% 34% 2/3 Song Scling 64 256 4 2/3 : 1 2.5 : 1 2 : 1 Song Scling Wk Scling 16 64 7.7% 128 256 9.4% 1.6% 2 16 64 6 82 15 128 256 173 215 Song Scling Wk Scling 256 4.3% 1.7 Wk Scling Song Scling CPU 2 12MB, 8MB 2 3 16 32 2 3 64 2 Song Scling 2 4 ءءب ٤.٤ 3.4 HDF 4.1 Wk/Song Scling Song Scling 192 8 4 6 64 64 48 Wk Scling Song Scling 1 2 5 1 9 c 21 Infomion Pocing Sociy of Jpn
6 6 IPSJ SIG Tchnicl Rpo 25 2 wih npho wihou npho / l 15 i c p 1 1 5 5 1 15 2 25 3 # of poc 25 2 / l 15 c i p 1 1 vy 1 imp vy 5 imp vy 2 imp vy imp wihou npho Fig. 9 9 (Wk Scling) Wk Scling Simulion Pfomnc wih nd wihou Snpho 5 5 1 15 2 25 3 # of poc ٩ ١٠ Wk/Song Scling Wk Scling ١١ 64 1 Song Scling 192 Song Scling 1 ١٢ 64 Fig. 1 1 (Song Scling) Song Scling Simulion Pfomnc wih nd wihou Snpho 3. 2.5 ] [ im 2. g in i 1.5 w g 1. v.5. 1 2 4 8 16 32 48 64 128 192 256 5. OhHlp 256 241-456 OhHlp Cyclic Lpfog Fig. 11 # of poc 11 (Wk Scling) Tim o Oupu Snpho in Wk Scling Simulion 1 c 21 Infomion Pocing Sociy of Jpn
IPSJ SIG Tchnicl Rpo Fig. 12.6.5 ] [ im.4 g in i.3 w g.2 v.1. 1 2 4 8 16 32 48 64 128 192 256 # of poc 12 (Song Scling) Tim o Oupu Snpho in Song Scling Simulion Wk Scling Song Scling #2311 1) H. Nkhim, Y. Miyk, H. Uui nd Y. Omu: OhHlp: A Sclbl Domin- Dcompoing Dynmic Lod Blncing fo Picl-in-Cll Simulion. In Poc. 23d Inl.Conf.Supcompuing, pp.9 99 (29). 2) A.P.Mhw: Cun Advnc Mhod nd Cyclic Lpfog fo 2D Mulipci Hybid Plm Simulion. J.Compu.Phy., Vol.112, pp.12 116 (1994). 3) H. Mumoo nd Y. Omu: Compu Spc Plm Phyic. T Scinific Publihing Compny (1993). 4) H. Nkhim: OhHlp Liby Pckg fo Sclbl Domin-Dcompod PIC Simulion, hp://www.p.mdi.kyoo-u.c.jp/ohhlp/ (29). 5) M. Shoji, Y. Omu, B. T. Tuuni, O. P. Vkhoglydov nd B. Lmbg: Mio Inbiliy nd L-mod Elcomgnic Ion Cycloon Inbiliy: Compiion in h Eh Mgnohh, J. Gophy. R., 114, A123, doi:1.129/28ja1438 (28). 6) Th HDF Goup: Infomion, Suppo, nd Sofw. hp://www.hdfgoup.og/ (29). 11 c 21 Infomion Pocing Sociy of Jpn