FX10 Oakleaf-FX Practical use of FX10 Supercomputer System (Oakleaf-FX) of Information Technology Center, The University of Tokyo 坂口吉生 小倉崇浩 あらまし FUJITSU Supercomputer PRIMEHPC FX10 Oakleaf-FX 2012 4 Oakleaf-FX 2012 6 1 PFLOPS 18 76 800 CPU 1500 Oakleaf-FX Oakleaf-FX Abstract Information Technology Center, The University of Tokyo (ICT/UT) is a core organization of Joint Usage/Research Center for Interdisciplinary Large-Scale Information Infrastructures which consists of eight academic supercomputer centers in Japan. There, Oakleaf-FX, a system centered on Fujitsu s PRIMEHPC FX10 (76 800 CPU cores,) which has been developed by further enhancing the technology applied to the K computer to realize both high performance and superior energy efficiency, started operations in April 2012 and achieved a performance of 1 PFLOPS (ranked 18th in the world) in June 2012. Supercomputing Division of ITC/UT provides services for operations of supercomputer systems and supporting more than 1500 users from both of inside and outside of the university for various cutting-edge R&D and education activities. Fujitsu is working to develop products with high application execution performance, and create user-friendly systems that can work in various operational environments and that are energy efficient. This paper presents a system overview of Oakleaf-FX and the issues to be overcome to develop supercomputers, together with measures for solving them. The results of various studies making use of Oakleaf-FX have been reported and this paper reports on four fields as successful examples of its application. FUJITSU. 65, 1, p. 61-68 01, 2014 61
まえがき 1965 1999 1500 2012 4 Oakleaf-FX Oakleaf-FX FUJITSU Supercomputer PRIMEHPC FX10 Oakleaf-FX Oakleaf-FX Oakleaf-FX の概要 Oakleaf-FX PRIMEHPC FX10 50 4800 PC FUJITSU Server PRIMERGY 74 FUJITSU Storage ETERNUS 234 図 -1 HPC Technical Computing Suite FEFS Fujitsu Exabyte File System Oakleaf-FX 1 PFLOPS HPC High Performance Computing スパコンに求められている課題 2004 CPU CPU TOP500 1 10 2010 156 CPU 2010 99.8 図 -2 FUJITSU Storage ETERNUS DX80 S2 1.1 P DX410 S2 2.1 P Software FUJITSU Supercomputer PRIMEHPC FX10 Technical Computing Suite OSS(Open Source Software) FUJITSU Server PRIMERGY RX300 S6 RX200 S6 NW ー 4800 ー (76 800 CPU コ ) (300 IO ー ) ー 1.13 PFLOPS 150 T -1 Oakleaf-FX 62 FUJITSU. 65, 1 01, 2014
100 000 000 10 000 000 10 システム コ ( ) 1998 141 2010 156 8000 7000 コ ( ) (GFLOPS) 1 000 000 100 000 10 000 1000 100 10 システム (GFLOPS) 10 システム (MHz) 1998 126 2010 140 6000 5000 4000 3000 2000 (MHz) 10 1998 109 2010 99.8 1000 1 1998/06 1999/06 2000/06 2001/06 2002/06 2003/06 2004/06 2005/06 2006/06 2007/06 2008/06 2009/06 2010/06 2011/06 2012/06 2013/06 0 ( / ) -2 Open Source Software OSS 2011 3 Oakleaf-FX の課題解決アプローチ アプリケーションの高い実行性能の実現 PRIMEHPC FX10 6 / Tofu VISIMPACT Virtual Single Processor by Integrated Multicore Parallel Architecture Oakleaf-FX 76 800 CPU MPI VISIMPACT VISIMPACT CPU 12 M L2 HPL High-Performance Linpack 1.04 PFLOPS 91.86 2012 6 TOP500 18 50 2 使いやすいシステムと柔軟な運用環境の提供 FUJITSU. 65, 1 01, 2014 63
Oakleaf-FX 1 Oakleaf-FX 2 3 24 HPC 4 Open Source Software Oakleaf-FX OSS 高性能と省電力を両立したグリーンスパコン Oakleaf-FX 2012 6 Green500 2 1176.8 kw/ 1.043 PFLOPS 886.3 MFLOPS/W 43 Oakleaf-FX 図 -3 Oakleaf-FX の活用事例 2012 4 2012 12 Oakleaf-FX 37 2012 6 Graph500 3 Oakleaf- FX 4 Oakleaf-FX 2012 7 2013 8 8 Oakleaf-FX Oakleaf-FX HPC 不均質多孔質媒体における3 次元地下水流れ ( 東大センター中島研吾教授 ) (4)-(6) 3-3 64 FUJITSU. 65, 1 01, 2014
Conjugate Gradient Method with Multigrid Preconditioner MGCG 図 -4 Oakleaf- FX 4096 65 536 CPU 17 179 869 184 10 ICCG 10 20 図 -5 大西洋起源海流の北極海氷分布への影響評価 ( 東京大学大気海洋研究所羽角博康教授 ) (7),(8) km 図 -6 1280 768 45 Oakleaf-FX 128 1 5 50-4 3 15.0 10.0 Rest 20 Coarse Grid Solver MPI_Allgather MPI_Isend/Irecv/Allreduce sec. 5.0 0.0 ELL-hCGA ELL-CGA ELL-CGA ELL 65 CRS 66 lev 6 51 lev 7 55 lev 8 60 ー -5 Oakleaf-FX MGCG -6 FUJITSU. 65, 1 01, 2014 65
図 -7 マルチスケールプラズマ乱流のジャイロ運動論的シミュレーション ( 東京大学生産技術研究所加藤千幸教授 ) (9) 5 図 -8 MPI/ OpenMP 10 9 10 10 10 5 1 Oakleaf-FX 512 8192 CPU 48 図 -9 ふくしゃ ブラックホール降着流の磁気流体 輻射磁気 流体シミュレーション ( 千葉大学理学研究科松元亮治教授 ) (10) 図 -10 400 HLLD 3 5 MP5 25 Performance(TFLOPS) 20 15 10 5 ン ー ー ン 0 0 5 10 15 20 Number of cores 1000-7 -9 Oakleaf-FX -8 66 FUJITSU. 65, 1 01, 2014
256 64 256 Oakleaf-FX 64 1024 CPU 100 図 -11 0 1 R3MHD MPI/OpenMP Oakleaf-FX 64 1024 CPU 10 3 今後の展望 2013 3 HPC JCAHPC Joint Center for Advanced High Performance Computing Oakleaf-FX -10 HLLD 3-11 FUJITSU. 65, 1 01, 2014 67
HPC むすび Oakleaf-FX 参考文献 1 TOP 500 http://www.top500.org/ 2 Green 500 http://www.green500.org/lists/green201206 3 Graph 500 http://www.graph500.org/results_june_2012 4 K. Nakajima OpenMP/MPI Hybrid Parallel Multigrid Method on Fujitsu FX10 Supercomputer System IEEE Proceedings of 2012 International Conference on Cluster Computing Workshops 2012 p.199-206 5 K. Nakajima Large-scale Simulations of 3D Groundwater Flow using Parallel Geometric Multigrid Method Procedia Computer Science Vol.18 p.1265-1274 2013 6 K. Nakajima Challenges in Sparse Linear Solvers for Post-Peta/Exascale Systems Latest Advances in Scalable Algorithms for Large Scale Systems ISC 13 International Supercomputing Conference Leipzig Germany 2013 7 T. Kawasaki et al. High-resolution modeling study on the Atlantic water inflow to the Arctic Ocean IAHS-IAPSO-IASPEI Joint Assembly Goteborg Sweden 2013 8 T. Kawasaki et al. High resolution modeling for long-term prediction of the Arctic sea ice NIPR Symposium Tokyo Japan 2012 9 GKV HPCS 2013 Tokyo Japan P1-1 2013 10 R. Matsumoto X-ray Flares Triggered by the Tidal Disruption of a Gas Cloud Approaching the Galactic Center Supermassive Black Hole 12th International Workshop on the Interrelationship between Plasma Experiments in Laboratory and Space IPELS Hakuba Japan July 1-5 2013 著者紹介 坂口吉生 ( さかぐちよしお ) HPC 小倉崇浩 ( おぐらたかひろ ) Oakleaf-FX 68 FUJITSU. 65, 1 01, 2014