PCクラスタコメント無い.PDF

Size: px

Start display at page:

Download "PCクラスタコメント無い.PDF"

しじんひでやま
5 years ago
Views:

1 BeowulfPC : PC MPICH Construction of a Beowulf Type PC Cluster Hiroaki MIYAGAWA and Yoshihiro MIZUGAI Department of Physics, Faculty of Science and Technology, Sophia University 7-1 Kioicho, Chiyoda-ku Tokyo, Keywords: Beowulf, PC cluster, MPICH, Himeno benchmark TOF NASA Goddard Space Flight Center (GSFC)Thomas Sterling Donald Becker 16 DX4 10Mbps Ethernet Linux Beowulf 4 Linux Ethernet NFS /home Remote Shell (rsh) Parallel Virtual Machine (PVM) 5 Message Passing Interface (MPI) 6 Beowulf PC 1CPU GHz Gigabit Ethernet TOP500 Supercomputer Sites 7 PC 1

2 Beowulf PC Beowulf PC 8 PC Gigabit Ethernet Fast Ethernet Beowulf PC (Fig.1) Fig. 1. The Beowulf type PC Cluster at Molecular Physics Lab., Sophia University. 2 BeowulfPC PC

3 2 Fast Ethernet Network Interface Card (NIC) NFS ServerWorks GC-SL Linux DELL PowerEdge 600SE Table CPU FSB 2nd cash File server Intel Pentium4 processor 2.80GHz 533MHz 512KB L2 cash Table Machine spec for File server. Chipset ServerWorks GC-SL Memory DDR266 ECC 256MB 2 HDD 40GB 7200rpm Drive CD-ROM / 2mode Floppy MPI Video Network onboard ATI RAGE XLTM 8MB Onboard Intel PRO/1000MT Intel PRO/100S Server rsh 2 2 /NFS Fast Ethernet NIC MPI Gigabit Ethernet NIC 1 Compute node CPU Intel Pentium4 processor 2.40GHz Linux FSB 533MHz 2nd cash 512KB L2 cash M/B ASUS P4GE-VM Table Chipset Intel845GE Memory Transcend DDR MB 2 HDD Seagate 7200rpm 40GB CPU Drive Linux Video MITSUMI 2mode Floppy Onboard Intel 82845GE GMCH Case OWLTECH OWL-103-Silent Network Linux Onboard Intel 10/100BASE-TX Intel PRO/1000 MT Desktop Table Machine spec for Compute node. 3

4 CPUIntel AMD x86 Dual CPU SMP CPU CPU Linux Linux 32bitCPU1 3GB 1 3GB X window system X Window system corega 8 KVMKeyboard, Video, Mouse CG-CKVM8P MPI 4

5 FHSW-1616NR FXG-08TL 16port Fast Ethernet 8port Gigabit Ethernet Beowulf PC Table Description Quantity Subtotal File server (Dell) 1 90,090 Compute node (self-made) 8 90,177*8 16port Fast Ethernet SW 1 21,546 8port Gigabit Ethernet SW 1 56,511 KVM Switch 1 45,171 LAN cable *18 Total ( ) 941,038 Table Price List. Beowulf PC Beowulf PC OS UNIX OS Linux Linux Red Hat Linux 8 MPI PVM MPI1994 MPI Forum 9 C Fortran MPI PVM 10 Argonne National Laboratory (ANL)Mississippi MPI MPICH 11 5

6 16port Fast Ethernet 8portGigabit Ethernet LAN 8 KVM 1 Fig.2 Fig. 2. Hardware Setting. /NFS Fast Ethernet fastlocal MPI Gigabit Ethernet gigalocal 2 Table Table IP FQDN node0.fastlocal node1.fastlocal node2.fastlocal node3.fastlocal node4.fastlocal node5.fastlocal node6.fastlocal node7.fastlocal server.fastlocal IP FQDN master.gigalocal slave1.gigalocal slave2.gigalocal slave3.gigalocal slave4.gigalocal slave5.gigalocal slave6.gigalocal slave7.gigalocal Table Network table for Fast Ethernet.Table.Network table for Gigabit Ethernet. 6

7 2 Red Hat Linux9 no-mouse IP fastlocal /24 NFS no firewall Custom Table Applications Internet (openssh) rsh Publishing (groff) System Base logrotate man Daemons Libraries nfs-utils ntp openssh-server portmap tcp_wrappers (libcap) (libstdc++) Development Language (perl) Libraries (perl-filter) Table Packages for File server /sbin/chkconfig kudzu, netfs, rawdevices, saslauthd, keytable, syslogd reboot TCP Wrapper /etc/hosts.allow /etc/hosts.allow ALL: sshd:all portmap: /etc/hosts.allow /etc/hosts.deny /etc/hosts.deny ALL:ALL 7

8 Table /etc/hosts fastlocal IPFully Qualified Domain Name(FQDN) Telnet SSH sshd /etc/ssh/sshd_config root SSH PermitRootLogin no telnet ID PasswordAuthenticationyes sshd MPICH NFS /home NFS NFS RPC portmapper portmap nfs, nfslock /etc/exports fastlocal /home rw, sync, no_root_squash no root squash root NFS root # /usr/sbin/exportfs -a /etc/exports nfs MPICH make NTP ntpd /etc/ntp.conf NTP local clock NTP NTP ntpd NFS 8

9 /images 3 Red Hat Linux 9 CD-ROM Red Hat /etc/export/images fastlocalro, sync, no_root_squash /images nfs reload /images Red Hat Linux9 1 /mnt/cdrom/images # dd if=./bootdisk.img of=/dev/fd0 bs=1440k # dd if=./drvnet.img of=/dev/fd0 bs=1440k Installation Method NFS images TableTCP/IP NFS RedHat /images Table Table MPICH gigalocaltable rsh no firewall Custom Table kudzu, rawdevices, saslauthd, keytable, syslogdreboot /etc/hosts.allow ALL: in.rlogind: in.rshd: /etc/hosts.deny ALL:ALL /etc/hosts fastlocalip IP /etc/fstab NFS (8192 ) rw,hard,intr,bg,rsize=8192,wsize= netfs reboot netfs /home 9

10 MPICH rsh rsh SSH SSH rsh 13 rsh gigalocal xinetd rsh rlogin xinetd /etc/xinetd.d/rsh/etc/xinetd.d/rloginonly_from IP /24 rshrlogin rsh TCP Wrapper /etc/hosts.equiv /root/.rhosts /etc/hosts.equiv /etc/hosts.equiv gigalocal rootrsh /etc/securettyrshrlogin root root r rcp /root/.rhosts root 600 NTP ntpd /etc/ntp.conf server IP ntpd MPICH ANL MPI 11 Linux MPICH (mpich.tar.gz) /usr/local/src/mpich # tar zxvf mpich.tar.gz mpich /mpich / #./configure -prefix=/usr/local/mpich prefix configure Makefile make make # make install machine MPICH machine /usr/local/mpich /share/machines.linux MPICH mpiccmpif77mpirun 10

11 ~/.bash_profile PATH=$PATH:/usr/local/mpich /bin Red Hat Linux Red Hat Linux Red Hat Linux /root/anaconda-ks.cfg /ks/ install nfs --server dir /images network ip hostname Table Table ks.cfg Red Hat Linux9 1 /mnt/cdrom/images # dd if=./bootdisk.img of=/dev/fd0 bs=1440k # /ks/ks.cfg a: Boot boot: linux ks=floppy dd kudzu, rawdevices, saslauthd, keytable, syslogdreboot MPICH rcp /etc/hosts/etc/hosts.allow /etc/hosts.deny /etc/fstab /root/.rhosts /etc/hosts.equiv /etc/securetty /etc/xinetd.d/rsh /etc/xinetd.d/rlogin/etc/ntp.conf rsh rlogin ntpd reboot rsh rloginntp /etc/fstab /home NFS 11 ID Network Information Service (NIS) NIS MPI

12 12 /etc/passwd, /etc/group, /etc/shadow rcp /sbin PC ScaLAPACK 14 NAS Parallel Benchmarks ScaLAPACK NAS Parallel Benchmarks 16 C+MPI cc_himenobmtxp_mpi.lzh cc_himenobmtxp_mpi.lzh paramset.sh./paramset.sh S paramset.sh XSS ML param.h Makefile Makefile.sample Makefile make $ mpirun -np 2./bmt mpirun np./paramset.sh $ make clean himenobmtxps.o make S Fig.4 1CPU MFLOPS4CPU MFLOPS8CPU MFLOPS 12

13 3000 MFLOPS Number of CPUs Fig. 4. HIMENO Benchmark. Gigabit Ethernet MPI Table Beowulf PC MFLOPS SGI CRAY-T3E 64 Origin NEC SX-5 BeowulfPC PC Linux PC BeowulfPC 1) : 50, (2001). 2) : 52, (2003). 13

14 3) : 52, (2003). 4) 5) 6) 7) 8) 9) 10) Douglas Eadline: Cluster Quick Start (GNU GENERAL PUBLIC LICENSE Version 2, 1999) 11) 12) Thomas L. Sterling, Donald J. Becker, John Salmon, Daniel F. Savarese: How to build a Beowulf (MIT Press, Cambridge, 1999) 13) Nathan Carstens: BUILDING A BEOWULF CLUSTER ( 2003) 14) 15) 16) 14

卒業論文

卒業論文 PC OpenMP SCore PC OpenMP PC PC PC Myrinet PC PC 1 OpenMP 2 1 3 3 PC 8 OpenMP 11 15 15 16 16 18 19 19 19 20 20 21 21 23 26 29 30 31 32 33 4 5 6 7 SCore 9 PC 10 OpenMP 14 16 17 10 17 11 19 12 19 13 20 1421