Oracle Real Applicatrion Clusters 10g 設定手順書

Transcription

1 ~ RAC ~ Oracle Real Application Clusters 10g Firewire ASM 2004/ 12

2 RAC RAC RAC RAC SIer ISV Oracle Real Application Clusters(RAC) Oracle Database 10g S/W RAC Cluster Ready Services(CRS) Automatic Storage Management(ASM) RAC RAC RAC RAC RAC RAC Oracle Real Application Clusters10g Firewire ASM Linux Oracle Real Application Clusters10g Firewire RAW Linux Oracle Real Application Clusters10g VMWare RAW Linux Oracle Real Application Clusters10g VMWare ASM Windows Oracle Real Application Clusters10g NAS Linux Oracle Real Application Clusters10g 1 RAC ASM Linux Oracle Real Application Clusters10g 1 RAC Linux OA RAC 2

3 VMWare Firewire NAS S/W RAC RAC / Firewire SCSI FiberChanel RAC NAS NetApp EMC NAS Network Attached Storage NFS RAC Firewire RAC RAC RAC Oracle Database 10g Release 1 ( ) for Linux x86 Firewire RAC RAC - RAC STATSPACK RAC - RAC RAC 3

4 Firewire RAC Linux Firewire IA IDE SCSI FC RAC OS SCSI FC Windows Firewire Windows Firewire Firewire Linux IEEE1394 4

5 Firewire...6 Firewire...7 Firewire RAC FirewireHDD IDE Firewire H/W...15 OS...15 OS...15 OS NIC CRS...43 Oracle Database 10g...59 VIP Red Hat Enterprise Linux 3.0 Tips Appendix Oracle Real Application Clusters 10g - Firewire ASM 5

6 Firewire OS CRS Appendix Firewire Firewire IEEE 1394 IEEE Ethernet IEEE802.3 LAN IEEE1394 Apple Firewire IEEE Apple IEEE1394 Firewire ilink IEEE1394 ilink Firewire Firewire 100/200/400Mbps USB2.0 HS HighSpped 480MBps USB2.0 Microsoft Windows2000/XP OS Firewire/USB2.0 - Oracle Real Application Clusters 10g - Firewire ASM 6

7 Firewire Firewire Firewire HDD HardDisk IEEE1394 FirewireHDD HardDiskCase IDE IEEE1394 HDD Firewire HDD Firewire HDD HDD HDD Firewire HDD HDD FirewireHDD FirewireHDD HDD Firewire Firewire RAC FirewireHDD Firewire PCI IEEE1394 Firewire IEEE1394 Firewire Firewire HDD IDE Firewire Firewire Firewire Card Firewire Card PC PC Firewire RAC RAC H/W RAC NIC NIC Ether - Oracle Real Application Clusters 10g - Firewire ASM 7

8 Ether S/W OS Linux MIRACLE LINUX V3.0 Firewire Oracle Oracle Database 10g Firewire Firewire SCSI Firewire Linux Oracle SCSI Oracle Oracle ASM Firewire Firewire Firewire HDD Firewire NIC NIC HUB IDE Ether HDD Firewire NIC NIC Firewire Firewire Oracle Oracle ASM Oracle ocssd crsd evmd Oracle Oracle RAC dbwr lgwr smon pmon lms lmd RAC ASM Oracle ASM Automatic Storage Management pmon smon ASM - Oracle Real Application Clusters 10g - Firewire ASM 8

9 RAC Cluster Ready Service(CRS) Orace Database 10g RAC Oracle RAC Oracle9i Microsoft Windows Linux RAC Oracle UNIX Oracle9i Database RAC OS Oracle Database 10g CRS Oracle9i Database ORACM Oracle Cluster Manager Service ocssd Oracle Synchronized Service OCR Oracle Cluster Registry OCR VIP( IP) RAC M CRS RAC OCR Voting Disk M CRS - Oracle Real Application Clusters 10g - Firewire ASM 9

10 VIP IP Virtual IP Address RAC VIP RAC IP TCP KeepAlive VIP ASM Automatic Storage Management ASM ASM RAW ASM ASM REDO ASM RAC Oracle RAC ASM RAW NAS - Oracle Real Application Clusters 10g - Firewire ASM 10

11 H/W x86 Pentium 600MHz 2 Ether PCI 2 Ether Ether PCI 3 512M IDEHardDisk 5G 3G CD-ROM 2G TEMP 1G IDE OK FirewireHDD IDE OS SWAP 3 512M SWAP 1.6G OS 2G SWAP 1.6G 3.6G 8.6G HDD OS SWAP OS 1G Firewire IDEHardDisk 2.4G 2.4G RAW RAW 2 FirewireHDD 6 2 Oxford911 Firewire 2 6 Texas Instruments TI VIA Firewire 2 Firewire LAN 4 1 LAN 2 4 Ether - Oracle Real Application Clusters 10g - Firewire ASM 11

12 S/W Red Hat Enterprise Linux 3.0 MIRACLE LINUX V3.0 Asianux 1.0 X-Windows Oracle Database 10g Release 1 (10.1.0) MIRACLE LINUX V3.0 MIRACLE LINUX V3.0 Red Hat Enterprise Linux 3.0 Firewire RAC RPM Red Hat Enterprise Linux 3.0 Tips Red Hat Enterprise Linux 3.0 Tips FirewireHDD IDE Firewire FirewireHDD IDE FirewirePCI OK FirewireHDD FirewireHDD Oxford911 HDD Oxford911 HDD Oxford911 Ocford911 HDD HDD ADS Technologies PYRO Drive Kit 1394 MediaFocus GXM-35F Novac KIT IEEE1394 Bytecc ME-320F IDE IDE - Oracle Real Application Clusters 10g - Firewire ASM 12

13 Western Digital 80G IDE drive (model WD800BB) Western Digital WDC WD40 Model: 0BB-00AUA1 Rev: 18.2 Western Digital 200BB 20GB Western Digital 2000BB 200GB IBM-DTLA Model: Rev: TW4O IDE Firewire TI VIA Western Digital WDC WD40 Model: 0BB-00AUA Novac KIT IEEE1394 NV-HD352E 8000 IEEE1394 Buffalo IFC-ILP94 IEEE Buffalo 10/100M PCI LAN LGY-PCI-TXD2 800 IEEE OS OS MIRACLE LINUX V3.0 - Asianux Inside Asianux RedHat3.0 MIRACLE LINUX RedFlag MIRACLE LINUX V /6/30 Oracle Tecnology NetWork Japan - Oracle Real Application Clusters 10g - Firewire ASM 13

14 OS MIRACLE LINUX V3.0 URL MIRACLE LINUX V3.0 Asianux Inside CRS Oracle Database 10g Release 1 (10.1.0) for Linux x86 CRS database Firewire Linux URL Linux Oracle Cluster File System (OCFS) 2004/09 30 Firewire Firewire NIC Failover Firewire Linux Oracle Firewire OTN Firewire [firewire] [files] kernel elorafw1.i686.rpm RPM SMP SMP 1CPU (2004/06/10 ) - Oracle Real Application Clusters 10g - Firewire ASM 14

15 H/W PCI Ether Firewire IEEE1394 HDD Master Masater/Slave Cable Select Master HDD HDD IEEE1394 HDD Firewire IEEE1394 HDD Firewire FirewireHDD OS OS RAC NIC IP 1 NIC IP oracle oracle OS OS RAC MIRACLE LINUX V3.0 Disk Druid 3G NIC Ethercard - Oracle Real Application Clusters 10g - Firewire ASM 15

16 (eth0) DHCP IP IP Firewire IP NIC(eth1) OS - IP IP oracle01 oracle02 2 OS DHCP IP DHCP DHCP LAN IP PrivateLAN PrivateIP OS NIC DHCP IP NIC OS (eth0 eth1 ) NIC OS NIC OS OS NIC NIC DHCP OS /etc/sysconfig/network NETWORKING yes HOSTNAME=oracle01 - Oracle Real Application Clusters 10g - Firewire ASM 16

17 [ M ] [ ] OS NIC 2 NIC OS OS NIC IP IP x.x IP Oracle Database 10g Linux 512M 1G 5G /tmp 900M [root@oracle01 root]# grep MemTotal /proc/meminfo MemTotal: kb [root@oracle01 root]# [root@oracle01 root]# grep SwapTotal /proc/meminfo SwapTotal: kb [root@oracle01 root]# - Oracle Real Application Clusters 10g - Firewire ASM 17

18 1G Root df dd mkswap swapon swapon s swap [root@oracle01 root]# df Filesystem 1K- % /dev/hda % / /dev/hda % /boot none % /dev/shm [root@oracle01 root]# dd [root@oracle01 root]# dd if=/dev/zero of=/swapfile bs=1024k count= mkswap [root@oracle01root]# mkswap /swapfile Setting up swapspace version 1, size = kb [root@oracle01 root]# swapon sawpon s [root@oracle01 root]# swapon /swapfile [root@oracle01 root]# swapon -s Filename Type Size Used Priority /dev/hda3 partition /swapfile file swapon /etc/sysctl.conf - Oracle Real Application Clusters 10g - Firewire ASM 18

19 root sysctl p MIRACLE LINUX V3.0 RedHat kernel.msgmnb = kernel.msgmni = 2878 kernel.sem = kernel.shmmax = fs.file-max = fs.aio-max-size = net.ipv4.ip_local_port_range = /etc/security/limits.conf * soft nproc 2048 * hard nproc * soft nofile 2048 * hard nofile /etc/pam.d/login session required /lib/security/pam_limits.so IP OS Ethernet/IP root ifconfig Linux eth0 eth1 Ethernet NIC eth0 eth1 IP inet.addr [root@oracle01 root]# ifconfig eth0 Link encap:ethernet HWaddr 00:50:8B:8F:34:9B inet addr: Bcast: Mask: UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:37439 errors:0 dropped:0 overruns:0 frame:0 TX packets:129 errors:0 dropped:0 overruns:0 carrier:0 - Oracle Real Application Clusters 10g - Firewire ASM 19

20 collisions:0 txqueuelen:1000 RX bytes: (3.0 Mb) TX bytes:12758 (12.4 Kb) Interrupt:10 Base address:0x2400 Memory: eth1 Link encap:ethernet HWaddr 00:07:40:C7:4D:A8 inet addr: Bcast: Mask: UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:4 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:240 (240.0 b) Interrupt:4 Base address:0x7000 lo Link encap:local Loopback inet addr: Mask: UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) eth0 eth1 IP eth0 PublicLAN IP eth0 IP PublicLAN CRS oracle01 oracle02 eth eth oracle01 eth0 PublicLAN oracle02 PublicLAN eth1 /etc/modules.conf alias eth0 8139too alias eth1 3c59x - Oracle Real Application Clusters 10g - Firewire ASM 20

21 3COM NIC eth1 Intel NIC eth0 Linux OS NIC eth0 IP NIC ifconfig eth0/eth1 /etc/modules.conf /etc/sysconfig/network-scrips Linux ifcfg-eth0 ifcfg-eth1 Ifcfg-eth0 DEVICE=eth0 BOOTPROTO=dhcp ONBOOT=yes TYPE=Ethernet ifcfg-eth1 DEVICE=eth1 ONBOOT=yes BOOTPROTO=static IPADDR= NETMASK= GATEWAY= ping ifconfig ping oracle02 oracle01 ping eth0 eth1 IP ping root]# ping PING ( ) 56(84) bytes of data. 64 bytes from : icmp_seq=0 ttl=64 time=0.297 ms 64 bytes from : icmp_seq=1 ttl=64 time=0.250 ms 64 bytes from : icmp_seq=2 ttl=64 time=0.252 ms 64 bytes from : icmp_seq=3 ttl=64 time=0.252 ms - Oracle Real Application Clusters 10g - Firewire ASM 21

22 /etc/hosts /etc/hosts Oracle Universal Installer ( ) /etc/hosts /etc/hosts IP NIC IP localhost.localdomain localhost oracle01 localhost.localdomain localhost localhost.localdomain localhost oracle oracle oracle01-priv oracle02-priv oracle01-vip oracle02-vip IP IP Telnet FTP SSH IP Oracle IP VIP VIP IP RAC Ether LAN HUB Ether HUB - Oracle Real Application Clusters 10g - Firewire ASM 22

23 VIP IP Virtual IP Address RAC VIP RAC IP TCP KeepAlive VIP Oracle Database 10g ping oracle01-vip ping root]# ping oracle01-priv PING oracle01-priv ( ) 56(84) bytes of data. 64 bytes from oracle01-priv ( ): icmp_seq=0 ttl=64 time=0.279 ms 64 bytes from oracle01-priv ( ): icmp_seq=1 ttl=64 time=0.262 ms 64 bytes from oracle01-priv ( ): icmp_seq=2 ttl=64 time=0.250 ms VIP DHCP VIP /etc/hosts Oracle DHCP VIP DHCP IP IP x DHCP VIP IP VIP IP VIP x.x VIP DHCP IP IP CRS root]# hostname oracle01 root]# - Oracle Real Application Clusters 10g - Firewire ASM 23

24 localdomain CRS /etc/sysconfig/network RSH SSH RAC RSH SSH RSH SSH RSH RSH oracle01 oracle01 oracle02 oracle01 oracle02 Rsh /etc/xinetd.d/rsh disable=yes disable=no service shell { socket_type wait user log_on_success log_on_failure server disable } ~ = stream = no = root += USERID += USERID = /usr/sbin/in.rshd = no service xinetd restart MIRACLE LINUX V3.0 xinetd OK [root@oracle01 root]# service xinetd restart - Oracle Real Application Clusters 10g - Firewire ASM 24

25 xinetd : [ ] xinetd : [ OK ] [root@oracle01 root]# FTP Miracle30 SSH Ftp otn CD WinSCP3 SSH FTP FTP Proftp /etc/proftpd.conf <limit STOR> <limit STOR> DenyAll AllowAll - - <Limit STOR> DenyAll </Limit> - - <Limit STOR> AllowAll </Limit> chkconfig proftpd on #chkconfig proftpd on proftpd [root@oracle01 root]# service proftpd start Starting proftpd: [ OK ] [root@oracle01root]# - Oracle Real Application Clusters 10g - Firewire ASM 25

26 oracle01 oracle02 Firewire Firewire ohci1394/sbp2 ohci1394/sbp2 dmesg dmesg Fdisk fdisk l fdisk l Raw Raw Firewire Firewire kernel elorafw1.i686.rpm Rpm -Uvh ivh U I Firewire [root@oracle01 oracle]# rpm -ivh kernel elorafw1.i686.rpm Preparing... ########################################### [100%] 1:kernel ########################################### [100%] [root@oracle021oracle]# - Oracle Real Application Clusters 10g - Firewire ASM 26

27 /boot/grub/menu.lst Asianux ( ELorafw1) #boot=/dev/hda default=1 timeout=10 title Asianux ( ELorafw1) root (hd0,0) kernel /vmlinuz elorafw1 ro root=label=/ initrd /initrd elorafw1.img title Asianux ( AX) root (hd0,0) kernel /vmlinuz ax ro root=label=/ initrd /initrd ax.img Firewire ELorafw1 root uname root]# uname -a Linux oracle ELorafw1 #1 Thu Jun 10 14:30:40 PDT 2004 i686 i686 i386 GNU/Linux root]# Firewire lsmod root]# lsmod Module Size Used by Not tainted ide-cd (autoclean) cdrom (autoclean) [ide-cd] soundcore (autoclean) 8139too Oracle Real Application Clusters 10g - Firewire ASM 27

28 mii [8139too] crc [8139too] e sbp (unused) ieee [sbp2] floppy (autoclean) sg (autoclean) (unused) scsi_mod (autoclean) [sbp2 sg] microcode (autoclean) keybdev (unused) mousedev hid (unused) input [keybdev mousedev hid] usb-uhci (unused) usbcore [hid usb-uhci] ext jbd [ext3] [root@oracle01 root]# ieee1394 sbp2 Firewire sbp2 ieee1394 firewire ieee1394 sbp2 ohci1394 ohci1394 rmmod ohci1394 [root@oracle01 root]# rmmod sbp2 [root@oracle01 root]# [root@oracle01 root]# rmmod ieee1394 [root@oracle01 root]# - Oracle Real Application Clusters 10g - Firewire ASM 28

29 firewire SCSI Firewire SCSI SCSI SCSI ohci1394 sbp2 root]# root]# modprobe ohci1394 root]# root]# modprobe sbp2 root]# lsmod ohci1394 sbp2 root]# lsmod Module Size Used by Not tainted sbp (unused) ohci (unused) ieee [sbp2 ohci1394] ide-cd (autoclean) cdrom (autoclean) [ide-cd] soundcore (autoclean) 8139too mii [8139too] crc [8139too] e floppy (autoclean) sg (autoclean) (unused) scsi_mod (autoclean) [sbp2 sg] microcode (autoclean) keybdev (unused) mousedev hid (unused) input [keybdev mousedev hid] usb-uhci (unused) - Oracle Real Application Clusters 10g - Firewire ASM 29

30 usbcore [hid usb-uhci] ext jbd [ext3] dmesg dmesg ieee1394: sbp2: Maximum concurrent logins supported: 4 4 Firewire ohci1394: $Rev: 896 $ Ben Collins <bcollins@debian.org> PCI: Found IRQ 11 for device 00:0e.0 ohci1394_0: OHCI (PCI): IRQ=[11] MMIO=[ ff] Max Packet= [2048] ieee1394: Host added: Node[00:1023] GUID[ d] [Linux OHCI-1394] ieee1394: Device added: Node[01:1023] GUID[00d04b ] [NOVAC CO.,LTD ] scsi0 : SCSI emulation for IEEE-1394 SBP-2 Devices blk: queue d , I/O limit 4095Mb (mask 0xffffffff) ieee1394: sbp2: Query logins to SBP-2 device successful ieee1394: sbp2: Maximum concurrent logins supported: 4 ieee1394: sbp2: Number of active logins: 0 ieee1394: sbp2: Logged into SBP-2 device ieee1394: sbp2: Node[01:1023]: Max speed [S400] - Max payload [2048] Vendor: WDC WD40 Model: 0BB-00AUA1 Rev: 18.2 Type: Direct-Access ANSI SCSI revision: 06 blk: queue d , I/O limit 4095Mb (mask 0xffffffff) [root@oracle02 root]# OK fdisk /dev/sda fdisk /dev/sda fdisk l - Oracle Real Application Clusters 10g - Firewire ASM 30

31 fdisk root]# fdisk /dev/sda : 1) (. LILO) 2) OS (. DOS FDISK, OS/2 FDISK) (m ): fdisk OK dmesg 40021M sda sda1 sda5 sda4 fdisk Attached scsi disk sda at scsi0, channel 0, id 0, lun 0 SCSI device sda: byte hdwr sectors (40021 MB) sda: unknown partison [root@oracle01 root]# sda Firewire fdisk dmesg Attached scsi disk sda at scsi0, channel 0, id 0, lun 0 SCSI device sda: byte hdwr sectors (40021 MB) sda: sda1 sda2 sda3 sda4 < sda5 sda6 > [root@oracle01 root]# /dev/sda1 /dev/sda2 15 sda4 sda4 sda1~sda Oracle Real Application Clusters 10g - Firewire ASM 31

32 LVM (logical VloumeManager) Linux Linux LVM RAC fdisk /dev/sdx OS /dev/hda /dev/sda firewire SCSI /dev/hda1 /dev/hda2 /dev/sda1 /dev/sda2 /dev/sda3 /dev/sda4 /dev/sda5 /dev/sda6 Linux OS 100M OS OS Oracle 5G OCR 100M 30M Oracle 2.4G /dev/sda4 1200M /dev/sda4 1200M /dev/hda fdisk /dev/sda fdisk n OCR P OCR 100M +100M [+100M] P - Oracle Real Application Clusters 10g - Firewire ASM 32

33 root]# fdisk /dev/sda : 1) (. LILO) 2) OS (. DOS FDISK, OS/2 FDISK) (m ): p Disk /dev/sda: GB, bytes 255 heads, 63 sectors/track, cylinders Units = of * 512 = bytes ID (m ): n e p p (1-4) (1-4): 1 ( , 1): ): M + K ( , ): +100M (m ): n e - Oracle Real Application Clusters 10g - Firewire ASM 33

34 p p (1-4) (1-4): 2 ( , 14): M + K ( , ): +30M (m ): n e e p (1-4) (1-4): 4 ( , 19): M + K ( , ): +3072M (m ): n l (5 ) l p (1-4) (19-392, 19): M + K (19-392, 392 ): +1200M (m ): n l (5 ) p (1-4) l ( , 166): Oracle Real Application Clusters 10g - Firewire ASM 34

35 + + M + K ( , 39 2): +1200M (m ): p Disk /dev/sda: GB, bytes 255 heads, 63 sectors/track, cylinders Units = of * 512 = bytes ID /dev/sda Linux /dev/sda Linux /dev/sda /dev/sda Linux /dev/sda Linux (m ): w ioctl() [root@oracle01 root]# fdisk -l Disk /dev/sda: GB, bytes 255 heads, 63 sectors/track, cylinders Units = of * 512 = bytes - Oracle Real Application Clusters 10g - Firewire ASM 35

36 ID /dev/sda Linux /dev/sda Linux /dev/sda /dev/sda Linux /dev/sda Linux Disk /dev/hda: 6448 MB, bytes 240 heads, 63 sectors/track, 833 cylinders Units = of * 512 = bytes ID /dev/hda1 * Linux /dev/hda Linux /dev/hda Linux [oracle@ouclassroompc19 temp]$ RAW SCSI OS RAW root #!/bin/sh raw /dev/raw/raw1 /dev/sda1 raw /dev/raw/raw2 /dev/sda2 raw /dev/raw/raw5 /dev/sda5 raw /dev/raw/raw6 /dev/sda6 [root@oracle01 root]#./raw.sh /dev/raw/raw1: bound to major 8, minor 1 /dev/raw/raw2: bound to major 8, minor 2 /dev/raw/raw5: bound to major 8, minor 5 /dev/raw/raw6: bound to major 8, minor 6 [root@oracle01 root]# - Oracle Real Application Clusters 10g - Firewire ASM 36

37 root]# raw -qa /dev/raw/raw1: bound to major 8, minor 1 /dev/raw/raw2: bound to major 8, minor 2 /dev/raw/raw5: bound to major 8, minor 5 /dev/raw/raw6: bound to major 8, minor 6 RAW major minor RAW RAW dd dd if=/dev/zero of=/dev/raw/raw1 bs=1024 count=1000 firewire Firewire dmesg Firewire fdisk fdisk fdisk l OS HW Firewire REMOVE Firewire HW Do Nothig REMOVE do nothing fdisk /dev/sda raw raw /dev/sdx - Oracle Real Application Clusters 10g - Firewire ASM 37

38 ohci1394 raw modprobe ohci1394 ohci1394 /etc/rc.d/rc5.d S53fw1394 #!/bin/sh echo "Starting Firewire" /sbin/modprobe -v ohci1394 /sbin/modprobe-v sbp2 chmod rc5.d]# chmod +x S53fw1394 rc5.d]# ls -l S53fw1394 -rwxr-xr-x 1 root root :51 S53fw1394 /etc/sysconfig/rawdevices # raw device bindings # format: <rawdev> <major> <minor> # <rawdev> <blockdev> # example: /dev/raw/raw1 /dev/sda1 # #dev/raw/raw2 8 5 /dev/raw/raw1 /dev/sda1 /dev/raw/raw2 /dev/sda2 /dev/raw/raw5 /dev/sda5 /dev/raw/raw6 /dev/sda6 oinstall dba Root groupadd ID Oracle Real Application Clusters 10g - Firewire ASM 38

39 root]# groupadd -g 500 oinstall root]# groupadd -g 501 dba root]# /etc/group root]# more /etc/group root:x:0:root bin:x:1:root,bin,daemon oinstall:x:500: dba:x:501: root]# oinstall dba oinstall Oracle dba Oracle useradd u ID g G d [root@oracle01 root]#useradd oracle u 500 g oinstall G dba d /home/oracle [root@oracle01 root]# passwd oracle Changing password for user oracle. New password: BAD PASSWORD: it is based on a dictionary word Retype new password: passwd: all authentication tokens updated successfully. [root@oracle01 root]# - Oracle Real Application Clusters 10g - Firewire ASM 39

40 /etc/passwd oracle oracle]$ pwd /home/oracle oracle]$ oracle]$ more /etc/passwd root:x:0:0:root:/root:/bin/bash bin:x:1:1:bin:/bin:/sbin/nologin squid:x:23:23::/var/spool/squid:/sbin/nologin oracle:x:500:500::/home/oracle:/bin/bash oracle]$ su oracle Pwd id root]# su - oracle [oracle@oracle01 oracle]$ pwd /home/oracle [oracle@oracle01 oracle]$ id uid=500(oracle) gid=500(oinstall) =500(oinstall),501(dba) [oracle@oracle01 oracle]$ oracle01 oracle02 oracle.rhosts [oracle@oracle01 oracle]$ more.rhosts oracle01 oracle oracle02 oracle oracle01 oracle02 oracle [oracle@oracle02 oracle]$ rsh oracle01 date connect to address : Connection refused - Oracle Real Application Clusters 10g - Firewire ASM 40

41 Trying krb4 rsh... connect to address : Connection refused trying normal rsh (/usr/bin/rsh) Mon Jul 26 20:42:19 JST 2004 oracle]$ RSH normal rsh.rhosts rsh rsh xinetd rsh RAW RAW OS raw root]# chown oracle:oinstall /dev/raw/raw[1-6] root]# chmod 660 /dev/raw/raw[1-6] Oracle.bash_profile export ORACLE_BASE=$HOME/app/oracle export ORACLE_HOME=$ORACLE_BASE/product/10.1.0/db export ORA_CRS_HOME=$ORACLE_BASE/product/10.1.0/crs export CH=$ORA_CRS_HOME export LD_LIBRARY_PATH=.:$ORACLE_HOME/lib:$LD_LIBRARY_PATH export NLS_LANG=Japanese_Japan.JA16EUC export LANG=ja_JP #PATH=$PATH:$HOME/bin PATH=$PATH:$HOME/bin:$ORACLE_HOME/bin:$ORA_CRS_HOME/bin - Oracle Real Application Clusters 10g - Firewire ASM 41

42 export PATH unset USERNAME alias cdo='cd $ORACLE_HOME' alias cds='cd $ORA_CRS_HOME' Oracle Database 10g ORACLE_SID RAC XX01 XX02 SQL*Plus ORACLE_SID xhost + root su oracle #xhost + access control disabled, clients can connect from any host OS CRS CRS /etc/hosts rsh ssh hostname /etc/sysconfig/network hostname /etc/hosts ifconfig eth IP CRS - Oracle Real Application Clusters 10g - Firewire ASM 42

43 CRS CRS (oracle01/oracle02) (oracle01) oracle01 oracle02 orainstroot.sh orainstroot.sh 2 orainstroot.sh 2 oracle02 - Oracle Real Application Clusters 10g - Firewire ASM 43

44 root.sh root.sh oracle01 OTN-J CRS DB CRS Disk1 DB CRS CRS $mkdir CRS $cp ship.crs.cpio.gz CRS $cd CRS $gzip d ship.crs.cpio.gz $cpio idmv < ship.crs.cpio Disk1 runinstaller CD-ROM OUI (oracle01) X-Window CRS runinstaller OUI $ cd / $/mnt/cdrom/runinstaller (oracle01) [ ] - Oracle Real Application Clusters 10g - Firewire ASM 44

45 (oracle01) [oinstall] - Oracle Real Application Clusters 10g - Firewire ASM 45

46 orainstroot.sh oracle01 oracle02 [ ] [root@oracle01 oracle]# cd /home/oracle/app/oracle/orainventory [root@oracle01 orainventory]# ls orainstroot.sh [root@oracle02 orainventory]# [root@oracle01 orainventory]#./orainstroot.sh Oracle (/etc/orainst.loc) : /home/oracle/app/oracle/orainventory : oinstall. [root@oracle01 orainventory]# /etc/orainst.loc - Oracle Real Application Clusters 10g - Firewire ASM 46

47 (oracle01) CRS ORA_CRS_HOME ORACLE_HOME (oracle01) [ ] (oracle01) /etc/hosts /etc/hosts - Oracle Real Application Clusters 10g - Firewire ASM 47

48 rsh rsh xinetd xinetd (oracle01) RAC [ ] [Do not Use] [Private] [Public] IP Private Public eth0 [Public] eth1 [Private] - Oracle Real Application Clusters 10g - Firewire ASM 48

49 OCR (oracle01) OCR /dev/raw/raw1 OCR (oracle01) /dev/raw/raw2 - Oracle Real Application Clusters 10g - Firewire ASM 49

50 orainstroot.sh (oracle01 oracle02) root orainstroot.sh orainventory]#./orainstroot.sh Oracle (/etc/orainst.loc) : /home/oracle/app/oracle/orainventory : oinstall. [root@oracle01 orainventory]# [ ] (oracle01) - Oracle Real Application Clusters 10g - Firewire ASM 50

51 OK [ ] [ ] [ ] CD-ROM (oracle01) CRS root.sh (oracle01 oracle02) 100% Root root.sh - Oracle Real Application Clusters 10g - Firewire ASM 51

52 oracle01 root.sh (oracle01) oracle01 oracle02 oracle01 root.sh oracle02 root.sh root ORA_CRS_HOME root.sh [Expecting the CRS daemons to be up within 600 seconds]. crs]# crs]#./root.sh Checking to see if Oracle CRS stack is already up... /etc/oracle does not exist. Creating it now. Setting the permissions on OCR backup directory Oracle Cluster Registry configuration upgraded successfully WARNING: directory '/home/oracle/app/oracle/product/10.1.0' is not owned by root WARNING: directory '/home/oracle/app/oracle/product' is not owned by root WARNING: directory '/home/oracle/app/oracle' is not owned by root WARNING: directory '/home/oracle/app' is not owned by root WARNING: directory '/home/oracle' is not owned by root clscfg: EXISTING configuration version 2 detected. clscfg: version 2 is 10G Release 1. assigning default hostname oracle01 for node 1. assigning default hostname oracle02 for node 2. Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR= node <nodenumber>: <nodename> <private interconnect name> <hostname> node 1: oracle01 oracle01-priv oracle01 node 2: oracle02 oracle02-priv oracle02 clscfg: Arguments check out successfully. NO KEYS WERE WRITTEN. Supply -force parameter to override. -force is destructive and will destroy any previous cluster configuration. Oracle Cluster Registry for cluster has already been initialized Adding daemons to inittab Preparing Oracle Cluster Ready Services (CRS): - Oracle Real Application Clusters 10g - Firewire ASM 52

53 Expecting the CRS daemons to be up within 600 seconds. CSS is active on these nodes. oracle01 CSS is inactive on these nodes. oracle02 Local node checking complete. Run root.sh on remaining nodes to start CRS daemons. crs]# oracle02 root.sh oracle02 root.sh crs]# root.sh -bash: root.sh: command not found crs]#./root.sh Checking to see if Oracle CRS stack is already up... /etc/oracle does not exist. Creating it now. Setting the permissions on OCR backup directory Oracle Cluster Registry configuration upgraded successfully WARNING: directory '/home/oracle/app/oracle/product/10.1.0' is not owned by root WARNING: directory '/home/oracle/app/oracle/product' is not owned by root WARNING: directory '/home/oracle/app/oracle' is not owned by root WARNING: directory '/home/oracle/app' is not owned by root WARNING: directory '/home/oracle' is not owned by root clscfg: EXISTING configuration version 2 detected. clscfg: version 2 is 10G Release 1. assigning default hostname oracle01 for node 1. assigning default hostname oracle02 for node 2. Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR= node <nodenumber>: <nodename> <private interconnect name> <hostname> node 1: oracle01 oracle01-priv oracle01 node 2: oracle02 oracle02-priv oracle02 clscfg: Arguments check out successfully. NO KEYS WERE WRITTEN. Supply -force parameter to override. - Oracle Real Application Clusters 10g - Firewire ASM 53

54 -force is destructive and will destroy any previous cluster configuration. Oracle Cluster Registry for cluster has already been initialized Adding daemons to inittab Preparing Oracle Cluster Ready Services (CRS): Expecting the CRS daemons to be up within 600 seconds. CSS is active on these nodes. oracle01 oracle02 CSS is active on all nodes. Waiting for the Oracle CRSD and EVMD to start Oracle CRS stack installed and running under init(1m) crs]# CRS CSS is active on these nodes. oracle01 oracle02 CSS is active on all nodes. CSS is active on these nodes. Expecting the CRS daemons to be up within 600 seconds. CRS /etc/hosts IP root.sh root.sh cp /etc/inittab.orig /etc/inittab CRS CRS /etc Oracle #rm r /etc/ora* Oracle Oracle $rm r app CRS Miraclelinux30 - Oracle Real Application Clusters 10g - Firewire ASM 54

55 rm rm i rm -f /etc/init.d/init.cssd rm -f /etc/init.d/init.crs rm -f /etc/init.d/init.crsd rm -f /etc/init.d/init.evmd rm -f /etc/rc2.d/k96init.crs rm -f /etc/rc2.d/s96init.crs rm -f /etc/rc3.d/k96init.crs rm -f /etc/rc3.d/s96init.crs rm -f /etc/rc5.d/k96init.crs rm -f /etc/rc5.d/s96init.crs rm -Rf /etc/oracle/scls_scr rm -f /etc/inittab.crs cp /etc/inittab.orig /etc/inittab OCR RAW CRS root CRS [root@oracle02 root]# chown oracle:oinstall /dev/raw/raw1 [root@oracle02 root]# chmod 660 /dev/raw/raw End CSS is active on these nodes. partner3 CSS is active on all nodes. CSS Waiting for the Oracle CRSD and EVMD to start CRS EVM CRS DBCA DB VIP Create Database SQL*Plus DB RAC CRS EVM CRS EVM CRS root.sh oracle01 oracle02 root.sh CRS ps elf - Oracle Real Application Clusters 10g - Firewire ASM 55

56 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin 3 OK [root@oracle01 crs]# ps -ef grep oracle root :42 pts/0 00:00:00 su - oracle oracle :43 pts/0 00:00:00 -bash oracle :45 pts/0 00:02:18 /tmp/orainstall _ AM/jre/1.4.2/bin/java -Doracle.installer.library_loc=/tmp/OraInstall _ AM/oui/lib/linux -Doracle.installer.oui_loc=/tmp/OraInstall _ AM/oui -Doracle.installer.bootstrap=TRUE -Doracle.installer.startup_locat root :46? 00:00:00 sshd: oracle [priv] oracle :46? 00:00:00 sshd: oracle@notty oracle :46? 00:00:00 /usr/libexec/openssh/sftp-server root :52 pts/2 00:00:00 su - oracle oracle :52 pts/2 00:00:00 -bash root :54? 00:00:00 sshd: oracle [priv] oracle :54? 00:00:00 sshd: oracle@pts/3 oracle :54 pts/3 00:00:00 -bash root :06? 00:00:00 /bin/su oracle -c exec /home/ora cle/app/oracle/product/10.1.0/crs/bin/evmd root :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /bin/su oracle -c /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd exit 137 oracle :07? 00:00:00 bash -c /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd exit 137 oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin - Oracle Real Application Clusters 10g - Firewire ASM 56

57 oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmlogger.bin -o /home/oracle/app/oracle/product/10.1.0/crs/evm/l og/evmlogger.info -l /home/oracle/app/oracle/product/10.1.0/crs/evm/log/evmlogger.log oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin - Oracle Real Application Clusters 10g - Firewire ASM 57

58 root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :15? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :15? 00:00:00 /bin/sh /home/oracle/app/oracle/product/10.1.0/crs/bin/racgwrap check root :15? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :15? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/racgmain check root :15? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/racgeut 54 /home/oracle/app/oracle/product/10.1.0/crs/bin/racgvip check oracle01 root :15? 00:00:00 /bin/sh /home/oracle/app/oracle/product/10.1.0/crs/bin/racgvip check oracle01 root :15 pts/3 00:00:00 grep oracle [root@oracle01 crs]# CRS CSS EVM OK CRS CRS CRS - Oracle Real Application Clusters 10g - Firewire ASM 58

59 Oracle Database 10g CRS (oracle01/oracle02) (oracle01) oracle01 oracle02 orainstroot.sh orainstroot.sh oracle02 root.sh VIPCA VIP root.sh - Oracle Real Application Clusters 10g - Firewire ASM 59

60 ConfigurationAssistant runinstaller (oracle01) - Oracle Real Application Clusters 10g - Firewire ASM 60

61 (oracle01) [ ] ORACLE_HOME (oracle01) CRS OUI [ ] - Oracle Real Application Clusters 10g - Firewire ASM 61

62 orainstroot.sh (oracle01 oracle02) $ORACLE_BASE/inventory/orainstRoot.sh (oracle01) Enterprise Edition - Oracle Real Application Clusters 10g - Firewire ASM 62

63 [ ] (oracle01) DBCA DBCA [ ] - Oracle Real Application Clusters 10g - Firewire ASM 63

64 (oracle01) db_name SID ORACLE_SID SID SID SID01 SID02 ORACLE_SID RAC SID [ora101] SID [rac0] (oracle01) - Oracle Real Application Clusters 10g - Firewire ASM 64

65 (oracle01) [ ] [ASM] [RAW ] ASM ASM (oracle01) - Oracle Real Application Clusters 10g - Firewire ASM 65

66 (oracle01) ASM ASM DATA /dev/raw/raw5 raw6 (oracle01) Change_on_install Manager DBSNMP SYSMAN - Oracle Real Application Clusters 10g - Firewire ASM 66

67 (oracle01) [ ] RAC [ ] [ ] - Oracle Real Application Clusters 10g - Firewire ASM 67

68 (oracle01) (oracle01) 100% ORACLE_HOME root root.sh Oracle01 root.sh root.sh [Enter the full pathname of the local bin directory: [/usr/local/bin]:] db]#./root.sh Running Oracle10 root.sh script... - Oracle Real Application Clusters 10g - Firewire ASM 68

69 nthe following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /home/oracle/app/oracle/product/10.1.0/db Enter the full pathname of the local bin directory: [/usr/local/bin]: /usr/local/bin OK [Now product-specific root actions will be performed.] VIPCA VirtualIP Configuration Assistant Running Oracle10 root.sh script... nthe following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /home/oracle/app/oracle/product/10.1.0/db Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin... Copying oraenv to /usr/local/bin... Copying coraenv to /usr/local/bin... ncreating /etc/oratab file... Adding entry to /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Now product-specific root actions will be performed. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. Warning: Cannot convert string "-watanabe-mincho-medium-r-normal--*-140-*-*-c-*-jisx " to type FontStruct [ ] VIPCA - Oracle Real Application Clusters 10g - Firewire ASM 69

70 VIP VIPCA (oracle01) VIP (oracle01) VIP eth0 LAN eth1 LAN eth0 - Oracle Real Application Clusters 10g - Firewire ASM 70

71 VIP (oracle01) VIP /etc/hosts VIP /etc/hosts VIP IP [IP ] (oracle01) VIPCA VIP IP [ ] - Oracle Real Application Clusters 10g - Firewire ASM 71

72 [ ] VIP ~ (oracle01) (oracle01) [ ] - Oracle Real Application Clusters 10g - Firewire ASM 72

73 Oracle02 root.sh (oracle02) root.sh Root ORACLE_HOME root.sh CRS resources are already db]# db]#./root.sh Running Oracle10 root.sh script... nthe following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /home/oracle/app/oracle/product/10.1.0/db Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin... Copying oraenv to /usr/local/bin... Copying coraenv to /usr/local/bin... ncreating /etc/oratab file... Adding entry to /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. Warning: Cannot convert string "-watanabe-mincho-medium-r-normal--*-140-*-*-c-*-jisx " to type FontStruct [root@oracle01 db]# [root@oracle01 db]#./root.sh Running Oracle10 root.sh script... nthe following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /home/oracle/app/oracle/product/10.1.0/db Enter the full pathname of the local bin directory: [/usr/local/bin]: - Oracle Real Application Clusters 10g - Firewire ASM 73

74 The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying dbhome to /usr/local/bin... The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying oraenv to /usr/local/bin... The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying coraenv to /usr/local/bin... Adding entry to /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. CRS resources are already configured VIP (oracle01 oracle02) VIP ONS Ps oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d VIPCA root.sh VIPCA [ ] ifconfig eth0:1 - Oracle Real Application Clusters 10g - Firewire ASM 74

75 oracle01 oracle02 root]# ifconfig eth0 Link encap:ethernet HWaddr 00:50:8B:8F:34:9B inet addr: Bcast: Mask: UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets: errors:0 dropped:0 overruns:0 frame:0 TX packets: errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes: (240.4 Mb) TX bytes: ( Mb) Interrupt:10 Base address:0x2400 Memory: eth0:1 Link encap:ethernet HWaddr 00:50:8B:8F:34:9B inet addr: Bcast: Mask: UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets: errors:0 dropped:0 overruns:0 frame:0 TX packets: errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes: (578.5 Mb) TX bytes: ( Mb) Interrupt:10 Base address:0x2400 Memory: eth1 Link encap:ethernet HWaddr 00:07:40:C7:4D:A8 inet addr: Bcast: Mask: UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets: errors:0 dropped:0 overruns:0 frame:0 TX packets: errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes: (578.5 Mb) TX bytes: ( Mb) Interrupt:4 Base address:0x7000 lo Link encap:local Loopback inet addr: Mask: UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets: errors:0 dropped:0 overruns:0 frame:0 TX packets: errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes: (714.5 Mb) TX bytes: (714.5 Mb) - Oracle Real Application Clusters 10g - Firewire ASM 75

76 root]# VIPCA [OK] (oracle01) (oracle01) OracleNetServices NetServices [OracleNetConfigurationiAssistant] [ ] [Oracle Database ConfigurationAssistant] [ ] - Oracle Real Application Clusters 10g - Firewire ASM 76

77 (oracle01) (oracle01) RAC v$ (oracle01) URL - Oracle Real Application Clusters 10g - Firewire ASM 77

78 [OK] (oracle01) [OK] RAC - Oracle Real Application Clusters 10g - Firewire ASM 78

79 (oracle01) - Oracle Real Application Clusters 10g - Firewire ASM 79

80 ps ASM oracle :33? 00:00:00 asm_pmon_+asm1 [+ASM01] SID +ASM +ASM02 SID oracle :07? 00:00:00 ora_pmon_rac01 ps ef [oracle@oracle01 oracle]$ ps -ef grep oracle root :20 pts/0 00:00:00 su - oracle oracle :20 pts/0 00:00:00 -bash root :35? 00:00:00 /bin/su oracle -c exec /home/ora cle/app/oracle/product/10.1.0/crs/bin/evmd root :35? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin root :36? 00:00:00 /bin/su oracle -c /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd exit 137 oracle :36? 00:00:00 bash -c /home/oracle/app/oracle/ product/10.1.0/crs/bin/ocssd exit 137 oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:04 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:02 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/ocssd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin - Oracle Real Application Clusters 10g - Firewire ASM 80

81 oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:02 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:01 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin oracle :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/evmd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :36? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin - Oracle Real Application Clusters 10g - Firewire ASM 81

82 oracle :37? 00:00:00 /home/oracle/app/oracle/product/ /crs/bin/evmlogger.bin -o /home/oracle/app/oracle/product/10.1.0/crs/evm/l og/evmlogger.info -l /home/oracle/app/oracle/product/10.1.0/crs/evm/log/evmlogge r.logroot :37? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :16? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d oracle :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/db/opmn/bin/ons -d root :17? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :24? 00:00:00 sshd: oracle [priv] oracle :24? 00:00:00 sshd: oracle@notty oracle :24? 00:00:00 /usr/libexec/openssh/sftp-server oracle :26? 00:00:00 /home/oracle/app/oracle/product/ /db/bin/tnslsnr LISTENER_ORACLE01 -inherit root :27? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :29 pts/2 00:00:00 su - oracle oracle :29 pts/2 00:00:00 -bash oracle :33? 00:00:00 asm_pmon_+asm1 oracle :33? 00:00:00 asm_diag_+asm1 oracle :33? 00:00:01 asm_lmon_+asm1 oracle :33? 00:00:00 asm_lmd0_+asm1 oracle :33? 00:00:01 asm_lms0_+asm1 root :33? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :33? 00:00:00 asm_mman_+asm1 oracle :33? 00:00:00 asm_dbw0_+asm1 oracle :33? 00:00:00 asm_lgwr_+asm1 oracle :33? 00:00:00 asm_ckpt_+asm1 oracle :33? 00:00:00 asm_smon_+asm1 oracle :33? 00:00:01 asm_rbal_+asm1 root :33? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :33? 00:00:00 asm_lck0_+asm1 root :33? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :33? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :34? 00:00:00 /home/oracle/app/oracle/product /db/bin/racgimon daemon ora.oracle01.asm1.asm oracle :34? 00:00:00 /home/oracle/app/oracle/product/ db/bin/racgimon daemon ora.oracle01.asm1.asm oracle :34? 00:00:00 /home/oracle/app/oracle/product /db/bin/racgimon daemon ora.oracle01.asm1.asm root :34? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :34? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :34? 00:00:00 /home/oracle/app/oracle/product/ /db/bin/racgimon daemon ora.oracle01.asm1.asm oracle :34? 00:00:00 /home/oracle/app/oracle/product/ /db/bin/racgimon daemon ora.oracle01.asm1.asm oracle :44? 00:00:00 /home/oracle/app/oracle/product/ - Oracle Real Application Clusters 10g - Firewire ASM 82

83 10.1.0/db/bin/racgimon daemon ora.oracle01.asm1.asm oracle :54? 00:00:00 /home/oracle/app/oracle/product/ /db/perl/bin/perl /home/oracle/app/oracle/product/10.1.0/db/bin/emwd.pl db console /home/oracle/app/oracle/product/10.1.0/db/oracle01_rac01/sysman/log/emdb.nohup oracle :56? 00:00:05 /home/oracle/app/oracle/product/10.1.0/db/bin/emagent oracle :57? 00:00:00 asm_pz99_+asm1 oracle :02? 00:00:00 oracle+asm1 (LOCAL=NO) oracle :03? 00:00:00 asm_pz98_+asm1 root :04? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :06? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :07? 00:00:00 ora_pmon_rac01 oracle :07? 00:00:00 ora_diag_rac01 oracle :07? 00:00:01 ora_lmon_rac01 root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :07? 00:00:04 ora_lmd0_rac01 oracle :07? 00:00:01 ora_lms0_rac01 oracle :07? 00:00:00 ora_lms1_rac01 oracle :07? 00:00:00 ora_mman_rac01 oracle :07? 00:00:00 ora_dbw0_rac01 oracle :07? 00:00:00 ora_lgwr_rac01 oracle :07? 00:00:00 ora_ckpt_rac01 oracle :07? 00:00:01 ora_smon_rac01 oracle :07? 00:00:00 ora_reco_rac01 oracle :07? 00:00:00 ora_cjq0_rac01 oracle :07? 00:00:00 ora_d000_rac01 oracle :07? 00:00:00 ora_s000_rac01 root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :07? 00:00:03 ora_lck0_rac01 root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :07? 00:00:00 ora_asmb_rac01 root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :07? 00:00:00 oracle+asm1 (DESCRIPTION=(LOCAL= YES)(ADDRESS=(PROTOCOL=beq))) oracle :07? 00:00:00 ora_rbal_rac01 root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :07? 00:00:00 ora_o001_rac01 root :07? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :08? 00:00:02 ora_pz99_rac01 oracle :08? 00:00:00 /home/oracle/app/oracle/product/ /crs/bin/evmlogger.bin -o /home/oracle/app/oracle/product/10.1.0/crs/evm/l og/evmlogger.info -l /home/oracle/app/oracle/product/10.1.0/crs/evm/log/evmlogge r.log root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :08? 00:00:00 ora_qmnc_rac01 root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :08? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :09? 00:00:01 ora_mmon_rac01 root :09? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :09? 00:00:00 ora_mmnl_rac01 oracle :09? 00:00:04 oraclerac01 (LOCAL=NO) - Oracle Real Application Clusters 10g - Firewire ASM 83

84 root :09? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :09? 00:00:07 ora_j000_rac01 oracle :09? 00:00:02 oraclerac01 (LOCAL=NO) oracle :10? 00:00:00 /home/oracle/app/oracle/product/ /db/bin/racgimon daemon ora.ora101.rac01.inst oracle :10? 00:00:00 /home/oracle/app/oracle/product/ /db/bin/racgimon daemon ora.ora101.rac01.inst oracle :10? 00:00:00 /home/oracle/app/oracle/product/ /db/bin/racgimon daemon ora.ora101.rac01.inst root :10? 00:00:00 /home/oracle/app/oracle/product/ /crs/bin/crsd.bin oracle :10? 00:00:00 /home/oracle/app/oracle/product/ /db/bin/racgimon daemon ora.ora101.rac01.inst oracle :10? 00:00:00 /home/oracle/app/oracle/product/ /db/bin/racgimon daemon ora.ora101.rac01.inst oracle :10? 00:00:00 ora_pz98_rac01 root :10? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin oracle :12? 00:00:00 oraclerac01 (LOCAL=NO) oracle :12? 00:00:00 oraclerac01 (LOCAL=NO) oracle :12? 00:00:32 oraclerac01 (LOCAL=NO) oracle :12? 00:00:00 oraclerac01 (LOCAL=NO) oracle :13? 00:00:00 oraclerac01 (LOCAL=NO) root :13? 00:00:00 sshd: oracle [priv] oracle :13? 00:00:00 sshd: oracle@pts/3 oracle :13 pts/3 00:00:00 -bash root :14? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :14? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :14? 00:00:00 /bin/sh /home/oracle/app/oracle/ product/10.1.0/crs/bin/racgwrap check root :14? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/crsd.bin root :14? 00:00:00 /home/oracle/app/oracle/product/10.1.0/crs/bin/racgmain check oracle :14? 00:00:00 ora_q000_rac01 oracle :14? 00:00:05 /home/oracle/app/oracle/product/ /db/jdk/bin/java -server -Xmx512M -XX:MaxPermSize=64m -XX:MinHeapFreeRatio =20 -XX:MaxHeapFreeRatio=40 -DORACLE_HOME=/home/oracle/app/oracle/product/ /db -Doracle.home=/home/oracle/app/oracle/product/10.1.0/db/oc4j -Doracle.oc4j.l oracle :14 pts/3 00:00:00 ps -ef oracle :14 pts/3 00:00:00 grep oracle [oracle@oracle01 oracle]$ Linux ID ps Firewire ASM RAC - Oracle Real Application Clusters 10g - Firewire ASM 84

85 ) ($HOME=/home/oracle ORACLE_BASE $ HOME/app/oracle ORACLE_HOME $HOME/app/oracle/prpduct/10.1.0/db ORA_CRS_HOME $HOME/app/oracle/product/10.1.0/crs ORACLE_SID 1 rac01 ORACLE_SID 2 rac02 ASM 1 +ASM1 ASM 2 +ASM2 ORACLE_HOME/dbs/inirac01.ora ORACLE_HOME/dbs/inirac02.ora ASM $ORACLE_BASE/admin/+ASM/pfile/init.ora REDO VotingDisk OCRDisk OCR /dev/raw/raw1 /dev/raw/raw2 SP REDO /dev/raw/raw5 SP REDO /dev/raw/raw6 DUMP $ORACLE_BASE/adim/ora101 - Oracle Real Application Clusters 10g - Firewire ASM 85

86 Red Hat Enterprise Linux 3.0 Tips MIRACLE LINUX V3.0 MIRACLE LINUX V3.0 Red Hat Enterprise Linux 3.0 Update2 Red Hat Enterprise Linux 3.0 Red Hat Enterprise Linux 3.0 Update2 Tips Update RAC Update Update2 RPM Red Hat RedHat xinetd.d]# uname -a Linux oracle EL #1 Thu Apr 22 00:27:41 EDT 2004 i686 i686 i386 GNU/L inux xinetd.d]# Firewire kernel elorafw1.i686.rpm (for a single CPU system) rpm -ivh <filename.rpm> MIRACLE LINUX Oracle /etc/sysctl.conf sysctl p kernel.shmall = kernel.shmmax = kernel.shmmni = 4096 kernel.sem = fs.file-max = net.ipv4.ip_local_port_range = PRM RedhatAS3.0 RPM - Oracle Real Application Clusters 10g - Firewire ASM 86

87 gcc compat-db compat-gcc compat-gcc-c compat-libstdc compat-libstdc++-devel openmotif setarch make-3.79 binutils rsh-server i386.rpm *SSH RSH Rsh MIRACLE LINUX V3. MIRACLE LINUX V3.0 - Oracle Real Application Clusters 10g - Firewire ASM 87

88 Firewire modprobe sbp2 SCSI device sda: byte hdwr sectors (61493 MB) sda:scsi0: ERROR on channel 0, id 0, lun 0, CDB: Read (10) Current sd08:00: sense key Medium Error Additional sense indicates Data phase error I/O error: dev 08:00, sector 0 scsi0: ERROR on channel 0, id 0, lun 0, CDB: Read (10) [sector(61493mb) 60G sbp 60GB SCSI sbp2 60GB Red Hat Enterprise Linux AS 2.1 Firewire rc2-orafw-smp 20GB 60GB dmesg sbp2 ieee1394: sbp2: Node[01:1023]: Max speed [S400] - Max payload [2] IEEE1394 [Max payload] 2 [Maxpayload[2048]] IEEE Oracle Real Application Clusters 10g - Firewire ASM 88

89 3 fdisk l dd rmmod sbp2 modprobe sbp2 Firewire rmmod sbp2 modprobe sbp2 fdisk /dev/sda su /etc/pam.d/su #auth required /lib/security/pam_wheel.so use_uid /sbin/lkcd_config OUI OUI Using paramfile: /oracle10/disk1/install/linux/oraparam.ini Checking requirements... Checking operating system version: must be redhat-2.1 or UnitedLinux-1.0 Failed <<<< Exiting Oracle Universal Installer, log for this session can be found at /oracle /orainventory/logs/installactions _ pm.log CD-ROM Disk1 Didk1 install/linux/oraparam.ini* [Linux] Red Hat Enterprise Linux AS 2.1 [Certified Versions] #Linux=redhat-2.1,UnitedLinux-1.0 OUI TMP TMP 777 Red Hat Enterprise Linux AS2.1 - Oracle Real Application Clusters 10g - Firewire ASM 89

90 CRS OCR OCR OUI CRS OUI RAW dd dd if=/dev/zero of=/dev/raw/raw12 bs=1024k count=10 CRS root.sh /etc/hosts 32 CRS /etc Oracle #rm r /etc/ora* Oracle Oracle $rm r app CRS Miracle Linux V3.0 rm rm i rm -f /etc/init.d/init.cssd rm -f /etc/init.d/init.crs rm -f /etc/init.d/init.crsd rm -f /etc/init.d/init.evmd rm -f /etc/rc2.d/k96init.crs rm -f /etc/rc2.d/s96init.crs rm -f /etc/rc3.d/k96init.crs rm -f /etc/rc3.d/s96init.crs rm -f /etc/rc5.d/k96init.crs rm -f /etc/rc5.d/s96init.crs rm -Rf /etc/oracle/scls_scr rm -f /etc/inittab.crs cp /etc/inittab.orig /etc/inittab OCR RAW CRS root - Oracle Real Application Clusters 10g - Firewire ASM 90

91 root]# chown oracle:oinstall /dev/raw/raw1 root]# chmod 660 /dev/raw/raw2 ASM RAW umount 2 [/dev/raw/raw1*] [/dev/raw/raw12*] 3 dd dd if=/dev/zero of=/dev/raw/raw15 bs=1024k count=100 4 mkfs Mkfs RAW [root@oracle02 crs]# mkfs /dev/sda5 mke2fs 1.32 (09-Nov-2002) Filesystem label= OS type: Linux Block size=4096 (log=2) Fragment size=4096 (log=2) inodes, blocks blocks (5.00%) reserved for the super user First data block=0 - Oracle Real Application Clusters 10g - Firewire ASM 91