RHEL54“加”Oracle10GRAC“加”裸设备安装.docx

RHEL5.4+Oracle 10G RAC+裸设备目录1 IP地址规划32共享磁盘存储(裸设备)规划33实施操作步骤43.1环境准备及检查41创建虚拟主机，规划IP42创建共享磁盘43.2系统及内核参数配置81各主机编辑文件 /etc/redhat-release(oracle不支持RHEL5版本)82各主机创建Oracle用户组oinstall、dba ；用户 oracle84各主机创建Oracle安装lv以及软件存放目录83各主机创建Oracle安装目录85各主机编辑文件 /home/oracle/.bash_profile96各主机编辑文件 /etc/sysctl.conf97 各主机编辑文件 /etc/hosts108各主机编辑文件 /etc/security/limits.conf109各主机编辑文件 /etc/pam.d/login1110各主机编辑文件 /etc/rc.local1111各主机登录oracle用户，配置Oracle SSH互信：1112配置NTP（可选）1213安装、database需要的rpm包1214创建LVM裸设备1415配置UDEV并且修改裸设备共享磁盘权限1516建立裸设备的软链接。1717创建裸设备映射文件1818禁止IPTABLES与SELINUX193.3安装Oracle10g_RAC191上传安装介质192解压三个安装介质203检查安装环境204安装clusterware215安装Oracle Database366升级clusterware427升级database448 NETCA创建监听469 DBCA建库5310使用裸设备创建Database5711导出dmp数据库文件7312导入dmp数据库文件7313开启数据库归档模式741 IP地址规划IP规划示例：主机名（不能大写）rac1rac2公共IP（eth0）192.168.65.111192.168.65.112私有IP（eth1）192.168.100.111192.168.100.112虚拟IP（eth0）192.168.65.113192.168.65.114ORACLE_SIDorcl1orcl2全局数据库名orcl2共享磁盘存储(裸设备)规划存储磁盘规划示例：(测试用)用途lv名裸设备名字大小存放集群注册表ocr/dev/vgdata/orcl_ocr/dev/raw/raw1512M表决磁盘voting disk/dev/vgdata/orcl_vdisk/dev/raw/raw2512Mspfile信息存放/dev/vgdata/rorcl_spfile/dev/raw/raw3128M控制文件/dev/vgdata/rorcl_ctl1/dev/raw/raw4128M控制文件/dev/vgdata/rorcl_ctl2/dev/raw/raw5128M控制文件/dev/vgdata/rorcl_ctl3/dev/raw/raw6128MSysaux表空间/dev/vgdata/rorcl_sysaux/dev/raw/raw71024MSystem表空间/dev/vgdata/rorcl_system/dev/raw/raw81024M系统临时表空间/dev/vgdata/rorcl_temp1/dev/raw/raw9128M撤销表空间/dev/vgdata/rorcl_undo1/dev/raw/raw10512M撤销表空间/dev/vgdata/rorcl_undo2/dev/raw/raw11512MUser表空间/dev/vgdata/rorcl_users/dev/raw/raw12128M重做日志文件/dev/vgdata/rorcl_redolog1/dev/raw/raw13512M重做日志文件/dev/vgdata/rorcl_redolog2/dev/raw/raw14512M重做日志文件/dev/vgdata/rorcl_redolog3/dev/raw/raw15512M重做日志文件/dev/vgdata/rorcl_redolog4/dev/raw/raw16512M用户数据表空间/dev/vgdata/rorcl_data1/dev/raw/raw17128M用户数据表空间/dev/vgdata/rorcl_data2/dev/raw/raw18128M用户数据表空间/dev/vgdata/rorcl_data3/dev/raw/raw19128M用户数据表空间/dev/vgdata/rorcl_data4/dev/raw/raw20128M3实施操作步骤3.1环境准备及检查1创建虚拟主机，规划IP请见IP规划示例。要设定为静态IP。主机名由字母加数字组成，不得有大写或其他特殊符号。2创建共享磁盘见存储磁盘规划示例。另外由于两台虚拟机如果不属于同一台物理服务器，共享磁盘要设置为物理，见下图；共享磁盘模式应为厚置备置零。磁盘总线应该另外再用一条总线，如果原来用了SCSI0：X，则现在需要用SCSI1：1、SCSI1：2、SCSI1：3。共享磁盘只需在主机1建立，主机2在建磁盘时直接指向主机1的磁盘位置即可。主机1创建磁盘步骤如下主机2创建磁盘步骤如下3.2系统及内核参数配置1各主机编辑文件 /etc/redhat-release(oracle不支持RHEL5版本)修改为：Red Hat Enterprise Linux Server release 4 (Tikanga)2各主机创建Oracle用户组oinstall、dba ；用户 oraclegroupadd oinstall groupadd dbauseradd -g oinstall -G dba oracle passwd oracle /密码设为 oracle4各主机创建Oracle安装lv以及软件存放目录lvcreate -L 15G -n lvoracle /dev/vgrootmkfs.ext3 /dev/vgroot/lvoraclemkdir /oraclemount /dev/vgroot/lvoracle /oraclelvcreate -L 5G -n lvsoftware /dev/vgrootmkfs.ext3 /dev/vgroot/lvsoftwaremkdir /softwaremount /dev/vgroot/lvsoftware /softwarecat>>/etc/fstab<<EOF/dev/vgroot/lvoracle /oracle ext3 defaults 1 1/dev/vgroot/lvsoftware /software ext3 defaults 1 1EOFchown -R oracle:oinstall /oraclechmod -R 755 /oraclechown -R oracle:oinstall /softwarechmod -R 755 /software3各主机创建Oracle安装目录mkdir -p /oracle/product/10.2.0/crsmkdir -p /oracle/product/10.2.0/dbchown -R oracle:oinstall /oraclechmod -R 755 /oracle5各主机编辑文件 /home/oracle/.bash_profile在oracle用户下初始化参数；添加修改：节点1 cp /home/oracle/.bash_profile /home/oracle/.bash_profile.bakcat>>/home/oracle/.bash_profile<<EOFexport ORACLE_BASE=/oracleexport ORACLE_HOME=/oracle/product/10.2.0/dbexport ORA_CRS_HOME=/oracle/product/10.2.0/crsexport ORACLE_SID=orcl1export ORACLE_TERM=xtermexport ORACLE_OWNER=oracleexport TNS_ADMIN=$ORACLE_HOME/network/adminexport ORA_NLS33=$ORACLE_HOME/ocommon/nls/admin/dataexport NLS_LANG=AMERICAN_AMERICA.ZHS16GBKPATH=$PATH:$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$ORA_ASM_HOME/binPATH=$PATH:/usr/bin:/bin:/usr/bin/X11:/usr/local/binexport PATHEOF节点2 cp /home/oracle/.bash_profile /home/oracle/.bash_profile.bakcat>>/home/oracle/.bash_profile<<EOFexport ORACLE_BASE=/oracleexport ORACLE_HOME=/oracle/product/10.2.0/dbexport ORA_CRS_HOME=/oracle/product/10.2.0/crsexport ORACLE_SID=orcl2export ORACLE_TERM=xtermexport ORACLE_OWNER=oracleexport TNS_ADMIN=$ORACLE_HOME/network/adminexport ORA_NLS33=$ORACLE_HOME/ocommon/nls/admin/dataexport NLS_LANG=AMERICAN_AMERICA.ZHS16GBKPATH=$PATH:$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$ORA_ASM_HOME/binPATH=$PATH:/usr/bin:/bin:/usr/bin/X11:/usr/local/binexport PATHEOFsource /home/oracle/.bash_profile6各主机编辑文件 /etc/sysctl.conf 配置内核参数；最后添加：cp /etc/sysctl.conf /etc/sysctl.conf.bakcat>>/etc/sysctl.conf<<EOFkernel.shmall = 2097152kernel.shmmax = 2147483648kernel.shmmni = 4096kernel.sem = 250 32000 100 128fs.file-max = 65536net.ipv4.ip_local_port_range = 1024 65000net.core.rmem_default = 262144net.core.rmem_max = 1048576net.core.wmem_default = 262144net.core.wmem_max = 1048576EOF删除原有的两行内容kernel.shmall =kernel.shmmax =使其生效：sysctl -p7 各主机编辑文件 /etc/hosts 添加：cat>>/etc/hosts<<EOF192.168.65.111 rac1192.168.65.112 rac2192.168.65.113 rac1-vip192.168.65.114 rac2-vip192.168.100.111 rac1-priv192.168.100.112 rac2-privEOF8各主机编辑文件 /etc/security/limits.conf 设置oracle使用的文件熟权限；最后添加：cat>>/etc/security/limits.conf <<EOForacle soft nofile 4096oracle hard nofile 63536oracl soft nproc 2047oracle hard nproc 16384EOF9各主机编辑文件 /etc/pam.d/login 修改安全限制；最后添加：cat>>/etc/pam.d/login <<EOFsession required /lib/security/pam_limits.soEOF10各主机编辑文件 /etc/rc.local 配置Hangcheck计时器；最后添加：cat>>/etc/rc.local <<EOF/sbin/modprobe hangcheck-timer hangcheck_tick=30 hangcheck_margin=180EOF11各主机登录oracle用户，配置Oracle SSH互信：1、进入Oracle用户#su - oraclemkdir /.sshchmod 700 /.sshssh-keygen -t rsassh-keygen -t dsa提示输入不用输入，直接回车：2、在主机1 上执行：touch /.ssh/authorized_keyscd /.sshls你应该可以看到你所创建的id_dsa.pub 和id_rsa.pub和authorized_keys在两个节点分别将id_dsa.pub 和id_rsa.pub加入到authorized_keys节点1：ssh rac1 cat /.ssh/id_rsa.pub >> /.ssh/authorized_keysssh rac1 cat /.ssh/id_dsa.pub >> /.ssh/authorized_keysssh rac2 cat /.ssh/id_rsa.pub >> /.ssh/authorized_keysssh rac2 cat /.ssh/id_dsa.pub >> /.ssh/authorized_keys节点2：ssh rac2 cat /.ssh/id_rsa.pub >> /.ssh/authorized_keysssh rac2 cat /.ssh/id_dsa.pub >> /.ssh/authorized_keysssh rac1 cat /.ssh/id_rsa.pub >> /.ssh/authorized_keysssh rac1 cat /.ssh/id_dsa.pub >> /.ssh/authorized_keysPS：如果提示是否连接选择yes，密码输入oracle用户的密码exec /usr/bin/ssh-agent $SHELL测试互信是否成功节点1ssh rac1 datessh rac2 datessh rac1-priv date （会提示输入yes 或密码）ssh rac2-priv date （会提示输入yes 或密码）节点2ssh rac1 datessh rac2 datessh rac1-priv date （会提示输入yes 或密码）ssh rac2-priv date （会提示输入yes 或密码）（若不需输入任何东西，时间又相差不大，则表示成功）SSH等价配置完成。12配置NTP（可选）rpm -qa |grep ntpchkconfig -level 2345 ntpd onservice ntpd startcat>>/etc/ntp.conf<<EOFrestrict 192.168.65.115 mask 255.255.255.255 nomodify notrap noqueryserver 192.168.65.115EOFservice ntpd restartcat>>/etc/ntp/step-tickers<<EOF192.168.65.115EOF13安装、database需要的rpm包可参考文件系统安装单节点的yum源配置，配置好后，使用yum install安装。mount /dev/hdc /mnt配置yum源，在/etc/yum.repos.d/rhel-debuginfo.repo (RHEL5)/etc/yum.repos.d/rhel-source.repo(RHEL6) 配置文件中添加如下配置：vi /etc/yum.repos.d/rhel-source.repocat>>/etc/yum.repos.d/rhel-debuginfo.repo<<EOFbasename=rhel5baseurl=file:/mnt/Serverenabled=1gpgcheck=0gpgkey=file:/etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-releaseEOF使用yum install 安装，如下：yum install -y binutils-* compat-libstdc+-* elfutils-libelf-* elfutils-libelf-devel-* gcc-* gcc-c+-* glibc-* glibc-common-* glibc-devel-* glibc-headers-* libaio-devel-* libaio-* libgcc-* libstdc+-* libstdc+-devel-* make-* numactl-* sysstat-* unixODBC-* unixODBC-devel-* pdksh-* compat-libcap1-* expat-* make-* libXp-devel* readline* lib* libXtst* libXp* compat-db-4.2.52-5.1* compat-gcc*如果以上安装包都安装后还不能启动安装图形界面，请彻底检查一下如下这些包是否安装上：rpm -qa binutils-2.17.50.0.6-9.el5.rpm          rpm -qa compat-db-4.2.52-5.1.rpm                rpm -qa compat-db-4.2.52-5.1.rpm                rpm -qa compat-libstdc+-296-2.96-138.rpm       rpm -qa compat-libstdc+-33-3.2.3-61.rpm        rpm -qa compat-libstdc+-33-3.2.3-61.rpm        rpm -qa control-center-2.16.0-16.el5.rpm        rpm -qa control-center-2.16.0-16.el5.rpm        rpm -qa gcc-c+-4.1.2-44.el5.rpm                rpm -qa glibc-common-2.5-34.rpm                 rpm -qa glibc-devel-2.5-34.rpm                  rpm -qa glibc-devel-2.5-34.rpm                  rpm -qa glibc-headers-2.5-34.rpm                rpm -qa libaio-0.3.106-3.2.rpm                  rpm -qa libaio-0.3.106-3.2.rpm                  rpm -qa libgcc-4.1.2-44.el5.rpm                 rpm -qa libgcc-4.1.2-44.el5.rpm                 rpm -qa libstdc+-4.1.2-44.el5.rpm              rpm -qa libstdc+-4.1.2-44.el5.rpm              rpm -qa libstdc+-devel-4.1.2-44.el5.rpm        rpm -qa libgomp-4.3.2-7.el5.rpm                 rpm -qa sysstat-7.0.2-3.el5.rpm                 rpm -qa compat-gcc-34-3.4.6-4.1.x86_64.rpm      rpm -qa compat-gcc-34-c+-3.4.6-4.1.x86_64.rpm  然后，找到这些包，执行安装：rpm -ivh binutils-2.17.50.0.6* -nodepsrpm -ivh compat-db-4.2.52-5.1* -nodepsrpm -ivh compat-libstdc+-296* -nodepsrpm -ivh compat-libstdc+-33-3.2.3-61.* -nodepsrpm -ivh control-center-2.16.0-16.el5.* -nodepsrpm -ivh gcc-c+-4.1.2-* -nodepsrpm -ivh glibc-common-* -nodepsrpm -ivh glibc-devel-2.5-* -nodepsrpm -ivh glibc-headers-* -nodepsrpm -ivh libaio-0.3.106-* -nodepsrpm -ivh libgcc-4.1.2* -nodepsrpm -ivh libstdc+-4.1.2* -nodepsrpm -ivh libstdc+-devel-4.1.2* -nodepsrpm -ivh libgomp* -nodepsrpm -ivh sysstat-7.0.2* -nodepsrpm -ivh compat-gcc* -nodeps通过以上检查并安装，肯定可以安装下去14创建LVM裸设备在两个节点执行pvcreate /dev/sdbpvcreate /dev/sdcpvcreate /dev/sddpvs在其中一个节点执行vgcreate vgdata /dev/sdd /dev/sdb /dev/sdcvgslvcreate -L 512M -n /dev/vgdata/orcl_ocrlvcreate -L 512M -n /dev/vgdata/orcl_vdisklvcreate -L 128M -n /dev/vgdata/orcl_spfilelvcreate -L 1024M -n /dev/vgdata/orcl_systemlvcreate -L 1024M -n /dev/vgdata/orcl_sysauxlvcreate -L 128M -n /dev/vgdata/orcl_temp1lvcreate -L 512M -n /dev/vgdata/orcl_undo1lvcreate -L 512M -n /dev/vgdata/orcl_undo2lvcreate -L 128M -n /dev/vgdata/orcl_userslvcreate -L 128M -n /dev/vgdata/orcl_ctl1lvcreate -L 128M -n /dev/vgdata/orcl_ctl2lvcreate -L 128M -n /dev/vgdata/orcl_ctl3lvcreate -L 512M -n /dev/vgdata/orcl_redolog1lvcreate -L 512M -n /dev/vgdata/orcl_redolog2lvcreate -L 512M -n /dev/vgdata/orcl_redolog3lvcreate -L 512M -n /dev/vgdata/orcl_redolog4lvcreate -L 128M -n /dev/vgdata/orcl_data1lvcreate -L 128M -n /dev/vgdata/orcl_data2lvcreate -L 128M -n /dev/vgdata/orcl_data3lvcreate -L 128M -n /dev/vgdata/orcl_data4lvs15配置UDEV并且修改裸设备共享磁盘权限在 /etc/udev/rules.d/60-raw.rules 里添加内容：cat>>/etc/udev/rules.d/60-raw.rules<<EOFACTION="add", KERNEL="/dev/vgdata/orcl_ocr", RUN+="/bin/raw /dev/raw/raw1 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_vdisk", RUN+="/bin/raw /dev/raw/raw2 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_spfile", RUN+="/bin/raw /dev/raw/raw3 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_ctl1", RUN+="/bin/raw /dev/raw/raw4 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_ctl2", RUN+="/bin/raw /dev/raw/raw5 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_ctl3", RUN+="/bin/raw /dev/raw/raw6 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_sysaux", RUN+="/bin/raw /dev/raw/raw7 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_system", RUN+="/bin/raw /dev/raw/raw8 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_temp1", RUN+="/bin/raw /dev/raw/raw9 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_undo1", RUN+="/bin/raw /dev/raw/raw10 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_undo2", RUN+="/bin/raw /dev/raw/raw11 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_users", RUN+="/bin/raw /dev/raw/raw12 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_redolog1", RUN+="/bin/raw /dev/raw/raw13 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_redolog2", RUN+="/bin/raw /dev/raw/raw14 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_redolog3", RUN+="/bin/raw /dev/raw/raw15 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_redolog4", RUN+="/bin/raw /dev/raw/raw16 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_data1", RUN+="/bin/raw /dev/raw/raw17 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_data1", RUN+="/bin/raw /dev/raw/raw18 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_data1", RUN+="/bin/raw /dev/raw/raw19 %N"ACTION="add", KERNEL="/dev/vgdata/orcl_data1", RUN+="/bin/raw /dev/raw/raw20 %N"KERNEL="raw1", OWNER="oracle", GROUP="oinstall", MODE="660"KERNEL="raw2", OWNER="oracle", GROUP="oinstall", MODE="660"KERNEL="raw3", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw4", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw5", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw6", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw7", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw8", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw9", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw10", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw11", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw12", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw13", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw14", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw15", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw16", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw17", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw18", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw19", OWNER="oracle", GROUP="oinstall", MODE="664"KERNEL="raw20", OWNER="oracle", GROUP="oinstall", MODE="664"EOF用命令：#start_udev用命令查看：ls /dev/raw/ -lcat>>/etc/sysconfig/rawdevices<<EOF/dev/raw/raw1 /dev/vgdata/orcl_ocr/dev/raw/raw2 /dev/vgdata/orcl_vdisk/dev/raw/raw3 /dev/vgdata/orcl_spfile/dev/raw/raw4 /dev/vgdata/orcl_ctl1/dev/raw/raw5 /dev/vgdata/orcl_ctl2/dev/raw/raw6 /dev/vgdata/orcl_ctl3/dev/raw/raw7 /dev/vgdata/orcl_sysaux/dev/raw/raw8 /dev/vgdata/orcl_system/dev/raw/raw9 /dev/vgdata/orcl_temp1/dev/raw/raw10 /dev/vgdata/orcl_undo1/dev/raw/raw11 /dev/vgdata/orcl_undo2 /dev/raw/raw12 /dev/vgdata/orcl_users/dev/raw/raw13 /dev/vgdata/orcl_redolog1/dev/raw/raw14 /dev/vgdata/orcl_redolog2/dev/raw/raw15 /dev/vgdata/orcl_redolog3/dev/raw/raw16 /de