移动-AIX营账数据库安装报告oracleracv40-internal.docx

广东移动BOSS1.5项目工程文档广东移动BOSS1.5版本扩容及容灾工程营业帐务子系统数据库安装报告上海新炬网络技术有限公司北京甲骨文软件系统有限公司 2006年8月文档更改历史记录日期版本号描述作者2006-9-10V1.0林小勇2006-09-11V2.0林小勇2006-09-27 V3.0V2.0基础作修正，并增加one-off-patch邓越，林小勇2006-11-21V4.0根据封版检查的要求，增加OS/DB参数设置及网络配置邓越，林小勇目 录1硬件配置52软件及版本53IP分配置及主机名54安装REAL APPLICATION CLUSTER64.1网络配置64.2共享存储配置64.3操作系统环境要求及设置64.4组及用户建立94.5修改OS参数及SHELL 限制：94.6修改用户配置文件104.7建立安装目录104.8所有节点配置RCP114.9在所有节点执行rootpre.sh脚本114.10安装Oracle Cluster Ready Service124.11安装 Oracle Database Server245安装ORACLE 10.2.0.2 补丁集305.1分别停止所有主机的CRS相关服务305.2确认所有CRS进程均已经停止305.3在其中一台主机上安装crs patch315.4确定CRS服务的运行状态355.5在其中一台主机上安装Database Server 补丁集356安装ONE-OFF-PATCH386.1one-off-patch列表386.2确认所有oracle进程均已停止。386.3安装one-off-patch396.4两节点的oracle文件同步436.5修改配置文件446.6修改操作系统的参数:446.7启动OCR进程447建立及配置用户数据库447.1建立数据库447.2建立必要的用户表空间508状态检测508.1版本信息508.2CRS进程状态508.3服务状态518.4实例运行状态518.5数据库基本属性529附录：539.1数据库参数设置539.2网络连接配置541 硬件配置名称数量配件服务器2IBM p595 20CPU/128G RAM/CD-DVD RROM本地存储2*273G SCSI HD共享存储1IBM DS83002 软件及版本软件及版本厂商介质AIX5.3（ML4）IBMCDHACMP 5.2 IBMCDOracle Database Enterprise Edition 企业版数据库10G Release2OracleCDOracle Cluster Ready Services 集群数据库选件OracleCD3 IP分配置及主机名主机名IP地址子网掩码S3_C_YZ_YZSJK10.243.208.5255.255.255.19210.243.208.6255.255.255.192192.168.208.5255.255.255.0S4_C_YZ_YZSJK10.243.208.7255.255.255.19210.243.208.8255.255.255.192192.168. 208.7255.255.255.04 安装Real Application Cluster4.1 网络配置修改S3_C_YZ_YZSJK 及S4_C_YZ_YZSJK 的/etc/hosts文件。加入以下内容：127.0.0.1 loopback localhost 10.243.208.5 S3_C_YZ_YZSJK192.168.208.5 s3yz_pri10.243.208.6 s3yz_vip10.243.208.131 S3_C_YZ_YZSJK_BEIFEN10.243.208.7 S4_C_YZ_YZSJK192.168.208.7 s4yz_pri 10.243.208.8 s4yz_vip10.243.208.132 S4_C_YZ_YZSJK_BEIFEN注：HACMP的节点名与RAC所用的主机名保持一致4.2 共享存储配置l 根据空间使用规划进行存储划分，建立LV 及符号链接见营账测试数据库文件链接建立脚本4.3 操作系统环境要求及设置l 内存要求：至少512MS3_C_YZ_YZSJK:/ora_install # lsattr -El mem0goodsize 127488 Amount of usable physical memory in Mbytes Falsesize 127488 Total amount of physical memory in Mbytes Falsel 本地存储空间要求软件安装目录4G， /tmp目录至少400M。S3_C_YZ_YZSJK:/ #df -kFilesystem 1024-blocks Free %Used Iused %Iused Mounted on/dev/hd4 1310720 873052 34% 3606 2% /dev/hd2 2752512 417124 85% 54293 36% /usr/dev/hd9var 1310720 1274524 3% 568 1% /var/dev/hd3 1310720 1298216 1% 186 1% /tmp/dev/hd1 1310720 1310148 1% 10 1% /home/proc - - - - - /proc/dev/hd10opt 131072 75336 43% 2345 12% /opt/dev/lv00 131072 126912 4% 18 1% /var/adm/csd/dev/ptflv 1310720 396700 70% 245 1% /ptf/dev/oracle_lv 10485760 10483796 1% 12 1% /oraclel 交换分区要求：最少400MS3_C_YZ_YZSJK:/ #lsps -aPage Space Physical Volume Volume Group Size %Used Active Auto Typepaging00 hdisk2 rootvg 32768MB 1 yes yes lvhd6 hdisk0 rootvg 32768MB 1 yes yes lvl AIX 5.3 ML 4所需软件包：确认是否安装已下软件包及补丁S3_C_YZ_YZSJK:/ora_install # lslpp -l bos.adt.base bos.adt.lib bos.adt.libm bos.perf.libperfstat bos.perf.perfstat bos.perf.proctools rsct.basic.rte vacpp.cmp.core vac.C Fileset Level State Description -Path: /usr/lib/objrepos bos.adt.base 5.3.0.40 COMMITTED Base Application Development ToolkitPath: /usr/lib/objrepos bos.adt.lib 5.3.0.40 COMMITTED Base Application Development LibrariesPath: /usr/lib/objrepos bos.adt.libm 5.3.0.40 COMMITTED Base Application Development Math LibraryPath: /usr/lib/objrepos bos.perf.libperfstat 5.3.0.30 COMMITTED Performance Statistics Library Interface Path: /etc/objrepos bos.perf.libperfstat 5.3.0.30 COMMITTED Performance Statistics Library Interface Path: /usr/lib/objrepos bos.perf.perfstat 5.3.0.40 COMMITTED Performance Statistics InterfacePath: /etc/objrepos bos.perf.perfstat 5.3.0.40 COMMITTED Performance Statistics InterfacePath: /usr/lib/objrepos bos.perf.proctools 5.3.0.30 COMMITTED Proc Filesystem Tools Path: /usr/lib/objrepos rsct.basic.rte 2.4.4.0 COMMITTED RSCT Basic FunctionPath: /etc/objrepos rsct.basic.rte 2.4.4.0 COMMITTED RSCT Basic FunctionPath: /usr/lib/objrepos vacpp.cmp.core 7.0.0.6 APPLIED IBM XL C/C+ CompilerPath: /etc/objrepos vacpp.cmp.core 7.0.0.0 COMMITTED IBM XL C/C+ Compilerl 所需操作系统补丁：S3_C_YZ_YZSJK:/ora_install # instfix -ik "IY58143 IY59386 IY60930 IY66513 IY61034 IY62191 IY60759 IY70159 IY68989" All filesets for IY58143 were found. All filesets for IY59386 were found. All filesets for IY60930 were found. All filesets for IY66513 were found. All filesets for IY61034 were found. All filesets for IY62191 were found. All filesets for IY60759 were found. All filesets for IY70159 were found. All filesets for IY68989 were found.l 2.5 JDK 环境与APAR required 所需的补丁取决JDK的版本：IBM JDK 1.3.1.11(32 bit) IY47055 IBM JDK 1.4.1.2 (32 bit) IY47536IBM JDK 1.4.1.1 (64 bit) IY47538S3_C_YZ_YZSJK:/ora_install # java versionjava version "1.4.2"Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2)Classic VM (build 1.4.2, J2RE 1.4.2 IBM AIX build ca142-20050929a (SR3) (JIT enabled: jitc)l GPFS所需软件包及补丁GPFS 2.3.0.1 (GPFS 2.3 plus APAR IY63969 - or later)S3_C_YZ_YZSJK:/ora_install #lslpp -l|grep GPFS gpfs.base 2.3.0.15 APPLIED GPFS File Manager gpfs.msg.en_US 2.3.0.10 APPLIED GPFS Server Messages - U.S. gpfs.base 2.3.0.15 APPLIED GPFS File Manager gpfs.docs.data 2.3.0.8 APPLIED GPFS Server Manpages and4.4 组及用户建立l 利用smitty工具分别在两台主机上新建三个组： oinstall,dba，hagsuserl 分别在两台主机上新建oracle用户，并加入以上新建的三个组之中，另外将root用户添加到hagsuser组中。注意：不同主机中所有的groupid及userid必须一致。l 修改oracle用户口令S3_C_YZ_YZSJK:/ora_install $su - oracleS3_C_YZ_YZSJK:/ora_install $ iduid=301(oracle) gid=301(dba) groups=302(oinstall),207(hagsuser)4.5 修改OS参数及SHELL 限制：在/etc/security/limits 文件中作以下调整:default: fsize = -1 core = -1 cpu = -1 data = -1 rss = -1 stack = -1 nofiles = -1#/usr/sbin/chdev -l sys0 -a ncargs=128#/usr/sbin/lsattr -El sys0 -a ncargsncargs 128 ARG/ENV list size in 4K byte blocks True#/usr/sbin/vmo -r -o v_pinshm=1 lru_file_repage=0注：AIX分页不足就从文件系统BUFFER CACHE拿内存，而不是使用SGA的内存空间 MINPERM% = 10-15%MAXPERM% = 20-30%MAXCLIENT% = MAXPERM% 4.6 修改用户配置文件PATH=$PATH:$HOME/bin export PATH unset USERNAME export ORACLE_BASE=/oracle/productsexport ORACLE_HOME=$ORACLE_BASE/10.2/dbexport ORA_CRS_HOME=$ORACLE_BASE/10.2/crsexport ORACLE_TERM=xtermexport NLS_LANG=AMERICAN_AMERICA.ZHS16GBKexport ORA_NLS33=$ORACLE_HOME/ocommon/nls/admin/dataexport PATH=$ORACLE_HOME/bin:$ORA_CRS_HOME/bin:$PATHexport AIXTHREAD_SCOPE=Sexport ORACLE_SID=szdb1unset USERNAME 4.7 建立安装目录建立安装目录并修改相关的读写权限mkdir p /oracle/products/10.2/crsmkdir p /oracle/products/10.2/dbchown -R oracle:oinstall /oracle/products/10.2/db chown -R root:oinstall /oracle/products/10.2/crs chmod -R 775 /oracle/products/10.2/crs chmod -R 775 /oracle/products/10.2/db 4.8 所有节点配置RCP为了在集群的某一个节点上安装其他节点的Oracle数据库软件，需要设置每个节点Oracle用户的同等性。 分别在两台主机修改/.rhosts & /home/oracle/.rhosts, 增加以下内容S3_C_YZ_YZSJK:/ #more /.rhosts S3_C_YZ_YZSJKS4_C_YZ_YZSJKl 确认是主机之间的信任连接S3_C_YZ_YZSJK:/ora_install #rsh S4_C_YZ_YZSJK ls /auditbincdrfilecdrom4.9 在所有节点执行rootpre.sh脚本S3_C_YZ_YZSJK:/source/database_install/Disk1/rootpre #/usr/sbin/slibcleanS3_C_YZ_YZSJK:/source/database_install/Disk1/rootpre #./rootpre.sh./rootpre.sh output will be logged in /tmp/rootpre.out_06-09-25.12:45:04Kernel extension /etc/pw-syscall.64bit_kernel is loaded.Unloading the existing extension: /etc/pw-syscall.64bit_kernel. Oracle Kernel Extension Loader for AIX Copyright (c) 1998,1999 Oracle Corporation Unconfigured the kernel extension successfully Unloaded the kernel extension successfullySaving the original files in /etc/ora_save_06-09-25.12:45:04.Copying new kernel extension to /etc.Loading the kernel extension from /etc Oracle Kernel Extension Loader for AIX Copyright (c) 1998,1999 Oracle Corporation Successfully loaded /etc/pw-syscall.64bit_kernel with kmid: 0x4494600 Successfully configured /etc/pw-syscall.64bit_kernel with kmid: 0x4494600The kernel extension was successfuly loaded.Configuring Asynchronous I/O.Asynchronous I/O is already definedConfiguring POSIX Asynchronous I/O.Posix Asynchronous I/O is already definedChecking if group services should be configured.Please confirm your Oracle userid is a member of the group: hagsuserConfiguring HACMP group services socket for possible use by Oracle.cp: /opt/ORCLcluster/lib/libskgxnr.a: Text file busycp: /opt/ORCLcluster/lib/libskgxnr.so: Text file busycp: /opt/ORCLcluster/lib32/libskgxnr.so: Text file busy4.10 安装Oracle Cluster Ready Servicel ./runInstaller启动安装程序l 指定安装产品位置及操作系统用户组的名字：oinstalll 指定OCR主目录：/oracle/products/10.2/crsl 进行安装环境检测：l 指定集群环境配置：根据/etc/hosts文件中的信息。分别输入两个节点的私有节点名，虚拟主机名l 指定两个网卡的通信类型：en5 为公共接口，用于外部通信，en6为私有接口，注意：仅使用PUBLIC和PRIVATE网卡，其他网卡设为不使用。l 指定OCR存储位置：/oracle/szdata/ocrl 指定voting 磁盘的位置：/oracle/szdata/votingl 开始ocr安装操作l 按照提示，以root用户登录系统，分别在两台主机执行脚本S3_C_YZ_YZSJK:/oracle/products/10.2/crs/oraInventory #sh orainstRoot.shChanging permissions of /oracle/products/10.2/crs/oraInventory to 775.Changing groupname of /oracle/products/10.2/crs/oraInventory to oinstall.The execution of the script is completeS4_C_YZ_YZSJK:/oracle/products/10.2/crs/oraInventory #sh orainstRoot.shChanging permissions of /oracle/products/10.2/crs/oraInventory to 775.Changing groupname of /oracle/products/10.2/crs/oraInventory to oinstall.The execution of the script is completeS3_C_YZ_YZSJK:/oracle/products/10.2/crs #sh root.shWARNING: directory '/oracle/products/10.2' is not owned by rootWARNING: directory '/oracle/products' is not owned by rootWARNING: directory '/oracle' is not owned by rootChecking to see if Oracle CRS stack is already configuredChecking to see if any 9i GSD is up/etc/oracle does not exist. Creating it now.Setting the permissions on OCR backup directorySetting up NS directoriesOracle Cluster Registry configuration upgraded successfullyWARNING: directory '/oracle/products/10.2' is not owned by rootWARNING: directory '/oracle/products' is not owned by rootWARNING: directory '/oracle' is not owned by rootSuccessfully accumulated necessary OCR keys.Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.node <nodenumber>: <nodename> <private interconnect name> <hostname>node 1: s3_c_yz_yzsjk s3yz_pri s3_c_yz_yzsjknode 2: s4_c_yz_yzsjk s4yz_pri s4_c_yz_yzsjkCreating OCR keys for user 'root', privgrp 'system'.Operation successful.Now formatting voting device: /oracle/szdata/votingFormat of 1 voting devices complete.Startup will be queued to init within 30 seconds.Adding daemons to inittabAdding daemons to inittabExpecting the CRS daemons to be up within 600 seconds.CSS is active on these nodes. s3_c_yz_yzsjkCSS is inactive on these nodes. s4_c_yz_yzsjkLocal node checking complete.Run root.sh on remaining nodes to start CRS daemons.S4_C_YZ_YZSJK:/oracle/products/10.2/crs #sh root.shWARNING: directory '/oracle' is not owned by rootChecking to see if Oracle CRS stack is already configuredChecking to see if any 9i GSD is up/oracle/products/10.2/crs/bin/lsdb: Cannot allocate memory of size 0 9i GSD is running on node ''. Stop the GSD and rerun root.shS4_C_YZ_YZSJK:/oracle/products/10.2/crs #ps -ef | grep gsd root 205490 106804 0 19:24:21 pts/0 0:00 grep gsd root 209832 49956 0 18:53:09 - 0:00 hagsd grpsvcs S4_C_YZ_YZSJK:/oracle/products/10.2/crs #sh root.shWARNING: directory '/oracle' is not owned by rootChecking to see if Oracle CRS stack is already configuredChecking to see if any 9i GSD is up/etc/oracle does not exist. Creating it now.Setting the permissions on OCR backup directorySetting up NS directoriesOracle Cluster Registry configuration upgraded successfullyWARNING: directory '/oracle' is not owned by rootclscfg: EXISTING configuration version 3 detected.clscfg: version 3 is 10G Release 2.Successfully accumulated necessary OCR keys.Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.node <nodenumber>: <nodename> <private interconnect name> <hostname>node 1: s3_c_yz_yzsjk s3yz_pri s3_c_yz_yzsjknode 2: s4_c_yz_yzsjk s4yz_pri s4_c_yz_yzsjkclscfg: Arguments check out successfully.NO KEYS WERE WRITTEN. Supply -force parameter to override.-force is destructive and will destroy any previous clusterconfiguration.Oracle Cluster Registry for cluster has already been initializedStartup will be queued to init within 30 seconds.Adding daemons to inittabAdding daemons to inittabExpecting the CRS daemons to be up within 600 seconds.CSS is active on these nodes. s3_c_yz_yzsjk s4_c_yz_yzsjkCSS is active on all nodes.Waiting for the Oracle CRSD and EVMD to startOracle CRS stack installed and running under init(1M)Running vipca(silent) for configuring nodeappsInvalid node name "S3_C