Sunday, September 26, 2021

Installation Guide for RAC 12102 on Linux 7.9

 

The below is the short details for installing RAC 12.1.0.2 on Linux 7.9




Installation of Linux 7.9 with 10GB RAM 4 cores on ssd drive on intel processor time taken is 15 mins to complete:
----------------------------------------------
1. Linux 7.9_x64 Installation Package Selection for GI_x64 12.1.0.2:
-- SERVER with GUI (almost all)
- Skipped Printer, Postgrade DB, Email Server etc.
-
----------------------------------------------
2. Partion of 1000GB Disk 
- / 50Gb
- /tmp 30GB
- swap 30GB
- /u01 

[root@rac1 ~]# hostnamectl
   Static hostname: rac1
         Icon name: computer-vm
           Chassis: vm
        Machine ID: bd06479dddfe40369e55335880714c92
           Boot ID: b11d88410e4542f0ad22ee7c944136de
    Virtualization: vmware
  Operating System: Oracle Linux Server 7.9
       CPE OS Name: cpe:/o:oracle:linux:7:9:server
            Kernel: Linux 5.4.17-2102.201.3.el7uek.x86_64
      Architecture: x86-64
[root@rac1 ~]#
[root@localhost ~]# uname -r
5.4.17-2102.201.3.el7uek.x86_64

[root@rac2 ~]# grep SwapTotal /proc/meminfo
SwapTotal:             0 kB
[root@rac2 ~]#
[root@rac2 ~]# df -h (dev/shm should be more than 3 GB, if not follow below steps)
mount -t tmpfs shmfs -o size=3g /dev/shm
cat /etc/fstab  (add below entry form permanent to avoid waring in installation)
tmpfs                   /dev/shm                tmpfs size=3g         0 0

Backup files before changes:
cp /etc/sysctl.conf /etc/sysctl.conf_bkp
cp /etc/sysconfig/network /etc/sysconfig/network_bkp
cp /etc/resolv.conf /etc/resolv.conf_bkp
cp /etc/security/limits.conf /etc/security/limits.conf_bkp

----------------------------------------------
3. NOW Install Vmware Tools

----------------------------------------------
4. change network adaptor of VMware to hostonly & 
Modify Default Linux Installation Parameters:

grep SELINUX /etc/selinux/config
SELINUX=disabled

systemctl status firewalld
systemctl stop firewalld
systemctl disable firewalld
pwd

service iptables status  <- in Linux 6

https://onlinedbalearning.blogspot.com/2018/12/cluvfy-pre-check-for-rac-oracle.html
Reason:Daemon "avahi-daemon" not configured and running
Solution :-
Stop avahi-daemon damon if it not configured
systemctl status avahi-daemon
systemctl stop avahi-daemon
systemctl disable avahi-daemon
pwd
----------------------------------------------
5. OS kernel parameter smsn during DELL Database (dbca) installation 
https://red.ht/3jhlEjf
SETTING SEMAPHORE PARAMETERS

cat /proc/sys/kernel/sem
ipcs -ls
32000   1024000000      500     32000

echo "kernel.sem=250 32000 100 128" >> /etc/sysctl.conf
echo 250 32000 100 128 > /proc/sys/kernel/sem
sysctl -p

# update hosts file entries
----------------------------
cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
##-- Public-IP
192.168.1.11    rac1.dell.com   rac1
192.168.1.12    rac2.dell.com   rac2
192.168.1.13    rac3.dell.com   rac3
##-- Private-IP
10.0.0.11 rac1-priv.dell.com rac1-priv
10.0.0.12 rac2-priv.dell.com rac2-priv
10.0.0.13 rac3-priv.dell.com rac3-priv
##-- Virtual-IP
192.168.1.21 rac1-vip.dell.com rac1-vip
192.168.1.22 rac2-vip.dell.com rac2-vip
192.168.1.23 rac3-vip.dell.com rac3-vip
##-- SCAN IP
192.168.1.30 dellc-scan.dell.com dellc-scan
192.168.1.31 dellc-scan.dell.com dellc-scan
192.168.1.32 dellc-scan.dell.com dellc-scan
##-- Storage-IP
192.168.1.40    san.dell.com    san

----------------------------------------------

6. Set adapter setting to NAT and make a yum install on mentioned RPM's
yum search oracle-rdbms
yum -y install oracle-rdbms-server-12cR1-preinstall
----------------------------
yum -y install binutils
yum -y install compat*
yum -y install gcc*
yum -y install glibc*
yum -y install libaio*
yum -y install ksh
yum -y install make
yum -y install libXi
yum -y install libXtst
yum -y install libgcc
yum -y install libstdc*
yum -y install sysstat
yum -y install nfs-utils
yum -y install xorg* xterm* xauth xclock

yum -y install oracleasmlib
yum -y install oracleasm-support
yum -y install oracleasm*
yum -y install kmod-oracleasm
yum -y install ntp
yum -y install tmux
yum -y install nscd
yum -y install named
yum -y install nmap
yum -y install bind
yum -y install bind-utils
yum -y install bind-chroot
rpm -qa oracleasmlib
nslookup dellc-scan
pwd


- manually download and install orcleasmlib cvuqdisk  rpm and if not installed
- check the backup files(sysctlconf, limitsconf, resolveconf) for updates

ls -ltrh /etc/security/limits.d/*.conf
cat /etc/sysctl.conf 
cat /etc/sysconfig/network
cat /etc/resolv.conf
cat /etc/security/limits.conf  <-- if nothing updated the manually update grid and oracle user parameters

----------------------------------
6.1. verify and update as below:
vi /etc/security/limits.conf
Go
grid soft nofile 131072
grid hard nofile 131072
grid soft nproc 131072
grid hard nproc 131072
grid soft core unlimited
grid hard core unlimited
grid soft memlock unlimited
grid hard memlock unlimited

oracle soft nofile 131072
oracle hard nofile 131072
oracle soft nproc 131072
oracle hard nproc 131072
oracle soft core unlimited
oracle hard core unlimited
oracle soft memlock unlimited
oracle hard memlock unlimited

oracle soft stack 10240
oracle hard stack 32768
----------------------------
hostnamectl --static
hostname
hostnamectl set-hostname rac1
hostnamectl set-hostname rac2
service network restart

[root@rac1 ~]# hostname -f
rac1.dell.com
[root@rac1 ~]#

----------------------------------------------
7. Configure DNS now are after completing all step before installation:
[root@rac1 ~]# hostname -f
rac1.dell.com
[root@rac1 ~]#
[root@rac1 ~]# hostname -i
192.168.1.11
[root@rac1 ~]#

sol to avoaid override /etc/resolve.conf for dns entries
[root@rac1 ~]# grep dns /etc/NetworkManager/NetworkManager.conf
dns=none
[root@rac1 ~]#

vi /etc/NetworkManager/NetworkManager.conf
...
[main]
dns=none
  #plugins=ifcfg-rh,ibft
...

----------------------------------------------
8. Configure server for GI Installation as per 

----------------------------------------------
9. cross verification
----------------------------
after all the configuration is done and need to restart Linux Server execute then below on both nodes:
iscsiadm -m discovery -t st -p 192.168.1.40
systemctl restart iscsi
oracleasm scandisks
oracleasm listdisks
ls -ltr /dev/oracleasm/disks

nslookup dellc-scan
nslookup rac1
nslookup rac2
systemctl status named

systemctl restart named
pwd
echo $ORACLE_UNQNAME

---------------
crsctl check cluster -all
srvctl config database
srvctl config database -d $ORACLE_UNQNAME
srvctl status asm
srvctl status database -d $ORACLE_UNQNAME
srvctl status instance -i $ORACLE_SID -d $ORACLE_UNQNAME 

watch -n 1 'crsctl check cluster -all'
watch -n 1 'srvctl status database -d $ORACLE_UNQNAME'




oracleasm deletedisk DELLASM ---> if already installed GI& DB on it
oracleasm createdisk DELLASM /dev/sdb1
---------
oracleasm configure -i
oracleasm status
----------------------------
# vi /etc/security/limits.conf
# vi /etc/pam.d/login
# vi /etc/security/limits.conf ---> update with * for all OS Users

----------------------------
# cat /etc/sysconfig/network


----------------------------------------------
10. Install CVUQDISK RPM form Grid software folder
cd /u01/software/12.1.0.2_GI/grid/rpm/
export CVUQDISK_GRP=oinstall
rpm -ivh cvuqdisk-1.0.9-1.rpm

Preparing...                          ################################# [100%]
Using default group oinstall to install package
Updating / installing...
   1:cvuqdisk-1.0.9-1                 ################################# [100%]
[root@rac1 rpm]#
[root@rac1 rpm]# 
scp cvuqdisk-1.0.9-1.rpm root@rac2:/u01

----------------------------------------------
11. update fstab for if got /dev/shm error in pre install checks:
[root@rac1 oracle]# cat /etc/fstab   --> if received and /dev/shm error then update entries in fstab

also check the exact error and take the screen shot of the issue
Linux OL7/RHEL7: PRVE-0421 : No entry exists in /etc/fstab for mounting /dev/shm (Doc ID 2065603.1)

INFO: Error Message:PRVF-4354 : Proper hard limit for resource "maximum open file descriptors" not found on 
node "rac2" [Expected = "65536" ; Found = "4096"]


NOTE :

----------------------------------------------
12. NTPD error Fixup
NTPD ERROR in grid and RDBMS Installation
Sol: we ignored and proceed with grid installation, later we stop ntpd on both nodes and moved the files, then ran cluvfy command
[root@rac1 run]# service ntpd stop
Redirecting to /bin/systemctl stop ntpd.service
[root@rac1 run]#
[root@rac1 run]#
[root@rac1 run]# mv /etc/ntp.conf /etc/ntp.conf.tmp
[root@rac1 ~]# cluvfy comp clocksync -n all
You must NOT be logged in as root (uid=0) when running /u01/app/grid_home/bin/cluvfy.
[root@rac1 ~]# su - grid
Last login: Sun Sep 19 21:43:58 +03 2021 on pts/1
[grid@rac1 ~]$ . dell.env
[grid@rac1 ~]$ cluvfy comp clocksync -n all

Verifying Clock Synchronization across the cluster nodes
Oracle Clusterware is installed on all nodes.
CTSS resource check passed
Query of CTSS for time offset passed

CTSS is in Active state. Proceeding with check of clock time offsets on all nodes...
Check of clock time offsets passed


Oracle Cluster Time Synchronization Services check passed

Verification of Clock Synchronization across the cluster nodes was successful.
[grid@rac1 ~]$ cluvfy comp clocksync -n all -verbose

Verifying Clock Synchronization across the cluster nodes

Checking if Clusterware is installed on all nodes...
Oracle Clusterware is installed on all nodes.

Checking if CTSS Resource is running on all nodes...
Check: CTSS Resource running on all nodes
  Node Name                             Status
  ------------------------------------  ------------------------
  rac1                                  passed
  rac2                                  passed
CTSS resource check passed

Querying CTSS for time offset on all nodes...
Query of CTSS for time offset passed

Check CTSS state started...
Check: CTSS state
  Node Name                             State
  ------------------------------------  ------------------------
  rac2                                  Active
  rac1                                  Active
CTSS is in Active state. Proceeding with check of clock time offsets on all nodes...
Reference Time Offset Limit: 1000.0 msecs
Check: Reference Time Offset
  Node Name     Time Offset               Status
  ------------  ------------------------  ------------------------
  rac2          0.0                       passed
  rac1          0.0                       passed

Time offset is within the specified limits on the following set of nodes:
"[rac2, rac1]"
Result: Check of clock time offsets passed


Oracle Cluster Time Synchronization Services check passed

Verification of Clock Synchronization across the cluster nodes was successful.
[grid@rac1 ~]$

----------------------------


Logfile for installation errors
/u01/app/oracle/product/12.1.0/dbhome_1/cfgtoollogs/oui/installActions2021-08-28_10-28-07PM.log

----------------------------------------------
13. Run Grid Installer cluvfy 
cd /u01/software/grid/
[grid@rac1 grid]$ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -fixup -verbose
[grid@rac1 grid]$ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2

Pre-check for cluster services setup was unsuccessful on all the nodes.
[grid@rac1 grid]$
[grid@rac1 grid]$ ./runInstaller
----------------------------
verify entries in parellel after running /u01/app/grid_home/root.sh  <-----
[root@rac2 ~]# cat /etc/oratab
[root@rac2 ~]# cat /etc/oraInst.loc
inventory_loc=/u01/app/oraInventory
inst_group=oinstall
[root@rac2 ~]# cat /u01/app/oraInventory/ContentsXML/inventory.xml
[root@rac1 ~]# tailf /u01/app/oraInventory/logs/installActions2021-09-19_08-30-05PM.log
[root@rac1 ~]# tailf /u01/app/grid_home/cfgtoollogs/oracle.assistants.asm_2021-09-19_09-13-12-PM.log
----------------------------


export DISPLAY=:0.0

if the display does not work follow the below stpes and check display is working fine
xclock : package install using below two steps:



1)  
# yum whatprovides xclock

2)    
# yum install xorg-x11-apps


Grid Infrastructure Fails to Start on Linux 7 After Node Reboot with OHASD Timed out Waiting for init.ohasd to be Started (Doc ID 2389622.1)


----------------------------
Installation of Oracle 12c Database Software on OL6/RHEL6 Fails with "undefined reference to symbol '__tls_get_addr@@GLIBC_2.3' " error (Doc ID 2056973.1)
Note : This error has been reported to occur even when doing an uncertified installation (for example, when you attempt to install Oracle 12.1.0.1 on OL/RHEL7).
----------------------------


deleteing folders (Doc ID 1997268.1)
----------------------------
[root@rac1 .oracle]# pwd
/var/tmp/.oracle
[root@rac1 .oracle]#

[root@rac1 .oracle]# cd /etc/oracle
[root@rac1 oracle]# ls -ltr
total 2988
drwxrwx--- 2 root oinstall    4096 Aug 23 02:46 lastgasp
-rws--x--- 1 root oinstall 3028840 Aug 23 02:46 setasmgid
drwxr-xr-x 3 root oinstall    4096 Aug 23 02:46 scls_scr
drwxrwxr-x 5 root oinstall    4096 Aug 23 02:46 oprocd
-rw-r--r-- 1 root root           0 Aug 23 02:46 olr.loc.orig
-rw-r--r-- 1 root oinstall      76 Aug 23 02:46 olr.loc
-rw-r--r-- 1 root root           0 Aug 23 02:46 ocr.loc.orig
-rw-r--r-- 1 root oinstall      37 Aug 23 02:46 ocr.loc
drwxrwxrwt 2 root oinstall    4096 Aug 23 02:48 maps
[root@rac1 oracle]#





No comments:

Post a Comment