Monday, March 6, 2017

Configure Open filer for RAC installation in VM ware

Hai, in this article I will demonstrate installation and Configuration of OPENFILER for RAC Installation
List of Topics (Linux, Database, RAC, EBS)

I have provided the links for complete installations in following Links:
  1. Openfiler Installation and configuration, 
  2. Linux Installtion
  3. Grid Installation
  4. Database Installation

NOTE: Install open filer with 512gbram, 10GB Hard disk, Hostonly N/W, and install s/w.
Before you click on reboot, attach 100GB addtion HDD and click reboot
NOTE: Before proceeding check ping for all IP’s
NOTE: for Rac Installation we need to have Public, Virtual, SCAN, SAN(openfiler) IP’s in same sequence

Assumptions:

Node Name
Adapter Name
IP – Type
IP Number
Netmask
RAC-1
Eth 0
Public
192.168.1.11
255.255.255.0
RAC-1
Eth 1
Private
10.0.0.11
255.0.0.0
RAC-1
hostfile
Virtual
192.168.1.21

-
-
-
-
-
RAC-2
Eth 0
Public
192.168.1.12
255.255.255.0
RAC-2
Eth 1
Private
10.0.0.12
255.0.0.0
RAC-2
hostfile
Virtual
192.168.1.22

-
-
-
-
-
RAC-1 / RAC-2
hostfile
Scan
192.168.1.30

Open Filer
Eth 0
Public
192.168.1.40
255.255.0.0

Steps included :
  1.     Create Virtual Machine with 512mb Memory
  2.     Install openfiler software with one network adapter
  3.     Attach 100gb disk for ASM before reboot
  4.     Configure ASM for Linux










Power on the Virtual Machine

















Before reboot add 100gb Disk for ASM Storage



Now reboot the system



Now open the GUI of open filer and prepare the disk for shareable
URL for Configuration of SAN https://192.168.1.40:446


Click on System tab add who can access SAN



Click on Volumes Tab and Create volume disk of 100GB





Create Volume Group for the Disk

Add Disk to Volume Group
Here you can define As per your requirement
1.       OCR
2.       Voting Disk (VD)
3.       Flash Recovery Area (FRA)
I am installing All together in one Disk only as vol 1







Enable and start service of iSCSI TARGET and iSCSI Initiator



Create IQN  for the disk
Note: if you created Different volume disks then create separate IQN’s for VD,OCR, FRA then define it Acc. Here I have used single iqn for all(OCR,VD,FRA) in a single disk as vol-1




You have Successfully Configured the OpenFiler

Now install RAC1, RAC 2 Machines with two Ethernet adapters and Provide the IP and subnet mask as shown in above table

After Successful installation of RAC1 and RAC2 Ping each other along with SAN there should be no network connectivity issue between all


Setting up Host file:
RAC1
RAC2
# login as: root
root@192.168.1.11's password:
Last login: Tue May 10 09:30:35 2016
[root@rac1 ~]# hostname
rac1.dell.com
[root@rac1 ~]# vi /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6

##-- Public-IP
192.168.1.11    rac1.dell.com   rac1
192.168.1.12    rac2.dell.com   rac2
192.168.1.13    rac3.dell.com   rac3
##-- Private-IP
10.0.0.11 rac1-priv.dell.com rac1-priv
10.0.0.12 rac2-priv.dell.com rac2-priv
10.0.0.13 rac3-priv.dell.com rac3-priv
##-- Virtual-IP
192.168.1.21 rac1-vip.dell.com rac1-vip
192.168.1.22 rac2-vip.dell.com rac2-vip
192.168.1.23 rac3-vip.dell.com rac3-vip
##-- SCAN IP
192.168.1.30 dellc-scan.dell.com dellc-scan
192.168.1.31 dellc-scan.dell.com dellc-scan
192.168.1.32 dellc-scan.dell.com dellc-scan
##-- Storage-IP
192.168.1.40    san.dell.com    san
[root@rac1 ~]#
[root@rac1 ~]# service network restart
Shutting down interface eth0:                              [  OK  ]
Shutting down interface eth1:                              [  OK  ]
Shutting down loopback interface:                          [  OK  ]
Bringing up loopback interface:                            [  OK  ]
Bringing up interface eth0:                                [  OK  ]
Bringing up interface eth1:                                [  OK  ]
[root@rac1 ~]# 

[root@rac1 ~]# hostname -i

192.168.1.11

[root@rac1 ~]#
login as: root
root@192.168.1.12's password:
Last login: Tue May 10 10:44:19 2016 from
 [root@rac2 ~]# hostname
rac2.dell.com
[root@rac2 ~]# vi /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6

##-- Public-IP
192.168.1.11    rac1.dell.com   rac1
192.168.1.12    rac2.dell.com   rac2
192.168.1.13    rac3.dell.com   rac3
##-- Private-IP
10.0.0.11 rac1-priv.dell.com rac1-priv
10.0.0.12 rac2-priv.dell.com rac2-priv
10.0.0.13 rac3-priv.dell.com rac3-priv
##-- Virtual-IP
192.168.1.21 rac1-vip.dell.com rac1-vip
192.168.1.22 rac2-vip.dell.com rac2-vip
192.168.1.23 rac3-vip.dell.com rac3-vip
##-- SCAN IP
192.168.1.30 dellc-scan.dell.com dellc-scan
192.168.1.31 dellc-scan.dell.com dellc-scan
192.168.1.32 dellc-scan.dell.com dellc-scan
##-- Storage-IP
192.168.1.40    san.dell.com    san
[root@rac2 ~]#
[root@rac2 ~]# service network restart
Shutting down interface eth0:                              [  OK  ]
Shutting down interface eth1:                              [  OK  ]
Shutting down loopback interface:                          [  OK  ]
Bringing up loopback interface:                            [  OK  ]
Bringing up interface eth0:                                [  OK  ]
Bringing up interface eth1:                                [  OK  ]
[root@rac2 ~]# 
[root@rac2 ~]# hostname -i
192.168.1.12
[root@rac2 ~]#




Node 1:-  RAC1
Node 2:- RAC2
[root@rac1 ~]# ping rac2
[root@rac1 ~]# ping rac1
[root@rac1 ~]# ping 192.168.1.40
[root@rac1 ~]# ping 192.168.1.11
[root@rac1 ~]# ping 192.168.1.12
[root@rac1 ~]# ping 10.0.0.11
[root@rac1 ~]# ping 10.0.0.12
[root@rac2 ~]# ping rac1
[root@rac2 ~]# ping rac2
[root@rac2 ~]# ping 192.168.1.40
[root@rac2 ~]# ping 192.168.1.12
[root@rac2 ~]# ping 192.168.1.11
[root@rac2 ~]# ping 10.0.0.12
[root@rac2 ~]# ping 10.0.0.11
Login to your Linux as root user and discover your IQN form all the NODES







Click here for installing Linux FOR RAC

Node-1 Machine: RAC1
login as: root
root@192.168.1.11's password:
Last login: Mon Feb 20 14:45:28 2017
[root@rac1 ~]# hostname
rac1.dell.com
[root@rac1 ~]#
[root@rac1 ~]# hostname -i
192.168.1.11
[root@rac1 ~]#
[root@rac1 ~]# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:0C:29:FB:3F:8D
          inet addr:192.168.1.11  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::20c:29ff:fefb:3f8d/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:281 errors:0 dropped:0 overruns:0 frame:0
          TX packets:163 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:47348 (46.2 KiB)  TX bytes:25000 (24.4 KiB)

eth1      Link encap:Ethernet  HWaddr 00:0C:29:FB:3F:97
          inet addr:10.0.0.11  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::20c:29ff:fefb:3f97/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:214 errors:0 dropped:0 overruns:0 frame:0
          TX packets:86 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:36007 (35.1 KiB)  TX bytes:17656 (17.2 KiB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:3758 errors:0 dropped:0 overruns:0 frame:0
          TX packets:3758 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:8380416 (7.9 MiB)  TX bytes:8380416 (7.9 MiB)

virbr0    Link encap:Ethernet  HWaddr EA:A2:66:7A:21:4C
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:20 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:3647 (3.5 KiB)

[root@rac1 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       38245   307202931   83  Linux
/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris
/dev/sda3           41433       43982    20482875   83  Linux
/dev/sda4           43983      130541   695285167+   5  Extended
/dev/sda5           43983      130541   695285136   83  Linux
[root@rac1 ~]#
[root@rac1 ~]#


Your Disk is Not Available. So, Discover your IQN
[root@rac1 ~]# 
[root@rac1 ~]#  iscsiadm -m discovery -t st -p 192.168.1.40
192.168.1.40:3260,1 iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0
[root@rac1 ~]#
[root@rac1 ~]# service iscsi restart
iscsiadm: No matching sessions found
Stopping iSCSI daemon:
iscsid is stopped                                          [  OK  ]
Starting iSCSI daemon: FATAL: Error inserting cxgb3i (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko): Unknown symbol in module, or unknown parameter (see dmesg)
FATAL: Error inserting ib_iser (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/infiniband/ulp/iser/ib_iser.ko): Unknown symbol in module, or unknown parameter (see dmesg)
                                                           [  OK  ]
                                                           [  OK  ]
Setting up iSCSI targets: Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] (multiple)
Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] successful.
                                                           [  OK  ]
[root@rac1 ~]# chkconfig iscsi on
[root@rac1 ~]# 
[root@rac1 ~]# chkconfig --list | grep iscsi
iscsi           0:off   1:off   2:on    3:on    4:on    5:on    6:off

iscsid          0:off   1:off   2:off   3:on    4:on    5:on    6:off
[root@rac1 ~]#
[root@rac1 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       38245   307202931   83  Linux
/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris
/dev/sda3           41433       43982    20482875   83  Linux
/dev/sda4           43983      130541   695285167+   5  Extended
/dev/sda5           43983      130541   695285136   83  Linux

Disk /dev/sdb: 102.3 GB, 102374572032 bytes
255 heads, 63 sectors/track, 12446 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table
[root@rac1 ~]#


Node-2 Machine: RAC2
login as: root
root@192.168.1.12's password:
Last login: Mon Feb 20 14:47:45 2017
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]# hostname
rac2.dell.com
[root@rac2 ~]# hostname -i
192.168.1.12
[root@rac2 ~]#

[root@rac2 ~]# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:0C:29:36:9C:16
          inet addr:192.168.1.12  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::20c:29ff:fe36:9c16/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:200 errors:0 dropped:0 overruns:0 frame:0
          TX packets:151 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:39700 (38.7 KiB)  TX bytes:26672 (26.0 KiB)

eth1      Link encap:Ethernet  HWaddr 00:0C:29:36:9C:20
          inet addr:10.0.0.12  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::20c:29ff:fe36:9c20/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:216 errors:0 dropped:0 overruns:0 frame:0
          TX packets:95 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:37580 (36.6 KiB)  TX bytes:19182 (18.7 KiB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:4374 errors:0 dropped:0 overruns:0 frame:0
          TX packets:4374 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:9177312 (8.7 MiB)  TX bytes:9177312 (8.7 MiB)

virbr0    Link encap:Ethernet  HWaddr 0E:D4:79:B6:C8:15
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:27 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:4405 (4.3 KiB)

[root@rac2 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       38245   307202931   83  Linux
/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris
/dev/sda3           41433       43982    20482875   83  Linux
/dev/sda4           43983      130541   695285167+   5  Extended
/dev/sda5           43983      130541   695285136   83  Linux
[root@rac2 ~]#
[root@rac2 ~]#

Your Disk is Not Available. So, Discover your IQN
[root@rac2 ~]# 
[root@rac2 ~]#  iscsiadm -m discovery -t st -p 192.168.1.40
192.168.1.40:3260,1 iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0
[root@rac2 ~]#
[root@rac2 ~]# service iscsi restart
iscsiadm: No matching sessions found
Stopping iSCSI daemon:
iscsid is stopped                                          [  OK  ]
Starting iSCSI daemon: FATAL: Error inserting cxgb3i (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko): Unknown symbol in module, or unknown parameter (see dmesg)
FATAL: Error inserting ib_iser (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/infiniband/ulp/iser/ib_iser.ko): Unknown symbol in module, or unknown parameter (see dmesg)
                                                           [  OK  ]
                                                           [  OK  ]
Setting up iSCSI targets: Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] (multiple)
Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] successful.
                                                           [  OK  ]
[root@rac2 ~]# chkconfig iscsi on
[root@rac2 ~]# 
[root@rac2 ~]#
[root@rac2 ~]# chkconfig --list | grep iscsi
iscsi           0:off   1:off   2:on    3:on    4:on    5:on    6:off

iscsid          0:off   1:off   2:off   3:on    4:on    5:on    6:off
[root@rac2 ~]#
[root@rac1 ~]# cat /etc/inittab

#
# inittab       This file describes how the INIT process should set up
#               the system in a certain run-level.
#
# Author:       Miquel van Smoorenburg, <miquels@drinkel.nl.mugnet.org>
#               Modified for RHS Linux by Marc Ewing and Donnie Barnes
#

 # Default runlevel. The runlevels used by RHS are:
#   0 - halt (Do NOT set initdefault to this)
#   1 - Single user mode
#   2 - Multiuser, without NFS (The same as 3, if you do not have networking)
#   3 - Full multiuser mode
#   4 - unused
#   5 - X11
#   6 - reboot (Do NOT set initdefault to this)
#
id:5:initdefault:

 # System initialization.
si::sysinit:/etc/rc.d/rc.sysinit

 l0:0:wait:/etc/rc.d/rc 0
l1:1:wait:/etc/rc.d/rc 1
l2:2:wait:/etc/rc.d/rc 2
l3:3:wait:/etc/rc.d/rc 3
l4:4:wait:/etc/rc.d/rc 4
l5:5:wait:/etc/rc.d/rc 5
l6:6:wait:/etc/rc.d/rc 6

 # Trap CTRL-ALT-DELETE
ca::ctrlaltdel:/sbin/shutdown -t3 -r now

 # When our UPS tells us power has failed, assume we have a few minutes
# of power left.  Schedule a shutdown for 2 minutes from now.
# This does, of course, assume you have powerd installed and your
# UPS connected and working correctly.
pf::powerfail:/sbin/shutdown -f -h +2 "Power Failure; System Shutting Down"

 # If power was restored before the shutdown kicked in, cancel it.
pr:12345:powerokwait:/sbin/shutdown -c "Power Restored; Shutdown Cancelled"
# Run gettys in standard runlevels
1:2345:respawn:/sbin/mingetty tty1
2:2345:respawn:/sbin/mingetty tty2
3:2345:respawn:/sbin/mingetty tty3
4:2345:respawn:/sbin/mingetty tty4
5:2345:respawn:/sbin/mingetty tty5
6:2345:respawn:/sbin/mingetty tty6

 # Run xdm in runlevel 5
x:5:respawn:/etc/X11/prefdm -nodaemon

 h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null

[root@rac1 ~]#
[root@rac1 ~]# who -r
         run-level 5  2018-01-30 07:57                   last=S

[root@rac1 ~]#
[root@rac2 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       38245   307202931   83  Linux
/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris
/dev/sda3           41433       43982    20482875   83  Linux
/dev/sda4           43983      130541   695285167+   5  Extended
/dev/sda5           43983      130541   695285136   83  Linux

Disk /dev/sdb: 102.3 GB, 102374572032 bytes
255 heads, 63 sectors/track, 12446 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table

 [root@rac2 ~]#





This article helps those who want to install grid Infrastructure in VMWARE using openfiler.



Click here for installing GRID infra-structure
Follow the same steps for Grid installation as shown in above link, in which i have installed Grid on VirtualBox. Skip those creation of Machine, Shareable Disk and Installation of Linux Steps 



Thanks for Reading

Regards,
Mohammed Areefuddin.

Posted by at
Labels: , , , ,

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)