RHCS +GFS2+iscsi+cLVM实现高可用web集群
RHEL6.6-x86-64软件源：
epel源
本地yum源
RHCS安装及配置
192.168.1.5 安装luci 两块硬盘, 其中/sdb提供共享存储。
集群节点
192.168.1.6安装ricci node1.mingxiao.info node1
192.168.1.7安装ricci node2.mingxiao.info node2
192.168.1.8 安装ricci node3.mingxiao.info node3
前提：
1> 192.168.1.5分别与node1,node2,node3互信
2> 时间同步
3> 节点主机名分别为node1.mingxiao.info、node2.mingxiao.info、node3.mingxiao.info
进主机192.168.1.5
1
2
3
4
5
6
vim /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.6 node1.mingxiao.info node1
192.168.1.7 node2.mingxiao.info node2
192.168.1.8 node3.mingxiao.info node3
# for I in {1..3}; do scp /etc/hosts node$I:/etc;done
时间同步
# for I in {1..3}; do ssh node$I 'ntpdate time.windows.com';done
节点间互信。
.....
# yum -y install luci
# for I in {1..3}; do ssh node$I 'yum -y install ricci'; done
# for I in {1..3}; do ssh node$I 'echo xiaoming | passwd --stdin ricci'; done
# for I in {1..3}; do ssh node$I 'service ricci start;chkconfig ricci on'; done
# for I in {1..3}; do ssh node$I 'yum -y install httpd'; done
# service luci start
浏览器输入https://192.168.1.5:8084访问web管理界面，输入root用户和root密码
创建集群，Password输入各节点ricci用户密码，
添加资源，这里添加两个一个为VIP，一个为httpd，添好如下图界面
添加故障转移域，如下图：
由于没有fences设备，所以不再添加。
接下来要配置iscsi，提供共享存储:
进192.168.1.5
# yum -y install scsi-target-utils
# for I in {1..3}; do ssh node$I 'yum -y install iscsi-initiator-utils'; done
1
2
3
4
5
6
7
8
9
vim /etc/tgt/targets.conf 添加如下内容
<target iqn.2015-05.ingo.mingxiao:ipsan.sdb>
<backing-store /dev/sdb>
vendor_id Xiaoming
lun 1
</backing-store>
initiator-address 192.168.1.0/24
incominguser iscsiuser xiaoming
</target>
# service tgtd start
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
# tgtadm --lld iscsi --mode target --op show#可查看到如下信息
Target 1: iqn.2015-05.ingo.mingxiao:ipsan.sdb
System information:
Driver: iscsi
State: ready
LUN information:
LUN: 0
Type: controller
SCSI ID: IET 00010000
SCSI SN: beaf10
Size: 0 MB, Block size: 1
Online: Yes
Removable media: No
Prevent removal: No
Readonly: No
Backing store type: null
Backing store path: None
Backing store flags:
LUN: 1
Type: disk
SCSI ID: IET 00010001
SCSI SN: beaf11
Size: 21475 MB, Block size: 512
Online: Yes
Removable media: No
Prevent removal: No
Readonly: No
Backing store type: rdwr
Backing store path: /dev/sdb
Backing store flags:
Account information:
iscsiuser
ACL information:
192.168.1.0/24
1
# for I in {1..3}; do ssh node$I 'echo "InitiatorName=`iscsi-iname -p iqn.2015-05.info.mingxiao`" > /etc/iscsi/initiatorname.iscsi'; done
1
2
3
4
vim /etc/iscsi/iscsid.conf #在node1、node2、node3启用下面三行
node.session.auth.authmethod = CHAP
node.session.auth.username = iscsiuser
node.session.auth.password = xiaoming
1
2
3
4
5
6
7
# ha ssh node$I 'iscsiadm -m discovery -t st -p 192.168.1.5';done
iscsid:
192.168.1.5:3260,1 iqn.2015-05.ingo.mingxiao:ipsan.sdb
iscsid:
192.168.1.5:3260,1 iqn.2015-05.ingo.mingxiao:ipsan.sdb
iscsid:
192.168.1.5:3260,1 iqn.2015-05.ingo.mingxiao:ipsan.sdb
1
2
3
4
5
6
7
# ha ssh node$I 'iscsiadm -m node -T iqn.2015-05.ingo.mingxiao:ipsan.sdb -p 192.168.1.5 -l ';done
Logging in to (multiple)
Login to successful.
Logging in to (multiple)
Login to successful.
Logging in to (multiple)
Login to successful.
node1，node2,node3分别安装以下两个rpm包，rpmfind.net可找到
1
2
3
4
5
# rpm -ivh lvm2-cluster-2.02.111-2.el6.x86_64.rpm gfs2-utils-3.0.12.1-68.el6.x86_64.rpm
warning: lvm2-cluster-2.02.111-2.el6.x86_64.rpm: Header V3 RSA/SHA1 Signature, key ID c105b9de: NOKEY
Preparing... ###########################################
1:gfs2-utils ########################################### [ 50%]
2:lvm2-cluster ###########################################
进node1
# pvcreate /dev/sdb
# vgcreate clustervg /dev/sdb
# lvcreate -L 5G -n clusterlv clustervg
# mkfs.gfs2 -j 2 -p lock_dlm -t mycluster:sdb/dev/clustervg/clusterlv
添加一个服务，名为webservice
将先前VIP资源加入
新建一个GFS2资源，并加入
将先前httpd资源加入
然后启动即可。
查看状态：
1
2
3
4
5
6
7
8
9
10
11
# clustat
Cluster Status for mycluster @ Thu May7 00:07:21 2015
Member Status: Quorate
Member Name ID Status
------ ---- ---- ------
node1.mingxiao.info 1 Online, Local, rgmanager
node2.mingxiao.info 2 Online, rgmanager
node3.mingxiao.info 3 Online, rgmanager
Service Name Owner (Last) State
------- ---- ----- ------ -----
service:webservice node1.mingxiao.info started
页:
[1]