Heartbeat+Haproxy实现负载均衡高可用

death114

　　环境说明：

主机名	角色	IP地址
mylinux1.contoso.com	heartbeat+haproxy	eth0:192.168.100.121 　　eth1:172.16.100.121
mylinux2.contoso.com	heartbeat+haproxy	eth0:192.168.100.122 　　eth1:172.16.100.122
mylinux3.contoso.com	web server 1	eth0:192.168.100.181
mylinux4.contoso.com	web server 2	eth0:192.168.100.182

　　一、环境准备
　　在mylinux1和mylinux2上安装heartbeat，可以手动安装，当然也可以使用前面发布的一篇heartbeat脚本的博文，里面有heartbeat快速安装脚本。
　　然后在mylinux2上安装haproxy，并将mylinux1上的haproxy配置文件和启停脚本都拷贝到mylinux2上。
　　要保证mylinux1和mylinux2的heartbeat+haproxy环境一致。
[root@mylinux1 ~]# scp /etc/init.d/haproxy mylinux2:/etc/init.d/
root@mylinux2's password:
Permission denied, please try again.
root@mylinux2's password:
haproxy                                       100% 1567     1.5KB/s   00:00   
[root@mylinux1 ~]# scp /usr/local/haproxy/conf/haproxy.cfg mylinux2:/usr/local/haproxy/conf/haproxy.cfg
root@mylinux2's password:
haproxy.cfg                                   100% 1194     1.2KB/s   00:00   
[root@mylinux2 haproxy]# ll /etc/init.d/haproxy
-rwxr-xr-x 1 root root 1567 Oct  1 02:11 /etc/init.d/haproxy
[root@mylinux2 haproxy]# ll /usr/local/haproxy/conf/haproxy.cfg
-rw-r--r-- 1 root root 1194 Oct  1 02:13 /usr/local/haproxy/conf/haproxy.cfg　　二、修改heartbeat的资源文件
[root@mylinux1 ~]# tail -1 /etc/ha.d/haresources
mylinux1.contoso.com IPaddr::192.168.100.120/24/eth0 haproxy
[root@mylinux2 haproxy]# tail -1 /etc/ha.d/haresources
mylinux1.contoso.com IPaddr::192.168.100.120/24/eth0 haproxy　　这里还是贴出两个heartbeat节点的ha.cf配置，如下：
[root@mylinux1 ~]# egrep -v "#|^$" /etc/ha.d/ha.cf
debugfile /var/log/ha-debug
logfile/var/log/ha-log
logfacilitylocal1
keepalive 2
deadtime 30
warntime 10
initdead 120
udpport694
mcast eth1 225.0.0.1 694 1 0
auto_failback on
nodemylinux1.contoso.com
nodemylinux2.contoso.com
respawn hacluster /usr/lib64/heartbeat/ipfail
[root@mylinux2 haproxy]# egrep -v "#|^$" /etc/ha.d/ha.cf
debugfile /var/log/ha-debug
logfile/var/log/ha-log
logfacilitylocal1
keepalive 2
deadtime 30
warntime 10
initdead 120
udpport694
mcast eth1 225.0.0.1 694 1 0
auto_failback on
node    mylinux1.contoso.com
node    mylinux2.contoso.com
respawn hacluster /usr/lib64/heartbeat/ipfail　　三、启动heartbeat服务
　　1、首先在mylinux1和mylinux2上先关闭haproxy服务

[root@mylinux1 ~]# service haproxy stop
Stop haproxy successful.
[root@mylinux2 haproxy]# service haproxy stop
Haproxy is not running. Stop haproxy failed!　　2、依次启动mylinux1和mylinux2上的heartbeat服务
[root@mylinux1 ~]# /etc/init.d/heartbeat start
Starting High-Availability services: INFO:  Resource is stopped
Done.
[root@mylinux2 haproxy]# /etc/init.d/heartbeat start
Starting High-Availability services: INFO:  Resource is stopped
Done.　　四、测试haproxy的高可用

　　1、首先，检查mylinux1的状态

[root@mylinux1 ~]# ip a|grep 192.168.100.120
    inet 192.168.100.120/24 brd 192.168.100.255 scope global secondary eth0
[root@mylinux1 ~]# service haproxy status
Haproxy (pid  3600) is running...　　2、其次，检查mylinux2的状态

[root@mylinux2 haproxy]# ip a |grep 192.168.100.120
[root@mylinux2 haproxy]# service haproxy status
Haproxy is stopped.　　3、查看监控界面

　　五、测试故障切换
　　1、停止mylinux1上的heartbeat服务
[root@mylinux1 ~]# /etc/init.d/heartbeat stop
Stopping High-Availability services: Done.　　2、检查mylinux1和mylinux2的状态
[root@mylinux1 ~]# ip a |grep 192.168.100.120
[root@mylinux1 ~]# service haproxy status
Haproxy is stopped.
[root@mylinux2 haproxy]# ip a |grep 192.168.100.120
    inet 192.168.100.120/24 brd 192.168.100.255 scope global secondary eth0
[root@mylinux2 haproxy]# service haproxy status
Haproxy (pid  3997) is running...　　3、查看监控页面

　　4、查看mylinux2上的heartbeat日志
　　[root@mylinux2 ~]# >/var/log/ha-log
　　[root@mylinux2 ~]# tail -f /var/log/ha-log
　　Oct 01 02:44:31 mylinux2.contoso.com heartbeat: [3534]: info: Received shutdown notice from 'mylinux1.contoso.com'.
　　Oct 01 02:44:31 mylinux2.contoso.com heartbeat: [3534]: info: Resources being acquired from mylinux1.contoso.com.
　　Oct 01 02:44:31 mylinux2.contoso.com heartbeat: [3655]: info: acquire local HA resources (standby).
　　Oct 01 02:44:31 mylinux2.contoso.com heartbeat: [3656]: info: No local resources [/usr/share/heartbeat/ResourceManager listkeys mylinux2.contoso.com] to acquire.
　　Oct 01 02:44:31 mylinux2.contoso.com heartbeat: [3655]: info: local HA resource acquisition completed (standby).
　　Oct 01 02:44:31 mylinux2.contoso.com heartbeat: [3534]: info: Standby resource acquisition done [all].
　　harc(default)[3681]:2016/10/01_02:44:31 info: Running /etc/ha.d//rc.d/status status
　　mach_down(default)[3698]:2016/10/01_02:44:31 info: Taking over resource group IPaddr::192.168.100.120/24/eth0
　　ResourceManager(default)[3725]:2016/10/01_02:44:31 info: Acquiring resource group: mylinux1.contoso.com IPaddr::192.168.100.120/24/eth0 haproxy
　　/usr/lib/ocf/resource.d//heartbeat/IPaddr(IPaddr_192.168.100.120)[3753]:       2016/10/01_02:44:31 INFO:  Resource is stopped
　　ResourceManager(default)[3725]:2016/10/01_02:44:31 info: Running /etc/ha.d/resource.d/IPaddr 192.168.100.120/24/eth0 start
　　IPaddr(IPaddr_192.168.100.120)[3878]:2016/10/01_02:44:32 INFO: Adding inet address 192.168.100.120/24 with broadcast address 192.168.100.255 to device eth0
　　IPaddr(IPaddr_192.168.100.120)[3878]:2016/10/01_02:44:32 INFO: Bringing device eth0 up
　　IPaddr(IPaddr_192.168.100.120)[3878]:2016/10/01_02:44:32 INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /var/run/resource-agents/send_arp-192.168.100.120 eth0 192.168.100.120 auto not_used not_used
　　/usr/lib/ocf/resource.d//heartbeat/IPaddr(IPaddr_192.168.100.120)[3852]:       2016/10/01_02:44:32 INFO:  Success
　　ResourceManager(default)[3725]:2016/10/01_02:44:32 info: Running /etc/init.d/haproxy  start
　　mach_down(default)[3698]:2016/10/01_02:44:32 info: /usr/share/heartbeat/mach_down: nice_failback: foreign resources acquired
　　mach_down(default)[3698]:2016/10/01_02:44:32 info: mach_down takeover complete for node mylinux1.contoso.com.
　　Oct 01 02:44:32 mylinux2.contoso.com heartbeat: [3534]: info: mach_down takeover complete.
　　Oct 01 02:45:02 mylinux2.contoso.com heartbeat: [3534]: WARN: node mylinux1.contoso.com: is dead
　　Oct 01 02:45:02 mylinux2.contoso.com heartbeat: [3534]: info: Dead node mylinux1.contoso.com gave up resources.
　　Oct 01 02:45:02 mylinux2.contoso.com heartbeat: [3534]: info: Link mylinux1.contoso.com:eth1 dead.
　　Oct 01 02:45:02 mylinux2.contoso.com ipfail: [3543]: info: Status update: Node mylinux1.contoso.com now has status dead
　　Oct 01 02:45:03 mylinux2.contoso.com ipfail: [3543]: info: NS: We are dead. :