lvs+keepalived 案例配置
基于keepalived和RS端脚本配置的案例，，后端是tomcat应用程序.软件地址：
wget http://www.keepalived.org/software/keepalived-1.1.19.tar.gz
再做以下操作之前，应该lvs配置成功、配置见这篇文章
http://douya.blog.运维网.com/6173221/1680692
开始配置lvs基于keepalived的环境
# ls -al /usr/src/
total 16
drwxr-xr-x.4 root root 4096 Nov 19 00:26 .
drwxr-xr-x. 14 root root 4096 Nov 19 00:32 ..
drwxr-xr-x.2 root root 4096 Sep 232011 debug
drwxr-xr-x.4 root root 4096 Nov 19 00:27 kernels
lrwxrwxrwx.1 root root 39 Nov 19 00:26 linux -> /usr/src/kernels/2.6.32-431.el6.x86_64/
安装前先查看是不是有此路径，如果没有,请执行以下步骤：
ls /usr/src/kernels/2.6.32-573.8.1.el6.x86_64/
yum installkernel kernel-devel-y
ln-s /usr/src/kernels/2.6.32-573.8.1.el6.x86_64/ /usr/src/linux/
tar xvf keepalived-1.1.19.tar.gz
cd keepalived-1.1.19
./configure
configure: error:
!!! OpenSSL is not properly installed on your system. !!!
!!! Can not include OpenSSL headers files. !!!
yum install openssl* -y
./configure
Keepalived configuration
------------------------
Keepalived version : 1.1.19
Compiler : gcc
Compiler flags : -g -O2
Extra Lib : -lpopt -lssl -lcrypto
Use IPVS Framework : Yes
IPVS sync daemon support : Yes
Use VRRP Framework : Yes
Use Debug flags : No
表明无误
make &&make install以上是编译安装，推荐使用yum install keepalived 安装
一、开始安装
yum install keepalived -y
二、开始配置keepalived、
lvs-1 配置keepalived ---MASTER
# more /etc/keepalived/keepalived.conf
! Configuration File for keepalived
global_defs {
notification_email {
334035686@qq.com
}
notification_email_fromroot@localhost
smtp_server localhost
smtp_connect_timeout 30
router_id LVS_1
}
vrrp_instance VI_1 {
state MASTER
interface eth0
virtual_router_id 51
priority 100
advert_int 1
authentication {
auth_type PASS
auth_pass 1111
}
virtual_ipaddress {
192.168.2.12/24
}
}
virtual_server192.168.2.12 80 { #设置虚拟服务器，需要指定虚拟IP与服务端口,用空格分隔
delay_loop 6 #设置健康状态检查时间，单位为秒
lb_algo rr #设置负载高度算法，rr为轮询
lb_kind DR #设置LVS实现负载均衡的机制，可以为{NAT|TUN|DR}三种
nat_mask 255.255.255.0 #设置掩码
persistence_timeout 50 #会话保持时间，单位为秒;这个选项对于动态网页是非常有用的，为集群系统中session共享提供了一个很好的解决方案
protocol TCP #指定转发协议类型可以设置{TCP|UDP}两种
real_server 192.168.2.221 80 { #后端服务器节点,需要指定Real_server的IP与端口,用空格分隔
weight 1 #配置服务节点的权重,数字越大，权重越高
TCP_CHECK {
connect_timeout 3 #这个设置几秒钟测试一下这服务有没有挂.
nb_get_retry 3
delay_before_retry 3
connect_port 80
}
}
real_server192.168.2.30 80 {
weight 1
TCP_CHECK {
connect_timeout 3 #这个设置几秒钟测试一下这服务有没有挂.
nb_get_retry 3
delay_before_retry 3
connect_port 80
}
}
} SLAVE端配置文件
# more /etc/keepalived/keepalived.conf
! Configuration File for keepalived
global_defs {
notification_email {
334035686@qq.com
}
notification_email_fromroot@localhost
smtp_server localhost
smtp_connect_timeout 30
router_id LVS_2
}
vrrp_instance VI_1 {
state BACKUP
interface eth0
virtual_router_id 51
priority 90
advert_int 1
authentication {
auth_type PASS
auth_pass 1111
}
virtual_ipaddress {
192.168.2.12/24
}
}
virtual_server192.168.2.12 80 { #设置虚拟服务器，需要指定虚拟IP与服务端口,用空格分隔
delay_loop 6 #设置健康状态检查时间，单位为秒
lb_algo rr #设置负载高度算法，rr为轮询
lb_kind DR #设置LVS实现负载均衡的机制，可以为{NAT|TUN|DR}三种
nat_mask 255.255.255.0 #设置掩码
persistence_timeout 50 #会话保持时间，单位为秒;这个选项对于动态网页是非常有用的，为集群系统中session共享提供了一个很好的解决方案
protocol TCP #指定转发协议类型可以设置{TCP|UDP}两种
real_server 192.168.2.221 80 { #后端服务器节点,需要指定Real_server的IP与端口,用空格分隔
weight 1 #配置服务节点的权重,数字越大，权重越高
TCP_CHECK {
connect_timeout 3 #这个设置几秒钟测试一下这服务有没有挂.
nb_get_retry 3
delay_before_retry 3
connect_port 80
}
}
real_server192.168.2.30 80 {
weight 1
TCP_CHECK {
connect_timeout 3 #这个设置几秒钟测试一下这服务有没有挂.
nb_get_retry 3
delay_before_retry 3
connect_port 80
}
}
} 启动master，slave，，在master查看状态
# ip a
1: lo:mtu 16436 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0:mtu 1500 qdisc mq state UP qlen 1000
link/ether 00:0c:29:c8:69:ec brd ff:ff:ff:ff:ff:ff
inet 192.168.2.13/24 brd 192.168.2.255 scope global eth0
inet 192.168.2.12/24 scope global secondary eth0
inet6 fe80::20c:29ff:fec8:69ec/64 scope link
valid_lft forever preferred_lft forever 到目前为止，在lvs server端的配置已经完成、
三、下面开始配置real-server后面节点即（绑定VIP到lo，抑制ARP、）
此处可以使用脚本进行配置
#!/bin/sh
#Date: 2015-11-20
#By: charles
#Description: deploy backend server (bind lo interface and Inhibition arp)
VIP="192.168.2.12"
INT="lo:0"
lo_INT=`ifconfig|grep lo|awk -F " " '{print $1 }'`
./etc/init.d/functions
function start() {
if [ "$lo_INT" == "lo" ];then
ifconfig $INT $VIPbroadcast $VIP netmask 255.255.255.255 up
route add -host $VIP dev $INT
echo "1" > /proc/sys/net/ipv4/conf/lo/arp_ignore
echo "2" > /proc/sys/net/ipv4/conf/lo/arp_announce
echo "1" > /proc/sys/net/ipv4/conf/all/arp_ignore
echo "2" > /proc/sys/net/ipv4/conf/all/arp_announce
else
echo "vip is binded,Pls Re binding"
exit 2
fi
if [ $? -eq 0 ]
then
action "start bind vip andInhibition arp is success" /bin/true
else
action "start bind vipandInhibition arpfailed" /bin/false
fi
}
function stop() {
ifconfig $INT $VIPbroadcast $VIP netmask 255.255.255.255 up
echo "0" > /proc/sys/net/ipv4/conf/lo/arp_ignore
echo "0" > /proc/sys/net/ipv4/conf/lo/arp_announce
echo "0" > /proc/sys/net/ipv4/conf/all/arp_ignore
echo "0" > /proc/sys/net/ipv4/conf/all/arp_announce
if [ "$INT" !="lo" ]
then
action "stop bind vip andInhibition arp is success" /bin/true
elif [ "$INT" =="lo" ]
then
action "stop bind vipis and Inhibition arpfailed" /bin/false
else
echo "bind Error"
fi
}
function restart() {
stop
sleep 1
start
}
case "$1" in
start)
start
;;
stop)
stop
;;
restart)
restart
;;
*)
echo "USAGE :$0 {start|stop|restart}"
exit 2
esac
exit $?四、还有对keepalived的日志做rsyslog的日志专门记录
root@lvs-1 ~]# cat /etc/sysconfig/keepalived
1，修改keepalived的日志格式
# Options for keepalived. See `keepalived --help' output and keepalived(8) and
# keepalived.conf(5) man pages for a list of all options. Here are the most
# common ones :
#
# --vrrp -P Only run with VRRP subsystem.
# --check -C Only run with Health-checker subsystem.
# --dont-release-vrrp-V Dont remove VRRP VIPs & VROUTEs on daemon stop.
# --dont-release-ipvs-I Dont remove IPVS topology on daemon stop.
# --dump-conf -d Dump the configuration data.
# --log-detail -D Detailed log messages.
# --log-facility -S 0-7 Set local syslog facility (default=LOG_DAEMON)
#
#KEEPALIVED_OPTIONS="-D"
KEEPALIVED_OPTIONS="-D -d -S 0",
2， 配置rsyslog
yum install syslog -y
新加一下行
# vim /etc/rsyslog.conf | grep local0
local0.* /var/log/keepalived.log
#
/etc/init.d/rsyslog restart
/etc/init.d/keepalived restart
3，查看日志
# tail -f /var/log/keepalived.log
Nov 20 13:36:27 lvs-1 Keepalived_healthcheckers: Using LinkWatch kernel netlink reflector...
Nov 20 13:36:27 lvs-1 Keepalived_healthcheckers: Activating healthchecker for service :80
Nov 20 13:36:27 lvs-1 Keepalived_healthcheckers: Activating healthchecker for service :80
Nov 20 13:36:28 lvs-1 Keepalived_vrrp: VRRP_Instance(VI_1) Transition to MASTER STATE
Nov 20 13:36:28 lvs-1 Keepalived_vrrp: VRRP_Instance(VI_1) Received lower prio advert, forcing new election
Nov 20 13:36:29 lvs-1 Keepalived_vrrp: VRRP_Instance(VI_1) Entering MASTER STATE
Nov 20 13:36:29 lvs-1 Keepalived_vrrp: VRRP_Instance(VI_1) setting protocol VIPs.
Nov 20 13:36:29 lvs-1 Keepalived_healthcheckers: Netlink reflector reports IP 192.168.2.12 added
Nov 20 13:36:29 lvs-1 Keepalived_vrrp: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.2.12
Nov 20 13:36:34 lvs-1 Keepalived_vrrp: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.2.12
##########################################################################################
LB server本机配置nginx服务
master 配置文件如下：
vim keepalived.conf
! Configuration File for keepalived
vrrp_script check_run {
script "/etc/keepalived/nginx_check.sh"
interval 5
weight 2
}
global_defs {
notification_email {
334035686@qq.com
}
notification_email_fromroot@localhost
smtp_server localhost
smtp_connect_timeout 30
router_id LVS_1
}
vrrp_instance VI_1 {
state MASTER
interface eth0
virtual_router_id 51## the same as slavelvs
priority 100
advert_int 1
track_interface {
eth0
}
authentication {
auth_type PASS
auth_pass 1111
}
virtual_ipaddress {
192.168.2.12
}
track_script {
check_run
}
}
#BACKUP 配置文件
vim keepalived.conf
! Configuration File for keepalived
vrrp_script check_run {
script "/etc/keepalived/nginx_check.sh"
interval 5
weight 2
}
global_defs {
notification_email {
334035686@qq.com
}
notification_email_fromroot@localhost
smtp_server localhost
smtp_connect_timeout 30
router_id LVS_1
}
vrrp_instance VI_1 {
state BACKUP
interface eth0
virtual_router_id 51## the same as MASTER lvs
priority 90
advert_int 1
track_interface {
eth0
}
authentication {
auth_type PASS
auth_pass 1111
}
virtual_ipaddress {
192.168.2.12
}
track_script {
check_run
}
}
以下是检查nginx健康状态的脚本：
#!/bin/bash
NGINX_PROCESS=`ps -C nginx --no-header | wc -l`
if [ $NGINX_PROCESS -eq 0 ];then
/usr/local/nginx/sbin/nginx
sleep 3
if [ `ps -C nginx --no-header | wc -l` -eq 0 ];then
/etc/init.d/keepalived stop
fi
fi
页:
[1]