Lvs+keepalived实现负载均衡、故障剔除(DR模式)

mouse

原创作品，允许转载，转载时请务必以超链接形式标明文章 原始出处 、作者信息和本声明。否则将追究法律责任。http://antsw.blog.iyunv.com/936097/214975 Node1: 192.168.1.253Node2: 192.168.1.254VIP: 192.168.1.250 环境 centos5.2（我这里是用两台机实现的）1、安装ipvsadmyum -y install ipvsadm 2、安装keepalived[iyunv@node1 ~]# wget http://www.keepalived.org/software/keepalived-1.1.15.tar.gz[iyunv@node1 ~]# tar zxvf keepalived-1.1.15.tar.gz[iyunv@node1 ~]# cd keepalived-1.1.15[iyunv@node1 keepalived-1.1.15]# ./configure --prefix=/ --mandir=/usr/local/share/man/ --with-kernel-dir=/usr/src/kernels/2.6.18-92.el5-i686/configure后会输入这结果为正确Keepalived configuration------------------------Keepalived version       : 1.1.15Compiler                 : gccCompiler flags           : -g -O2Extra Lib                : -lpopt -lssl -lcryptoUse IPVS Framework       : Yes    #支持lvsIPVS sync daemon support : Yes  Use VRRP Framework       : YesUse LinkWatch            : NoUse Debug flags          : No [iyunv@node1 keepalived-1.1.15]# make && make install到此，lvs+keepalived安装完成。但是还不能使用lvs功能，接下来以dr模式配置lvs+keepalived 3、[iyunv@node1 ~]# cd /etc/keepalived/[iyunv@node1 keepalived]# vim keepalived.conf! Configuration File for keepalivedglobal_defs {   notification_email {    shanswei@gmail.com   }   notification_email_from  shanswei@gmail.com   smtp_server 127.0.0.1   smtp_connect_timeout 30   router_id LVS_DEVEL} vrrp_instance VI_1 {    state MASTER      ##主lvs设置成master    interface eth0    virtual_router_id 51    priority 102     ##从lvs设置成 99    advert_int 1    authentication {        auth_type PASS        auth_pass 1111    }    virtual_ipaddress {       192.168.1.250 ## 如多个vip，继续换行填写。    }}virtual_server 192.168.1.250 80 {    delay_loop 6    lb_algo wlc    lb_kind DR    persistence_timeout 50    protocol TCP     real_server 192.168.1.253 80 {        weight 3        TCP_CHECK {        connect_port 80        connect_timeout 30        }    }    real_server 192.168.1.254 80 {        weight 1        TCP_CHECK {        connect_port 80        connect_timeout 30        }    } 好了，keepalived配置完成了。启动keepalived  
[iyunv@node1 ~]# /etc/init.d/keepalived start
如果要随系统启动，执行chkconfig --add keepalived
                                       chkconfig keepalived  on 4、接着配置真实服务器，这里通过脚本来实现吧(这个脚本只在WEB机上执行，我现在是用两台机。服务器既充当lvs、也充当web机) [iyunv@node1 keepalived]# vim realserver#!/bin/bash#description : start realserverVIP=192.168.1.250/etc/rc.d/init.d/functionscase "$1" instart)echo " start LVS of REALServer"/sbin/ifconfig lo:0 $VIP broadcast $VIP netmask 255.255.255.255 upecho "1" >/proc/sys/net/ipv4/conf/lo/arp_ignoreecho "2" >/proc/sys/net/ipv4/conf/lo/arp_announceecho "1" >/proc/sys/net/ipv4/conf/all/arp_ignoreecho "2" >/proc/sys/net/ipv4/conf/all/arp_announce;;stop)/sbin/ifconfig lo:0 downecho "close LVS Directorserver"echo "0" >/proc/sys/net/ipv4/conf/lo/arp_ignoreecho "0" >/proc/sys/net/ipv4/conf/lo/arp_announceecho "0" >/proc/sys/net/ipv4/conf/all/arp_ignoreecho "0" >/proc/sys/net/ipv4/conf/all/arp_announce;;*)echo "Usage: $0 {start|stop}"exit 1esac[iyunv@node1 keepalived]# chmod +x realserver[iyunv@node1 keepalived]# ./realserver start 5、启动keepalived (附启动日志)[iyunv@node1 ~]# /etc/init.d/keepalived start  (主LVS)Oct 15 13:59:36 vmtest Keepalived: Starting Keepalived v1.1.15 (10/15,2009)Oct 15 13:59:36 vmtest Keepalived_healthcheckers: Using MII-BMSR NIC polling thread...Oct 15 13:59:36 vmtest Keepalived_healthcheckers: Netlink reflector reports IP 192.168.1.253 addedOct 15 13:59:36 vmtest Keepalived_healthcheckers: Netlink reflector reports IP 10.0.0.253 addedOct 15 13:59:36 vmtest Keepalived_healthcheckers: Registering Kernel netlink reflectorOct 15 13:59:36 vmtest Keepalived_healthcheckers: Registering Kernel netlink command channelOct 15 13:59:36 vmtest Keepalived_healthcheckers: Opening file '/etc/keepalived/keepalived.conf'.Oct 15 13:59:36 vmtest Keepalived_healthcheckers: Configuration is using : 11891 BytesOct 15 13:59:36 vmtest Keepalived_healthcheckers: Activating healtchecker for service [192.168.1.253:80]Oct 15 13:59:36 vmtest Keepalived_healthcheckers: Activating healtchecker for service [192.168.1.254:80]Oct 15 13:59:36 vmtest Keepalived: Starting Healthcheck child process, pid=28419Oct 15 13:59:36 vmtest Keepalived_vrrp: Using MII-BMSR NIC polling thread...Oct 15 13:59:36 vmtest Keepalived_vrrp: Netlink reflector reports IP 192.168.1.253 addedOct 15 13:59:36 vmtest Keepalived: Starting VRRP child process, pid=28420Oct 15 13:59:36 vmtest Keepalived_vrrp: Netlink reflector reports IP 10.0.0.253 addedOct 15 13:59:36 vmtest Keepalived_vrrp: Registering Kernel netlink reflectorOct 15 13:59:36 vmtest Keepalived_vrrp: Registering Kernel netlink command channelOct 15 13:59:36 vmtest Keepalived_vrrp: Registering gratutious ARP shared channelOct 15 13:59:36 vmtest Keepalived_vrrp: Opening file '/etc/keepalived/keepalived.conf'.Oct 15 13:59:36 vmtest Keepalived_vrrp: Configuration is using : 36278 BytesOct 15 13:59:36 vmtest Keepalived_vrrp: VRRP sockpool: [ifindex(2), proto(112), fd(8,9)]Oct 15 13:59:37 vmtest Keepalived_vrrp: VRRP_Instance(VI_1) Transition to MASTER STATEOct 15 13:59:38 vmtest Keepalived_vrrp: VRRP_Instance(VI_1) Entering MASTER STATEOct 15 13:59:38 vmtest Keepalived_vrrp: VRRP_Instance(VI_1) setting protocol VIPs.Oct 15 13:59:38 vmtest Keepalived_vrrp: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.1.250Oct 15 13:59:38 vmtest Keepalived_healthcheckers: Netlink reflector reports IP 192.168.1.250 addedOct 15 13:59:38 vmtest avahi-daemon[2580]: Registering new address record for 192.168.1.250 on eth0.Oct 15 13:59:38 vmtest Keepalived_vrrp: Netlink reflector reports IP 192.168.1.250 addedOct 15 13:59:43 vmtest Keepalived_vrrp: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.1.250 [iyunv@node1 ~]# /etc/init.d/keepalived start  (从LVS)Oct 15 15:40:26 node1 Keepalived: Starting Keepalived v1.1.15 (10/12,2009)Oct 15 15:40:26 node1 Keepalived_healthcheckers: Using MII-BMSR NIC polling thread...Oct 15 15:40:26 node1 Keepalived: Starting Healthcheck child process, pid=11157Oct 15 15:40:26 node1 Keepalived: Starting VRRP child process, pid=11159Oct 15 15:40:26 node1 Keepalived_vrrp: Using MII-BMSR NIC polling thread...Oct 15 15:40:26 node1 Keepalived_vrrp: Registering Kernel netlink reflectorOct 15 15:40:26 node1 Keepalived_vrrp: Registering Kernel netlink command channelOct 15 15:40:26 node1 Keepalived_vrrp: Registering gratutious ARP shared channelOct 15 15:40:26 node1 Keepalived_vrrp: Opening file '/etc/keepalived/keepalived.conf'.Oct 15 15:40:26 node1 Keepalived_vrrp: Configuration is using : 36712 BytesOct 15 15:40:26 node1 Keepalived_vrrp: VRRP_Instance(VI_1) Entering BACKUP STATEOct 15 15:40:26 node1 Keepalived_vrrp: VRRP sockpool: [ifindex(2), proto(112), fd(7,8)]Oct 15 15:40:26 node1 Keepalived_healthcheckers: Registering Kernel netlink reflectorOct 15 15:40:26 node1 Keepalived_healthcheckers: Registering Kernel netlink command channelOct 15 15:40:26 node1 Keepalived_healthcheckers: Opening file '/etc/keepalived/keepalived.conf'.Oct 15 15:40:26 node1 Keepalived_healthcheckers: Configuration is using : 12417 BytesOct 15 15:40:26 node1 Keepalived_healthcheckers: Activating healtchecker for service [192.168.1.253:80]Oct 15 15:40:26 node1 Keepalived_healthcheckers: Activating healtchecker for service [192.168.1.254:80]绿色字体表示启动成功 6、测试，我现在停掉主lvs上面的keepalived，从lvs会出现以下日志，表示从lvs能正常接管主的lvs，从而实现lvs主从互备功能，当主lvs的keepalived启动后。会自动切换回来[iyunv@node1 ~]# tali -f /var/log/messagesOct 15 15:43:18 node1 Keepalived_vrrp: VRRP_Instance(VI_1) Transition to MASTER STATEOct 15 15:43:19 node1 Keepalived_vrrp: VRRP_Instance(VI_1) Entering MASTER STATEOct 15 15:43:19 node1 Keepalived_vrrp: VRRP_Instance(VI_1) setting protocol VIPs.Oct 15 15:43:19 node1 Keepalived_vrrp: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.1.250Oct 15 15:43:19 node1 avahi-daemon[3087]: Registering new address record for 192.168.1.250 on eth0.Oct 15 15:43:24 node1 Keepalived_vrrp: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.1.250 7、测试down机，比如我这机跑的是web服务，我现在停止apache，出现以下现像 绿线画的是lvs正常，当我停止httpd的时候，再看lvs时，192.168.1.253这个IP已不在lvs表中（画红线处），因为我停掉了httpd服务。我再启动httpd服务时，再查看lvs，192.168.1.253又自动加进表中（画蓝线处），此时已实现了负载均衡、故障剔除功能。 8、心得 这个配置只需要两个软件就可以了，ipvsadm、keepalived，再加上一个脚本，这个脚本只在
web机上执行 还有keepalived的配置文件，在一台机上配置好了之后，直接拷到另一台机去，拷到另一台
机只需要改动两个地方
vrrp_instanceVI_1{     stateMASTER       ##主lvs设置成master
    interfaceeth0
    virtual_router_id51     priority102   ##从lvs设置成 99
    stateMASTER 如果是从lvs，则改成BACKUP，priority102 改为小于100. 　　本文出自 “山捻子” 博客，请务必保留此出处http://antsw.blog.iyunv.com/936097/214975