设为首页 收藏本站

运维网

 找回密码
 立即注册
查看: 1308|回复: 0

[经验分享] 通过Keepalived实现Redis Failover自动故障切换功能(整理中) .

[复制链接]
zhangsanfeng88

尚未签到
发表于 2015-11-20 08:19:15 | 显示全部楼层 |阅读模式
通过Keepalived实现Redis Failover自动故障切换功能
分类： Linux 2013-06-21 16:44 1049人阅读 评论(1)收藏举报　　详细可参考http://heylinux.com/archives/1942.html
　　http://blog.iyunv.com/qingrx/article/details/9146779
　　
　　设计思路：
redis 主和 redis从  正常同步；
　　redis主keepalived 启动，执行redis_master.sh脚本，vip在自己身上；
　　redis 从keepalived 启动，执行redis_slave.sh脚本；
　　redis主服务关闭，则redis主执行redis_fault.sh脚本， vip落在redis 从上，redis从执行redis_master.sh脚本，变成主；
　　redis主服务开启，则redis主执行redis_slave.sh脚本变成从，vip还在redis 从上，还是主；
　　redis从服务关闭，则redis从执行redis_fault.sh脚本， vip落在redis主上，redis主执行redis_master.sh脚本，变成主；
　　redis从服务开启，则redis从执行redis_slave.sh脚本变成从， vip还在redis主上，redis主继续做主，此时为redis初试主从状态；
　　
　　环境：
　　10.7.13.43 redis
　　10.7.13.44 redis-slave
　　10.7.13.45 vip
　　
　　
　　
　　
　　
　　一:安装keepalived
　　(redis和redis-slave两台服务器都安装)
　　1. 安装操作系统的 ipvsadm
　　yum -y install ipvsadm
　　否则出现如下错误：
　　如果这个不安装 make 会有如下错误
   make
make -C lib || exit 1;
make[1]: Entering directory `/httx/download/keepalived-1.2.10/lib'
make[1]: Nothing to be done for `all'.
make[1]: Leaving directory `/httx/download/keepalived-1.2.10/lib'
make -C keepalived
make[1]: Entering directory `/httx/download/keepalived-1.2.10/keepalived'
make[2]: Entering directory `/httx/download/keepalived-1.2.10/keepalived/core'
make[2]: Nothing to be done for `all'.
make[2]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived/core'
make[2]: Entering directory `/httx/download/keepalived-1.2.10/keepalived/check'
make[2]: Nothing to be done for `all'.
make[2]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived/check'
make[2]: Entering directory `/httx/download/keepalived-1.2.10/keepalived/vrrp'
make[2]: Nothing to be done for `all'.
make[2]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived/vrrp'
make[2]: Entering directory `/httx/download/keepalived-1.2.10/keepalived/libipvs-2.6'
gcc -g -O2  -I/usr/src/linux/include -I/usr/src/linux/include -DLIBIPVS_DONTUSE_NL -Wall -Wunused -c -o libipvs.o libipvs.c
libipvs.c: In function ‘nlerr2syserr’:
libipvs.c:61: error: ‘NLE_BAD_SOCK’ undeclared (first use in this function)
libipvs.c:61: error: (Each undeclared identifier is reported only once
libipvs.c:61: error: for each function it appears in.)
libipvs.c:62: error: ‘NLE_EXIST’ undeclared (first use in this function)
libipvs.c:63: error: ‘NLE_NOADDR’ undeclared (first use in this function)
libipvs.c:64: error: ‘NLE_OBJ_NOTFOUND’ undeclared (first use in this function)
libipvs.c:65: error: ‘NLE_INTR’ undeclared (first use in this function)
libipvs.c:66: error: ‘NLE_AGAIN’ undeclared (first use in this function)
libipvs.c:67: error: ‘NLE_INVAL’ undeclared (first use in this function)
libipvs.c:68: error: ‘NLE_NOACCESS’ undeclared (first use in this function)
libipvs.c:69: error: ‘NLE_NOMEM’ undeclared (first use in this function)
libipvs.c:70: error: ‘NLE_AF_NOSUPPORT’ undeclared (first use in this function)
libipvs.c:71: error: ‘NLE_PROTO_MISMATCH’ undeclared (first use in this function)
libipvs.c:72: error: ‘NLE_OPNOTSUPP’ undeclared (first use in this function)
libipvs.c:73: error: ‘NLE_PERM’ undeclared (first use in this function)
libipvs.c:74: error: ‘NLE_BUSY’ undeclared (first use in this function)
libipvs.c:75: error: ‘NLE_RANGE’ undeclared (first use in this function)
libipvs.c:76: error: ‘NLE_NODEV’ undeclared (first use in this function)
make[2]: *** [libipvs.o] Error 1
make[2]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived/libipvs-2.6'
make[1]: *** [all] Error 1
make[1]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived'
make: *** [all] Error 2
　　1.wget http://www.keepalived.org/software/keepalived-1.2.10.tar.gz
2.安装操作系统组件 openssl-devel
  yum -y install openssl-devel
  否则出现如下错误：
  configure: error:
  !!! OpenSSL is not properly installed on your system. !!!
  !!! Can not include OpenSSL headers files.
2.安装 tar zxvf keepalived-1.2.10.tar.gz  
  cd keepalived-1.2.10
3. ./configure --prefix=/httx/run/keepalived   
4. yum -y install ipvsadm
   如果这个不安装 make 会有如下错误
   make
make -C lib || exit 1;
make[1]: Entering directory `/httx/download/keepalived-1.2.10/lib'
make[1]: Nothing to be done for `all'.
make[1]: Leaving directory `/httx/download/keepalived-1.2.10/lib'
make -C keepalived
make[1]: Entering directory `/httx/download/keepalived-1.2.10/keepalived'
make[2]: Entering directory `/httx/download/keepalived-1.2.10/keepalived/core'
make[2]: Nothing to be done for `all'.
make[2]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived/core'
make[2]: Entering directory `/httx/download/keepalived-1.2.10/keepalived/check'
make[2]: Nothing to be done for `all'.
make[2]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived/check'
make[2]: Entering directory `/httx/download/keepalived-1.2.10/keepalived/vrrp'
make[2]: Nothing to be done for `all'.
make[2]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived/vrrp'
make[2]: Entering directory `/httx/download/keepalived-1.2.10/keepalived/libipvs-2.6'
gcc -g -O2  -I/usr/src/linux/include -I/usr/src/linux/include -DLIBIPVS_DONTUSE_NL -Wall -Wunused -c -o libipvs.o libipvs.c
libipvs.c: In function ‘nlerr2syserr’:
libipvs.c:61: error: ‘NLE_BAD_SOCK’ undeclared (first use in this function)
libipvs.c:61: error: (Each undeclared identifier is reported only once
libipvs.c:61: error: for each function it appears in.)
libipvs.c:62: error: ‘NLE_EXIST’ undeclared (first use in this function)
libipvs.c:63: error: ‘NLE_NOADDR’ undeclared (first use in this function)
libipvs.c:64: error: ‘NLE_OBJ_NOTFOUND’ undeclared (first use in this function)
libipvs.c:65: error: ‘NLE_INTR’ undeclared (first use in this function)
libipvs.c:66: error: ‘NLE_AGAIN’ undeclared (first use in this function)
libipvs.c:67: error: ‘NLE_INVAL’ undeclared (first use in this function)
libipvs.c:68: error: ‘NLE_NOACCESS’ undeclared (first use in this function)
libipvs.c:69: error: ‘NLE_NOMEM’ undeclared (first use in this function)
libipvs.c:70: error: ‘NLE_AF_NOSUPPORT’ undeclared (first use in this function)
libipvs.c:71: error: ‘NLE_PROTO_MISMATCH’ undeclared (first use in this function)
libipvs.c:72: error: ‘NLE_OPNOTSUPP’ undeclared (first use in this function)
libipvs.c:73: error: ‘NLE_PERM’ undeclared (first use in this function)
libipvs.c:74: error: ‘NLE_BUSY’ undeclared (first use in this function)
libipvs.c:75: error: ‘NLE_RANGE’ undeclared (first use in this function)
libipvs.c:76: error: ‘NLE_NODEV’ undeclared (first use in this function)
make[2]: *** [libipvs.o] Error 1
make[2]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived/libipvs-2.6'
make[1]: *** [all] Error 1
make[1]: Leaving directory `/httx/download/keepalived-1.2.10/keepalived'
make: *** [all] Error 2
  
5. make && make install  
6. 日志文件 /httx/logs/keepalived/keepalived-redis-state.log
7. chmod +x *.sh
8. 复制配置文件
keepalived/sbin/keepalived -d -D -S 0   --启动命令 http://www.iyunv.com/Linux/2014-02/96081.htm 参数意义待确认，暂时用安装文件
cp /httx/run/keepalived/etc/rc.d/init.d/keepalived /etc/init.d/   -- 并修改该文件的参数  /var/lock/subsys/$prog 为 /httx/run/keepalived/lock/$prog
chmod 755 /etc/init.d/keepalived
cp /httx/run/keepalived/sbin/keepalived /usr/sbin/  
cp /httx/run/keepalived/etc/sysconfig/keepalived /etc/sysconfig/   --配置服务
　　#运行 由于keepalived配置文件不是在启动时一次性加载并读取完成的，所以必须是完整路径，可以根据log判断是否加载了正确的配置文件
　　keepalived –f /usr/local/etc/keepalived/keepalived.conf
　　运行过程可以查看log：
　　tail -f /var/log/message  
　　
　　二:安装redis
　　(redis和redis-slave两台服务器都安装)
　　
　　tar   -zxvf redis-2.4.17.tar.gz
　　cd redis-2.4.17
　　./configure
　　make
　　make install
　　
　　redis-slve只需注意一点
　　[iyunv@redis bin]# pwd
　　/usr/local/bin
　　[iyunv@redis bin]# vim redis.conf
　　116  slaveof 192.168.1.235 6379
　　
　　三：通过Keepalived实现Redis Failover自动故障切换
　　
　　修改Master和Slave的/etc/hosts文件
　　[iyunv@redis rc.d]# cat /etc/hosts
　　192.168.1.235   redis
　　192.168.1.236   redis-slave
　　
　　Master上是
　　[iyunv@redis rc.d]# cat /etc/sysconfig/network
　　NETWORKING=yes
　　HOSTNAME=redis
　　
　　Slave上是
　　[iyunv@redis-slave linux]# cat /etc/sysconfig/network
　　NETWORKING=yes
　　HOSTNAME=redis-slave
　　修改完主机名重启机器生效
　　
　　
　　默认安装完成keepalived之后是没有配置文件的，因此我们需要手动创建：
　　首先，在Master上创建如下配置文件：
　　[iyunv@redis  linux]# vim /etc/keepalived/keepalived.conf
　　global_defs {


   notification_email {


     695207668@qq.com


   }


   notification_email_from keepalived@redis


   router_id jt-db-redis-m1


}




vrrp_script chk_redis {


    script "/httx/run/keepalived/etc/keepalived/scripts/redis_check.sh"


    interval 1


   # weight 4


}




vrrp_instance mes_Redis {


    state MASTER


  #  interface eth0
  interface br0
    garp_master_delay 10


    smtp_alert


    virtual_router_id 3


    priority 100


     nopreempt


    advert_int 1


    authentication {


        auth_type PASS


        auth_pass 1111


    }


    virtual_ipaddress {


        10.7.13.46


    }


    track_script {


        chk_redis


    }


    notify_master /httx/run/keepalived/etc/keepalived/scripts/redis_master.sh
    notify_backup /httx/run/keepalived/etc/keepalived/scripts/redis_slave.sh
    notify_fault /httx/run/keepalived/etc/keepalived/scripts/redis_fault.sh
    notify_stop  /httx/run/keepalived/etc/keepalived/scripts/redis_stop.sh


}

　　
　　
　　然后，在Slave上创建如下配置文件：
　　[iyunv@redis-slave linux]# vim /etc/keepalived/keepalived.conf
　　global_defs {


   notification_email {


     695207668@qq.com


   }


   notification_email_from keepalived@redis-slave


   router_id jt-db-redis-s1


}




vrrp_script chk_redis {
    script "/httx/run/keepalived/etc/keepalived/scripts/redis_check.sh"
    interval 1
    #  weight 4
}




vrrp_instance mes_Redis {


    state BACKUP


  #  interface eth0
    interface br0


    garp_master_delay 10


    smtp_alert


    virtual_router_id 3


    priority 99


    nopreempt


    advert_int 1


    authentication {


        auth_type PASS


        auth_pass 1111


    }


    virtual_ipaddress {


        10.7.13.46


    }


    track_script {


        chk_redis


    }


    notify_master /httx/run/keepalived/etc/keepalived/scripts/redis_master.sh
    notify_backup /httx/run/keepalived/etc/keepalived/scripts/redis_slave.sh
    notify_fault  /httx/run/keepalived/etc/keepalived/scripts/redis_fault.sh
    notify_stop   /httx/run/keepalived/etc/keepalived/scripts/redis_stop.sh


}

　　
　　
　　在Master和Slave上创建监控Redis的脚本
　　mkdir /etc/keepalived/scripts
　　vim /etc/keepalived/scripts/redis_check.sh
　　#!/bin/bash
　　ALIVE=`/usr/local/bin/redis-cli PING`
　　if [ "$ALIVE" == "PONG" ]; then
　　echo $ALIVE
　　exit 0
　　else
　　echo $ALIVE
　　exit 1
　　fi
　　
　　编写以下负责运作的关键脚本：
　　notify_master /etc/keepalived/scripts/redis_master.sh
　　notify_backup /etc/keepalived/scripts/redis_slave.sh
　　notify_fault /etc/keepalived/scripts/redis_fault.sh
　　notify_stop /etc/keepalived/scripts/redis_stop.sh
　　
　　因为Keepalived在转换状态时会依照状态来呼叫：
　　当进入Master状态时会呼叫notify_master
　　当进入Backup状态时会呼叫notify_backup
　　当发现异常情况时进入Fault状态呼叫notify_fault
　　当Keepalived程序终止时则呼叫notify_stop
　　
　　首先，在Redis Master上创建notity_master与notify_backup脚本：
　　vim /etc/keepalived/scripts/redis_master.sh
　　#!/bin/bash
　　
　　REDISCLI="/usr/local/bin/redis-cli"
　　LOGFILE="/var/log/keepalived-redis-state.log"
　　
　　echo "[master]" >> $LOGFILE
　　date >> $LOGFILE
　　echo "Being master...." >> $LOGFILE 2>&1
　　
　　echo "Run SLAVEOF cmd ..." >> $LOGFILE
　　$REDISCLI SLAVEOF 192.168.1.236 6379 >> $LOGFILE  2>&1
　　sleep 10 #延迟10秒以后待数据同步完成后再取消同步状态
　　
　　echo "Run SLAVEOF NO ONE cmd ..." >> $LOGFILE
　　$REDISCLI SLAVEOF NO ONE >> $LOGFILE 2>&1
　　
　　vim /etc/keepalived/scripts/redis_slave.sh
　　#!/bin/bash
　　
　　REDISCLI="/usr/local/bin/redis-cli"
　　LOGFILE="/var/log/keepalived-redis-state.log"
　　
　　echo "[backup]" >> $LOGFILE
　　date >> $LOGFILE
　　echo "Being slave...." >> $LOGFILE 2>&1
　　
　　sleep 15 #延迟15秒待数据被对方同步完成之后再切换主从角色
　　echo "Run SLAVEOF cmd ..." >> $LOGFILE
　　$REDISCLI SLAVEOF 192.168.1.236 6379 >> $LOGFILE  2>&1
　　
　　
　　接着，在Redis Slave上创建notity_master与notify_backup脚本：
　　
　　vim /etc/keepalived/scripts/redis_master.sh
　　#!/bin/bash
　　
　　REDISCLI="/usr/local/bin/redis-cli"
　　LOGFILE="/var/log/keepalived-redis-state.log"
　　
　　echo "[master]" >> $LOGFILE
　　date >> $LOGFILE
　　echo "Being master...." >> $LOGFILE 2>&1
　　
　　echo "Run SLAVEOF cmd ..." >> $LOGFILE
　　$REDISCLI SLAVEOF 192.168.1.235 6379 >> $LOGFILE  2>&1
　　sleep 10 #延迟10秒以后待数据同步完成后再取消同步状态
　　
　　echo "Run SLAVEOF NO ONE cmd ..." >> $LOGFILE
　　$REDISCLI SLAVEOF NO ONE >> $LOGFILE 2>&1
　　
　　vim /etc/keepalived/scripts/redis_slave.sh
　　#!/bin/bash
　　
　　REDISCLI="/usr/local/bin/redis-cli"
　　LOGFILE="/var/log/keepalived-redis-state.log"
　　
　　echo "[backup]" >> $LOGFILE
　　date >> $LOGFILE
　　echo "Being slave...." >> $LOGFILE 2>&1
　　
　　sleep 15 #延迟15秒待数据被对方同步完成之后再切换主从角色
　　echo "Run SLAVEOF cmd ..." >> $LOGFILE
　　$REDISCLI SLAVEOF 192.168.1.235 6379 >> $LOGFILE  2>&1
　　
　　然后在Master与Slave创建如下相同的脚本：
　　vim /etc/keepalived/scripts/redis_fault.sh
　　#!/bin/bash
　　
　　LOGFILE=/var/log/keepalived-redis-state.log
　　
　　echo "[fault]" >> $LOGFILE
　　date >> $LOGFILE
　　
　　vim /etc/keepalived/scripts/redis_stop.sh
　　#!/bin/bash
　　
　　LOGFILE=/var/log/keepalived-redis-state.log
　　
　　echo "[stop]" >> $LOGFILE
　　date >> $LOGFILE
　　
　　
　　在Master与Slave给脚本都加上可执行权限：
　　chmod +x /etc/keepalived/scripts/*.sh
　　
　　脚本创建完成以后，我们开始按照如下流程进行测试：
　　1.启动Master上的Redis
　　[iyunv@redis bin]# pwd
　　/usr/local/bin
　　[iyunv@redis bin]# ./redis-server redis.conf
　　
　　2.启动Slave上的Redis
　　[iyunv@redis bin]# pwd
　　/usr/local/bin
　　[iyunv@redis bin]# ./redis-server redis.conf
　　
　　3.启动Master上的Keepalived
　　/etc/init.d/keepalived start
　　
　　4.启动Slave上的Keepalived
　　/etc/init.d/keepalived start
　　
　　5.尝试通过VIP连接Redis:
　　[iyunv@redis bin]#pwd
　　/usr/local/bin
　　[iyunv@redis bin]# ./redis-cli -h 192.168.1.237 info
　　role:master
　　slave0:192.168.1.236,6379,online
　　连接成功，Slave也连接上来了
　　
　　6.尝试插入一些数据：
　　[iyunv@redis bin]# ./redis-cli -h 192.168.1.237 SET Hello Redis
　　从VIP读取数据
　　[iyunv@redis bin]# ./redis-cli -h 192.168.1.237 GET Hello
　　"Redis"
　　
　　
　　从Master读取数据
　　[iyunv@redis bin]# ./redis-cli -h 192.168.1.235  GET Hello
　　"Redis"
　　
　　从Slave读取数据
　　[iyunv@redis-slave bin]# ./redis-cli -h 192.168.1.235  GET Hello
　　"Redis"
　　
　　下面，模拟故障产生：
　　将Master上的Redis进程杀死：
　　[iyunv@redis bin]# ./redis-cli shutdown
　　
　　查看Master上的Keepalived日志
　　[iyunv@redis scripts]# tail /var/log/keepalived-redis-state.log
　　[fault]
　　Thu Sep 27 08:29:01 CST 2012
　　
　　同时Slave上的日志显示：
　　[iyunv@redis-slave scripts]# tail /var/log/keepalived-redis-state.log
　　[master]
　　Thu Nov 15 12:06:04 CST 2012
　　Being master....
　　Run SLAVEOF cmd ...
　　OK
　　Run SLAVEOF NO ONE cmd ...
　　OK
　　
　　然后我们可以发现，Slave已经接管服务，并且担任Master的角色了。
　　./redis-cli -h 192.168.1.237 info
　　./redis-cli -h 192.168.1.236 info
　　role:master
　　
　　然后我们恢复Master的Redis进程
　　主变成slave
　　
　　
　　然后把236redis停掉
　　235恢复主的角色，在把236redis开启
　　
　　恢复235是主，236是备
　　
　　自动切换成功！
　　

运维网声明 1、欢迎大家加入本站运维交流群:群②:261659950 群⑤:202807635 群⑦870801961 群⑧679858003
2、本站所有主题由该帖子作者发表，该帖子作者与运维网享有帖子相关版权
3、所有作品的著作权均归原作者享有，请您和我们一样尊重他人的著作权等合法权益。如果您对作品感到满意，请购买正版
4、禁止制作、复制、发布和传播具有反动、淫秽、色情、暴力、凶杀等内容的信息，一经发现立即删除。若您因此触犯法律，一切后果自负，我们对此不承担任何责任
5、所有资源均系网友上传或者通过网络收集，我们仅提供一个展示、介绍、观摩学习的平台，我们不对其内容的准确性、可靠性、正当性、安全性、合法性等负责，亦不承担任何法律责任
6、所有作品仅供您个人学习、研究或欣赏，不得用于商业或者其他用途，否则，一切后果均由您自己承担，我们对此不承担任何法律责任
7、如涉及侵犯版权等问题，请您及时通知我们，我们将立即采取措施予以解决
8、联系人Email：admin@iyunv.com 网址：www.yunweiku.com

所有资源均系网友上传或者通过网络收集,我们仅提供一个展示、介绍、观摩学习的平台,我们不对其承担任何法律责任,如涉及侵犯版权等问题,请您及时通知我们,我们将立即处理,联系人Email:kefu@iyunv.com,QQ:1061981298 本贴地址：https://www.yunweiku.com/thread-141328-1-1.html 上篇帖子： LVS+Keepalived实验笔记 下篇帖子： LVS+Keepalived 部署
回复

使用道具 举报

返回列表
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

扫码加入运维网微信交流群X

扫码加入运维网微信交流群

扫描二维码加入运维网微信交流群，最新一手资源尽在官方微信交流群！快快加入我们吧...

扫描微信二维码查看详情

客服 E-mail:iyunvcom@gmail.com

本站由青云提供云计算服务

运维网--中国最专业的运维工程师交流社区

豫ICP备20007574号-1 Copyright © 2012-2025

关于我们

发展历程

联系我们

关注我们

广告服务

广告案例

隐私条款

免责声明

用户登录

用户注册

版主守则

申请版主

手机版

金币获取

帮助中心

每日签到

Good Good

Study

Day Day

UP


客服E-mail:kefu@iyunv.com 客服QQ：1061981298


QQ群⑦：运维网交流群⑦ QQ群⑧：运维网交流群⑧ k8s群：运维网kubernetes交流群


提醒：禁止发布任何违反国家法律、法规的言论与图片等内容；本站内容均来自个人观点与网络等信息，非本站认同之观点.


本站大部分资源是网友从网上搜集分享而来，其版权均归原作者及其网站所有，我们尊重他人的合法权益，如有内容侵犯您的合法权益，请及时与我们联系进行核实删除！



合作伙伴: 青云cloud

快速回复 返回顶部 返回列表