Redis 3.0集群搭建/配置/FAQ

rgbnj

·声明

1，已官网中文教程为基础，边看边学，结合环境现状搭建。

2，哥对Ruby不热爱、不熟悉、不感冒，所述内容如有疑义请谅解。

3，3.0官说集群还在测试中，其实用用也还算马马虎虎，对外集群API真心少，望有识之士能够出力。



·准备材料

VM9，CentOS 6.4_x86_64（2.6+），SecureCRT，CentOS-6.4-x86_64-bin-DVD1.iso

redis官网：redis-3.0.0-beta1.tar.gz

ruby官网：rubygems-2.0.7.zip

rubygem官网：redis-3.0.7.gem



·下锅

1，把一些基础包装一下，后面会用到

service iptables stop

放入DVD1-

yum install –y gcc*

yum install –y ruby

yum install –y ruby-rdoc

2，装redis

tar -xvf redis-3.0.0-beta1.tar.gz

cd redis-3.0.0-beta

make

make install

ll /usr/local/bin

3，配置集群（假定 $REDIS_HOME=/root/soft/redis，就像ORACLE_HOME一样）

cd $REDIS_HOME

mkdir cluster-test

cd cluster-test

mkdir 7000 7001 7002 7003 7004 7005

vim redis.conf，修改内容如下：

port 7000 个性化


cluster-enabled yes
cluster-config-file nodes.7000.conf 个性化
cluster-node-timeout 5000
appendonly yes
appendfilename "appendonly.7000.aof" 个性化
deamonize yes
pidfile 个性化
log 个性化



cp ../redis.conf ./7000

cp ../redis.conf ./7001

cp ../redis.conf ./7002

cp ../redis.conf ./7003

cp ../redis.conf ./7004

cp ../redis.conf ./7005

cp /usr/local/bin/redis-server ./7000

cp /usr/local/bin/redis-server ./7001

cp /usr/local/bin/redis-server ./7002

cp /usr/local/bin/redis-server ./7003

cp /usr/local/bin/redis-server ./7004

cp /usr/local/bin/redis-server ./7005

/root/soft/redis/cluster-test/redis-server /root/soft/redis/cluster-test/7000/redis.conf

/root/soft/redis/cluster-test/redis-server /root/soft/redis/cluster-test/7001/redis.conf

/root/soft/redis/cluster-test/redis-server /root/soft/redis/cluster-test/7002/redis.conf

/root/soft/redis/cluster-test/redis-server /root/soft/redis/cluster-test/7003/redis.conf

/root/soft/redis/cluster-test/redis-server /root/soft/redis/cluster-test/7004/redis.conf

/root/soft/redis/cluster-test/redis-server /root/soft/redis/cluster-test/7005/redis.conf

如果需要看一看：ps –ef|grep redis

如果需要杀一杀：ps -ef|grep redis|egrep -v grep|awk -F ' ' '{print $2}'|xargs kill -9

4，配置ruby集群脚本

cd /root/soft/rubygems

ruby setup.rb

到redis-3.0.7.gem路径下

gem install -l redis（不用L的话，走ruby官网，95%被WALL，你懂得，自己改source吧）

./redis-trib.rb create --replicas 1 127.0.0.1:7000 127.0.0.1:7002 127.0.0.3:7003 127.0.0.1:7004 127.0.0.1:7005 127.0.0.1:7005（半路记得“yes"一下）


>>> Creating cluster
Connecting to node 127.0.0.1:7000: OK
Connecting to node 127.0.0.1:7001: OK
Connecting to node 127.0.0.1:7002: OK
Connecting to node 127.0.0.1:7003: OK
Connecting to node 127.0.0.1:7004: OK
Connecting to node 127.0.0.1:7005: OK
>>> Performing hash slots allocation on 6 nodes...
Using 3 masters:
127.0.0.1:7000
127.0.0.1:7001
127.0.0.1:7002
127.0.0.1:7000 replica #1 is 127.0.0.1:7003
127.0.0.1:7001 replica #1 is 127.0.0.1:7004
127.0.0.1:7002 replica #1 is 127.0.0.1:7005
M: bc66d90ca24eb6b69a3b375a4e242fef00de2052 127.0.0.1:7000
   slots:0-5460 (5461 slots) master
M: bc66d90ca24eb6b69a3b375a4e242fef00de2052 127.0.0.1:7001
   slots:5461-10921 (5461 slots) master
M: bc66d90ca24eb6b69a3b375a4e242fef00de2052 127.0.0.1:7002
   slots:10922-16383 (5462 slots) master
S: bc66d90ca24eb6b69a3b375a4e242fef00de2052 127.0.0.1:7003
   replicates bc66d90ca24eb6b69a3b375a4e242fef00de2052
S: bc66d90ca24eb6b69a3b375a4e242fef00de2052 127.0.0.1:7004
   replicates bc66d90ca24eb6b69a3b375a4e242fef00de2052
S: bc66d90ca24eb6b69a3b375a4e242fef00de2052 127.0.0.1:7005
   replicates bc66d90ca24eb6b69a3b375a4e242fef00de2052
Can I set the above configuration? (type 'yes' to accept): yes
>>> Nodes configuration updated
>>> Sending CLUSTER MEET messages to join the cluster
Waiting for the cluster to join...
>>> Performing Cluster Check (using node 127.0.0.1:7000)
M: 75bab28893c3536aecdb9879df97db89b24ce21e 127.0.0.1:7000
   slots:5461-10921 (5461 slots) master
M: cfc344721cad8a5ddb7a8d675eb3a4d6e5b9d1c1 127.0.0.1:7002
   slots:10922-16383 (5462 slots) master
M: 01b3977a3f592fd1538e8c83f86bbba37d0c1058 127.0.0.3:7003
   slots:0-5460 (5461 slots) master
M: df59fce238a1c538933bdc170edb27835d0b7cc7 127.0.0.1:7004
   slots: (0 slots) master
   replicates 01b3977a3f592fd1538e8c83f86bbba37d0c1058
M: b6bdb2d309aa7f0b810288f24e975230419f25b1 127.0.0.1:7005
   slots: (0 slots) master
   replicates 75bab28893c3536aecdb9879df97db89b24ce21e
M: b6bdb2d309aa7f0b810288f24e975230419f25b1 127.0.0.1:7005
   slots: (0 slots) master
   replicates cfc344721cad8a5ddb7a8d675eb3a4d6e5b9d1c1
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.

  redis-cli -c -p 7000


127.0.0.1:7000> set b c
-> Redirected to slot [3300] located at 127.0.0.1:7003
OK
127.0.0.1:7003> set hello world
OK
127.0.0.1:7003> get foo
-> Redirected to slot [12182] located at 127.0.0.1:7002
(nil)
127.0.0.1:7002> get hello
-> Redirected to slot [866] located at 127.0.0.1:7003
"world"
127.0.0.1:7003> get b
"c"
127.0.0.1:7003>



·FAQ


*** ERROR: Invalid configuration for cluster creation.

*** Redis Cluster requires at least 3 master nodes.

*** This is not possible with 4 nodes and 1 replicas per node.

*** At least 6 nodes are required.



·Redis官说，至少3+3，还延续着Master-Slave的设计理念，这点上个人觉得Cassandra的一致性确实了得。



Either the node already knows other nodes


·因为报错是ruby报的，不太能够理解其意思，因为我之前做了些单机压测，可能直接叠上集群会有垃圾数据，所以把/var/db/和/var/log/下能清空的都清空了。



[13321] 09 Mar 08:09:24.290 # Handshake error: we already know node bc66d90ca24eb6b69a3b375a4e242fef00de2052, updating the address if needed.


·同样道理，ruby报的错，一开始一直在join被我ctrl+c之后开始报错，用上面的方法无果。把所有app目录清空然后redis重装。大家测试时，最后事先vmware快照一下或者redis现网数据备份一下。