linre 发表于 2014-11-20 11:38:57

运维自动化之ansible playbook结合docker安装redis主从

现在在介绍一下ansible结合docker安装redis主从(redis版本是2.6.17)。目前ansible使用的人比较多,docker也最近比较流行,而且做测试的话,ansible+docker是个很好的组合。本文主要是介绍如何使用ansible的playbook安装redis主从,可以自动的做好主从,这样节省安装时间、减少问题产生。
docker版本


1
2
3
4
5
6
7
8
9
10
09:49:09 # docker version
Client version: 0.11.1
Client API version: 1.11
Go version (client): go1.2.1
Git commit (client): fb99f99/0.11.1
Server version: 0.11.1
Server API version: 1.11
Git commit (server): fb99f99/0.11.1
Go version (server): go1.2.1
Last stable version: 1.1.2, please update docker




ansible版本

1
2
09:51:55 # ansible --version
ansible 1.4.3




1、查看已有的docker镜像


1
2
3
4
5
09:39:26 # docker images
REPOSITORY          TAG               IMAGE ID            CREATED             VIRTUAL SIZE
ubuntu            3.0               6cee55276528      9 weeks ago         369.8 MB
centos5             3.0               e08d23b09189      9 weeks ago         840.9 MB
centos6             3.0               e94a3b24a19b      9 weeks ago         415.9 MB




2、查看当前运行的docker容器

1
2
3
4
5
6
09:39:47 # docker ps -a
CONTAINER ID      IMAGE               COMMAND             CREATED             STATUS            PORTS                   NAMES
846efb9e4d7a      ubuntu:3.0          /usr/sbin/sshd -D   2 weeks ago         Up 6 days         0.0.0.0:49167->22/tcp   ubuntu-test1      
b9a9e6f2caed      centos6:3.0         /usr/sbin/sshd -D   3 weeks ago         Up 6 days         0.0.0.0:49166->22/tcp   zabbix-server      
978fff134b18      centos6:3.0         /usr/sbin/sshd -D   5 weeks ago         Up 6 days         0.0.0.0:49165->22/tcp   centos6-test5      
root@ip-10-10-10-10:/etc/ansible/roles/redis_install/templates




3、加载测试容器
由于是做redis主从,所以需要2个容器

1
2
3
4
5
6
7
8
9
10
11
12
13
09:39:50 # timedocker inspect $(docker run -d -p 22--name="redis-master" centos6:3.0 /usr/sbin/sshd -D)|grep -i address|awk -F '"' '{print $4}'
172.17.0.5

real    0m6.369s
user    0m0.036s
sys 0m0.049s
root@ip-10-10-10-10:/etc/ansible/roles/redis_install/templates
09:40:25 # timedocker inspect $(docker run -d -p 22--name="redis-slave" centos6:3.0 /usr/sbin/sshd -D)|grep -i address|awk -F '"' '{print $4}'
172.17.0.6

real    0m12.567s
user    0m0.047s
sys 0m0.060s




然后把新容器的ip加入到ansible的hosts里

1
2
3
4
5
root@ip-10-10-10-10:/etc/ansible/roles/redis_install/templates
09:40:46 # echo "172.17.0.5">>/etc/ansible/hosts
root@ip-10-10-10-10:/etc/ansible/roles/redis_install/templates
09:40:58 # echo "172.17.0.6">>/etc/ansible/hosts
root@ip-10-10-10-10:/etc/ansible/roles/redis_install/templates




4、ansible安装redis的信息


1
2
3
4
5
6
7
09:52:11 # cat /etc/ansible/roles/redis_install/vars/main.yml
redis_dir: /data
redis_version: 2.6.17
redis_port: 6379
redis_conf_dir: /data/redis-2.6.17/conf
redis_db_dir: /data/redis-2.6.17/db
redis_log_dir: /data/redis-2.6.17/log




5、下面是redis的playbook结构


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
09:55:12 # tree /etc/ansible/roles/redis_install /etc/ansible/roles/redis_delete
/etc/ansible/roles/redis_install
├── files
│   └── redis-2.6.17.tar.gz
├── handlers
├── meta
│   └── main.yml
├── tasks
│   ├── copy.yml
│   ├── delete.yml
│   ├── install.yml
│   └── main.yml
├── templates
│   └── redis.conf
└── vars
    └── main.yml
/etc/ansible/roles/redis_delete
├── files
├── handlers
├── meta
│   └── main.yml
├── tasks
│   ├── delete.yml
│   └── main.yml
├── templates
│   └── delete_redis.sh
└── vars
    └── main.yml

12 directories, 13 files




6、playbook安装redis的内容是

1
2
3
4
5
6
7
8
09:57:09 # cat redis_install.yml
---
- hosts: "{{host}}"
remote_user: "{{user}}"
gather_facts: True
roles:
    - common
    - redis_install




7、playbook删除redis的内容是

1
2
3
4
5
6
7
09:57:31 # cat redis_delete.yml
---
- hosts: "{{host}}"
remote_user: "{{user}}"
gather_facts: True
roles:
    - redis_delete




下面是安装redis主从
8、安装redis master

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
09:43:11 # time ansible-playbook redis_install.yml --extra-vars "host=172.17.0.5 user=root" -k
SSH password:

PLAY *************************************************************

GATHERING FACTS ***************************************************************
ok:

TASK: ***********************
changed:

TASK: ******************
ok:

TASK: ******************************
ok:

TASK: *********
changed:

TASK: ********************
changed:

TASK: *********************
changed: => (item=redis-cli)
changed: => (item=redis-server)

TASK: *********************
failed: => {"changed": true, "cmd": "grep -c '/usr/bin/redis-server /data/redis-2.6.17/conf/redis_6379.conf' /etc/rc.local ", "delta": "0:00:00.007160", "end": "2014-08-13 09:45:18.660617", "item": "", "rc": 1, "start": "2014-08-13 09:45:18.653457"}
stdout: 0
...ignoring

TASK: ***********************
changed:

TASK: ******************
changed:

TASK: ****
changed:

PLAY RECAP ********************************************************************
172.17.0.5               : ok=11   changed=8    unreachable=0    failed=0   


real    0m12.757s
user    0m3.453s
sys 0m0.497s




9、查看redis master安装情况

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
09:48:39 # ssh 172.17.0.5
root@172.17.0.5's password:
Last login: Wed Aug 13 09:45:28 2014 from 172.17.42.1
root@06762530db8c:~
09:48:43 # ps -ef|grep redis
root       294   10 09:45 ?      00:00:00 /usr/bin/redis-server /data/redis-2.6.17/conf/redis_6379.conf
root       343   3290 09:48 pts/0    00:00:00 grep redis
root@06762530db8c:~
09:48:46 # cat /etc/rc.local
#!/bin/sh
#
# This script will be executed *after* all the other init scripts.
# You can put your own initialization stuff in here if you don't
# want to do the full Sys V style init stuff.

touch /var/lock/subsys/local
/usr/bin/redis-server /data/redis-2.6.17/conf/redis_6379.conf
root@06762530db8c:~
09:48:52 # redis-cli -h 172.17.0.5 -p 6379
redis 172.17.0.5:6379> keys *
(empty list or set)
redis 172.17.0.5:6379>




10、安装redis slave

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
09:45:20 # time ansible-playbook redis_install.yml --extra-vars "host=172.17.0.6 user=root redis_master_ip=172.17.0.5 redis_master_port=6379" -k
SSH password:

PLAY *************************************************************

GATHERING FACTS ***************************************************************
ok:

TASK: ***********************
changed:

TASK: ******************
changed:

TASK: ******************************
ok:

TASK: *********
changed:

TASK: ********************
changed:

TASK: *********************
changed: => (item=redis-cli)
changed: => (item=redis-server)

TASK: *********************
failed: => {"changed": true, "cmd": "grep -c '/usr/bin/redis-server /data/redis-2.6.17/conf/redis_6379.conf' /etc/rc.local ", "delta": "0:00:00.006751", "end": "2014-08-13 09:49:07.569522", "item": "", "rc": 1, "start": "2014-08-13 09:49:07.562771"}
stdout: 0
...ignoring

TASK: ***********************
changed:

TASK: ******************
changed:

TASK: ****
changed:

PLAY RECAP ********************************************************************
172.17.0.6               : ok=11   changed=9    unreachable=0    failed=0   


real    1m48.579s
user    0m6.781s
sys 0m0.654s




11、查看redis slave安装情况

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
09:59:24 # ssh 172.17.0.6
root@172.17.0.6's password:
root@dfec766fbaa7:~
09:59:28 # ll
total 0
root@dfec766fbaa7:~
09:59:31 # ps -ef|grep redis
root       197   10 09:49 ?      00:00:00 /usr/bin/redis-server /data/redis-2.6.17/conf/redis_6379.conf
root       227   2120 09:59 pts/0    00:00:00 grep redis
09:59:49 # grep slave /data/redis-2.6.17/conf/redis_6379.conf |egrep -v "^#"
slaveof 172.17.0.5 6379
slave-serve-stale-data yes
slave-read-only yes
slave-priority 100
client-output-buffer-limit slave 256mb 64mb 60
root@dfec766fbaa7:~
10:00:09 # redis-cli -h 172.17.0.6 -p 6379
redis 172.17.0.6:6379> keys *
(empty list or set)
redis 172.17.0.6:6379> info
# Server
redis_version:2.6.17
redis_git_sha1:00000000
redis_git_dirty:0
redis_mode:standalone
os:Linux 2.6.32-431.17.1.el6.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
gcc_version:4.4.7
process_id:197
run_id:81207df2727abe534ae606afc0cb80016f75a422
tcp_port:6379
uptime_in_seconds:685
uptime_in_days:0
hz:10
lru_clock:280339

# Clients
connected_clients:2
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0

# Memory
used_memory:878072
used_memory_human:857.49K
used_memory_rss:7569408
used_memory_peak:877280
used_memory_peak_human:856.72K
used_memory_lua:31744
mem_fragmentation_ratio:8.62
mem_allocator:jemalloc-3.2.0

# Persistence
loading:0
rdb_changes_since_last_save:0
rdb_bgsave_in_progress:0
rdb_last_save_time:1407894548
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:-1
rdb_current_bgsave_time_sec:-1
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok

# Stats
total_connections_received:1
total_commands_processed:70
instantaneous_ops_per_sec:0
rejected_connections:0
expired_keys:0
evicted_keys:0
keyspace_hits:0
keyspace_misses:0
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:0

# Replication
role:slave
master_host:172.17.0.5
master_port:6379
master_link_status:up
master_last_io_seconds_ago:1
master_sync_in_progress:0
slave_priority:100
slave_read_only:1
connected_slaves:0

# CPU
used_cpu_sys:0.24
used_cpu_user:0.10
used_cpu_sys_children:0.00
used_cpu_user_children:0.00

# Keyspace




可以从上面的Replication里看到主从做好了,信息如下图

然后去redis master里查看主从信息

12、redis 主从测试
A.redis master插入key

1
2
3
4
5
6
7
8
redis 172.17.0.5:6379> set master 1
OK
redis 172.17.0.5:6379> set slave 0
OK
redis 172.17.0.5:6379> get master
"1"
redis 172.17.0.5:6379> get slave
"0"




B.redis slave读取key

1
2
3
4
5
6
7
redis 172.17.0.6:6379> keys *
1) "master"
2) "slave"
redis 172.17.0.6:6379> get master
"1"
redis 172.17.0.6:6379> get slave
"0"




可以看到主从建立完成
下面是redis slave的日志情况

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
10:08:04 # cat /data/redis-2.6.17/log/redis_6379.log
                _._                                                
         _.-``__ ''-._                                             
      _.-``    `.`_.''-._         Redis 2.6.17 (00000000/0) 64 bit
.-`` .-```.```\/    _.,_ ''-._                                 
(    '      ,       .-`| `,    )   Running in stand alone mode
|`-._`-...-` __...-.``-._|'` _.-'|   Port: 6379
|    `-._   `._    /   _.-'    |   PID: 197
`-._    `-._`-./_.-'    _.-'                                 
|`-._`-._    `-.__.-'    _.-'_.-'|                                 
|    `-._`-._      _.-'_.-'    |         http://redis.io      
`-._    `-._`-.__.-'_.-'    _.-'                                 
|`-._`-._    `-.__.-'    _.-'_.-'|                                 
|    `-._`-._      _.-'_.-'    |                                 
`-._    `-._`-.__.-'_.-'    _.-'                                 
      `-._    `-.__.-'    _.-'                                       
          `-._      _.-'                                          
            `-.__.-'                                             

13 Aug 09:49:08.878 # Server started, Redis version 2.6.17
13 Aug 09:49:08.879 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
13 Aug 09:49:08.879 * The server is now ready to accept connections on port 6379
13 Aug 09:49:09.879 * Connecting to MASTER 172.17.0.5:6379
13 Aug 09:49:09.879 * MASTER <-> SLAVE sync started
13 Aug 09:49:09.881 * Non blocking connect for SYNC fired the event.
13 Aug 09:49:09.881 * Master replied to PING, replication can continue...
13 Aug 09:49:10.035 * MASTER <-> SLAVE sync: receiving 18 bytes from master
13 Aug 09:49:10.035 * MASTER <-> SLAVE sync: Loading DB in memory
13 Aug 09:49:10.035 * MASTER <-> SLAVE sync: Finished with success
13 Aug 10:04:56.980 * 1 changes in 900 seconds. Saving...
13 Aug 10:04:56.982 * Background saving started by pid 233
13 Aug 10:04:57.226 * DB saved on disk
13 Aug 10:04:57.227 * RDB: 6 MB of memory used by copy-on-write
13 Aug 10:04:57.293 * Background saving terminated with success




13、删除redis安装
无论redis主从,删除都是一样的命令

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
09:57:32 # time ansible-playbook redis_delete.yml --extra-vars "host=172.17.0.5 user=root" -k
SSH password:

PLAY *************************************************************

GATHERING FACTS ***************************************************************
ok:

TASK: ********************
changed:

TASK: ****************
changed: => (item=redis-cli)
changed: => (item=redis-server)

TASK: **********************
changed:

TASK: *********************
changed:

PLAY RECAP ********************************************************************
172.17.0.5               : ok=5    changed=4    unreachable=0    failed=0   


real    0m6.929s
user    0m1.942s
sys 0m0.250s
root@ip-10-10-10-10:/etc/ansible
10:09:18 # time ansible-playbook redis_delete.yml --extra-vars "host=172.17.0.6 user=root" -k
SSH password:

PLAY *************************************************************

GATHERING FACTS ***************************************************************
ok:

TASK: ********************
changed:

TASK: ****************
changed: => (item=redis-cli)
changed: => (item=redis-server)

TASK: **********************
changed:

TASK: *********************
changed:

PLAY RECAP ********************************************************************
172.17.0.6               : ok=5    changed=4    unreachable=0    failed=0   


real    0m5.897s
user    0m1.726s
sys 0m0.258s




15、删除后测试
A.redis master上


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
10:09:55 # ifconfig
eth0      Link encap:EthernetHWaddr C6:3A:D2:D9:DD:D9
          inet addr:172.17.0.5Bcast:0.0.0.0Mask:255.255.0.0
          inet6 addr: fe80::c43a:d2ff:fed9:ddd9/64 Scope:Link
          UP BROADCAST RUNNINGMTU:1500Metric:1
          RX packets:13236 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12843 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:26106313 (24.8 MiB)TX bytes:906412 (885.1 KiB)

lo      Link encap:Local Loopback
          inet addr:127.0.0.1Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNINGMTU:16436Metric:1
          RX packets:196 errors:0 dropped:0 overruns:0 frame:0
          TX packets:196 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:9665 (9.4 KiB)TX bytes:9665 (9.4 KiB)

root@06762530db8c:~
10:09:56 # ps -ef|grep redis
root       431   3290 10:09 pts/0    00:00:00 grep redis
root@06762530db8c:~
10:09:59 # cat /etc/rc.local
#!/bin/sh
#
# This script will be executed *after* all the other init scripts.
# You can put your own initialization stuff in here if you don't
# want to do the full Sys V style init stuff.

touch /var/lock/subsys/local
root@06762530db8c:~
10:10:01 # ll /data/
total 4
drwxr-xr-x 2 root root 4096 Jun5 10:21 soft
root@06762530db8c:~




B. redis slave上

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
10:08:09 # ifconfig
eth0      Link encap:EthernetHWaddr BE:97:0C:B2:02:D9
          inet addr:172.17.0.6Bcast:0.0.0.0Mask:255.255.0.0
          inet6 addr: fe80::bc97:cff:feb2:2d9/64 Scope:Link
          UP BROADCAST RUNNINGMTU:1500Metric:1
          RX packets:13062 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12704 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:25967216 (24.7 MiB)TX bytes:842881 (823.1 KiB)

lo      Link encap:Local Loopback
          inet addr:127.0.0.1Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNINGMTU:16436Metric:1
          RX packets:86 errors:0 dropped:0 overruns:0 frame:0
          TX packets:86 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:5288 (5.1 KiB)TX bytes:5288 (5.1 KiB)

root@dfec766fbaa7:~
10:10:32 # ps -ef|grep redis
root       319   2120 10:10 pts/0    00:00:00 grep redis
root@dfec766fbaa7:~
10:10:37 # cat /etc/rc.local
#!/bin/sh
#
# This script will be executed *after* all the other init scripts.
# You can put your own initialization stuff in here if you don't
# want to do the full Sys V style init stuff.

touch /var/lock/subsys/local
root@dfec766fbaa7:~
10:10:39 # ll /data/
total 4
drwxr-xr-x 2 root root 4096 Jun5 10:21 soft
root@dfec766fbaa7:~




如果大家想使用我的例子,可以从github里下载(地址是https://github.com/dl528888/ansi ... aster/redis_install),然后放到/etc/ansible目录里,下面是内容


页: [1]
查看完整版本: 运维自动化之ansible playbook结合docker安装redis主从