corosync+pacemaker实现高可用的MariaDB

21312190p

一、准备工作
承接上文：corosync+pacemaker使用crmsh构建高可用集群

二、MariaDB server配置（基于nfs）
nfs server准备

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96

1、在nfs server准备LVM存储空间 [iyunv@node3 ~]# fdisk /dev/sdb Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel Building a new DOS disklabel with disk identifier 0x61284c6a. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite) WARNING: DOS-compatible mode is deprecated. It's strongly recommended to          switch off the mode (command 'c') and change display units to          sectors (command 'u'). Command (m for help): n Command action    e   extended    p   primary partition (1-4) p Partition number (1-4): 3 First cylinder (1-1305, default 1): Using default value 1 Last cylinder, +cylinders or +size{K,M,G} (1-1305, default 1305): +10G Value out of range. Last cylinder, +cylinders or +size{K,M,G} (1-1305, default 1305): +5G Command (m for help): t Selected partition 3 Hex code (type L to list codes): 8e Changed system type of partition 3 to 8e (Linux LVM) Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. Syncing disks. [iyunv@node3 ~]# partx -a /dev/sdb [iyunv@node3 ~]# pvcreate /dev/sdb3   Physical volume "/dev/sdb3" successfully created [iyunv@node3 ~]# vgcreate myvg /dev/sdb3   Volume group "myvg" successfully created [iyunv@node3 ~]# lvcreate -L 5G -n mydata myvg   Logical volume "mydata" created. [iyunv@node3 ~]# mke2fs -t ext4 /dev/myvg/mydata mke2fs 1.41.12 (17-May-2010) Filesystem label= OS type: Linux Block size=4096 (log=2) Fragment size=4096 (log=2) Stride=0 blocks, Stripe width=0 blocks 327680 inodes, 1310720 blocks 65536 blocks (5.00%) reserved for the super user First data block=0 Maximum filesystem blocks=1342177280 40 block groups 32768 blocks per group, 32768 fragments per group 8192 inodes per group Superblock backups stored on blocks:     32768, 98304, 163840, 229376, 294912, 819200, 884736 Writing inode tables: done                            Creating journal (32768 blocks): done Writing superblocks and filesystem accounting information: done This filesystem will be automatically checked every 36 mounts or 180 days, whichever comes first.  Use tune2fs -c or -i to override. 2、开机自动挂载，并nfs导出 [iyunv@node3 ~]# mkdir  /mydata [iyunv@node3 ~]# vim /etc/fstab /dev/myvg/mydata        /mydata                 ext4    defaults        0 0 [iyunv@node3 ~]# mount -a [iyunv@node3 ~]# mount | grep /mydata /dev/mapper/myvg-mydata on /mydata type ext4 (rw) [iyunv@node3 ~]# vim /etc/exports /mydata         192.168.0.0/24(rw,no_root_squash) #共享给192.168.0.0/24网段，可读可写，允许root用户登录便于初始化，配置结束可取消root用户登录 3、导出nfs共享目录 #创建mysql用户，指明uid，gid。各节点的mysql用户uid，gid一致。 [iyunv@node3 ~]# groupadd -r -g 306 mysql [iyunv@node3 ~]# useradd -r -g 306 -u 306 mysql #创建共享目录，并修改属主属组。 [iyunv@node3 ~]# mkdir /mydata/data [iyunv@node3 ~]# chown -R mysql.mysql /mydata/data #导出nfs共享目录 [iyunv@node3 ~]# exportfs -arv exporting 192.168.0.0/24:/mydata [iyunv@node3 ~]# service nfs start

三、各节点准备mysql
node1

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74

创建mysql用户，uid和gid与nfs server的mysql用户保持一致 [iyunv@node1 ~]# groupadd -r -g 306 mysql [iyunv@node1 ~]# useradd -r -g 306 -u 306 mysql 安装mariadb [iyunv@node1 ~]# tar xf mariadb-5.5.46-linux-x86_64.tar.gz -C /usr/local/ [iyunv@node1 ~]# cd /usr/local [iyunv@node1 local]# ln -sv mariadb-5.5.46-linux-x86_64 mysql `mysql' -> `mariadb-5.5.46-linux-x86_64' [iyunv@node1 local]# cd mysql/ [iyunv@node1 mysql]# chown -R root.mysql ./* 挂载nfs文件系统 [iyunv@node1 mysql]# mount -t nfs 192.168.0.20:/mydata /mydata [iyunv@node1 mysql]# mount | grep /mydata 192.168.0.20:/mydata on /mydata type nfs (rw,vers=4,addr=192.168.0.20,clientaddr=192.168.0.15) 初始化mysql至nfs，此步骤只需一个节点操作即可，本文node1执行，那么node2就不需要执行 初始化操作后，可以将nfs server的共享选项中的no_root_squash移除了 [iyunv@node1 mysql]# ./scripts/mysql_install_db --datadir=/mydata/data/ --user=mysql nfs server端查看 [iyunv@node3 ~]# cd /mydata/data [iyunv@node3 data]# ll total 32 -rw-rw---- 1 mysql mysql 16384 Nov 21 20:32 aria_log.00000001 -rw-rw---- 1 mysql mysql    52 Nov 21 20:32 aria_log_control drwx------ 2 mysql root   4096 Nov 21 20:32 mysql drwx------ 2 mysql mysql  4096 Nov 21 20:32 performance_schema drwx------ 2 mysql root   4096 Nov 21 20:32 test node1节点配置mysql [iyunv@node1 mysql]# mkdir /etc/mysql [iyunv@node1 mysql]# cp support-files/my-large.cnf /etc/mysql/my.cnf [iyunv@node1 mysql]# vim /etc/mysql/my.cnf datadir = /mydata/data innodb_file_per_table = on skip_name_resolve = on 为mysql提供服务脚本，并禁止其开机启动 [iyunv@node1 mysql]# cp support-files/mysql.server /etc/rc.d/init.d/mysqld [iyunv@node1 mysql]# chkconfig --add mysqld [iyunv@node1 mysql]# chkconfig mysqld off 启动mysql，创建mydb数据库 [iyunv@node1 mysql]# service mysqld start Starting MySQL..... SUCCESS! [iyunv@node1 mysql]# vim /root/.bashrc PATH=/usr/local/mysql/bin:$PATH export PATH [iyunv@node1 mysql]# source /root/.bashrc [iyunv@node1 mysql]# mysql Welcome to the MariaDB monitor.  Commands end with ; or \g. Your MariaDB connection id is 2 Server version: 5.5.46-MariaDB-log MariaDB Server Copyright (c) 2000, 2015, Oracle, MariaDB Corporation Ab and others. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. MariaDB [(none)]> create database mydb; Query OK, 1 row affected (0.16 sec) MariaDB [(none)]> flush privileges; Query OK, 0 rows affected (0.03 sec) MariaDB [(none)]> exit Bye [iyunv@node1 mysql]# service mysqld stop Shutting down MySQL.. SUCCESS! 卸载共享目录 [iyunv@node1 mysql]# umount /mydata

node2

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53

[iyunv@node2 ~]# groupadd -r -g 306 mysql [iyunv@node2 ~]# useradd -r -g 306 -u 306 mysql [iyunv@node2 ~]# tar xf mariadb-5.5.46-linux-x86_64.tar.gz -C /usr/local [iyunv@node2 ~]# cd /usr/local/ [iyunv@node2 local]# ln -sv mariadb-5.5.46-linux-x86_64 mysql `mysql' -> `mariadb-5.5.46-linux-x86_64' [iyunv@node2 local]# cd mysql/ [iyunv@node2 mysql]# chown  root.mysql ./* 将node1的配置文件复制给node2 [iyunv@node2 mysql]# mkdir /etc/mysql/ [iyunv@node1 mysql]# scp /etc/mysql/my.cnf node2:/etc/mysql/ 为node2节点准备服务脚本，并禁止开机启动 [iyunv@node2 mysql]# cp support-files/mysql.server /etc/rc.d/init.d/mysqld [iyunv@node2 mysql]# chkconfig --add mysqld [iyunv@node2 mysql]# chkconfig mysqld off 挂在共享文件系统，启动mysql [iyunv@node2 mysql]# mkdir /mydata [iyunv@node2 mysql]# mount -t nfs 192.168.0.20:/mydata /mydata [iyunv@node2 mysql]# service mysqld start Starting MySQL.. SUCCESS! [iyunv@node2 mysql]# vim /root/.bashrc PATH=/usr/local/mysql/bin:$PATH export PATH [iyunv@node2 mysql]# source /root/.bashrc MariaDB [(none)]> show databases; +--------------------+ | Database           | +--------------------+ | information_schema | | mydb               | | mysql              | | performance_schema | | test               | +--------------------+ 5 rows in set (0.02 sec) 授权远程访问 MariaDB [(none)]> grant all on *.* to 'root'@'192.168.%.%' identified by 'jymlinux'; Query OK, 0 rows affected (0.03 sec) MariaDB [(none)]> flush privileges; Query OK, 0 rows affected (0.01 sec) MariaDB [(none)]> exit Bye 停止mysql，并卸载共享目录 [iyunv@node2 mysql]# service mysqld stop Shutting down MySQL.. SUCCESS! [iyunv@node2 mysql]# umount /mydata

四、使用crmsh配置mariadb高可用

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18

[iyunv@node1 ~]# crm crm(live)# cd configure crm(live)configure# primitive myip ocf:heartbeat:IPaddr params ip=192.168.0.17 nic=eth0 cidr_netmask=24 op monitor interval=10s timeout=20s crm(live)configure# verify crm(live)configure# commit crm(live)configure# primitive mystore ocf:heartbeat:Filesystem params device=192.168.0.20:/mydata/data directory=/mydata fstype=nfs crm(live)configure# verify WARNING: mystore: default timeout 20s for start is smaller than the advised 60 WARNING: mystore: default timeout 20s for stop is smaller than the advised 60 crm(live)configure# commit WARNING: mystore: default timeout 20s for start is smaller than the advised 60 WARNING: mystore: default timeout 20s for stop is smaller than the advised 60 crm(live)configure# primitive myserver ocf:heartbeat:mysql params binary="/usr/local/mysql/bin/mysqld_safe" config="/etc/mysql/my.cnf" datadir="/mydata/data"  op start timeout=120s op stop timeout=120s op monitor interval=20s timeout=30s crm(live)configure# verify crm(live)configure# commit 定义组资源 crm(live)configure# group myservice myip mystore myserver