一、名词解释
Corosync：它属于OpenAIS(开放式应用接口规范)中的一个项目corosync一版本中本身不具 备投票功能，到了corosync 2.0之后引入了votequorum子系统也具备了投票功能了，如果我们用的是1版本的，又需要用到票数做决策时那该如何是好呢；当然，在红帽上把 cman + corosync结合起来用，但是早期cman跟pacemaker没法结合起来，如果想用pacemaker又想用投票功能的话，那就把cman当成 corosync的插件来用，把cman当成corodync的投票功能，当然，这里结合了两个了Messaging Lader；Corosync目前有两个主流的版本：一个是2系列的，另一个是1系列的稳定版；2版本和1版本差别很大，1版本不具有投票功能，2版本之 后引入了votequorum后支持投票功能了；OpenAIS自从诞生之后，红帽就基于这个规范研发了一个高可用集群的解决方案叫cman，并为cman提供了rgmangaer作为资源管理器，并且容合conga全生命周期的管理接口形成了RHCS；
Conrosync是从OpenAIS这个大项目中分支出来的一个项目，而Pacemaker是heartbeat v3版本中分裂出来专门用于提供高可用集群CRM的组件，功能十分强大， Coreosync在传递信息的时候可以通过一个简单的配置文件来定义信息传递的方式和协议等，Corosync可以提供一个完整的HA功 能，Corosync是未来的发展方向，在以后的新项目里，一般采用Corosync，而heartbeat_gui可以提供很好的HA管理功能，可以实 现图形化的管理。
Pacemaker是一个集群管理器。它利用首选集群基础设施（OpenAIS 或heartbeat）提供的消息和成员能力，由辅助节点和系统进行故障检测和回收，实现性群集服务（亦称资源）的高可用性。
DRBD：DRBD (Distributed Replicated Block Device) 是 Linux 平台上的分散式储存系统。其中包含了核心模组，数个使用者空间管理程式及 shell scripts，通常用于高可用性（high availability, HA）丛集。DRBD 类似磁盘阵列的RAID 1（镜像），只不过 RAID 1 是在同一台电脑内，而 DRBD 是透过网络。
二、环境准备
(由于实验的时候，在最后资源定义的时候出了点错，导致测试机全部重新系统了，博文有些地方可能文字记录和截图有不符的地方，请以文字或者代码记录为准)
1、操作系统 & IP
CentOS 6.6 x86_64
node1 172.16.6.100 Legion100.dwhd.org
node2 172.16.6.101 Legion101.dwhd.org
vip 172.16.7.200
2、软件版本
corosync-1.4.7-1.el6.x86_64
crmsh-2.1-1.6.x86_64
pacemaker-1.1.12+git20140723.483f48a-1.1.x86_64
drbd84-utils-8.9.2-1.el6.elrepo.x86_64
kmod-drbd84-8.4.6-1.el6.elrepo.x86_64
mariadb-10.0.19
3、配置node1 node2时间同步、ssh互相、主机名互解
[root@Legion100 ~]# echo "172.16.6.100 Legion100.dwhd.org Legion100 node1" >> /etc/hosts [root@Legion100 ~]# echo "172.16.6.101 Legion101.dwhd.org Legion101 node2" >> /etc/hosts [root@Legion100 ~]# echo "*/5 * * * * /usr/sbin/ntpdate pool.ntp.org >/dev/null 2>&1" >> /var/spool/cron/root [root@Legion100 ~]# ssh-keygen -t rsa -f ~/.ssh/id_rsa -P '' Generating public/private rsa key pair. Your identification has been saved in /root/.ssh/id_rsa. Your public key has been saved in /root/.ssh/id_rsa.pub. The key fingerprint is: 4f:b8:f6:ab:5b:17:d0:61:f2:09:a9:0a:f1:d7:39:84 root@Legion100.dwhd.org The key's randomart image is: +--[ RSA 2048]----+ | .o.o | | . E o* o | | o +..+ | | . . o.+. | | . oS ... | | . + . | | o o . | | . o . | | ooo. | +-----------------+ [root@Legion100 ~]# ssh-copy-id -i ~/.ssh/id_rsa.pub root@Legion101.dwhd.org The authenticity of host 'Legion101.dwhd.org (172.16.6.101)' can't be established. RSA key fingerprint is e9:95:aa:7f:39:5b:52:a7:9b:5e:fe:98:19:82:14:e3. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'Legion101.dwhd.org,172.16.6.101' (RSA) to the list of known hosts. root@Legion101.dwhd.org's password: Now try logging into the machine, with "ssh 'root@Legion101.dwhd.org'", and check in: .ssh/authorized_keys to make sure we haven't added extra keys that you weren't expecting. [root@Legion100 ~]#
[root@Legion101 ~]# echo "172.16.6.101 Legion101.dwhd.org Legion101 node2" >> /etc/hosts [root@Legion101 ~]# echo "172.16.6.100 Legion100.dwhd.org Legion100 node1" >> /etc/hosts [root@Legion101 ~]# echo "*/5 * * * * /usr/sbin/ntpdate pool.ntp.org >/dev/null 2>&1" >> /var/spool/cron/root [root@Legion101 ~]# ssh-keygen -t rsa -f ~/.ssh/id_rsa -P '' Generating public/private rsa key pair. Your identification has been saved in /root/.ssh/id_rsa. Your public key has been saved in /root/.ssh/id_rsa.pub. The key fingerprint is: c0:51:c6:23:c9:ed:04:d9:58:22:47:f0:1b:19:af:cd root@Legion101.dwhd.org The key's randomart image is: +--[ RSA 2048]----+ | o+B@+ | | =*B* | | *+.. | | B. | | o E | | | | | | | | | +-----------------+ [root@Legion101 ~]# ssh-copy-id -i ~/.ssh/id_rsa.pub root@Legion100.dwhd.org The authenticity of host 'Legion100.dwhd.org (172.16.6.100)' can't be established. RSA key fingerprint is 90:26:f4:28:31:04:03:6c:9f:ec:e4:09:04:32:92:ee. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'Legion100.dwhd.org,172.16.6.100' (RSA) to the list of known hosts. root@Legion100.dwhd.org's password: Now try logging into the machine, with "ssh 'root@Legion100.dwhd.org'", and check in: .ssh/authorized_keys to make sure we haven't added extra keys that you weren't expecting. [root@Legion101 ~]#
三、高可用环境搭建
1、Corosync 安装与配置
1)、node1
[root@Legion100 ~]# yum install corosync pacemaker python-dateutil python-lxml pssh -y
[root@Legion100 ~]# cd /etc/corosync/
[root@Legion100 /etc/corosync]# ls
corosync.conf.example corosync.conf.example.udpu service.d uidgid.d
[root@Legion100 /etc/corosync]# cp -a corosync.conf.example corosync.conf
[root@Legion100 /etc/corosync]# grep -Ev '^(\s+)?#|^$' corosync.conf #参考配置
compatibility: whitetank
totem {
version: 2
secauth: on
threads: 0
interface {
ringnumber: 0
bindnetaddr: 172.16.0.0
mcastaddr: 225.172.16.6
mcastport: 5405
ttl: 1
}
}
logging {
fileline: off
to_stderr: no
to_logfile: yes
logfile: /var/log/cluster/corosync.log
to_syslog: no
debug: off
timestamp: on
logger_subsys {
subsys: AMF
debug: off
}
}
amf {
mode: disabled
}
service {
ver: 0
name: pacemaker
}
aisexec {
user: root
group: root
}
[root@Legion100 /etc/corosync]# corosync-keygen #生成密匙文件
Corosync Cluster Engine Authentication key generator.
Gathering 1024 bits for key from /dev/random.
Press keys on your keyboard to generate entropy.
Writing corosync key to /etc/corosync/authkey.
[root@Legion100 /etc/corosync]# ls -l /etc/corosync/
总用量 24
-r-------- 1 root root 128 5月 30 01:43 authkey
-rw-r--r-- 1 root root 2869 5月 30 01:42 corosync.conf
-rw-r--r-- 1 root root 2663 10月 15 2014 corosync.conf.example
-rw-r--r-- 1 root root 1073 10月 15 2014 corosync.conf.example.udpu
drwxr-xr-x 2 root root 4096 10月 15 2014 service.d
drwxr-xr-x 2 root root 4096 10月 15 2014 uidgid.d
[root@Legion100 /etc/corosync]# file /etc/corosync/authkey
/etc/corosync/authkey: data
[root@Legion100 /etc/corosync]#
2)、node2
[root@Legion101 ~]# yum install corosync pacemaker python-dateutil python-lxml pssh -y
[root@Legion101 ~]# scp Legion100:/etc/corosync/{corosync.conf,authkey} /etc/corosync/
The authenticity of host 'Legion100 (172.16.6.100)' can't be established.
RSA key fingerprint is fd:ed:c3:bf:ed:3a:62:d3:73:18:9c:b6:3b:b8:37:f4.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'Legion100' (RSA) to the list of known hosts.
corosync.conf 100% 702 0.7KB/s 00:00
authkey 100% 128 0.1KB/s 00:00
[root@Legion101 ~]#
2、安装crmsh
crmsh下载地址：
http://download.opensuse.org/repositories/network:/ha-clustering:/Stable/ 请用自己对应的版本
1)、node1
[root@Legion100 ~]# wget http://www.dwhd.org/wp-content/uploads/2015/05/crmsh-2.1-1.6.x86_64.rpm
[root@Legion100 ~]# yum install crmsh-2.1-1.6.x86_64.rpm
[root@Legion100 ~]# crm
crm(live)# help
^OHelp overview for crmsh
^O
Available topics:
Overview^O Available help topics and commands
Topics^O Available help topics
Description^O Program description
CommandLine^O Command line options
Introduction^O User interface
Introcution^O Tab completion
Features^O Syntax: Attribute references
Reference^O Command reference
Available commands:
cd^O Navigate the level structure
help^O Show help (help topics for list of topics)
ls^O List levels and commands
quit^O Exit the interactive shell
report^O Create cluster status report
status^O Cluster status
up^O Go back to previous level
cib^O/ CIB shadow management
commit^O Copy a shadow CIB to the cluster
delete^O Delete a shadow CIB
diff^O Diff between the shadow CIB and the live CIB
import^O Import a CIB or PE input file to a shadow
crm(live)# quit
bye
[root@Legion100 ~]#
2)、node2
[root@Legion101 ~]# cd
[root@Legion101 ~]# wget http://www.dwhd.org/wp-content/uploads/2015/05/crmsh-2.1-1.6.x86_64.rpm
[root@Legion101 ~]# yum install crmsh-2.1-1.6.x86_64.rpm
[root@Legion101 ~]# crm
crm(live)# help
^OHelp overview for crmsh
^O
Available topics:
Overview^O Available help topics and commands
Topics^O Available help topics
Description^O Program description
CommandLine^O Command line options
Introduction^O User interface
Introcution^O Tab completion
Features^O Syntax: Attribute references
Reference^O Command reference
Available commands:
cd^O Navigate the level structure
help^O Show help (help topics for list of topics)
ls^O List levels and commands
quit^O Exit the interactive shell
report^O Create cluster status report
status^O Cluster status
up^O Go back to previous level
cib^O/ CIB shadow management
commit^O Copy a shadow CIB to the cluster
delete^O Delete a shadow CIB
diff^O Diff between the shadow CIB and the live CIB
crm(live)# quit
bye
[root@Legion101 ~]#
3、启动corosync
（注，在配置corosync时，将pacemaker整合进corosync中，corosync启动的同时也会启动pacemaker）
[root@Legion100 ~]# service corosync start Starting Corosync Cluster Engine (corosync): [确定] [root@Legion100 ~]# ssh 172.16.6.101 "service corosync start" Starting Corosync Cluster Engine (corosync): [确定] [root@Legion100 ~]#
4、查看启动信息
1)、查看corosync引擎是否正常启动
[root@Legion100 ~]# grep -E "Corosync Cluster Engine|configuration file" /var/log/cluster/corosync.log
May 30 02:43:22 corosync [MAIN ] Corosync Cluster Engine ('1.4.7'): started and ready to provide service.
May 30 02:43:22 corosync [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'.
[root@Legion100 ~]# ssh root@172.16.6.101 "grep -E 'Corosync Cluster Engine|configuration file' /var/log/cluster/corosync.log"
May 30 02:43:44 corosync [MAIN ] Corosync Cluster Engine ('1.4.7'): started and ready to provide service.
May 30 02:43:44 corosync [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'.
[root@Legion100 ~]#
2)、查看初始化成员节点通知是否正常发出
[root@Legion100 ~]# grep 'TOTEM' /var/log/cluster/corosync.log May 30 02:43:22 corosync [TOTEM ] Initializing transport (UDP/IP Multicast). May 30 02:43:22 corosync [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0). May 30 02:43:22 corosync [TOTEM ] The network interface [172.16.6.100] is now up. May 30 02:43:22 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed. May 30 02:43:44 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed. [root@Legion100 ~]# ssh root@172.16.6.101 "grep 'TOTEM' /var/log/cluster/corosync.log" May 30 02:43:44 corosync [TOTEM ] Initializing transport (UDP/IP Multicast). May 30 02:43:44 corosync [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0). May 30 02:43:44 corosync [TOTEM ] The network interface [172.16.6.101] is now up. May 30 02:43:44 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed. May 30 02:43:44 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed. [root@Legion100 ~]#
3)、检查启动过程中是否有错误产生
[root@Legion100 ~]# grep 'ERROR:' /var/log/cluster/corosync.log [root@Legion100 ~]# ssh root@172.16.6.101 "grep 'ERROR:' /var/log/cluster/corosync.log"
4)、查看pacemaker是否正常启动
[root@Legion100 ~]# grep 'pcmk_startup' /var/log/cluster/corosync.log May 30 02:43:22 corosync [pcmk ] info: pcmk_startup: CRM: Initialized May 30 02:43:22 corosync [pcmk ] Logging: Initialized pcmk_startup May 30 02:43:22 corosync [pcmk ] info: pcmk_startup: Maximum core file size is: 18446744073709551615 May 30 02:43:22 corosync [pcmk ] info: pcmk_startup: Service: 9 May 30 02:43:22 corosync [pcmk ] info: pcmk_startup: Local hostname: Legion100.dwhd.org [root@Legion100 ~]# ssh root@172.16.6.101 "grep 'pcmk_startup' /var/log/cluster/corosync.log" May 30 02:43:44 corosync [pcmk ] info: pcmk_startup: CRM: Initialized May 30 02:43:44 corosync [pcmk ] Logging: Initialized pcmk_startup May 30 02:43:44 corosync [pcmk ] info: pcmk_startup: Maximum core file size is: 18446744073709551615 May 30 02:43:44 corosync [pcmk ] info: pcmk_startup: Service: 9 May 30 02:43:44 corosync [pcmk ] info: pcmk_startup: Local hostname: Legion101.dwhd.org [root@Legion100 ~]#
5、查看集群状态
[root@Legion100 ~]# crm status Last updated: Sat May 30 03:00:41 2015 Last change: Sat May 30 02:44:06 2015 Stack: classic openais (with plugin) Current DC: Legion100.dwhd.org - partition with quorum Version: 1.1.12-1.1.12+git20140723.483f48a 2 Nodes configured, 2 expected votes 0 Resources configured Online: [ Legion100.dwhd.org Legion101.dwhd.org ] [root@Legion100 ~]#
四、DRBD 安装与配置
1安装DRBD
1)、node1
[root@Legion100 ~]# rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org [root@Legion100 ~]# rpm -Uvh http://www.elrepo.org/elrepo-release-6-6.el6.elrepo.noarch.rpm [root@Legion100 ~]# yum install drbd84 kmod-drbd84 -y [root@Legion100 ~]# chkconfig --add drbd [root@Legion100 ~]# chkconfig drbd on [root@Legion100 ~]# chkconfig --list drbd drbd 0:关闭 1:关闭 2:启用 3:启用 4:启用 5:启用 6:关闭 [root@Legion100 ~]#
2)、node2
[root@Legion101 ~]# rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org [root@Legion101 ~]# rpm -Uvh http://www.elrepo.org/elrepo-release-6-6.el6.elrepo.noarch.rpm [root@Legion101 ~]# yum install drbd84 kmod-drbd84 -y [root@Legion101 ~]# chkconfig drbd on [root@Legion101 ~]# chkconfig --list drbd drbd 0:关闭 1:关闭 2:启用 3:启用 4:启用 5:启用 6:关闭 [root@Legion101 ~]#
2、配置DRBD
[root@Legion101 /tmp]# cd /etc/drbd.d/
[root@Legion101 /etc/drbd.d]# grep -Ev '^(\s+)?#|^$' global_common.conf
global {
usage-count yes; #让linbit公司收集目前drbd的使用情况，yes为参加
}
common {
handlers {
pri-on-incon-degr "/usr/lib/drbd/notify-pri-on-incon-degr.sh; /usr/lib/drbd/notify-emergency-reboot.sh; echo b > /proc/sysrq-trigger ; reboot -f";
pri-lost-after-sb "/usr/lib/drbd/notify-pri-lost-after-sb.sh; /usr/lib/drbd/notify-emergency-reboot.sh; echo b > /proc/sysrq-trigger ; reboot -f";
local-io-error "/usr/lib/drbd/notify-io-error.sh; /usr/lib/drbd/notify-emergency-shutdown.sh; echo o > /proc/sysrq-trigger ; halt -f";
}
startup {
}
options {
}
disk {
on-io-error detach; #同步错误的做法是分离
}
net {
cram-hmac-alg "sha1"; #设置加密算法sha1
shared-secret "YzYxMDc1ZGYxYWU4"; #设置加密key
}
}
[root@Legion101 /etc/drbd.d]#
3、添加资源&同步配置
[root@Legion101 /etc/drbd.d]# cat mariadb.res
resource mariadb {
on Legion100.dwhd.org {
device /dev/drbd0;
disk /dev/sdb1;
address 172.16.6.100:7789;
meta-disk internal;
}
on Legion101.dwhd.org {
device /dev/drbd0;
disk /dev/sdb1;
address 172.16.6.101:7789;
meta-disk internal;
}
}
[root@Legion101 /etc/drbd/drbd.d]# scp global_common.conf mariadb.res node1:/etc/drbd.d/
global_common.conf 100% 2461 2.4KB/s 00:00
mariadb.res 100% 282 0.3KB/s 00:00
[root@Legion101 /etc/drbd/drbd.d]#
4、初始化node1和node2上的资源
[root@Legion100 /tmp/drbd-8.4.3/drbd]# drbdadm create-md mariadb
You want me to create a v08 style flexible-size internal meta data block.
There appears to be a v08 flexible-size internal meta data block
already in place on /dev/sdb at byte offset 64424505344
Do you really want to overwrite the existing v08 meta-data?
[need to type 'yes' to confirm] yes
Writing meta data...
md_offset 64424505344
al_offset 64424472576
bm_offset 64422506496
Found some data
==> This might destroy existing data! <==
Do you want to proceed?
[need to type 'yes' to confirm] yes
initializing activity log
NOT initializing bitmap
New drbd meta data block successfully created.
success
[root@Legion100 /tmp/drbd-8.4.3/drbd]# [/bash]
[bash][root@Legion101 /etc/drbd/drbd.d]# drbdadm create-md mariadb
You want me to create a v08 style flexible-size internal meta data block.
There appears to be a v08 flexible-size internal meta data block
already in place on /dev/sdb at byte offset 64424505344
Do you really want to overwrite the existing v08 meta-data?
[need to type 'yes' to confirm] yes
Writing meta data...
md_offset 64424505344
al_offset 64424472576
bm_offset 64422506496
Found some data
==> This might destroy existing data! <==
Do you want to proceed?
[need to type 'yes' to confirm] yes
initializing activity log
NOT initializing bitmap
New drbd meta data block successfully created.
success
[root@Legion101 /etc/drbd/drbd.d]# [/bash]
<a href="http://www.dwhd.org/wp-content/uploads/2015/05/Corosync20150530033354.png"><img class="alignnone size-full wp-image-712" src="http://www.dwhd.org/wp-content/uploads/2015/05/Corosync20150530033354.png" alt="Corosync20150530033354" width="796" height="501" /></a>
<a href="http://www.dwhd.org/wp-content/uploads/2015/05/Corosync20150530033424.png"><img class="alignnone size-full wp-image-713" src="http://www.dwhd.org/wp-content/uploads/2015/05/Corosync20150530033424.png" alt="Corosync20150530033424" width="826" height="503" /></a>
<span style="color: #0000ff;">5、启动DRBD</span>
[root@Legion100 /tmp/drbd-8.4.3/drbd]# /etc/init.d/drbd start
Starting DRBD resources: [
create res: mariadb
prepare disk: mariadb
adjust disk: mariadb
adjust net: mariadb
]
..........
***************************************************************
DRBD's startup script waits for the peer node(s) to appear.
- In case this node was already a degraded cluster before the
reboot the timeout is 0 seconds. [degr-wfc-timeout]
- If the peer was available before the reboot the timeout will
expire after 0 seconds. [wfc-timeout]
(These values are for resource 'mariadb'; 0 sec -> wait forever)
To abort waiting enter 'yes' [ 14]: yes
.
[root@Legion100 /tmp/drbd-8.4.3/drbd]#
[root@Legion101 /etc/drbd/drbd.d]# /etc/init.d/drbd start
Starting DRBD resources: [
create res: mariadb
prepare disk: mariadb
adjust disk: mariadb
adjust net: mariadb
]
.
[root@Legion101 /etc/drbd/drbd.d]#
6、查看drbd状态
[root@Legion100 ~]# drbd-overview 0:mariadb/0 Connected Secondary/Secondary Inconsistent/Inconsistent C r----- [root@Legion100 ~]# ssh root@172.16.6.101 "drbd-overview" 0:mariadb/0 Connected Secondary/Secondary Inconsistent/Inconsistent C r----- [root@Legion100 ~]#
7、设置node1为主节点
[root@Legion100 ~]# drbdadm -- --overwrite-data-of-peer primary mariadb
[root@Legion100 ~]# drbd-overview
0:mariadb/0 SyncSource Primary/Secondary UpToDate/Inconsistent C r-----
[>....................] sync'ed: 0.2% (61364/61436)M
[root@Legion100 ~]# ssh root@172.16.6.101 "drbd-overview"
0:mariadb/0 SyncTarget Secondary/Primary Inconsistent/UpToDate C r-----
[>....................] sync'ed: 0.4% (61212/61436)M
[root@Legion100 ~]# cat /proc/drbd
version: 8.4.3 (api:1/proto:86-101)
GIT-hash: 89a294209144b68adb3ee85a73221f964d3ee515 build by root@Legion100.dwhd.org, 2015-05-30 03:06:56
0: cs:SyncSource ro:Primary/Secondary ds:UpToDate/Inconsistent C r---n-
ns:1750940 nr:0 dw:0 dr:1754784 al:0 bm:106 lo:0 pe:2 ua:4 ap:0 ep:1 wo:f oos:61163612
[>....................] sync'ed: 2.8% (59728/61436)M
finish: 0:16:11 speed: 62,976 (54,656) K/sec
[root@Legion100 ~]# drbdadm role mariadb
Primary/Secondary
[root@Legion100 ~]#
8、格式化并挂载
当下图的进度跑完就可以了，切记
[root@Legion100 ~]# mke2fs -t ext4 -L drbdMariaDB /dev/drbd0 [root@Legion100 ~]# mkdir /data [root@Legion100 ~]# mount /dev/drbd0 /data/ [root@Legion100 ~]# mount /dev/mapper/vgzhongH-root on / type ext4 (rw,acl) proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) /dev/sda1 on /boot type ext4 (rw) /dev/mapper/vgzhongH-data on /data type ext4 (rw,acl) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) /dev/drbd0 on /data type ext4 (rw) [root@Legion100 ~]# df -hP Filesystem Size Used Avail Use% Mounted on /dev/mapper/vgzhongH-root 30G 3.4G 25G 13% / tmpfs 932M 37M 895M 4% /dev/shm /dev/sda1 477M 34M 418M 8% /boot /dev/mapper/vgzhongH-data 59G 52M 56G 1% /data /dev/drbd0 59G 52M 56G 1% /data [root@Legion100 ~]#
五、安装数据库MariaDB
1、node1
[root@Legion100 ~]# groupadd -g 1500 mysql && useradd -g mysql -u 1500 -s /sbin/nologin -M mysql
[root@Legion100 ~]# cd /tmp/ && wget http://www.dwhd.org/wp-content/uploads/2015/05/cmake-3.2.2.tar.gz
[root@Legion101 /tmp]# tar xf cmake-3.2.2.tar.gz
[root@Legion100 /tmp]# cd cmake-3.2.2
[root@Legion100 /tmp/cmake-3.2.2]# ./bootstrap
[root@Legion100 /tmp/cmake-3.2.2]# [ "$?" = "0" ] && make && make install && which cmake && cd ../
/usr/local/bin/cmake
[root@Legion100 /tmp]# wget "https://downloads.mariadb.org/interstitial/mariadb-10.0.19/source/mariadb-10.0.19.tar.gz/from/http%3A//mirrors.opencas.cn/mariadb" -O mariadb-10.0.19.tar.gz
[root@Legion100 /tmp]# tar xf mariadb-10.0.19.tar.gz
[root@Legion100 /tmp]# cd mariadb-10.0.19
[root@Legion100 /tmp/mariadb-10.0.19]# cmake . -DCMAKE_INSTALL_PREFIX=/usr/local/mysql \
-DMYSQL_DATADIR=/data/mysql \
-DWITH_SSL=system \
-DWITH_INNOBASE_STORAGE_ENGINE=1 \
-DWITH_ARCHIVE_STORAGE_ENGINE=1 \
-DWITH_BLACKHOLE_STORAGE_ENGINE=1 \
-DWITH_SPHINX_STORAGE_ENGINE=1 \
-DWITH_ARIA_STORAGE_ENGINE=1 \
-DWITH_XTRADB_STORAGE_ENGINE=1 \
-DWITH_PARTITION_STORAGE_ENGINE=1 \
-DWITH_FEDERATEDX_STORAGE_ENGINE=1 \
-DWITH_MYISAM_STORAGE_ENGINE=1 \
-DWITH_PERFSCHEMA_STORAGE_ENGINE=1 \
-DWITH_EXTRA_CHARSETS=all \
-DWITH_EMBEDDED_SERVER=1 \
-DWITH_READLINE=1 \
-DWITH_ZLIB=system \
-DWITH_LIBWRAP=0 \
-DEXTRA_CHARSETS=all \
-DENABLED_LOCAL_INFILE=1 \
-DMYSQL_UNIX_ADDR=/tmp/mysql.sock \
-DDEFAULT_CHARSET=utf8 \
-DDEFAULT_COLLATION=utf8_general_ci
[root@Legion100 /tmp/mariadb-10.0.19]# make -j $(awk '/processor/{i++}END{print i}' /proc/cpuinfo) && make install && echo $?
[root@Legion100 /tmp/mariadb-10.0.19]# cd /usr/local/mysql/
[root@Legion100 /usr/local/mysql]# echo "export PATH=/usr/local/mysql/bin:\$PATH" > /etc/profile.d/mariadb10.0.19.sh
[root@Legion100 /usr/local/mysql]# . /etc/profile.d/mariadb10.0.19.sh
[root@Legion100 /usr/local/mysql]# cp -a support-files/mysql.server /etc/rc.d/init.d/mysqld
[root@Legion100 /usr/local/mysql]# \cp support-files/my-large.cnf /etc/my.cnf
[root@Legion100 /usr/local/mysql]# sed -i '/query_cache_size/a datadir = /data/mysql' /etc/my.cnf
[root@Legion100 /usr/local/mysql]# mkdir -p /data/mysql
[root@Legion100 /usr/local/mysql]# chown -R mysql.mysql /data/mysql
[root@Legion100 /usr/local/mysql]# /usr/local/mysql/scripts/mysql_install_db --user=mysql --datadir=/data/mysql/ --basedir=/usr/local/mysql
[root@Legion100 /usr/local/mysql]# scp /etc/rc.d/init.d/mysqld 172.16.6.101:/etc/rc.d/init.d/mysqld
mysqld 100% 12KB 11.9KB/s 00:00
[root@Legion100 /usr/local/mysql]# scp /etc/my.cnf 172.16.6.101:/etc/
my.cnf 100% 4903 4.8KB/s 00:00
[root@Legion100 /usr/local/mysql]# scp /tmp/{cmake-3.2.2.tar.gz,mariadb-10.0.19.tar.gz} 172.16.6.101:/tmp
cmake-3.2.2.tar.gz 100% 6288KB 6.1MB/s 00:00
mariadb-10.0.19.tar.gz 100% 54MB 53.6MB/s 00:01
[root@Legion100 /usr/local/mysql]#
2、node2
[root@Legion101 /etc/drbd/drbd.d]# groupadd -g 1500 mysql && useradd -g mysql -u 1500 -s /sbin/nologin -M mysql
[root@Legion101 /etc/drbd/drbd.d]# cd /tmp/
[root@Legion101 /tmp]# tar xf cmake-3.2.2.tar.gz
[root@Legion101 /tmp]# cd cmake-3.2.2
[root@Legion101 /tmp/cmake-3.2.2]# ./bootstrap
[root@Legion101 /tmp/cmake-3.2.2]# [ "$?" = "0" ] && make && make install && which cmake && cd ../
[root@Legion101 /tmp]# tar xf mariadb-10.0.19.tar.gz
[root@Legion101 /tmp]# cd mariadb-10.0.19
[root@Legion101 /tmp/mariadb-10.0.19]# cmake . -DCMAKE_INSTALL_PREFIX=/usr/local/mysql \
-DMYSQL_DATADIR=/data/mysql \
-DWITH_SSL=system \
-DWITH_INNOBASE_STORAGE_ENGINE=1 \
-DWITH_ARCHIVE_STORAGE_ENGINE=1 \
-DWITH_BLACKHOLE_STORAGE_ENGINE=1 \
-DWITH_SPHINX_STORAGE_ENGINE=1 \
-DWITH_ARIA_STORAGE_ENGINE=1 \
-DWITH_XTRADB_STORAGE_ENGINE=1 \
-DWITH_PARTITION_STORAGE_ENGINE=1 \
-DWITH_FEDERATEDX_STORAGE_ENGINE=1 \
-DWITH_MYISAM_STORAGE_ENGINE=1 \
-DWITH_PERFSCHEMA_STORAGE_ENGINE=1 \
-DWITH_EXTRA_CHARSETS=all \
-DWITH_EMBEDDED_SERVER=1 \
-DWITH_READLINE=1 \
-DWITH_ZLIB=system \
-DWITH_LIBWRAP=0 \
-DEXTRA_CHARSETS=all \
-DENABLED_LOCAL_INFILE=1 \
-DMYSQL_UNIX_ADDR=/tmp/mysql.sock \
-DDEFAULT_CHARSET=utf8 \
-DDEFAULT_COLLATION=utf8_general_ci
[root@Legion101 /tmp/mariadb-10.0.19]# make -j $(awk '/processor/{i++}END{print i}' /proc/cpuinfo) && make install && echo $?
[root@Legion101 /usr/local/mysql]# echo "export PATH=/usr/local/mysql/bin:\$PATH" > /etc/profile.d/mariadb10.0.19.sh
[root@Legion101 /usr/local/mysql]# . /etc/profile.d/mariadb10.0.19.sh
3、确保node1和node2上mysql用户UID、GID一致
[root@Legion100 /usr/local/mysql]# id mysql uid=1500(mysql) gid=1500(mysql) 组=1500(mysql) [root@Legion100 /usr/local/mysql]#
[root@Legion101 /tmp/mariadb-10.0.19]# id mysql uid=1500(mysql) gid=1500(mysql) 组=1500(mysql) [root@Legion101 /tmp/mariadb-10.0.19]#
4、将node1的DRBD设置为主节点
[root@Legion100 /usr/local/mysql]# drbdadm primary mariadb
[root@Legion100 /usr/local/mysql]# drbd-overview
0:mariadb/0 Connected Primary/Secondary UpToDate/UpToDate C r----- /data ext4 59G 162M 56G 1%
[root@Legion100 /usr/local/mysql]# cat /proc/drbd
version: 8.4.3 (api:1/proto:86-101)
GIT-hash: 89a294209144b68adb3ee85a73221f964d3ee515 build by root@Legion100.dwhd.org, 2015-05-30 03:06:56
0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----
ns:64157908 nr:0 dw:1245304 dr:62914049 al:328 bm:3839 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0
[root@Legion100 /usr/local/mysql]#
5、启动并测试node1上的MariaDB
[root@Legion100 /usr/local/mysql]# /etc/init.d/mysqld start Starting MySQL. [确定] [root@Legion100 /usr/local/mysql]# mysql <<< "show databases;" Database information_schema mysql performance_schema test [root@Legion100 /usr/local/mysql]# [/bash] <span style="color: #0000ff;">6、关闭node1上的mysql且取消开机启动</span> [root@Legion100 /usr/local/mysql]# /etc/init.d/mysqld stop Shutting down MySQL... [确定] [root@Legion100 /usr/local/mysql]# chkconfig mysqld off [root@Legion100 /usr/local/mysql]# chkconfig --list mysqld mysqld 0:关闭 1:关闭 2:关闭 3:关闭 4:关闭 5:关闭 6:关闭 [root@Legion100 /usr/local/mysql]# umount /data/ [root@Legion100 /usr/local/mysql]#
7、将node1节点设置为从，node2节点上的DRBD设置为主节点并挂载
[root@Legion100 /usr/local/mysql]# drbdadm secondary mariadb [root@Legion100 /usr/local/mysql]# drbdadm role mariadb Secondary/Secondary [root@Legion100 /usr/local/mysql]#
[root@Legion101 /etc/drbd/drbd.d]# drbdadm primary mariadb [root@Legion101 /etc/drbd/drbd.d]# drbdadm role mariadb Primary/Secondary [root@Legion101 /etc/drbd/drbd.d]# mount /dev/drbd0 /data/ [root@Legion101 /etc/drbd/drbd.d]# mount /dev/mapper/vgzhongH-root on / type ext4 (rw,acl) proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) /dev/sda1 on /boot type ext4 (rw) /dev/mapper/vgzhongH-data on /data type ext4 (rw,acl) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) /dev/drbd0 on /data type ext4 (rw) [root@Legion101 /etc/drbd/drbd.d]# df -hP Filesystem Size Used Avail Use% Mounted on /dev/mapper/vgzhongH-root 30G 7.5G 21G 27% / tmpfs 932M 22M 910M 3% /dev/shm /dev/sda1 477M 34M 418M 8% /boot /dev/mapper/vgzhongH-data 59G 162M 56G 1% /data /dev/drbd0 59G 162M 56G 1% /data [root@Legion101 /etc/drbd/drbd.d]#
8、启动并测试node2上的MariaDB
[root@Legion101 /etc/drbd/drbd.d]# /etc/init.d/mysqld start Starting MySQL.. [确定] [root@Legion101 /etc/drbd/drbd.d]# mysql <<< "show databases;" Database information_schema mysql performance_schema test [root@Legion101 /etc/drbd/drbd.d]# [/bash] <span style="color: #0000ff;">9、关闭node2节点上的MariaDB且设置为开机不自动启动</span> [root@Legion101 /etc/drbd/drbd.d]# /etc/init.d/mysqld stop Shutting down MySQL... [确定] [root@Legion101 /etc/drbd/drbd.d]# chkconfig mysqld off [root@Legion101 /etc/drbd/drbd.d]# chkconfig --list mysqld mysqld 0:关闭 1:关闭 2:关闭 3:关闭 4:关闭 5:关闭 6:关闭 [root@Legion101 ~]# umount /data/ [root@Legion101 /etc/drbd/drbd.d]#
六、crmsh 资源管理
1、关闭drbd并设置开机不启动
[root@Legion100 ~]# /etc/init.d/drbd stop Stopping all DRBD resources: . [root@Legion100 ~]# chkconfig drbd off [root@Legion100 ~]# chkconfig --list drbd drbd 0:关闭 1:关闭 2:关闭 3:关闭 4:关闭 5:关闭 6:关闭 [root@Legion100 ~]# ssh root@172.16.6.101 "/etc/init.d/drbd stop" Stopping all DRBD resources: . [root@Legion100 ~]# ssh root@172.16.6.101 "chkconfig drbd off && chkconfig --list drbd" drbd 0:关闭 1:关闭 2:关闭 3:关闭 4:关闭 5:关闭 6:关闭 [root@Legion100 ~]#
2、增加drbd资源
[root@Legion100 ~]# crm
crm(live)# configure
crm(live)configure# property stonith-enabled=false
crm(live)configure# property no-quorum-policy=ignore
crm(live)configure# verify
crm(live)configure# commit
crm(live)configure# primitive mysqldrbd ocf:linbit:drbd params drbd_resource=web op start timeout=240 op stop timeout=100 op monitor role=Master interval=20 timeout=30 op monitor role=Slave interval=30 timeout=30
crm(live)configure# verify
crm(live)configure# ms ms_mysqldrbd mysqldrbd meta master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true
crm(live)configure# verify
crm(live)configure# show
node Legion100.dwhd.org
node Legion101.dwhd.org
primitive mysqldrbd ocf:linbit:drbd \
params drbd_resource=web \
op start timeout=240 interval=0 \
op stop timeout=100 interval=0 \
op monitor role=Master interval=20 timeout=30 \
op monitor role=Slave interval=30 timeout=30
ms ms_mysqldrbd mysqldrbd \
meta master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true
property cib-bootstrap-options: \
dc-version=1.1.11-97629de \
cluster-infrastructure="classic openais (with plugin)" \
expected-quorum-votes=2 \
stonith-enabled=false \
no-quorum-policy=ignore
crm(live)configure# commit
crm(live)configure# quit
bye
[root@Legion100 ~]# crm status
Last updated: Sun May 31 14:45:53 2015
Last change: Sun May 31 14:45:46 2015
Stack: classic openais (with plugin)
Current DC: Legion100.dwhd.org - partition with quorum
Version: 1.1.11-97629de
2 Nodes configured, 2 expected votes
2 Resources configured
Online: [ Legion100.dwhd.org Legion101.dwhd.org ]
Master/Slave Set: ms_mysqldrbd [mysqldrbd]
Masters: [ Legion101.dwhd.org ]
Slaves: [ Legion100.dwhd.org ]
[root@Legion100 ~]#
3、添加文件系统资源
[root@Legion100 ~]# crm configure
crm(live)configure# primitive mystore ocf:heartbeat:Filesystem params device=/dev/drbd0 directory=/data fstype=ext4 op start timeout=60 op stop timeout=60
crm(live)configure# verify
crm(live)configure# colocation mystore_with_ms_mysqldrbd inf: mystore ms_mysqldrbd:Master
crm(live)configure# order mystore_after_ms_mysqldrbd mandatory: ms_mysqldrbd:promote mystore:start
crm(live)configure# verify
crm(live)configure# commit
crm(live)configure# show
node Legion100.dwhd.org
node Legion101.dwhd.org
primitive mysqldrbd ocf:linbit:drbd \
params drbd_resource=web \
op start timeout=240 interval=0 \
op stop timeout=100 interval=0 \
op monitor role=Master interval=20 timeout=30 \
op monitor role=Slave interval=30 timeout=30
primitive mystore Filesystem \
params device="/dev/drbd0" directory="/data" fstype=ext4 \
op start timeout=60 interval=0 \
op stop timeout=60 interval=0
ms ms_mysqldrbd mysqldrbd \
meta master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true
colocation mystore_with_ms_mysqldrbd inf: mystore ms_mysqldrbd:Master
order mystore_after_ms_mysqldrbd Mandatory: ms_mysqldrbd:promote mystore:start
property cib-bootstrap-options: \
dc-version=1.1.11-97629de \
cluster-infrastructure="classic openais (with plugin)" \
expected-quorum-votes=2 \
stonith-enabled=false \
no-quorum-policy=ignore
crm(live)configure#
4、添加mysql资源
[root@Legion100 ~]# crm configure
crm(live)configure# primitive mysqld lsb:mysqld
crm(live)configure# colocation mysqld_with_mystore inf: mysqld mystore
crm(live)configure# verify
crm(live)configure# commit
crm(live)configure# quit
bye
[root@Legion100 ~]# crm status
Last updated: Sun May 31 14:53:44 2015
Last change: Sun May 31 14:53:39 2015
Stack: classic openais (with plugin)
Current DC: Legion100.dwhd.org - partition with quorum
Version: 1.1.11-97629de
2 Nodes configured, 2 expected votes
4 Resources configured
Online: [ Legion100.dwhd.org Legion101.dwhd.org ]
Master/Slave Set: ms_mysqldrbd [mysqldrbd]
Masters: [ Legion100.dwhd.org ]
Slaves: [ Legion101.dwhd.org ]
mystore (ocf::heartbeat:Filesystem): Started Legion100.dwhd.org
mysqld (lsb:mysqld): Started Legion100.dwhd.org
[root@Legion100 ~]# crm configure
crm(live)configure# order mysqld_after_mystore mandatory: mystore mysqld
crm(live)configure# verify
crm(live)configure# commit
crm(live)configure# show
node Legion100.dwhd.org
node Legion101.dwhd.org
primitive mysqld lsb:mysqld
primitive mysqldrbd ocf:linbit:drbd \
params drbd_resource=web \
op start timeout=240 interval=0 \
op stop timeout=100 interval=0 \
op monitor role=Master interval=20 timeout=30 \
op monitor role=Slave interval=30 timeout=30
primitive mystore Filesystem \
params device="/dev/drbd0" directory="/data" fstype=ext4 \
op start timeout=60 interval=0 \
op stop timeout=60 interval=0
ms ms_mysqldrbd mysqldrbd \
meta master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true
colocation mysqld_with_mystore inf: mysqld mystore
colocation mystore_with_ms_mysqldrbd inf: mystore ms_mysqldrbd:Master
order mysqld_after_mystore Mandatory: mystore mysqld
order mystore_after_ms_mysqldrbd Mandatory: ms_mysqldrbd:promote mystore:start
property cib-bootstrap-options: \
dc-version=1.1.11-97629de \
cluster-infrastructure="classic openais (with plugin)" \
expected-quorum-votes=2 \
stonith-enabled=false \
no-quorum-policy=ignore
crm(live)configure# quit
bye
[root@Legion100 ~]# crm status
Last updated: Sun May 31 14:54:47 2015
Last change: Sun May 31 14:54:22 2015
Stack: classic openais (with plugin)
Current DC: Legion100.dwhd.org - partition with quorum
Version: 1.1.11-97629de
2 Nodes configured, 2 expected votes
4 Resources configured
Online: [ Legion100.dwhd.org Legion101.dwhd.org ]
Master/Slave Set: ms_mysqldrbd [mysqldrbd]
Masters: [ Legion100.dwhd.org ]
Slaves: [ Legion101.dwhd.org ]
mystore (ocf::heartbeat:Filesystem): Started Legion100.dwhd.org
mysqld (lsb:mysqld): Started Legion100.dwhd.org
[root@Legion100 ~]#
5、添加vip资源
[root@Legion100 ~]# crm configure
crm(live)configure# primitive myvip ocf:heartbeat:IPaddr params ip="172.16.7.200" op monitor interval=20 timeout=20 on-fail=restart
crm(live)configure# verify
crm(live)configure# colocation vip_with_ms_mysqldrbd inf: ms_mysqldrbd:Master vip
crm(live)configure# verify
crm(live)configure# commit
crm(live)configure# show
node Legion100.dwhd.org
node Legion101.dwhd.org
primitive mysqld lsb:mysqld
primitive mysqldrbd ocf:linbit:drbd \
params drbd_resource=web \
op start timeout=240 interval=0 \
op stop timeout=100 interval=0 \
op monitor role=Master interval=20 timeout=30 \
op monitor role=Slave interval=30 timeout=30
primitive mystore Filesystem \
params device="/dev/drbd0" directory="/data" fstype=ext4 \
op start timeout=60 interval=0 \
op stop timeout=60 interval=0
primitive vip IPaddr \
params ip=172.16.7.200 \
op monitor interval=20 timeout=20 on-fail=restart
ms ms_mysqldrbd mysqldrbd \
meta master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true
colocation mysqld_with_mystore inf: mysqld mystore
colocation mystore_with_ms_mysqldrbd inf: mystore ms_mysqldrbd:Master
colocation vip_with_ms_mysqldrbd inf: ms_mysqldrbd:Master vip
order mysqld_after_mystore Mandatory: mystore mysqld
order mystore_after_ms_mysqldrbd Mandatory: ms_mysqldrbd:promote mystore:start
property cib-bootstrap-options: \
dc-version=1.1.11-97629de \
cluster-infrastructure="classic openais (with plugin)" \
expected-quorum-votes=2 \
stonith-enabled=false \
no-quorum-policy=ignore
crm(live)configure# quit
bye
[root@Legion100 ~]# crm status
Last updated: Sun May 31 15:16:36 2015
Last change: Sun May 31 15:16:30 2015
Stack: classic openais (with plugin)
Current DC: Legion100.dwhd.org - partition with quorum
Version: 1.1.11-97629de
2 Nodes configured, 2 expected votes
5 Resources configured
Online: [ Legion100.dwhd.org Legion101.dwhd.org ]
Master/Slave Set: ms_mysqldrbd [mysqldrbd]
Masters: [ Legion100.dwhd.org ]
Slaves: [ Legion101.dwhd.org ]
mystore (ocf::heartbeat:Filesystem): Started Legion100.dwhd.org
mysqld (lsb:mysqld): Started Legion100.dwhd.org
vip (ocf::heartbeat:IPaddr): Started Legion100.dwhd.org
[root@Legion100 ~]#
6、查看mysql启动 drbd挂载 vip的情况
[root@Legion100 ~]# netstat -tnlp | grep 3306
tcp 0 0 :::3306 :::* LISTEN 81037/mysqld
[root@Legion100 ~]# df -hP
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vgzhongH-root 30G 7.1G 21G 26% /
tmpfs 932M 37M 895M 4% /dev/shm
/dev/sda1 477M 34M 418M 8% /boot
/dev/drbd0 4.9G 120M 4.5G 3% /data
[root@Legion100 ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:0c:29:e6:29:99 brd ff:ff:ff:ff:ff:ff
inet 172.16.6.100/16 brd 172.16.255.255 scope global eth0
inet 172.16.7.200/16 brd 172.16.255.255 scope global secondary eth0
inet6 2001:470:24:9e2:20c:29ff:fee6:2999/64 scope global dynamic
valid_lft 7190sec preferred_lft 1790sec
inet6 fe80::20c:29ff:fee6:2999/64 scope link
valid_lft forever preferred_lft forever
3: pan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
link/ether 1a:54:78:d1:47:aa brd ff:ff:ff:ff:ff:ff
[root@Legion100 ~]#
7、添加mysql的授权且进行远程连接测试
[root@Legion100 ~]# mysql
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 6
Server version: 10.0.19-MariaDB-log Source distribution
Copyright (c) 2000, 2015, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]> grant all on *.* to root@"172.16.%.%" identified by "lookback";
Query OK, 0 rows affected (0.00 sec)
MariaDB [(none)]> flush privileges;
Query OK, 0 rows affected (0.00 sec)
MariaDB [(none)]> \q
Bye
[root@Legion100 ~]#
[root@Legion101 ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:0c:29:14:0f:ea brd ff:ff:ff:ff:ff:ff
inet 172.16.6.101/16 brd 172.16.255.255 scope global eth0
inet6 2001:470:24:9e2:20c:29ff:fe14:fea/64 scope global dynamic
valid_lft 6950sec preferred_lft 1550sec
inet6 fe80::20c:29ff:fe14:fea/64 scope link
valid_lft forever preferred_lft forever
3: pan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
link/ether f6:6d:0c:e5:58:d5 brd ff:ff:ff:ff:ff:ff
[root@Legion101 ~]# mysql -uroot -plookback -h172.16.7.200
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 7
Server version: 10.0.19-MariaDB-log Source distribution
Copyright (c) 2000, 2015, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| performance_schema |
| test |
+--------------------+
4 rows in set (0.08 sec)
MariaDB [(none)]> \q
Bye
[root@Legion101 ~]#
8、切换节点资源转移
[root@Legion100 ~]# crm status
Last updated: Sun May 31 15:27:52 2015
Last change: Sun May 31 15:27:49 2015
Stack: classic openais (with plugin)
Current DC: Legion100.dwhd.org - partition with quorum
Version: 1.1.11-97629de
2 Nodes configured, 2 expected votes
5 Resources configured
Online: [ Legion100.dwhd.org Legion101.dwhd.org ]
Master/Slave Set: ms_mysqldrbd [mysqldrbd]
Masters: [ Legion100.dwhd.org ] #开始主节点是node1
Slaves: [ Legion101.dwhd.org ]
mystore (ocf::heartbeat:Filesystem): Started Legion100.dwhd.org
mysqld (lsb:mysqld): Started Legion100.dwhd.org
vip (ocf::heartbeat:IPaddr): Started Legion100.dwhd.org
[root@Legion100 ~]# crm node standby Legion100.dwhd.org
[root@Legion100 ~]# crm status
Last updated: Sun May 31 15:28:50 2015
Last change: Sun May 31 15:28:03 2015
Stack: classic openais (with plugin)
Current DC: Legion100.dwhd.org - partition with quorum
Version: 1.1.11-97629de
2 Nodes configured, 2 expected votes
5 Resources configured
Node Legion100.dwhd.org: standby
Online: [ Legion101.dwhd.org ]
Master/Slave Set: ms_mysqldrbd [mysqldrbd]
Masters: [ Legion101.dwhd.org ] #此时主节点已经是node2了说明转移成功
Stopped: [ Legion100.dwhd.org ]
mystore (ocf::heartbeat:Filesystem): Started Legion101.dwhd.org
mysqld (lsb:mysqld): Started Legion101.dwhd.org
vip (ocf::heartbeat:IPaddr): Started Legion101.dwhd.org
[root@Legion100 ~]#
[root@Legion100 ~]# netstat -tnlp | grep 3306
[root@Legion100 ~]# df -hP
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vgzhongH-root 30G 7.1G 21G 26% /
tmpfs 932M 37M 895M 4% /dev/shm
/dev/sda1 477M 34M 418M 8% /boot
[root@Legion100 ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:0c:29:e6:29:99 brd ff:ff:ff:ff:ff:ff
inet 172.16.6.100/16 brd 172.16.255.255 scope global eth0
inet6 2001:470:24:9e2:20c:29ff:fee6:2999/64 scope global dynamic
valid_lft 7061sec preferred_lft 1661sec
inet6 fe80::20c:29ff:fee6:2999/64 scope link
valid_lft forever preferred_lft forever
3: pan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
link/ether 1a:54:78:d1:47:aa brd ff:ff:ff:ff:ff:ff
[root@Legion100 ~]#
[root@Legion101 ~]# netstat -tnlp | grep 3306
tcp 0 0 :::3306 :::* LISTEN 78683/mysqld
[root@Legion101 ~]# df -hP
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vgzhongH-root 30G 7.1G 21G 26% /
tmpfs 932M 22M 910M 3% /dev/shm
/dev/sda1 477M 34M 418M 8% /boot
/dev/drbd0 4.9G 120M 4.5G 3% /data
[root@Legion101 ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:0c:29:14:0f:ea brd ff:ff:ff:ff:ff:ff
inet 172.16.6.101/16 brd 172.16.255.255 scope global eth0
inet 172.16.7.200/16 brd 172.16.255.255 scope global secondary eth0
inet6 2001:470:24:9e2:20c:29ff:fe14:fea/64 scope global dynamic
valid_lft 7012sec preferred_lft 1612sec
inet6 fe80::20c:29ff:fe14:fea/64 scope link
valid_lft forever preferred_lft forever
3: pan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
link/ether f6:6d:0c:e5:58:d5 brd ff:ff:ff:ff:ff:ff
[root@Legion101 ~]#
9、现在来测试down vip
[root@Legion101 ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:0c:29:14:0f:ea brd ff:ff:ff:ff:ff:ff
inet 172.16.6.101/16 brd 172.16.255.255 scope global eth0
inet 172.16.7.200/16 brd 172.16.255.255 scope global secondary eth0
inet6 2001:470:24:9e2:20c:29ff:fe14:fea/64 scope global dynamic
valid_lft 6880sec preferred_lft 1480sec
inet6 fe80::20c:29ff:fe14:fea/64 scope link
valid_lft forever preferred_lft forever
3: pan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
link/ether f6:6d:0c:e5:58:d5 brd ff:ff:ff:ff:ff:ff
[root@Legion101 ~]# ip addr del 172.16.7.200/16 dev eth0
[root@Legion101 ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:0c:29:14:0f:ea brd ff:ff:ff:ff:ff:ff
inet 172.16.6.101/16 brd 172.16.255.255 scope global eth0
inet6 2001:470:24:9e2:20c:29ff:fe14:fea/64 scope global dynamic
valid_lft 6797sec preferred_lft 1397sec
inet6 fe80::20c:29ff:fe14:fea/64 scope link
valid_lft forever preferred_lft forever
3: pan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
link/ether f6:6d:0c:e5:58:d5 brd ff:ff:ff:ff:ff:ff
[root@Legion101 ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:0c:29:14:0f:ea brd ff:ff:ff:ff:ff:ff
inet 172.16.6.101/16 brd 172.16.255.255 scope global eth0
inet 172.16.7.200/16 brd 172.16.255.255 scope global secondary eth0
inet6 2001:470:24:9e2:20c:29ff:fe14:fea/64 scope global dynamic
valid_lft 6793sec preferred_lft 1393sec
inet6 fe80::20c:29ff:fe14:fea/64 scope link
valid_lft forever preferred_lft forever
3: pan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
link/ether f6:6d:0c:e5:58:d5 brd ff:ff:ff:ff:ff:ff
[root@Legion101 ~]#
有次可见 vip也能重新启动
您可以选择一种方式赞助本站
支付宝扫一扫赞助
微信钱包扫描赞助
赏