转:11g R2 RAC: REBOOT-LESS FENCING WITH MISSING NETWORK HEARTBEAT
原文:http://oracleinaction.com/reboot-less-fencing-missing-nhb/In my earlier post, I had discussed about reboot-less node fencing , a new feature introduced since 11.2.0.2. In this post, I will demonstrate reboot-less node fencing when network heartbeat is lost.
– Check that clusterware version is 11.2.0.3
# crsctl query crs activeversion
Oracle Clusterware active version on the cluster is [11.2.0.3.0]
– check that both the nodes in the cluster are active
# olsnodes -s
host01Active
host02Active
– Find out pvt interconnect
# oifcfg getif
eth0192.9.201.0globalpublic
eth110.0.0.0globalcluster_interconnect
– Stop pvt interconnect on node2
# ifdown eth1
– Alert log of node2 –
– Note that instead of rebooting the node, CRSD resources are cleaned up
CRS-1612:Network communication with node host01 (1) missing for 50% of timeout interval.
..
Removal of this node from cluster in 6.640 seconds
2013-10-09 10:45:53.924
..
CRS-1609:This node is unable to communicate with other nodes in the cluster and is goingdown to preserve cluster integrity;
CRS-1656:The CSS daemon is terminating due to a fatal error; ..
CRS-1652:Starting clean up of CRSD resources.
2013-10-09 10:46:01.918
...
CRS-1654:Clean up of CRSD resources finished successfully.
2013-10-09 10:46:03.794
— Check that OHAS serviceis still up on host02
# crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
CRS-4534: Cannot communicate with Event Manager
– Check that resources cssd , crsd and HAIP are down on host02[
# crsctl stat res -t -init
——————————————————————————–
NAME TARGETSTATE SERVER STATE_DETAILS
——————————————————————————–
Cluster Resources
——————————————————————————–
ora.asm
1 ONLINEOFFLINE
ora.cluster_interconnect.haip
1 ONLINEOFFLINE
ora.crf
1 ONLINEONLINE host02
ora.crsd
1 ONLINEOFFLINE
ora.cssd
1 ONLINEOFFLINE STARTING
ora.cssdmonitor
1 ONLINEONLINE host02
ora.ctssd
1 ONLINEOFFLINE
ora.diskmon
1 OFFLINE OFFLINE
ora.drivers.acfs
1 ONLINEONLINE host02
ora.evmd
1 ONLINEINTERMEDIATE host02
ora.gipcd
1 ONLINEONLINE host02
ora.gpnpd
1 ONLINEONLINE host02
ora.mdnsd
1 ONLINEONLINE host02
-- Restart private interconnect on host02
# ifup eth1
- Alert log of host02
-- Note that as soon as private network is started, CSSD, CRSD and EVMD services start immediately and host02 joins the cluster
CRS-1713:CSSD daemon is started in clustered mode
2013-10-09 10:47:04.944
...
CRS-1601:CSSD Reconfiguration complete. Active nodes are host01 host02 .
2013-10-09 10:55:22.403
..
CRS-1012:The OCR service started on node host02.
2013-10-09 10:56:25.304
...
CRS-1401:EVMD started on node host02.
2013-10-09 10:56:41.996
...
CRS-1201:CRSD started on node host02.
2013-10-09 10:56:45.274
-- check that resources haip, cssd and crsd have started on host02
# crsctl stat res -t -init
--------------------------------------------------------------------------------
NAME TARGETSTATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINEONLINE host02 Started
ora.cluster_interconnect.haip
1 ONLINEONLINE host02
ora.crf
1 ONLINEONLINE host02
ora.crsd
1 ONLINEONLINE host02
ora.cssd
1 ONLINEONLINE host02
ora.cssdmonitor
1 ONLINEONLINE host02
ora.ctssd
1 ONLINEONLINE host02 OBSERVER
ora.diskmon
1 OFFLINE OFFLINE
ora.drivers.acfs
1 ONLINEONLINE host02
ora.evmd
1 ONLINEONLINE host02
ora.gipcd
1 ONLINEONLINE host02
ora.gpnpd
1 ONLINEONLINE host02
ora.mdnsd
1 ONLINEONLINE host02
-- Check that host02 has joined the cluster
# olsnodes -s
host01Active
host02Active
References:
http://ora-ssn.blogspot.in/2011/09/reboot-less-node-fencing-in-oracle.html
http://www.trivadis.com/uploads/tx_cabagdownloadarea/Trivadis_oracle_clusterware_node_fencing_v.pdf
http://www.vmcd.org/2012/03/11gr2-rac-rebootless-node-fencing/
---------------------------------------------------------------------------------------------
Related Links:
Home
11g R2 RAC Index
11g R2 RAC:Node Eviction Due To CSSDagent Stopping
11g R2 RAC : Node Eviction Due To Member Kill Escalation
11g R2 RAC: Node Eviction Due To Missing Disk Heartbeat 11g R2 RAC: Node Eviction Due To Missing Network Heartbeat
11g R2 RAC :Reboot-less Node Fencing
11g R2 RAC :Reboot-lessFencing With Missing Disk Heartbeat
页:
[1]