新闻详情

新闻详情

首页 / 资讯中心 / 详情

Oracle 11gR2 RAC OCR和votingdisk故障恢复案例

发布时间:2026/10/1 10:23:04来源:尧图网络
Oracle 11gR2 RAC OCR和votingdisk故障恢复案例
ASM磁盘组冗余的三种类型external、normal、high,这里恢复的是normal状态,模拟OCR磁盘或votedisk不可用时RAC会出现什么现象给出故障定位的整个过程。在11.2.0.3中表决盘是放到了ocr中所以 OCR磁盘或votedisk不可用的两个实验一起做。在11.2.0.3中可ASM磁盘组冗余的三种类型external、normal、high,这里恢复的是normal状态,模拟OCR磁盘或votedisk不可用时RAC会出现什么现象给出故障定位的整个过程。在11.2.0.3中表决盘是放到了ocr中所以OCR磁盘或votedisk不可用的两个实验一起做。在11.2.0.3中可以手动备份OCR但手动备份是无效的。ocrconfig -export /u01/ocr.exp检查OCR有哪些备份[rootrac1 ~]# ocrconfig -showbackuprac1 2013/07/22 05:39:51 /u01/grid/crs/cdata/rac/backup00.ocrrac1 2013/07/22 01:39:51 /u01/grid/crs/cdata/rac/backup01.ocrrac1 2013/07/21 21:39:50 /u01/grid/crs/cdata/rac/backup02.ocrrac2 2013/07/21 01:52:54 /u01/grid/crs/cdata/rac/day.ocrrac2 2013/07/09 01:52:25 /u01/grid/crs/cdata/rac/week.ocrPROT-25: Manual backups for the Oracle Cluster Registry are not available注意orcle明确给出了手动备份是无效的查看表决盘信息[rootrac1 ~]# crsctl query css votedisk## STATE File Universal Id File Name Disk group-- ----- ----------------- --------- ---------1. ONLINE 745716af7e5b4faebfc8d948d096aa55 (/dev/oracleasm/disks/OCR_VOT1) [OCR_VOT]2. ONLINE 7092079f66c04f9dbf65974d0dcc611a (/dev/oracleasm/disks/OCR_VOT2) [OCR_VOT]3. ONLINE 6510631353284f5fbf3d4c8839822dbd (/dev/oracleasm/disks/OCR_VOT3) [OCR_VOT]Located 3 voting disk(s).#停库[rootrac1 ~]# srvctl stop database -d orcl -o immediate#停集群[rootrac1 ~]# crsctl stop cluster -all -f#破坏OCR和VOT[rootrac1 ~]# dd if/dev/zero f/dev/mapper/mpathap1 bs1024K count1记录了10 的读入记录了10 的写出1048576字节(1.0 MB)已复制0.0160613 秒65.3 MB/秒[rootrac1 ~]# dd if/dev/zero f/dev/mapper/mpathap2 bs1024K count1记录了10 的读入记录了10 的写出1048576字节(1.0 MB)已复制0.00800275 秒131 MB/秒[rootrac1 ~]# dd if/dev/zero f/dev/mapper/mpathap3 bs1024K count1记录了10 的读入记录了10 的写出1048576字节(1.0 MB)已复制0.00927389 秒113 MB/秒注意破坏后各节点服务一切正常[rootrac1 ~]# crs_stat -tName Type Target State Host------------------------------------------------------------ora.DATA.dg ora....up.type ONLINE ONLINE rac1ora.FRA.dg ora....up.type ONLINE ONLINE rac1ora....ER.lsnr ora....er.type ONLINE ONLINE rac1ora....N1.lsnr ora....er.type ONLINE ONLINE rac1ora.OCR_VOT.dg ora....up.type ONLINE ONLINE rac1ora.asm ora.asm.type ONLINE ONLINE rac1ora.orcl.db ora....se.type ONLINE ONLINE rac1ora.cvu ora.cvu.type ONLINE ONLINE rac1ora....SM1.asm application ONLINE ONLINE rac1ora....C1.lsnr application ONLINE ONLINE rac1ora....ac1.gsd application OFFLINE OFFLINEora....ac1.ons application ONLINE ONLINE rac1ora....ac1.vip ora....t1.type ONLINE ONLINE rac1ora....SM2.asm application ONLINE ONLINE rac2ora....C2.lsnr application ONLINE ONLINE rac2ora....ac2.gsd application OFFLINE OFFLINEora....ac2.ons application ONLINE ONLINE rac2ora....ac2.vip ora....t1.type ONLINE ONLINE rac2ora.gsd ora.gsd.type OFFLINE OFFLINEora....network ora....rk.type ONLINE ONLINE rac1ora.oc4j ora.oc4j.type ONLINE ONLINE rac1ora.ons ora.ons.type ONLINE ONLINE rac1ora....ry.acfs ora....fs.type ONLINE ONLINE rac1ora.scan1.vip ora....ip.type ONLINE ONLINE rac1所有节点重启操作系统后集群服务启不来了[rootrac1 ~]# reboot如果只是停止集群服务后面的重新创建ASM磁盘组会失败但重启操作系统后就可以创建成功。检查CRS[gridrac1 ~]$ crsctl check crsCRS-4638: Oracle High Availability Services is onlineCRS-4535: Cannot communicate with Cluster Ready ServicesCRS-4530: Communications failure contacting Cluster Synchronization Services daemonCRS-4534: Cannot communicate with Event Manager启动集群服务[rootrac1 ~]# crsctl start cluster -allCRS-2672: 尝试启动 ora.cssdmonitor (在 rac1 上)CRS-2672: 尝试启动 ora.cssdmonitor (在 rac2 上)CRS-2676: 成功启动 ora.cssdmonitor (在 rac1 上)CRS-2676: 成功启动 ora.cssdmonitor (在 rac2 上)CRS-2672: 尝试启动 ora.cssd (在 rac1 上)CRS-2672: 尝试启动 ora.diskmon (在 rac1 上)CRS-2672: 尝试启动 ora.cssd (在 rac2 上)CRS-2672: 尝试启动 ora.diskmon (在 rac2 上)CRS-2676: 成功启动 ora.diskmon (在 rac1 上)CRS-2676: 成功启动 ora.diskmon (在 rac2 上)# 直停在这里其他终端使用其他命令启动集群服务[rootrac1 ~]# crsctl start crsCRS-4640: Oracle High Availability Services is already activeCRS-4000: Command Start failed, or completed with errors.操作系统及crs日志中没看到特别有用的信息[rootrac1 ~]# vi /var/log/messages[gridrac1 ~]# vi $ORACLE_HOME/log/rac1/crsd/crsd.logocss日志中提示vi $ORACLE_HOME/log/rac1/cssd/ocssd.log2013-07-21 21:15:08.550: [ CSSD][1095031104]clssnmvFindInitialConfigs: No voting files found发现部分ASM磁盘没有了[rootrac1 ~]# /etc/init.d/oracleasm scandisksScanning the system for Oracle ASMLib disks: [ OK ][rootrac1 ~]# /etc/init.d/oracleasm listdisksDATAFRA依照RAC安装文档重建ASM磁盘[rootrac1 ~]# /etc/init.d/oracleasm createdisk OCR_VOT1 /dev/mapper/mpathap1Marking disk OCR_VOT1 as an ASM disk: [ OK ][rootrac1 ~]# /etc/init.d/oracleasm createdisk OCR_VOT2 /dev/mapper/mpathap2Marking disk OCR_VOT2 as an ASM disk: [ OK ][rootrac1 ~]# /etc/init.d/oracleasm createdisk OCR_VOT3 /dev/mapper/mpathap3Marking disk OCR_VOT3 as an ASM disk: [ OK ]停掉集群服务要加-f否则可能停止非常慢[rootrac1 ~]# crsctl stop crs -fCRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on rac1CRS-2673: Attempting to stop ora.mdnsd on rac1CRS-2673: Attempting to stop ora.crf on rac1CRS-2677: Stop of ora.mdnsd on rac1 succeededCRS-2677: Stop of ora.crf on rac1 succeededCRS-2673: Attempting to stop ora.gipcd on rac1CRS-2677: Stop of ora.gipcd on rac1 succeededCRS-2673: Attempting to stop ora.gpnpd on rac1CRS-2677: Stop of ora.gpnpd on rac1 succeededCRS-2793: Shutdown of Oracle High Availability Services-managed resources on rac1 has completedCRS-4133: Oracle High Availability Services has been stopped.以-excl -nocrs 方式启动集群这将启动ASM实例 但不启动CRS[rootrac1 ~]# crsctl start crs -excl -nocrsCRS-4123: Oracle High Availability Services has been started.CRS-2672: Attempting to start ora.mdnsd on rac1CRS-2676: Start of ora.mdnsd on rac1 succeededCRS-2672: Attempting to start ora.gpnpd on rac1CRS-2676: Start of ora.gpnpd on rac1 succeededCRS-2672: Attempting to start ora.cssdmonitor on rac1CRS-2672: Attempting to start ora.gipcd on rac1CRS-2676: Start of ora.cssdmonitor on rac1 succeededCRS-2676: Start of ora.gipcd on rac1 succeededCRS-2672: Attempting to start ora.cssd on rac1CRS-2672: Attempting to start ora.diskmon on rac1CRS-2676: Start of ora.diskmon on rac1 succeededCRS-2676: Start of ora.cssd on rac1 succeededCRS-2672: Attempting to start ora.drivers.acfs on rac1CRS-2679: Attempting to clean ora.cluster_interconnect.haip on rac1CRS-2672: Attempting to start ora.ctssd on rac1CRS-2681: Clean of ora.cluster_interconnect.haip on rac1 succeededCRS-2672: Attempting to start ora.cluster_interconnect.haip on rac1CRS-2676: Start of ora.drivers.acfs on rac1 succeededCRS-2676: Start of ora.ctssd on rac1 succeededCRS-2676: Start of ora.cluster_interconnect.haip on rac1 succeededCRS-2672: Attempting to start ora.asm on rac1CRS-2676: Start of ora.asm on rac1 succeeded此时crs仍然报错[rootrac1 ~]# crs_stat -tCRS-0184: Cannot communicate with the CRS daemon.[rootrac1 ~]# crsctl check crsCRS-4638: Oracle High Availability Services is onlineCRS-4535: Cannot communicate with Cluster Ready ServicesCRS-4530: Communications failure contacting Cluster Synchronization Services daemonCRS-4534: Cannot communicate with Event Manager重建原ocr和votedisk所在磁盘组注意这里是在grid用户下SQL col path for a50SQL set lines 300SQL select path,header_status from v$asm_disk;SQL create diskgroup OCR_VOT normal redundancy disk /dev/oracleasm/disks/OCR_VOT1,/dev/oracleasm/disks/OCR_VOT2,/dev/oracleasm/disks/OCR_VOT3attribute compatible.rdbms 11.2,compatible.asm 11.2;ASM磁盘组冗余的三种类型external、normal、high我这里之前用的是normal。从ocr backup中恢复OCR在每个节点grid用户下cd $ORACLE_HOME/cdata/racocrconfig -restore /u01/grid/crs/cdata/rac/backup00.ocr恢复表决盘的准备工作show parameter asm_diskstring如果asm_diskstring没有值表示ASM磁盘用的是默认ASM磁盘搜索路径。修改成实际的ASM磁盘搜索路径alter system set asm_diskstring/dev/oracleasm/disks/*;恢复表决盘[rootrac1 ~]# crsctl replace votedisk OCR_VOTSuccessful addition of voting disk 4ad2b9cc0a754fffbf1515281199a78f.Successful addition of voting disk 9f8dc1c013df4f39bfd85c64051a0bc1.Successful addition of voting disk a4aea7a1aa434fb3bff161f6ea8ce102.Successfully replaced voting disk group with OCR_VOT.CRS-4266: Voting file(s) successfully replacedocr和vot恢复后crs等服务就会自动起来了。[rootrac1 ~]# crsctl check crsCRS-4638: Oracle High Availability Services is onlineCRS-4535: Cannot communicate with Cluster Ready ServicesCRS-4529: Cluster Synchronization Services is onlineCRS-4534: Cannot communicate with Event Manager[rootrac1 ~]# crsctl query css votedisk## STATE File Universal Id File Name Disk group-- ----- ----------------- --------- ---------1. ONLINE 4ad2b9cc0a754fffbf1515281199a78f (/dev/oracleasm/disks/OCR_VOT1) [OCR_VOT]2. ONLINE 9f8dc1c013df4f39bfd85c64051a0bc1 (/dev/oracleasm/disks/OCR_VOT2) [OCR_VOT]3. ONLINE a4aea7a1aa434fb3bff161f6ea8ce102 (/dev/oracleasm/disks/OCR_VOT3) [OCR_VOT]Located 3 voting disk(s).重启集群服务检查是否已经恢复正常[rootrac1 ~]# crsctl stop crs[rootrac1 ~]# crsctl start crsCRS-4123: Oracle High Availability Services has been started.其他节点也可以启动了[rootrac2 ~]# crsctl start crs等一会儿检查服务已经起来了[rootrac1 ~]# crs_stat -tName Type Target State Host------------------------------------------------------------ora.DATA.dg ora....up.type ONLINE ONLINE rac1ora.FRA.dg ora....up.type ONLINE ONLINE rac1ora....ER.lsnr ora....er.type ONLINE ONLINE rac1ora....N1.lsnr ora....er.type ONLINE ONLINE rac1ora.OCR_VOT.dg ora....up.type ONLINE ONLINE rac1ora.asm ora.asm.type ONLINE ONLINE rac1ora.orcl.db ora....se.type ONLINE ONLINE rac1ora.cvu ora.cvu.type ONLINE ONLINE rac1ora....SM1.asm application ONLINE ONLINE rac1ora....C1.lsnr application ONLINE ONLINE rac1ora....ac1.gsd application OFFLINE OFFLINEora....ac1.ons application ONLINE ONLINE rac1ora....ac1.vip ora....t1.type ONLINE ONLINE rac1ora....SM2.asm application ONLINE ONLINE rac2ora....C2.lsnr application ONLINE ONLINE rac2ora....ac2.gsd application OFFLINE OFFLINEora....ac2.ons application ONLINE ONLINE rac2ora....ac2.vip ora....t1.type ONLINE ONLINE rac2ora.gsd ora.gsd.type OFFLINE OFFLINEora....network ora....rk.type ONLINE ONLINE rac1ora.oc4j ora.oc4j.type ONLINE ONLINE rac1ora.ons ora.ons.type ONLINE ONLINE rac1ora....ry.acfs ora....fs.type ONLINE ONLINE rac1ora.scan1.vip ora....ip.type ONLINE ONLINE rac1到这里为止OCR和
网站建设高端定制企业官网
RELATED

相关资讯

更多精彩内容,欢迎继续阅读

较早相关资讯

最新相关资讯

HTML+CSS实战:5页静态官网从规划到交付完整攻略 2026/10/1 11:09:10

HTML+CSS实战:5页静态官网从规划到交付完整攻略

最近帮一个刚学完 HTML 和 CSS 的朋友整理他人生中第一个多页面站点,项目名就叫《天津 htmlcss 5页》。听名字就知道,这是一个纯静态站点:5 个页面,共享一套导航和风格,不碰框架、不碰构建工具,连后端都不需…

阅读更多 →
JS对象动态访问:方括号语法、可选链与安全取值实战 2026/10/1 11:08:56

JS对象动态访问:方括号语法、可选链与安全取值实战

前几天改一个老项目里的表格排序功能,遇到一个特别典型的报错:TypeError: Cannot read properties of undefined (reading values)。翻到代码才发现,同事用点号写法硬编码了一个由后端动态返回的字段名。这个场景我见过太多次了——对象属性的…

阅读更多 →
实时流处理架构实战:Flume+Kafka+Flink+Structured Streaming方案详解 2026/10/1 11:08:43

实时流处理架构实战:Flume+Kafka+Flink+Structured Streaming方案详解

1. 从业务痛点聊起:为什么实时流处理成了刚需过去几年,我参与过不少数据平台类的项目,发现一个共性现象:几乎所有团队在建设数据中台或BI体系时,都会先做离线数仓,稳定跑通后再考虑实时链路。可一旦业务方尝…

阅读更多 →
C语言结构体大小计算:内存对齐规则与工程实践详解 2026/10/1 11:08:37

C语言结构体大小计算:内存对齐规则与工程实践详解

结构体大小这个问题,几乎是每个学C语言的人都会撞上的墙。学完基本语法,写了个结构体,一sizeof算出来,怎么跟想象中“成员大小加起来”不一样?多出来的那几个字节去哪了?我之前带过的不少新人,项…

阅读更多 →
纯前端JS实现本地文件拆分与合并:File、Blob与Stream实战 2026/10/1 11:08:37

纯前端JS实现本地文件拆分与合并:File、Blob与Stream实战

我刚做完一个挺有意思的小项目:一个纯前端、基于JS实现的文件合并拆分在线工具。起因很简单——经常要把几十个TXT日志按日期拆开,或者反过来把一堆分片合成一个大压缩包。市面上那些在线工具大部分得先把文件上传到服务器,一个是慢&#xff…

阅读更多 →
多空动能背离指标详解:识别趋势力竭的技术分析工具 2026/10/1 11:08:30

多空动能背离指标详解:识别趋势力竭的技术分析工具

1. 这个指标到底在说什么做交易的人,大概都遇到过这种场景:价格明明还在往上冲,自己刚追进去,结果立刻被套在高点;或者是跌了很久觉得到底了,抄进去之后发现下面还有地下室。事后复盘一看,很多次…

阅读更多 →

今日资讯

本周资讯

本月资讯

看完文章仍有疑问?

联系尧图顾问,获取一对一建站咨询

立即免费咨询 📞 400-888-8888
📞 ✉