mongodb分片集群突然停电造成一些错误，分片无法启动
今天突然停电使mongodb分片集群造成这种错误，暂时不知道怎么解决，如果 有人知道请回复我，现在把记录下来，等后期处理。
Fri Aug8 10:49:52.165 connection accepted from 172.16.0.115:59542 #2 (2 connections now open)
Fri Aug8 10:49:52.954 connection accepted from 172.16.0.103:33501 #3 (2 connections now open)
Fri Aug8 10:49:52.954 connection accepted from 172.16.0.103:33502 #4 (3 connections now open)
Fri Aug8 10:49:52.955 end connection 172.16.0.103:33501 (2 connections now open)
Fri Aug8 10:49:55.104 replSet syncing to: 172.16.0.115:11731
Fri Aug8 10:49:55.108 replSet still syncing, not yet to minValid optime 53e421d7:3a
Fri Aug8 10:49:55.154 getFile(): n=808581868
Fri Aug8 10:49:55.154 Assertion: 10295:getFile(): bad file number value (corrupt db?): run repair
0xde0151 0xda188b 0x8d5465 0xb89952 0x818116 0x818244 0x81a4d4 0xa62bd5 0xa62c1c 0xab959c 0xa6c93c 0xc222ab 0xc28184 0xc28728 0xc2b45d 0xc2b73c 0xe289d9 0x3dffe0683d 0x3dfeed503d
/home/mongodb/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21)
/home/mongodb/bin/mongod(_ZN5mongo11msgassertedEiPKc+0x9b)
/home/mongodb/bin/mongod(_ZN5mongo8Database7getFileEiib+0x395)
/home/mongodb/bin/mongod(_ZNK5mongo7DiskLoc3recEv+0x42)
/home/mongodb/bin/mongod(_ZNK5mongo16NamespaceDetails11inCapExtentERKNS_7DiskLocE+0x26)
/home/mongodb/bin/mongod(_ZN5mongo16NamespaceDetails10__capAllocEi+0xc4)
/home/mongodb/bin/mongod(_ZN5mongo16NamespaceDetails11cappedAllocEPKci+0x2e4)
/home/mongodb/bin/mongod(_ZN5mongo16NamespaceDetails6_allocEPKci+0x25)
/home/mongodb/bin/mongod(_ZN5mongo16NamespaceDetails5allocEPKci+0x3c)
/home/mongodb/bin/mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x1ec)
/home/mongodb/bin/mongod(_ZN5mongo11_logOpObjRSERKNS_7BSONObjE+0x4cc)
/home/mongodb/bin/mongod(_ZN5mongo7replset8SyncTail15applyOpsToOplogEPSt5dequeINS_7BSONObjESaIS3_EE+0x4b)
/home/mongodb/bin/mongod(_ZN5mongo7replset8SyncTail16oplogApplicationEv+0x584)
/home/mongodb/bin/mongod(_ZN5mongo11ReplSetImpl11_syncThreadEv+0xb8)
/home/mongodb/bin/mongod(_ZN5mongo11ReplSetImpl10syncThreadEv+0x2d)
/home/mongodb/bin/mongod(_ZN5mongo15startSyncThreadEv+0x6c)
/home/mongodb/bin/mongod
/lib64/libpthread.so.0
/lib64/libc.so.6(clone+0x6d)
Fri Aug8 10:49:55.166 replSet syncThread: 10295 getFile(): bad file number value (corrupt db?): run repair
Fri Aug8 10:49:56.105 replset setting oplog notifier to 172.16.0.115:11731
Fri Aug8 10:50:02.191 end connection 172.16.0.115:59542 (1 connection now open)
Fri Aug8 10:50:02.191 connection accepted from 172.16.0.115:59549 #5 (2 connections now open)
Fri Aug8 10:50:06.228 Assertion: 10334:BSONObj> 0xde0151 0xda188b 0xda1dcc 0x6ec92f 0xa2aad8 0xa2bfcc 0xa2c370 0x7fbcf0 0x8016d0 0x80180f 0x80180f 0x80190c 0x814173 0x8105f1 0x813291 0xb60b84 0xb6245e 0xb626be 0xa7c88b 0xa73af7
/home/mongodb/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21)
/home/mongodb/bin/mongod(_ZN5mongo11msgassertedEiPKc+0x9b)
/home/mongodb/bin/mongod
/home/mongodb/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x5bf)
/home/mongodb/bin/mongod(_ZNK5mongo5KeyV16toBsonEv+0x98)
/home/mongodb/bin/mongod(_ZNK5mongo5KeyV113compareHybridERKS0_RKNS_8OrderingE+0x3c)
/home/mongodb/bin/mongod(_ZNK5mongo5KeyV19woCompareERKS0_RKNS_8OrderingE+0x230)
/home/mongodb/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE4findERKNS_12IndexDetailsERKNS_5KeyV1ERKNS_7DiskLocERKNS_8OrderingERib+0x120)
/home/mongodb/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE6locateERKNS_12IndexDetailsERKNS_7DiskLocERKNS_5KeyV1ERKNS_8OrderingERiRbS8_i+0x60)
/home/mongodb/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE6locateERKNS_12IndexDetailsERKNS_7DiskLocERKNS_5KeyV1ERKNS_8OrderingERiRbS8_i+0x19f)
/home/mongodb/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE6locateERKNS_12IndexDetailsERKNS_7DiskLocERKNS_5KeyV1ERKNS_8OrderingERiRbS8_i+0x19f)
/home/mongodb/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE6locateERKNS_12IndexDetailsERKNS_7DiskLocERKNS_7BSONObjERKNS_8OrderingERiRbS8_i+0x8c)
/home/mongodb/bin/mongod(_ZN5mongo15BtreeCursorImplINS_12BtreeData_V1EE7_locateERKNS_7BSONObjERKNS_7DiskLocE+0x93)
/home/mongodb/bin/mongod(_ZN5mongo11BtreeCursor33initWithoutIndependentFieldRangesEv+0x1f1)
/home/mongodb/bin/mongod(_ZN5mongo11BtreeCursor4makeEPNS_16NamespaceDetailsERKNS_12IndexDetailsERKNS_7BSONObjES8_bi+0xa1)
/home/mongodb/bin/mongod(_ZNK5mongo15CursorGenerator14shortcutCursorEv+0x6c4)
/home/mongodb/bin/mongod(_ZN5mongo15CursorGenerator8generateEv+0x3e)
/home/mongodb/bin/mongod(_ZN5mongo25NamespaceDetailsTransient9getCursorERKNS_10StringDataERKNS_7BSONObjES6_RKNS_24QueryPlanSelectionPolicyERKN5boost10shared_ptrIKNS_11ParsedQueryEEEbPNS_16QueryPlanSummaryE+0x3e)
/home/mongodb/bin/mongod(_ZN5mongo13deleteObjectsEPKcNS_7BSONObjEbbbPNS_11RemoveSaverE+0x14b)
/home/mongodb/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xc57)
Fri Aug8 10:50:06.241 ERROR: writer worker caught exception: BSONObj> Fri Aug8 10:50:06.241 Fatal Assertion 16360
0xde0151 0xd9ff43 0xc28aac 0xdada91 0xe289d9 0x3dffe0683d 0x3dfeed503d
/home/mongodb/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21)
/home/mongodb/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3)
/home/mongodb/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x12c)
/home/mongodb/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281)
/home/mongodb/bin/mongod
/lib64/libpthread.so.0
/lib64/libc.so.6(clone+0x6d)
Fri Aug8 10:50:06.245
***aborting after fassert() failure
Fri Aug8 10:50:06.245 Got signal: 6 (Aborted).
Fri Aug8 10:50:06.250 Backtrace:
0xde0151 0x6d0529 0x3dfee30330 0x3dfee302c5 0x3dfee31d70 0xd9ff7e 0xc28aac 0xdada91 0xe289d9 0x3dffe0683d 0x3dfeed503d
/home/mongodb/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21)
/home/mongodb/bin/mongod(_ZN5mongo10abruptQuitEi+0x399)
/lib64/libc.so.6
/lib64/libc.so.6(gsignal+0x35)
/lib64/libc.so.6(abort+0x110)
/home/mongodb/bin/mongod(_ZN5mongo13fassertFailedEi+0xde)
/home/mongodb/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x12c)
/home/mongodb/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281)
/home/mongodb/bin/mongod
/lib64/libpthread.so.0
/lib64/libc.so.6(clone+0x6d)
页:
[1]