mongodb分片集群突然停电造成一些错误，分片无法启动（非正常关闭）

ddddddf

　　报错：

• 　　/data/mongodb2/log/mongo.log
  

　　2015-09-14T05:41:49.288-0400 ***** SERVER RESTARTED *****
　　2015-09-14T05:41:49.293-0400 [initandlisten] MongoDB starting : pid=13693 port=27017 dbpath=/data/mongodb2/db 64-bit host=mongodb02.com
　　2015-09-14T05:41:49.293-0400 [initandlisten]
　　2015-09-14T05:41:49.293-0400 [initandlisten] ** WARNING: You are running on a NUMA machine.
　　2015-09-14T05:41:49.293-0400 [initandlisten] **          We suggest launching mongod like this to avoid performance problems:
　　2015-09-14T05:41:49.293-0400 [initandlisten] **              numactl --interleave=all mongod [other options]
　　2015-09-14T05:41:49.565-0400 [initandlisten]
　　2015-09-14T05:41:49.565-0400 [initandlisten] db version v2.6.4
　　2015-09-14T05:41:49.565-0400 [initandlisten] git version: 3a830be0eb92d772aa855ebb711ac91d658ee910
　　2015-09-14T05:41:49.565-0400 [initandlisten] build info: Linux build7.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
　　2015-09-14T05:41:49.565-0400 [initandlisten] allocator: tcmalloc
　　2015-09-14T05:41:49.565-0400 [initandlisten] options: { net: { http: { RESTInterfaceEnabled: true, enabled: true }, maxIncomingConnections: 8000, port: 27017 }, processManagement: { fork: true }, replication: { replSet: "rep1" }, security: { keyFile: "/data/mongodb2/keyfile/security" }, storage: { dbPath: "/data/mongodb2/db" }, systemLog: { destination: "file", logAppend: true, path: "/data/mongodb2/log/mongo.log" } }
　　2015-09-14T05:41:49.584-0400 [initandlisten] journal dir=/data/mongodb2/db/journal
　　2015-09-14T05:41:49.585-0400 [initandlisten] recover : no journal files present, no recovery needed
　　2015-09-14T05:41:49.914-0400 [initandlisten] preallocateIsFaster=true 5.7

　　2015-09-14T05:41:50.258-0400 [initandlisten] Assertion: 10334:BSONObj>　　2015-09-14T05:41:50.266-0400 [initandlisten] cache_common 0x11e6111 0x1187e49 0x116c9f6 0x116cf4c 0x77329b 0xefd3e8 0x8dd353 0x8b57e2 0x8c20d0 0x765f0e 0x76ab3f 0x76c62f 0x76cedb 0x76d475 0x76d699 0x7f14cf5ceaf5 0x764329
　　mongod(_ZN5mongo15printStackTraceERSo+0x21) [0x11e6111]
　　mongod(_ZN5mongo10logContextEPKc+0x159) [0x1187e49]
　　mongod(_ZN5mongo11msgassertedEiPKc+0xe6) [0x116c9f6]
　　mongod() [0x116cf4c]
　　mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x41b) [0x77329b]
　　mongod(_ZNK5mongo7DiskLoc3objEv+0x68) [0xefd3e8]
　　mongod(_ZN5mongo12IndexCatalog4initEv+0x213) [0x8dd353]
　　mongod(_ZN5mongo10CollectionC1ERKNS_10StringDataEPNS_16NamespaceDetailsEPNS_8DatabaseE+0x2e2) [0x8b57e2]
　　mongod(_ZN5mongo8Database13getCollectionERKNS_10StringDataE+0x150) [0x8c20d0]
　　mongod(_ZN5mongo17checkForIdIndexesEPNS_8DatabaseE+0x19e) [0x765f0e]
　　mongod() [0x76ab3f]
　　mongod(_ZN5mongo14_initAndListenEi+0x5df) [0x76c62f]
　　mongod(_ZN5mongo13initAndListenEi+0x1b) [0x76cedb]
　　mongod() [0x76d475]
　　mongod(main+0x9) [0x76d699]
　　/lib64/libc.so.6(__libc_start_main+0xf5) [0x7f14cf5ceaf5]
　　mongod() [0x764329]

　　2015-09-14T05:41:50.267-0400 [initandlisten] exception in initAndListen: 10334 BSONObj>　　2015-09-14T05:41:50.267-0400 [initandlisten] dbexit:
　　2015-09-14T05:41:50.267-0400 [initandlisten] shutdown: going to close listening sockets...
　　2015-09-14T05:41:50.267-0400 [initandlisten] shutdown: going to flush diaglog...
　　2015-09-14T05:41:50.267-0400 [initandlisten] shutdown: going to close sockets...
　　2015-09-14T05:41:50.267-0400 [initandlisten] shutdown: waiting for fs preallocator...
　　2015-09-14T05:41:50.267-0400 [initandlisten] shutdown: lock for final commit...
　　2015-09-14T05:41:50.267-0400 [initandlisten] shutdown: final commit...
　　2015-09-14T05:41:50.267-0400 [initandlisten] shutdown: closing all files...
　　2015-09-14T05:41:50.268-0400 [initandlisten] closeAllFiles() finished
　　2015-09-14T05:41:50.268-0400 [initandlisten] journalCleanup...
　　2015-09-14T05:41:50.268-0400 [initandlisten] removeJournalFiles
　　2015-09-14T05:41:50.269-0400 [initandlisten] shutdown: removing fs lock...
　　2015-09-14T05:41:50.269-0400 [initandlisten] dbexit: really exiting now
　　systemctl status mongodb.service
　　mongodb.service - mongodb
　　Loaded: loaded (/usr/lib/systemd/system/mongodb.service; enabled)
　　Active: failed (Result: exit-code) since Mon 2015-09-14 05:25:06 EDT; 1h 10min ago
　　Process: 13499 ExecStart=/usr/local/mongodb/bin/mongod --dbpath=/data/mongodb2/db --logpath=/data/mongodb2/log/mongo.log --fork --port 27017 --logappend --replSet rep1 --rest --httpinterface --maxConns=8000 --keyFile=/data/mongodb2/keyfile/security (code=exited, status=100)
　　Sep 14 05:25:05 mongodb02.com systemd[1]: Starting mongodb...
　　Sep 14 05:25:05 mongodb02.com mongod[13499]: about to fork child process, waiting until server is ready for connections.
　　Sep 14 05:25:05 mongodb02.com mongod[13499]: forked process: 13501
　　Sep 14 05:25:06 mongodb02.com mongod[13499]: ERROR: child process failed, exited with error number 100
　　Sep 14 05:25:06 mongodb02.com systemd[1]: mongodb.service: control process exited, code=exited status=100
　　Sep 14 05:25:06 mongodb02.com systemd[1]: Failed to start mongodb.
　　Sep 14 05:25:06 mongodb02.com systemd[1]: Unit mongodb.service entered failed state.
　　[root@mongodb02 ~]# /usr/local/mongodb/bin/mongod --dbpath=/data/mongoarb/arbiter --logpath=/data/mongoarb/log/arbiter.log --fork --port 27027 --logappend --replSet rep1 --keyFile=/data/mongoarb/keyfile/security --rest
　　2015-09-14T06:57:48.025-0400 ** WARNING: --rest is specified without --httpinterface,
　　2015-09-14T06:57:48.025-0400 **          enabling http interface
　　about to fork child process, waiting until server is ready for connections.
　　forked process: 14495
　　ERROR: child process failed, exited with error number 1
　　因为提示子进程失败
　　[root@mongodb02 ~]# /usr/local/mongodb/bin/mongod --dbpath=/data/mongodb2/db --logpath=/data/mongodb2/log/mongo.log --fork --port 27017 --logappend --replSet rep1 --rest --httpinterface --maxConns=8000 --keyFile=/data/mongodb2/keyfile/security
　　about to fork child process, waiting until server is ready for connections.
　　forked process: 14545
　　ERROR: child process failed, exited with error number 100
　　初始化，又是提示子进程启动失败。