Oracle Server - Standard Edition - Version: 10.2.0.4 andlater<wbr><wbr> [Release: 10.2 and later]<br>Information in this document applies to any platform.<br>Symptoms<br><br><br>=== ODM Issue Clarification ===<br><br>Database goes in hang mode. Not able to make any new connectionsand not able to perform any<br>operations on existing connections. It happens frequently.<br><br>The alert.log shows enteries like:-<br>Thu Oct 7 22:15:14 2010<br>ksvcreate: Process(m001) creation failed<br>Thu Oct 7 22:17:37 2010<br>kkjcre1p: unable to spawn jobq slave process<br>Thu Oct 7 22:17:37 2010<br>Errors in file/orahome/oracle/ora10g/admin/WPCPRODB/bdump/wpcprodb_cjq0_1474640.trc:<br>Cause<br><br>The alert.log messages are not the cause , but result .PMON isneeded to create new processes and since PMON itself is hung , nonew processes can be started.<br><br>This is verified form Systemstate dump:-<br><br>--<br><br>OSD pid info: Unix process pid: 1519850, image: oracle@wpcdbqa(PMON)<br><br>errorstack<br>kksLockWait+01fc<-kgxWait+0168<-kgxExclusive+00bc<-kksFreeHeapGetMutex+0228<-kksCursorFreeCallBack+0088<-kgllccl+13cc<-kgllcu+01b4<br><br><br>waiting for 'cursor: pin X' blocking sess=0x0 seq=8166 wait_time=0seconds since wait started=0<br><wbr><wbr><wbr><wbr>idn=6e0a6074, value=20600000000, where|sleeps=b003c1e3a<br>Dumping Session Wait History<br><br>The holder of the mutex does not exist ( dead process)<br>Solution<br><br>This is due to a known bug<br><br><< Bug8426816>> PMON may hang cleaning up adead process (rare)<br><br>Details:<br>This problem is introduced in 10.2.0.4 by the fix for bug5377099.<br>Under a very specific scenario involving process death at aprecise<br>point in time, an instance hang may result due to PMONgetting<br>blocked when attempting to clean up a failed process.<br>Rediscovery Notes:<br>PMON gets stuck during cleanup waiting for a mutex in X mode<br>and that mutex is held in X mode by the dead process being<br>cleaned up . PMON is blocked under a stack including<br>kksFreeHeapGetMutex()<br>Note:<br>One off patches for this bug also fix issue in bug 5377099 .<br><br><br><br>Action Plan:-<br><br>1)Please apply this patch to fix the issue.<br>or<br>2)The patch is also included in 10.2.0.4.2 PSU patch .<br>( which fixes other known issues of 10.2.0.4.0)<br><br>You may refer to note: 8833280.8<br><br>安徽-惜分飞<chf.dba@gmail.com><wbr>12:26:20<br>[ID 1233079.1<br>安徽-惜分飞<chf.dba@gmail.com><wbr>12:26:49<br>Bug 8833280<br><br></wbr></wbr></wbr></wbr></wbr></wbr></wbr></wbr>