Results 1 to 5 of 5
  1. #1
    Join Date
    Jun 2009
    Posts
    272

    Unanswered: Instance crashed abnormally

    DB2 V9.5
    Single Partitioned environment.

    Our instance has crashed with the below error. Any ideas as to what caused the error ?

    Although instance crashed with ADM0502C, IBM has a opinion that the instance didn't crash due to ADM0502C. It crashed due to signal 0102 [diag message pasted at the bottom] which means a kill -9 on db2 process was issued by a user outside DB2.

    Any thoughts about the issue ?

    2014-02-17-08.10.40.455206-360 E112413A635 LEVEL: Severe
    PID : 1855668 TID : 191525 PROC : db2sysc 0
    INSTANCE: uszpsb10 NODE : 000 DB : PZDWCE01
    APPHDL : 0-3368 APPID: 10.148.204.97.51489.14021714070
    AUTHID : ZDWDOC01
    EDUID : 191525 EDUNAME: db2agent (PZDWCE01) 0
    FUNCTION: DB2 UDB, oper system services, sqloEDUCodeTrapHandler, probe:30
    MESSAGE : ADM0502C The DB2 instance has terminated abnormally. To remedy this
    problem, increase the AGENT_STACK_SZ DBM configuration parameter.
    Contact IBM Support for further assistance.

    2014-02-17-08.10.40.455843-360 E113049A476 LEVEL: Severe
    PID : 1855668 TID : 191525 PROC : db2sysc 0
    INSTANCE: uszpsb10 NODE : 000 DB : PZDWCE01
    APPHDL : 0-3368 APPID: 10.148.204.97.51489.14021714070
    AUTHID : ZDWDOC01
    EDUID : 191525 EDUNAME: db2agent (PZDWCE01) 0
    FUNCTION: DB2 UDB, oper system services, sqloEDUCodeTrapHandler, probe:40
    DATA #1 : <preformatted>
    Current stack size = 4194304

    2014-02-17-08.10.40.579917-360 E113526A549 LEVEL: Severe
    PID : 1171530 TID : 258 PROC : db2wdog 0
    INSTANCE: uszpsb10 NODE : 000
    EDUID : 258 EDUNAME: db2wdog 0
    FUNCTION: DB2 UDB, base sys utilities, sqleWatchDog, probe:20
    MESSAGE : ADM0503C An unexpected internal processing error has occurred. ALL
    DB2 PROCESSES ASSOCIATED WITH THIS INSTANCE HAVE BEEN SHUTDOWN.
    Diagnostic information has been recorded. Contact IBM Support for
    further assistance.

    2014-02-17-08.10.40.580708-360 E114076A422 LEVEL: Error
    PID : 1171530 TID : 258 PROC : db2wdog 0
    INSTANCE: uszpsb10 NODE : 000
    EDUID : 258 EDUNAME: db2wdog 0
    FUNCTION: DB2 UDB, base sys utilities, sqleWatchDog, probe:21
    DATA #1 : Process ID, 4 bytes
    1855668
    DATA #2 : Hexdump, 8 bytes
    0x07000000003FDF60 : 0000 0102 0000 0009

  2. #2
    Join Date
    Apr 2006
    Location
    Belgium
    Posts
    2,514
    Provided Answers: 11
    is OOM killer active ?
    Best Regards, Guy Przytula
    Database Software Consultant
    Good DBAs are not formed in a week or a month. They are created little by little, day by day. Protracted and patient effort is needed to develop good DBAs.
    Spoon feeding : To treat (another) in a way that discourages independent thought or action, as by overindulgence.
    DB2 UDB LUW Certified V7-V8-V9-V9.7-V10.1-V10.5 DB Admin - Advanced DBA -Dprop..
    Information Server Datastage Certified
    http://www.infocura.be

  3. #3
    Join Date
    Aug 2008
    Location
    Toronto, Canada
    Posts
    2,369
    I'm pretty sure the crash is not due to sigkill. Look for a file t1855668.191525.000.trap.txt in your diagpath (inside FODC subdir). This trap file may explain the reason why it crashed.

  4. #4
    Join Date
    Jun 2009
    Posts
    272
    @db2girl:

    Here is the initial content in the file

    <?xml version="1.0" encoding="ISO-8859-1"?>
    <?xml-stylesheet href="http://raspd.torolab.ibm.com/db2trapfile.xsl" type="text/xsl"?>
    <DB2TrapFile version="1.0">
    <Trap>
    <Header>
    DB2 build information: DB2 v9.5.0.4 s090429 SQL09054
    timestamp: 2014-02-17-08.10.37.768004
    instance name: uszpsb10.000
    EDU name : db2agent (PZDWCE01) 0
    EDU ID : 191525
    Signal #11
    uname: S:AIX R:1 V:6 M:00F69BBB4C00 N:shapdb04
    process id: 1855668
    thread id : 191525 (0x2EC25)
    kthread id : 13127865
    </Header>
    <SignalDetails>
    <Siginfo_t length="64">
    0000000B 00000000 00000033 00000000
    00000000 00000000 07000003 0500AFB0
    00000000 00000000 00000000 00000000
    00000000 00000000 00000000 00000000
    </Siginfo_t>
    Signal #11 (SIGSEGV): si_addr is 0x070000030500AFB0, si_code is 0x00000033 (SEGV_ACCERR:Invalid permissions for mapped object.)
    </SignalDetails>
    <ResourceLimits>
    Data seg top [sbrk(0)] = 0x000000012F1C8BE0
    Cur data size (bytes) = 0x7FFFFFFFFFFFFFFF
    Cur stack size (bytes) = 0x0000000100000000
    Cur core size (bytes) = 0x00000000FFFFFFFF
    nofiles (descriptors) = 0x7FFFFFFFFFFFFFFF
    </ResourceLimits>

  5. #5
    Join Date
    Aug 2008
    Location
    Toronto, Canada
    Posts
    2,369
    Trap file contains signal #11 (most likely a db2 defect)
    Support said crash was due to signal #9, which is incorrect.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •