Results 1 to 8 of 8
  1. #1
    Join Date
    Apr 2015
    Posts
    6

    Answered: DB2 abnormal instance shutdown

    Hi All,

    Could you please help me to diagnosis the issue.

    PFA for logs.





    Thanks in Advance,

    Srikanth Gujarathi.
    Attached Thumbnails Attached Thumbnails stmmlog.JPG   errupt1.JPG   errupt2.JPG  
    Attached Files Attached Files
    Last edited by srikanth.gujarath; 07-18-16 at 14:23.

  2. Best Answer
    Posted by StellaZhang

    "Srikanth,


    <StackTrace>
    -------Frame------ ------Function + Offset------
    0x09000000039A279C sqloPostEDUWaitPost@clone0 + 0x98
    0x09000000038140C4 sqleiagt_cb + 0x574
    0x09000000038139CC sqleInterruptApplication__FP19sqle_coordinator_cbU cUii + 0xB8
    0x0900000003813778 ForceAllApplications__14sqeAppServicesFP18sqle_master_app_cbiT2P8sqled bcbN22 + 0x1F8
    0x0900000003A1C684 sqleTermDbConnect__FP13sqle_agent_cbP8sqledbcbP5sqlcaP21sqleTermCon nectStatus + 0x23C
    0x09000000039E6F50 sqlesrsp__FP20sqle_agent_privatecbUcP5sqlcai + 0x594
    0x0900000003A344BC sqlesrspWrp__FP14db2UCinterface + 0xAC
    0x0900000003A345F8 sqleUCagentConnectReset + 0xA0
    0x0900000003A34A10 @48@sqljsCleanup__FP13sqle_agent_cbP11UCconHandle + 0x168
    0x0900000003A360F4 @48@sqljsDrdaAsInnerDriver__FP17sqlcc_init_structb + 0x138
    0x0900000003A35DDC sqljsDrdaAsDriver__FP17sqlcc_init_struct + 0x9C
    0x0900000003A31C24 sqleRunAgent__FPcUi + 0x370
    0x0900000003844D94 sqloCreateEDU__FPFPcUi_vPcUlP13SQLO_EDU_INFOPi + 0x268
    0x09000000038447A8 @49@sqloRunGDS__Fv + 0xDC
    0x0900000003845968 sqloInitEDUServices + 0x178
    0x090000000381FA70 @49@sqloSystemControllerMain__FCUiPFv_iPFi_vPPvCPi + 0x2E8
    0x090000000381E4CC sqloRunInstance + 0xA8
    0x00000001000029F8 DB2main + 0x930
    0x0000000100003D50 main + 0x10
    </StackTrace>


    This crash is due to known issue : http://www-01.ibm.com/support/docvie...id=swg1IZ23936
    First fixed in DB2 Version 9.1 Fix Pack 6.
    Secondly, why are you still on DB2 v9.1.0.4? All support for DB2 V9.1 ended on April 30, 2012."


  3. #2
    Join Date
    Apr 2012
    Posts
    1,035
    Provided Answers: 18
    Not enough information. Can't open your attachments. Post in plain text your DB2 version/fixpack/operating-system platform. Have you followed the DB2 documentation about how to diagnose crashes ?

  4. #3
    Join Date
    Apr 2015
    Posts
    6
    Quote Originally Posted by db2mor View Post
    Not enough information. Can't open your attachments. Post in plain text your DB2 version/fixpack/operating-system platform. Have you followed the DB2 documentation about how to diagnose crashes ?

    Hi ,

    db2 version=9.1

    Fix pack=9.1.0.4

    OS=AIX 5.3


    db2diag.log logged below.

    PID : 872526 TID : 1 PROC : db2stmm (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-946 APPID: *LOCAL.DB2.160616023040
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, Self tuning memory manager, stmmMemoryTunerMain, probe:1583
    MESSAGE : The self tuning memory manager is shutting down due to an unexpected
    error.

    2016-06-16-10.48.40.368062+480 I3011491A464 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:1
    MESSAGE : Error in agent servicing application with coor_node:
    DATA #1 : Hexdump, 2 bytes
    0x0FFFFFFFFFFF6FE0 : 0000 ..

    2016-06-16-10.48.40.401327+480 I3011956A471 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:2
    MESSAGE : Error in agent servicing application with coor_agent_index:
    DATA #1 : Hexdump, 2 bytes
    0x0FFFFFFFFFFF6FE2 : 03AA ..

    2016-06-16-10.48.40.401480+480 I3012428A464 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:3
    MESSAGE : Error in agent servicing application with CLIENT PID:
    DATA #1 : Hexdump, 1 bytes
    0x0FFFFFFFFFFF6FF8 : 30 0

    2016-06-16-10.48.40.401632+480 I3012893A383 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:4
    MESSAGE : Error in agent servicing application with INBOUND APPLICATION ID:

    2016-06-16-10.48.40.401795+480 I3013277A478 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:5
    MESSAGE : Error in agent servicing application with INBOUND SEQUENCE NUMBER:
    DATA #1 : Hexdump, 2 bytes
    0x000000011150B37C : 0006 ..

    2016-06-16-10.48.40.401947+480 I3013756A384 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:6
    MESSAGE : Error in agent servicing application with OUTBOUND APPLICATION ID:

    2016-06-16-10.48.40.402095+480 I3014141A385 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:7
    MESSAGE : Error in agent servicing application with OUTBOUND SEQUENCE NUMBER:

    2016-06-16-10.48.40.402242+480 I3014527A566 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:8
    MESSAGE : Error in agent servicing application with AUTHORIZATION ID:
    DATA #1 : Hexdump, 31 bytes
    0x07800000004F6091 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
    0x07800000004F60A1 : 0000 0000 0000 0000 0000 0000 0000 00 ...............

    2016-06-16-10.48.40.402453+480 I3015094A478 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:9
    MESSAGE : Error in agent servicing application with PRODUCT SIGNATURE:
    DATA #1 : Hexdump, 8 bytes
    0x07800000004F73F0 : 4A43 4330 3330 3630 JCC03060

    2016-06-16-10.48.40.402605+480 I3015573A554 LEVEL: Error
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, probe:10
    MESSAGE : Error in agent servicing application with APPLICATION NAME:
    DATA #1 : Hexdump, 18 bytes
    0x07800000004F73C6 : 6462 326A 6363 5F61 7070 6C69 6361 7469 db2jcc_applicati
    0x07800000004F73D6 : 6F6E on

    2016-06-16-10.48.40.434965+480 I3016128A409 LEVEL: Event
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, trace services, pdInvokeCalloutScript, probe:10
    START : Invoking /home/db2inst9/sqllib/bin/db2cos from oper system services sqloEDUCodeTrapHandler

    2016-06-16-10.48.46.507953+480 I3016538A370 LEVEL: Event
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, trace services, pdInvokeCalloutScript, probe:20
    STOP : Completed invoking /home/db2inst9/sqllib/bin/db2cos

    2016-06-16-10.48.46.572980+480 E3016909A580 LEVEL: Severe
    PID : 913618 TID : 1 PROC : db2agent (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-938
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, oper system services, sqloEDUCodeTrapHandler, probe:10
    MESSAGE : ADM0503C An unexpected internal processing error has occurred. ALL
    DB2 PROCESSES ASSOCIATED WITH THIS INSTANCE HAVE BEEN SHUTDOWN.
    Diagnostic information has been recorded. Contact IBM Support for
    further assistance.


    STMM.9260.log below

    2016-06-16-10.48.40.058035+480 A6974999A464 LEVEL: Warning
    PID : 872526 TID : 1 PROC : db2stmm (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-946 APPID: *LOCAL.DB2.160616023040
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, Self tuning memory manager, stmmMemoryTunerMain, probe:1583
    MESSAGE : The self tuning memory manager is shutting down due to an unexpected
    error.

    2016-06-16-10.48.40.106380+480 A6975464A454 LEVEL: Event
    PID : 872526 TID : 1 PROC : db2stmm (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-946 APPID: *LOCAL.DB2.160616023040
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, config/install, sqlfLogUpdateCfgParam, probe:2956
    MESSAGE : STMM CFG DB COMMON01: "Stmm_opt_buffpage" From: "1000" <automatic> To: "0" <automatic>

    2016-06-16-10.48.40.112916+480 A6975919A452 LEVEL: Event
    PID : 872526 TID : 1 PROC : db2stmm (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-946 APPID: *LOCAL.DB2.160616023040
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, config/install, sqlfLogUpdateCfgParam, probe:2956
    MESSAGE : STMM CFG DB COMMON01: "Stmm_opt_sortheap" From: "56" <automatic> To: "0" <automatic>

    2016-06-16-10.48.40.118903+480 A6976372A454 LEVEL: Event
    PID : 872526 TID : 1 PROC : db2stmm (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-946 APPID: *LOCAL.DB2.160616023040
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, config/install, sqlfLogUpdateCfgParam, probe:2956
    MESSAGE : STMM CFG DB COMMON01: "Stmm_opt_locklist" From: "5960" <automatic> To: "0" <automatic>

    2016-06-16-10.48.40.124889+480 A6976827A452 LEVEL: Event
    PID : 872526 TID : 1 PROC : db2stmm (COMMON01)
    INSTANCE: db2inst9 NODE : 000 DB : COMMON01
    APPHDL : 0-946 APPID: *LOCAL.DB2.160616023040
    AUTHID : DB2INST9
    FUNCTION: DB2 UDB, config/install, sqlfLogUpdateCfgParam, probe:2956
    MESSAGE : STMM CFG DB COMMON01: "Stmm_opt_maxlocks" From: "98" <automatic> To: "0" <automatic>
    Last edited by srikanth.gujarath; 07-19-16 at 11:44.

  5. #4
    Join Date
    Apr 2012
    Posts
    1,035
    Provided Answers: 18
    Evidently this antique system is configured to run db2cos when the DB2-instance gets in trouble. Have you studied the db2cos output?

  6. #5
    Join Date
    Apr 2015
    Posts
    6
    Hi Mor,

    Thanks for the reply , will go through db2cos output file .

    Thanks & Regards,
    Srikanth Gujarathi.

  7. #6
    Join Date
    Apr 2015
    Posts
    6
    t913618.000.txt

    Hi Mor,

    I have attached trap file pfa.

    Thanks & Regards,
    Srikanth Gujarathi

  8. #7
    Join Date
    May 2015
    Location
    Korea
    Posts
    54
    Provided Answers: 1
    Srikanth,


    <StackTrace>
    -------Frame------ ------Function + Offset------
    0x09000000039A279C sqloPostEDUWaitPost@clone0 + 0x98
    0x09000000038140C4 sqleiagt_cb + 0x574
    0x09000000038139CC sqleInterruptApplication__FP19sqle_coordinator_cbU cUii + 0xB8
    0x0900000003813778 ForceAllApplications__14sqeAppServicesFP18sqle_master_app_cbiT2P8sqled bcbN22 + 0x1F8
    0x0900000003A1C684 sqleTermDbConnect__FP13sqle_agent_cbP8sqledbcbP5sqlcaP21sqleTermCon nectStatus + 0x23C
    0x09000000039E6F50 sqlesrsp__FP20sqle_agent_privatecbUcP5sqlcai + 0x594
    0x0900000003A344BC sqlesrspWrp__FP14db2UCinterface + 0xAC
    0x0900000003A345F8 sqleUCagentConnectReset + 0xA0
    0x0900000003A34A10 @48@sqljsCleanup__FP13sqle_agent_cbP11UCconHandle + 0x168
    0x0900000003A360F4 @48@sqljsDrdaAsInnerDriver__FP17sqlcc_init_structb + 0x138
    0x0900000003A35DDC sqljsDrdaAsDriver__FP17sqlcc_init_struct + 0x9C
    0x0900000003A31C24 sqleRunAgent__FPcUi + 0x370
    0x0900000003844D94 sqloCreateEDU__FPFPcUi_vPcUlP13SQLO_EDU_INFOPi + 0x268
    0x09000000038447A8 @49@sqloRunGDS__Fv + 0xDC
    0x0900000003845968 sqloInitEDUServices + 0x178
    0x090000000381FA70 @49@sqloSystemControllerMain__FCUiPFv_iPFi_vPPvCPi + 0x2E8
    0x090000000381E4CC sqloRunInstance + 0xA8
    0x00000001000029F8 DB2main + 0x930
    0x0000000100003D50 main + 0x10
    </StackTrace>


    This crash is due to known issue : http://www-01.ibm.com/support/docvie...id=swg1IZ23936
    First fixed in DB2 Version 9.1 Fix Pack 6.
    Secondly, why are you still on DB2 v9.1.0.4? All support for DB2 V9.1 ended on April 30, 2012.

  9. #8
    Join Date
    Apr 2015
    Posts
    6
    Hi StellaZhang,

    Thank you for the information and we planning to move the data from old version to new version .

    But we are facing the above issue and we are restarting the database whenever its goes down.

    And we are planning to apply fix pack 12.

    Can we apply the latest fix for this issue or shall we apply fix pack 6.

    Thanks & Regards,
    Srikanth Gujarathi.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •