I am trying to format a TSM db2 7.7 database on AIX 6.1. I tried to start db2 and I am getting the error:
ebsbeta(tsminst1)/tsm62>db2start
01/06/2010 14:58:48 0 0 SQL1220N The database manager shared memory set cannot be allocated.
SQL1032N No start database manager command was issued. SQLSTATE=57019.

I have been searching the error message and everything point to fenced_pool and, numdb. Below is the get database manager configuration. I have tried to include relevant information.

a
Also when I try to format the database
ANR0279S The database manager failed to start. The database manager license key
is invalid or was removed.
ANR2678E Server database format failed.

Thanks for any help

Database Manager Configuration

Node type = Enterprise Server Edition with local and remote clients

Database manager configuration release level = 0x0d00

CPU speed (millisec/instruction) (CPUSPEED) = 4.000000e-05
Communications bandwidth (MB/sec) (COMM_BANDWIDTH) = 1.250000e+00

Max number of concurrently active databases (NUMDB) = 8
Federated Database System Support (FEDERATED) = NO
Transaction processor monitor name (TP_MON_NAME) =

Default charge-back account (DFT_ACCOUNT_STR) =

Java Development Kit installation path (JDK_PATH) = /home/db2v2/sqllib/java/jdk64

Diagnostic error capture level (DIAGLEVEL) = 3
Notify Level (NOTIFYLEVEL) = 3
Diagnostic data directory path (DIAGPATH) =
Size of rotating db2diag & notify logs (MB) (DIAGSIZE) = 0

Default database monitor switches
Buffer pool (DFT_MON_BUFPOOL) = OFF
Lock (DFT_MON_LOCK) = OFF
Sort (DFT_MON_SORT) = OFF
Statement (DFT_MON_STMT) = OFF
Table (DFT_MON_TABLE) = OFF
Timestamp (DFT_MON_TIMESTAMP) = ON
Unit of work (DFT_MON_UOW) = OFF
Monitor health of instance and databases (HEALTH_MON) = ON

SYSADM group name (SYSADM_GROUP) =
SYSCTRL group name (SYSCTRL_GROUP) =
SYSMAINT group name (SYSMAINT_GROUP) =
SYSMON group name (SYSMON_GROUP) =

Client Userid-Password Plugin (CLNT_PW_PLUGIN) =
Client Kerberos Plugin (CLNT_KRB_PLUGIN) =
Group Plugin (GROUP_PLUGIN) =
GSS Plugin for Local Authorization (LOCAL_GSSPLUGIN) =
Server Plugin Mode (SRV_PLUGIN_MODE) = UNFENCED
Server List of GSS Plugins (SRVCON_GSSPLUGIN_LIST) =
Server Userid-Password Plugin (SRVCON_PW_PLUGIN) =
Server Connection Authentication (SRVCON_AUTH) = NOT_SPECIFIED
Cluster manager (CLUSTER_MGR) =

Database manager authentication (AUTHENTICATION) = SERVER
Alternate authentication (ALTERNATE_AUTH_ENC) = NOT_SPECIFIED
Cataloging allowed without authority (CATALOG_NOAUTH) = NO
Trust all clients (TRUST_ALLCLNTS) = YES
Trusted client authentication (TRUST_CLNTAUTH) = CLIENT
Bypass federated authentication (FED_NOAUTH) = NO

Default database path (DFTDBPATH) = /tsm62

Database monitor heap size (4KB) (MON_HEAP_SZ) = AUTOMATIC(90)
Java Virtual Machine heap size (4KB) (JAVA_HEAP_SZ) = 2048
Audit buffer size (4KB) (AUDIT_BUF_SZ) = 0
Size of instance shared memory (4KB) (INSTANCE_MEMORY) = AUTOMATIC(20)
Backup buffer default size (4KB) (BACKBUFSZ) = 1024
Restore buffer default size (4KB) (RESTBUFSZ) = 1024

Agent stack size (AGENT_STACK_SZ) = 1024
Sort heap threshold (4KB) (SHEAPTHRES) = 0

Directory cache support (DIR_CACHE) = YES

Application support layer heap size (4KB) (ASLHEAPSZ) = 15
Max requester I/O block size (bytes) (RQRIOBLK) = 32767
Query heap size (4KB) (QUERY_HEAP_SZ) = 1000

Workload impact by throttled utilities(UTIL_IMPACT_LIM) = 10

Priority of agents (AGENTPRI) = SYSTEM
Agent pool size (NUM_POOLAGENTS) = AUTOMATIC(100)
Initial number of agents in pool (NUM_INITAGENTS) = 0
Max number of coordinating agents (MAX_COORDAGENTS) = AUTOMATIC(200)
Max number of client connections (MAX_CONNECTIONS) = AUTOMATIC(MAX_COORDAGENTS)

Keep fenced process (KEEPFENCED) = YES
Number of pooled fenced processes (FENCED_POOL) = AUTOMATIC(MAX_COORDAGENTS)
Initial number of fenced processes (NUM_INITFENCED) = 0

Index re-creation time and redo index build (INDEXREC) = RESTART

Transaction manager database name (TM_DATABASE) = 1ST_CONN
Transaction resync interval (sec) (RESYNC_INTERVAL) = 180

SPM name (SPM_NAME) =
SPM log size (SPM_LOG_FILE_SZ) = 256
SPM resync agent limit (SPM_MAX_RESYNC) = 20
SPM log path (SPM_LOG_PATH) =

TCP/IP Service name (SVCENAME) =
Discovery mode (DISCOVER) = SEARCH
Discover server instance (DISCOVER_INST) = ENABLE

SSL server keydb file (SSL_SVR_KEYDB) =
SSL server stash file (SSL_SVR_STASH) =
SSL server certificate label (SSL_SVR_LABEL) =
SSL service name (SSL_SVCENAME) =
SSL cipher specs (SSL_CIPHERSPECS) =
SSL versions (SSL_VERSIONS) =
SSL client keydb file (SSL_CLNT_KEYDB) =
SSL client stash file (SSL_CLNT_STASH) =

Maximum query degree of parallelism (MAX_QUERYDEGREE) = ANY
Enable intra-partition parallelism (INTRA_PARALLEL) = NO

Maximum Asynchronous TQs per query (FEDERATED_ASYNC) = 0

No. of int. communication buffers(4KB)(FCM_NUM_BUFFERS) = AUTOMATIC(4096)
No. of int. communication channels (FCM_NUM_CHANNELS) = AUTOMATIC(2048)
Node connection elapse time (sec) (CONN_ELAPSE) = 10
Max number of node connection retries (MAX_CONNRETRIES) = 5
Max time difference between nodes (min) (MAX_TIME_DIFF) = 60

db2start/db2stop timeout (min) (START_STOP_TIME) = 10

ebsbeta(tsminst1)/tsm62>ulimit -a
time(seconds) unlimited
file(blocks) unlimited
data(kbytes) unlimited
stack(kbytes) 196608
memory(kbytes) unlimited
coredump(blocks) unlimited
nofiles(descriptors) unlimited
threads(per process) unlimited
processes(per user) unlimited


ebsbeta(tsminst1)/tsm62>echo $DB2INSTANCE
tsminst1

Check what's in the diagnostic log (~/sqllib/db2dump/db2diag.log). You may need to increase diagnostic level to get additional information (db2 update dbm cfg using diaglevel 4).

I see where the log says no instance, but db2ilist
ebsbeta(tsminst1)/tsm62>db2ilist
tsminst1
ebsbeta(tsminst1)/tsm62>



2010-01-06-15.46.10.382463-360 I4985A468 LEVEL: Error
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, SQO Memory Management, sqloAllocateSharedMemory, probe:2000
MESSAGE : ZRC=0x870F00B4=-2029059916=SQLO_NO_INSTANCE "No instance available."
DATA #1 : String, 44 bytes
Error generating ftok key for shared memory.
DATA #2 : Memory set type, PD_TYPE_SET_TYPE, 4 bytes
0

2010-01-06-15.46.10.383265-360 I5454A326 LEVEL: Severe
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, base sys utilities, DB2StartMain, probe:350
MESSAGE : ZRC=0x870F00B4=-2029059916=SQLO_NO_INSTANCE "No instance available."




ebsbeta(tsminst1)/tsm62>db2start
01/06/2010 15:46:10 0 0 SQL1220N The database manager shared memory set cannot be allocated.
SQL1032N No start database manager command was issued. SQLSTATE=57019
ebsbeta(tsminst1)/tsm62>cat sqllib/db2dump/db2diag.log

2010-01-06-15.46.09.999355-360 I1A1292 LEVEL: Event
PID : 213152 TID : 1 PROC : db2start
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, RAS/PD component, pdLogInternal, probe:120
START : New Diagnostic Log file
DATA #1 : Build Level, 152 bytes
Instance "tsminst1" uses "64" bits and DB2 code release "SQL09070"
with level identifier "08010107".
Informational tokens are "DB2 v9.7.0.0", "s090521", "AIX6497", Fix Pack "0".
DATA #2 : System Info, 224 bytes
System: AIX ebsbeta 1 6 0005842C4C00
CPU: total:4 online:4 Threading degree per core:1
Physical Memory(MB): total:8192 free:6478
Virtual Memory(MB): total:10240 free:8519
Swap Memory(MB): total:2048 free:2041
Kernel Params: msgMaxMessageSize:4194304 msgMaxQueueSize:4194304
shmMax:68719476736 shmMin:1 shmIDs:131072
shmSegments:68719476736 semIDs:131072 semNumPerID:65535
semOps:1024 semMaxVal:32767 semAdjustOnExit:16384
Cur data size (bytes) = 0x7FFFFFFFFFFFFFFF
Cur stack size (bytes) = 0x000000000C000000
Cur core size (bytes) = 0x00000000FFFFFFFF
nofiles (descriptors) = 0x7FFFFFFFFFFFFFFF

Information in this record is only valid at the time when this file was
created (see this record's time stamp)

2010-01-06-15.46.09.996588-360 I1294A313 LEVEL: Event
PID : 213152 TID : 1 PROC : db2start
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, base sys utilities, sqleIssueStartStop, probe:21
DATA #1 : <preformatted>
Single node instance [0] is starting

2010-01-06-15.46.10.109368-360 I1608A1637 LEVEL: Event
PID : 213152 TID : 1 PROC : db2start
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, base sys utilities, sqleStartStopSingleNode, probe:1130
DATA #1 : String, 26 bytes
/tsm62/sqllib/adm/db2star2
DATA #2 : Hexdump, 256 bytes
0x0FFFFFFFFFFF4B00 : 2F74 736D 3632 2F73 716C 6C69 622F 6164 /tsm62/sqllib/ad
0x0FFFFFFFFFFF4B10 : 6D2F 6462 3273 7461 7232 004E 4F4D 5347 m/db2star2.NOMSG
0x0FFFFFFFFFFF4B20 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4B30 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4B40 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4B50 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4B60 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4B70 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4B80 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4B90 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4BA0 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4BB0 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4BC0 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4BD0 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4BE0 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0FFFFFFFFFFF4BF0 : 0000 0000 0000 0000 0000 0000 0000 0000 ................

2010-01-06-15.46.10.209425-360 I3246A376 LEVEL: Info
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 Common, Security, Users and Groups, secLoadClientAuthPlugin, probe:10
DATA #1 : String, 82 bytes
Loaded plugin library /tsm62/sqllib/security64/plugin/IBM/client/IBMOSauthclient.a

2010-01-06-15.46.10.241073-360 I3623A322 LEVEL: Info
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, bsu security, sqlexLogPluginMessage, probe:20
DATA #1 : String with size, 37 bytes
db2secClientAuthPluginInit successful

2010-01-06-15.46.10.251460-360 I3946A366 LEVEL: Info
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 Common, Security, Users and Groups, secLoadGroupPlugin, probe:10
DATA #1 : String, 77 bytes
Loaded plugin library /tsm62/sqllib/security64/plugin/IBM/group/IBMOSgroups.a

2010-01-06-15.46.10.251709-360 I4313A317 LEVEL: Info
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, bsu security, sqlexLogPluginMessage, probe:20
DATA #1 : String with size, 32 bytes
db2secGroupPluginInit successful

2010-01-06-15.46.10.265121-360 E4631A353 LEVEL: Info
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, base sys utilities, DB2StartMain, probe:298
DATA #1 : <preformatted>
Current FCM parameters configuration:
fcm_num_buffers 4096
fcm_num_channels 2048

2010-01-06-15.46.10.382463-360 I4985A468 LEVEL: Error
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, SQO Memory Management, sqloAllocateSharedMemory, probe:2000
MESSAGE : ZRC=0x870F00B4=-2029059916=SQLO_NO_INSTANCE "No instance available."
DATA #1 : String, 44 bytes
Error generating ftok key for shared memory.
DATA #2 : Memory set type, PD_TYPE_SET_TYPE, 4 bytes
0

2010-01-06-15.46.10.383265-360 I5454A326 LEVEL: Severe
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, base sys utilities, DB2StartMain, probe:350
MESSAGE : ZRC=0x870F00B4=-2029059916=SQLO_NO_INSTANCE "No instance available."

2010-01-06-15.46.10.383564-360 I5781A341 LEVEL: Severe
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, base sys utilities, DB2StartMain, probe:3
DATA #1 : Hexdump, 4 bytes
0x0FFFFFFFFFFF961C : FFFF FB3C ...<

2010-01-06-15.46.10.383750-360 I6123A340 LEVEL: Error
PID : 249956 TID : 1 PROC : db2star2
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, base sys utilities, DB2StartMain, probe:3
DATA #2 : Hexdump, 4 bytes
0x0FFFFFFFFFFF961C : FFFF FB3C ...<

2010-01-06-15.46.10.399528-360 I6464A306 LEVEL: Event
PID : 213152 TID : 1 PROC : db2start
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, base sys utilities, sqleIssueStartStop, probe:190
DATA #1 : <preformatted>
Single node stopped [-1032].

2010-01-06-15.46.10.401835-360 I6771A661 LEVEL: Info
PID : 213152 TID : 1 PROC : db2start
INSTANCE: tsminst1 NODE : 000
EDUID : 1
FUNCTION: DB2 UDB, oper system services, sqlofica, probe:10
DATA #1 : SQLCA, PD_DB2_TYPE_SQLCA, 136 bytes
sqlcaid : SQLCA sqlcabc: 136 sqlcode: -1032 sqlerrml: 0
sqlerrmc:
sqlerrp : SQLEPFIN
sqlerrd : (1) 0x00000000 (2) 0x00000000 (3) 0x00000000
(4) 0x00000000 (5) 0x00000000 (6) 0x00000000
sqlwarn : (1) (2) (3) (4) (5) (6)
(7) (8) (9) (10) (11)
sqlstate: 57019
ebsbeta(tsminst1)/tsm62>

This generally happens if instance memory is less than the total memory on the box. Check if the instance memory configured is more than the totaly box memory.

Instance memory - db2 get dbm cfg | grep -i instance_memory
Real memory on the box - lsattr -El sys0 | grep -i realmem

ebsbeta(tsminst1)/tsm62/tsminst1>db2 get dbm cfg | grep -i instance_memory
Size of instance shared memory (4KB) (INSTANCE_MEMORY) = AUTOMATIC(20)
ebsbeta(tsminst1)/tsm62/tsminst1>lsattr -El sys0 | grep -i realmem
realmem 8388608 Amount of usable physical memory in Kbytes False

instance_memory is too small. why? update it to automatic without specifying any value: db2 update dbm cfg using instance_memory automatic

But the db2diag.log is not really complaining about instance_memory... the error is related to ftok. So, perform the following:

cd /home/db2v2/sqllib
mv .ftok .ftok.old
db2ftok
db2start

Thanks so very much. I looked and there was no .ftok so I ran the db2ftok and .ftok was created and the db2start worked.
Again thanks.

.ftok should exist under the instance home dir/sqllib

Sorry, I should have put "cd /tsm62/sqllib" instead of "cd /home/db2v2/sqllib"

But it doesn't really matter anymore... since db2start worked.

That's okay I did not see it in sqllib so did a find . -name for .ftok and when it did not come back I was thinking yeah that's the problem. Ran the db2ftok and there it was next db2start and success. I appreciate your help I have done some db2 in past life, but now in real life AIX and TSM. The TSM 6.2 beta went to db2 9.7 so support and I have been stumped for a week.

Again thanks for your help