DIA3800C A data file error has occured

rhayabusa22 · #1 (**permalink**) 08-20-09, 13:09

Hi Guys,

I am using db2v7.1 on SunOS 5.8 for datawarehousing. A couple days ago, a warhouse manager ETL was doing a delete from a table and I cancelled the process. I usually drop and rebuild that particular staging table because it contains millions of records and I don't want to lose time writing those useless records into the transaction log. I ended up issuing a force application due to the process taking a long while to stop. After which the system came unresponsive. I stoppped and started the database after which nobody could connect, giving the error SQL0104N internal error. I looked at the db2diag.log and found the error DIA3800C A data file error has occurred. Does anyone know what this error is? I've never heard the phrase data file when dealing with db2.

Code:

2009-08-17-18.04.06.530470   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpresr   Probe:1   Database:TDWDB
DIA3908W Crash recovery has been initiated.  Lowtran LSN is "02B7D773800C", 
Minbuff LSN is "02B80991A0D7".

2009-08-17-18.04.06.558148   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlprecm   Probe:125   Database:TDWDB

Using parallel recovery with 4 agents 64 QSets 448 queues and 2 chunks


2009-08-17-18.05.08.462559   Instance:db2inst1   Node:000
PID:5180(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
data_management  sqldRedoUpsert   Probe:2   Database:TDWDB

logic err016f 0002 0213 0000 2207 d009 0115 0a37       .o......"......7                
0a53 0000 0115 0100                           .S......                


2009-08-17-18.05.08.691193   Instance:db2inst1   Node:000
PID:5180(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
data_management  sqldRedoUpsert   Probe:1171   Database:TDWDB
DIA3800C A data file error has occurred, record id is "".

ZRC=FFFFF401

String Title:INDENTIFIERS: PID:5180 Node:000

Tablespace ID = 2, Object ID = 531, Object Type = 0


String Title:PAGE CONTENTS: PID:5180 Node:000
Obj Page = 159056, Pool Page = 2230224, Slot Count = 14


String Title:SPACE MANAGEMENT: PID:5180 Node:000
Free Space = 122, Reserved = 0, Youngest Reserved = 0


String Title:RID CONTENTS: PID:5180 Node:000
Page = 2230224, Slot = 9


String Title:SLOT DIRECTORY: PID:5180 Node:000
Record Offset = 1258


String Title:RECORD HEADER: PID:5180 Node:000
Record Type = 0, Record Length = 277


Data Title:RECORD DATA: PID:5180 Node:000
0000 0115 0100 00fe 0000 0000 0100 0000       ................                
0000 3020 2020 2020 2020 2020 2020 2020       ..0                             
2000 3632 312d 3436 3836 2020 2020 2020        .621-4686                      
2020 2020 0000 0b00 3632 312d 3436 3836           ....621-4686                
2020 2020 2020 2020 2020 2020 00ff ff00                   ....                
3632 372d 3637 3631 2020 2020 2020 2020       627-6761                        
2020 2020 0000 0200 0001 0000 0000 0000           ............                
066c 0020 0906 0307 2140 0000 0000 0000       .l. ....!@......                
0007 0000 0200 0000 041b 0000 0000 2800       ..............(.                
494e 5f4d 4f43 5f48 4920 2020 2020 2020       IN_MOC_HI                       
2020 2020 0000 0000 0000 0000 003c 00ff           .........<..                
ff00 0001 0036 3231 3436 3836 2020 2020       .....6214686                    
2020 2020 2020 2020 2000 3632 3736 3736                .627676                
3120 2020 2020 2020 2020 2020 0000 0001       1           ....                
0000 0100 0000 0300 0024 8200 0000 2516       .........$....%.                
0031 3131 2020 2020 2020 2020 2020 2020       .111                            
0000 fe00 0f00 3120 2020 2020 2020 2020       ......1                         
2020 2020 20                                                       


Data Title:OBJECT_DESC PID:5180 Node:000
0002 0213 0002 0213 0000 0000 02af a166       ...............f                
800c 0000 0000 0000 0000 1080 0000 0000       ................                
0000 1120 0000 0002 0000 0027 0000 0000       ... .......'....                
0000 1000 0000 0020 0000 0001 0213 0002       ....... ........                
1182 79a4 1184 0030                           ..y....0                


Data Title:PAGE HEADER: PID:5180 Node:000
0030 0fd0 0000 0434 0300 02b0 87ac f5cc       .0.....4........                
0022 07d0 0213 0002 9096 ccda 0002 6d50       ."............mP                
0000 0002 0000 0002 0000 0000 0000 0000       ................                

Dump File:/sunfire2/home/db2inst1/sqllib/db2dump/5180.000 Data:SQLB_PAGE
Dump File:/sunfire2/home/db2inst1/sqllib/db2dump/5180.000 Data:SQLD_TCB

String Title:sqleMarkDBad: PID:5180 Node:000
Marking the database bad.

2009-08-17-18.05.10.383994   Instance:db2inst1   Node:000
PID:5180(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
data_management  sqldRedo   Probe:2626   Database:TDWDB
DIA3800C A data file error has occurred, record id is "".

ZRC=FFFFF401

rhayabusa22 · #2 (**permalink**) 08-20-09, 13:11

Code:

2009-08-17-18.05.10.560172   Instance:db2inst1   Node:000
PID:5180(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
data_management  sqldmrdo   Probe:222   Database:TDWDB

Error during redo.ffff f401 016f 0002 0213 02b8 0991 a0d7       .....o..........                


Data Title:logrec PID:5180 Node:000
016f 0002 0213 0000 2207 d009 0115 0a37       .o......"......7                
0a53 0000 0115 0100 00fe 0000 0000 0100       .S..............                
0000 0000 3020 2020 2020 2020 2020 2020       ....0                           
2020 2000 3632 312d 3436 3836 2020 2020          .621-4686                    
2020 2020 2020 0000 0b00 3632 312d 3436             ....621-46                
3836 2020 2020 2020 2020 2020 2020 00ff       86            ..                
ff00 3632 372d 3637 3631 2020 2020 2020       ..627-6761                      
2020 2020 2020 0000 0200 0001 0000 0000             ..........                
0000 066c 0020 0906 0307 2140 0000 0000       ...l. ....!@....                
0000 0007 0000 0200 0000 041b 0000 0000       ................                
2800 494e 5f4d 4f43 5f48 4920 2020 2020       (.IN_MOC_HI                     
2020 2020 2020 0000 0000 0000 0000 003c             .........<                
00ff ff00 0001 0036 3231 3436 3836 2020       .......6214686                  
2020 2020 2020 2020 2020 2000 3632 3736                  .6276                
3736 3120 2020 2020 2020 2020 2020 0000       761           ..                
0001 0000 0100 0000 0300 0024 8200 0000       ...........$....                
2516 0031 3131 2020 2020 2020 2020 2020       %..111                          
2020 0000 fe00 0f00 3120 2020 2020 2020         ......1                       
2020 2020 2020 20                                                    


2009-08-17-18.05.11.436399   Instance:db2inst1   Node:000
PID:5180(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpRecDbRedo   Probe:50   Database:TDWDB

REDO returns -3071 on log record: 0000 0127 0043 0000 02b8 0991 9f86 0000       ...'.C..........                
006e 7dd4 02b8 0166 6d95 0000 0000 0000       .n}....fm.......                


2009-08-17-18.05.11.646179   Instance:db2inst1   Node:000
PID:5180(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpRecDbRedo   Probe:50   Database:TDWDB

extra info: 016f 0002 0213 0000 2207 d009 0115 0a37       .o......"......7                
0a53 0000 0115 0100 00fe 0000 0000 0100       .S..............                
0000 0000 3020 2020 2020 2020 2020 2020       ....0                           
2020 2000 3632 312d 3436 3836 2020 2020          .621-4686                    
2020 2020 2020 0000 0b00 3632 312d 3436             ....621-46                
3836 2020 2020 2020 2020 2020 2020 00ff       86            ..                
ff00 3632 372d 3637 3631 2020 2020 2020       ..627-6761                      
2020 2020 2020 0000 0200 0001 0000 0000             ..........                
0000 066c 0020 0906 0307 2140 0000 0000       ...l. ....!@....                
0000 0007 0000 0200 0000 041b 0000 0000       ................                
2800 494e 5f4d 4f43 5f48 4920 2020 2020       (.IN_MOC_HI                     
2020 2020 2020 0000 0000 0000 0000 003c             .........<                
00ff ff00 0001 0036 3231 3436 3836 2020       .......6214686                  
2020 2020 2020 2020 2020 2000 3632 3736                  .6276                
3736 3120 2020 2020 2020 2020 2020 0000       761           ..                
0001 0000 0100 0000 0300 0024 8200 0000       ...........$....                
2516 0031 3131 2020 2020 2020 2020 2020       %..111                          
2020 0000 fe00 0f00 3120 2020 2020 2020         ......1                       
2020 2020 2020 20                                                    


2009-08-17-18.05.12.443670   Instance:db2inst1   Node:000
PID:5180(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpPRecProcLog   Probe:250   Database:TDWDB
DIA3800C A data file error has occurred, record id is "".

ZRC=FFFFF401

2009-08-17-18.05.12.599572   Instance:db2inst1   Node:000
PID:5180(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpPRecProcLog   Probe:250   Database:TDWDB

qEntry for 02B80991A0D7 entryType 1 queueId 9 waitOthers 0 numQSetBlocked 0 lrHeader:
0000 0127 0043 0000 02b8 0991 9f86 0000       ...'.C..........                
006e 7dd4 02b8 0166 6d95 0000 0000 0000       .n}....fm.......                


2009-08-17-18.05.12.828276   Instance:db2inst1   Node:
PID:5178(db2agnsc (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpPRecReadLog   Probe:29300   Database:TDWDB
DIA9999E An internal error occurred. Report the following error code : "     
512".

2009-08-17-18.05.12.915311   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpresr   Probe:160   Database:TDWDB
DIA3907W In-doubt transaction(s) exists at the end of crash recovery.

2009-08-17-18.05.12.953198   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpresr   Probe:10   Database:TDWDB
DIA3910W Crash recovery completed. Return Code = "-3071"

2009-08-17-18.05.12.977289   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
recovery_manager  sqlpresr   Probe:10   Database:TDWDB

Recovery started on log file: 5330 3030 3030 3030 2e4c 4f47                 S0000000.LOG                


2009-08-17-18.05.13.154760   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
base_sys_utilities  sqlesrsu   Probe:16   Database:TDWDB

DiagData
ffff f401                                     ....                


2009-08-17-18.05.13.353598   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
base_sys_utilities  sqlesrsu   Probe:16   Database:TDWDB

RIDS/sqlesrsu MS/UNK_REC_ERR PRCS/16ffff f401                                     ....                


2009-08-17-18.05.13.541718   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
base_sys_utilities  sqlesrsu   Probe:110   Database:TDWDB

Restart failed with sqlcode: ffff fbee                                     ....                


2009-08-17-18.05.13.756548   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
base_sys_utilities  sqlesrsu   Probe:202   Database:TDWDB

String Title: PID:5166 Node:000
If 'DATALINK: file server not registered' appears above and DATALINKS=NO, set DATALINKS=YES and try RESTART again

2009-08-17-18.05.13.851700   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
buffer_pool_services  sqlbTerminateAgent   Probe:837   Database:TDWDB
DIA3727C The database has been marked as being damaged.

ZRC=FFFFE11A

2009-08-17-18.05.14.020322   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
base_sys_utilities  sqleTermDbConnect   Probe:5   Database:TDWDB
DIA3727C The database has been marked as being damaged.

ZRC=FFFFE11A

2009-08-17-18.05.16.041071   Instance:db2inst1   Node:000
PID:5166(db2agent (TDWDB))   Appid:*LOCAL.db2inst1.090818000359
base_sys_utilities  sqlesrsu   Probe:22   Database:TDWDB

DiagData
ffff fbf6

n_i · #3 (**permalink**) 08-20-09, 13:34

Looks like one of the tables has been damaged. Your best bet would be to restore the database. You will probably be able to see more details if you run "db2dart tdwdb /t /tsi 2 /oi 531" - the tablespace ID and object ID come from the "Tablespace ID = 2, Object ID = 531, Object Type = 0" line in db2diag.log

rhayabusa22 · #4 (**permalink**) 08-20-09, 13:45

Thanks for the quick reply. I had run the db2dart command but I saw no errors. However when I ran the db2dart for all tablespaces, the in question tablespace had a checksum value of -xxxx. All the others had positive values. Not sure if that means anything.

I guess I will proceed with the db restore.

Thanks once again

Internet Services

Web Development

Digital Marketing

Consumer Tech