Results 1 to 13 of 13
  1. #1
    Join Date
    Feb 2013
    Posts
    29

    Unanswered: DB2 HADR problem - corrupted installation ??

    Hello,

    I have a problem with my db2 hadr:

    - I have two systems in my HADR configuration, lts call them node1 and node2
    - Both systems are running SUSE Enterprise Server 11
    - Database version is: 9.7 patchlevel 4

    Node1 was primary node and node2 was standby node. HADR was nearsync.
    I have decided to upgrade node1 so I did a takeover to node2. After upgrade I have rebooted node1 and set up HADR once again so that node1 was standby and node2 was primary.

    After I tried to do a switchover I received a reason code 10 and was unable to do a takeover to node1.

    I thought that something got corrupted on node1 regarding the datafiles or logs etc. so I shut down HADR alltogether, but the problem was that db2stop did not work anymore on node1 (node2 works fine by the way).

    So on node1 I killed the instance (there was no other way) and now when I try to do db2start I get this messages:

    "SQL5043N Support for one or more communications protocols failed to start successfully. However, core database manager functionality started successfully."

    And this in the log file:

    2013-08-20-16.25.26.522278+120 E157579679E306 LEVEL: Event
    PID : 13101 TID : 140737352853280PROC : db2star2
    INSTANCE: db2insp1 NODE : 000
    FUNCTION: DB2 UDB, base sys utilities, DB2StartMain, probe:911
    MESSAGE : ADM7513W Database manager has started.
    START : DB2 DBM

    2013-08-20-16.25.26.560773+120 I157579986E454 LEVEL: Warning
    PID : 13101 TID : 140737352853280PROC : db2star2
    INSTANCE: db2insp1 NODE : 000
    FUNCTION: DB2 UDB, oper system services, sqloInvokeVendorFunction, probe:50
    MESSAGE : ZRC=0x870F0009=-2029060087=SQLO_EOF "the data does not exist"
    DIA8506C Unexpected end of file was reached.
    DATA #1 : String, 46 bytes
    Pipe read from vendor process was interrupted.

    2013-08-20-16.25.26.561028+120 E157580441E396 LEVEL: Error
    PID : 13101 TID : 140737352853280PROC : db2star2
    INSTANCE: db2insp1 NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaDoesRGExist, probe:40
    RETCODE : ECF=0x9000052D=-1879046867=ECF_SQLHA_VENDOR_CALL_PROG_ERROR
    HA Infrastructure vendor function call internal error

    2013-08-20-16.25.26.561119+120 I157580838E344 LEVEL: Error
    PID : 13101 TID : 140737352853280PROC : db2star2
    INSTANCE: db2insp1 NODE : 000
    FUNCTION: <0>, <0>, <0>, probe:100
    RETCODE : ECF=0x9000052D=-1879046867=ECF_SQLHA_VENDOR_CALL_PROG_ERROR
    HA Infrastructure vendor function call internal error

    2013-08-20-16.25.26.561160+120 I157581183E335 LEVEL: Severe
    PID : 13101 TID : 140737352853280PROC : db2star2
    INSTANCE: db2insp1 NODE : 000
    FUNCTION: DB2 UDB, base sys utilities, DB2StartMain, probe:754
    DATA #1 : Hexdump, 4 bytes
    0x00007FFFFFFFE1F4 : AA00 7382 ..s.

    2013-08-20-16.25.26.561240+120 E157581519E271 LEVEL: Warning
    PID : 13101 TID : 140737352853280PROC : db2star2
    INSTANCE: db2insp1 NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaOnlineDB2Partition, probe:71


    Does anyone have a clue what is wrong ? Is my installation corrupted on node1 ?
    I have no problem with reinstalling the DB2 and recreating the instances etc. but I would rather solve the problem. I have searched the web, but IBM documentation is pretty scarce regarding DB2 help.

    Thanks in advance and best regards.

  2. #2
    Join Date
    Jun 2003
    Location
    Toronto, Canada
    Posts
    5,516
    Provided Answers: 1
    Quote Originally Posted by kwhtre View Post
    I have decided to upgrade node1 so I did a takeover to node2. After upgrade
    What exactly did you upgrade and how?
    ---
    "It does not work" is not a valid problem statement.

  3. #3
    Join Date
    May 2003
    Location
    USA
    Posts
    5,737
    Quote Originally Posted by kwhtre View Post
    Node1 was primary node and node2 was standby node. HADR was nearsync.
    I have decided to upgrade node1 so I did a takeover to node2. After upgrade I have rebooted node1 and set up HADR once again so that node1 was standby and node2 was primary.

    After I tried to do a switchover I received a reason code 10 and was unable to do a takeover to node1.
    I don't know exactly what caused your problem or what you were trying to upgrade, but here is what I would recommend next time for a DB2 fixpack or OS upgrade (if upgrading to new version, such as DB2 10.1+, this exact procedure will not work):

    On standby node:
    • db2 deactivate db <sample>
    • db2stop
    • do DB2 fixpack or OS upgrade (not DB2 version upgrade)
    • db2start
    • db2 activate db <sample>
    • verify that HADR is in peer mode (db2pd -d sample -hadr). If in Catch-up mode, wait until it is in peer mode.
    • db2 takeover HADR on db sample


    On primary node:
    • db2 deactivate db <sample>
    • db2stop
    • do DB2 fixpack or OS upgrade (not DB2 version upgrade)
    • db2start
    • db2 activate db <sample>
    • verify that HADR is in peer mode (db2pd -d sample -hadr). If in Catch-up mode, wait until it is in peer mode.
    • db2 takeover HADR on db sample
    M. A. Feldman
    IBM Certified DBA on DB2 for Linux, UNIX, and Windows
    IBM Certified DBA on DB2 for z/OS and OS/390

  4. #4
    Join Date
    Feb 2013
    Posts
    29
    Hi,

    I upgraded the kernel on node1 to version 3.0.13-0.27 using Yast.

    So the kernel is now 2.6.32.46-0.3 on node2 and 3.0.13-0.27 on node1.

    Thank you for the procedure, but do you have any advice on how to resolve the issue ?
    Like I said, IBM is rather vague on how to deal with specific problems like this one.

    Thanks

  5. #5
    Join Date
    Jun 2003
    Location
    Toronto, Canada
    Posts
    5,516
    Provided Answers: 1
    I suggest you open a PMR with IBM support.
    ---
    "It does not work" is not a valid problem statement.

  6. #6
    Join Date
    Feb 2013
    Posts
    29
    OK, so in the event that I would be unable to open a case at IBM, would you agree that the best way to resolve my problem would be to (since node2 functions fine as a single instance db now):

    - reinstall db2 software on the corrupted node (node1)
    - recreate the necessary instances on node1
    - backup node2 db and restore it on node1 and recreate HADR with node2 being primary and node1 standby
    - do a takeover back to node1

    That is what I intend to do if I will be unable to open a case at ibm (I have to check if my company has support from IBM)

    Thanks again for your help and best regards.

  7. #7
    Join Date
    Aug 2008
    Location
    Toronto, Canada
    Posts
    2,367
    Check what cluster_mgr dbm cfg is set to. If it's set to TSA and you're not using TSA, unset it and try db2start again.

  8. #8
    Join Date
    Jun 2003
    Location
    Toronto, Canada
    Posts
    5,516
    Provided Answers: 1
    I can't say if your plan makes sense or not, because I don't know what is the problem with your instance. Have you confirmed that DB2 supports the kernel version that you have so bravely upgraded to?
    ---
    "It does not work" is not a valid problem statement.

  9. #9
    Join Date
    Feb 2013
    Posts
    29
    Hi,

    in fact we are using TSA, but the command lssam outputs this:

    Code:
    Offline IBM.ResourceGroup:db2_db2insp1_db2insp1_DBPKZ-rg Nominal=Online                                                 
             Offline IBM.Application:db2_db2insp1_db2insp1_DBPKZ-rs Control=SuspendedPropagated                              
                     Offline IBM.Application:db2_db2insp1_db2insp1_DBPKZ-rs:pfdb01                                               
                     Offline IBM.Application:db2_db2insp1_db2insp1_DBPKZ-rs:pvdb02                                                  
    Online IBM.ResourceGroup:db2_db2insp1_pfdb01_0-rg Nominal=Online                                                                     
             Online IBM.Application:db2_db2insp1_pfdb01_0-rs                                                                             
                     Online IBM.Application:db2_db2insp1_pfdb01_0-rs:pfdb01
    Online IBM.ResourceGroup:db2_db2insp1_pvdb02_0-rg Nominal=Online
            '- Online IBM.Application:db2_db2insp1_pvdb02_0-rs
                    '- Online IBM.Application:db2_db2insp1_pvdb02_0-rs:pvdb02
    Online IBM.Equivalency:db2_db2insp1_db2insp1_DBPKZ-rg_group-equ
            |- Online IBM.PeerNode:pvdb02:pvdb02
            '- Online IBM.PeerNode:pfdb01:pfdb01
    Online IBM.Equivalency:db2_db2insp1_pfdb01_0-rg_group-equ
            '- Online IBM.PeerNode:pfdb01:pfdb01
    Online IBM.Equivalency:db2_db2insp1_pvdb02_0-rg_group-equ
            '- Online IBM.PeerNode:pvdb02:pvdb02
    Online IBM.Equivalency:db2_public_network_0
            |- Online IBM.NetworkInterface:eth0:pvdb02
            '- Online IBM.NetworkInterface:bond0:pfdb01
    (lsrsrc-api) 2610-440 Permission is denied to access a resource specified in this command.\nNetwork Identity db2insp1@0x51c59d508c2f7186/clusteruser requires 's' permission for the resource '0x201f 0xffff 0xc620066b 0xb732009f 0x9227b887 0xfa448a30' of class IBM.ResourceGroup on node pfdb01
    (lsrsrc-api) 2610-440 Permission is denied to access a resource specified in this command.\nNetwork Identity db2insp1@0x51c59d508c2f7186/clusteruser requires 's' permission for the resource '0x2020 0xffff 0xc620066b 0xb732009f 0x9227b889 0x42645768' of class IBM.ManagedResource on node pfdb01 
    lssam: An unexpected RMC error occurred.The RMC return code was 1.
    here are the outputs of commands lsrpdomain and lsrpnode:

    lsrpdomain:

    Name OpState RSCTActiveVersion MixedVersions TSPort GSPort
    hadr_dbpkz Online 3.1.0.3 No 12347 12348

    lsrpnode:

    Name OpState RSCTVersion
    pfdb01 Online 3.1.0.3
    pvdb02 Online 3.1.0.3

    Both nodes give the same output of these commands.
    Could the problem be with TSA ? Is that "offline" in the first command output the reason ?

  10. #10
    Join Date
    Apr 2006
    Location
    Belgium
    Posts
    2,514
    Provided Answers: 11
    lssam output should be like :
    Online IBM.ResourceGroup:db2_db2inst1_alx00005_0-rg Nominal=Online
    '- Online IBM.Application:db2_db2inst1_alx00005_0-rs
    '- Online IBM.Application:db2_db2inst1_alx00005_0-rs:alx00005
    Online IBM.ResourceGroup:db2_db2inst1_alx00006_0-rg Nominal=Online
    '- Online IBM.Application:db2_db2inst1_alx00006_0-rs
    '- Online IBM.Application:db2_db2inst1_alx00006_0-rs:alx00006
    Online IBM.ResourceGroup:db2_db2inst1_db2inst1_AM-rg Nominal=Online

    first node - second node - db.....

    at the end of lssam is an error
    executed from root ?
    we have had a similar situation where one of the rsmc processes was down and needed a restart....
    Best Regards, Guy Przytula
    Database Software Consultant
    Good DBAs are not formed in a week or a month. They are created little by little, day by day. Protracted and patient effort is needed to develop good DBAs.
    Spoon feeding : To treat (another) in a way that discourages independent thought or action, as by overindulgence.
    DB2 UDB LUW Certified V7-V8-V9-V9.7-V10.1-V10.5 DB Admin - Advanced DBA -Dprop..
    Information Server Datastage Certified
    http://www.infocura.be

  11. #11
    Join Date
    Feb 2013
    Posts
    29
    No, I executed the command as an instance owner - db2insp1

    There is another symptom:

    I have done a db2haicu -disable on node2 (current primary node)
    When I tried to do the same on node1 I got this error:

    "There was an error with one of the issued cluster manager commands. Refer to db2diag.log and the DB2 Information Center for details."

    db2diag.log:

    Code:
    2013-08-21-10.56.32.845806+120 I157736411E454      LEVEL: Warning
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 UDB, oper system services, sqloInvokeVendorFunction, probe:50
    MESSAGE : ZRC=0x870F0009=-2029060087=SQLO_EOF "the data does not exist"
              DIA8506C Unexpected end of file was reached.
    DATA #1 : String, 46 bytes
    Pipe read from vendor process was interrupted.
    
    2013-08-21-10.56.32.846215+120 E157736866E398      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaListCluster, probe:1000
    RETCODE : ECF=0x9000052D=-1879046867=ECF_SQLHA_VENDOR_CALL_PROG_ERROR
              HA Infrastructure vendor function call internal error
    
    2013-08-21-10.56.32.846328+120 I157737265E3589     LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 UDB, oper system services, sqloNotifyVendorOfNewCall, probe:1000
    MESSAGE : ZRC=0x800F00AF=-2146500433=SQLO_PROG_ERR "Unknown"
    DATA #1 : ZRC, PD_TYPE_ZRC, 4 bytes
    0x870F00A6
    DATA #2 : unsigned integer, 4 bytes
    10
    DATA #3 : Hexdump, 624 bytes
    0x00007FFFEDCF90E0 : 40AA E5F7 FF7F 0000 0000 0000 0000 0000    @...............
    0x00007FFFEDCF90F0 : 0000 0000 0000 0000 4534 0000 0000 0000    ........E4......
    0x00007FFFEDCF9100 : 0600 0000 4200 0000 0010 0000 0000 0000    ....B...........
    0x00007FFFEDCF9110 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9120 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9130 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9140 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9150 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9160 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9170 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9180 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9190 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91A0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91B0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91C0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91D0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    
    
    2013-08-21-10.56.32.846609+120 I157740855E3589     LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 UDB, oper system services, sqloNotifyVendorOfNewCall, probe:1010
    MESSAGE : ZRC=0x800F00AF=-2146500433=SQLO_PROG_ERR "Unknown"
    DATA #1 : ZRC, PD_TYPE_ZRC, 4 bytes
    0x870F00A6
    DATA #2 : unsigned integer, 4 bytes
    10
    DATA #3 : Hexdump, 624 bytes
    0x00007FFFEDCF90E0 : 40AA E5F7 FF7F 0000 0000 0000 0000 0000    @...............
    0x00007FFFEDCF90F0 : 0000 0000 0000 0000 4534 0000 0000 0000    ........E4......
    0x00007FFFEDCF9100 : 0600 0000 4200 0000 0010 0000 0000 0000    ....B...........
    0x00007FFFEDCF9110 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9120 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9130 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9140 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9150 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9160 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9170 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9180 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF9190 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91A0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91B0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91C0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91D0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    0x00007FFFEDCF91E0 : 0000 0000 0000 0000 0000 0000 0000 0000    ................
    
    
    2013-08-21-10.56.32.846856+120 I157744445E922      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 UDB, oper system services, sqlossig, probe:10
    MESSAGE : Sending SIGKILL to the following process id
    DATA #1 : signed integer, 4 bytes
    13381
    CALLSTCK: 
      [0] 0x00007FFFF5A85333 pdLog + 0x1FF
      [1] 0x00007FFFF5B4155E sqlossig + 0x10A
      [2] 0x00007FFFF5B2F978 /home/db2insp1/sqllib/lib64/libdb2.so.1 + 0x55B978
      [3] 0x00007FFFF5B2F466 sqloTerminateVendorProcess + 0x8E
      [4] 0x00007FFFF5E9ECCA _Z16sqlhaListClusterP16listClusterBlock + 0x35A
      [5] 0x000000000043E1F1 _Z26sqlhaUIGetActiveDomainNamePbPc + 0x151
      [6] 0x00000000004573B7 _ZN17SqlhaUIAppContext6UpdateEv + 0x155B
      [7] 0x0000000000455D50 _ZN17SqlhaUIAppContext11getInstanceEv + 0x168
      [8] 0x0000000000419F81 main + 0x969
      [9] 0x00007FFFF4AE5C36 __libc_start_main + 0xE6
    
    2013-08-21-10.56.32.848281+120 E157745368E325      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaListCluster, probe:1500
    RETCODE : ZRC=0x800F00AF=-2146500433=SQLO_PROG_ERR "Unknown"
    
    2013-08-21-10.56.32.848471+120 E157745694E399      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaUIListAllDomainsInClus, probe:200
    RETCODE : ECF=0x9000052F=-1879046865=ECF_SQLHA_INTERNAL
              Internal SQLHA Error
    MESSAGE : Failed to get cluster list.
    
    2013-08-21-10.56.32.848542+120 E157746094E361      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaUIListAllDomainsInClus, probe:200
    RETCODE : ECF=0x9000052F=-1879046865=ECF_SQLHA_INTERNAL
              Internal SQLHA Error
    
    2013-08-21-10.56.32.848595+120 E157746456E410      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaUIGetActiveDomainName, probe:200
    RETCODE : ECF=0x9000052F=-1879046865=ECF_SQLHA_INTERNAL
              Internal SQLHA Error
    MESSAGE : Error in retrieving Domains in Cluster.
    
    2013-08-21-10.56.32.848646+120 E157746867E498      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaUIGetActiveDomainName, probe:200
    RETCODE : ECF=0x9000052F=-1879046865=ECF_SQLHA_INTERNAL
              Internal SQLHA Error
    DATA #1 : String, 0 bytes
    Object not dumped: Address: 0x00007FFFFFFFB4E0 Size: 0 Reason: Zero-length data
    DATA #2 : Boolean, 8 bytes
    true
    
    2013-08-21-10.56.32.848743+120 E157747366E360      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, SqlhaUIAppContext::Update, probe:1100
    RETCODE : ECF=0x9000052F=-1879046865=ECF_SQLHA_INTERNAL
              Internal SQLHA Error
    
    2013-08-21-10.56.32.848807+120 E157747727E364      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, SqlhaUIAppContext::getInstance, probe:100
    RETCODE : ECF=0x9000052F=-1879046865=ECF_SQLHA_INTERNAL
              Internal SQLHA Error
    
    2013-08-21-10.56.32.848895+120 E157748092E353      LEVEL: Error
    PID     : 13379                TID  : 140737352865568PROC : db2haicu
    INSTANCE: db2insp1             NODE : 000
    FUNCTION: DB2 Common, SQLHA APIs for DB2 HA Infrastructure, sqlhaUIMain, probe:900
    RETCODE : ECF=0x90000530=-1879046864=ECF_SQLHA_NOTINITED
              Library uninitialized error

  12. #12
    Join Date
    Apr 2006
    Location
    Belgium
    Posts
    2,514
    Provided Answers: 11
    rsmc command should be executed as root
    db2haicu disable should only be executed at one node and will disable all
    try to read some doc in infocenter about tsa....
    Best Regards, Guy Przytula
    Database Software Consultant
    Good DBAs are not formed in a week or a month. They are created little by little, day by day. Protracted and patient effort is needed to develop good DBAs.
    Spoon feeding : To treat (another) in a way that discourages independent thought or action, as by overindulgence.
    DB2 UDB LUW Certified V7-V8-V9-V9.7-V10.1-V10.5 DB Admin - Advanced DBA -Dprop..
    Information Server Datastage Certified
    http://www.infocura.be

  13. #13
    Join Date
    Feb 2013
    Posts
    29
    Thanks for your help for now guys, i've opened a case at IBM and I'm waiting for their response now. Hopefully they can provide a solution.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •