Page 1 of 2 12 LastLast
Results 1 to 15 of 16
  1. #1
    Join Date
    Aug 2008
    Posts
    2

    Unanswered: Problem running root.sh during RAC install.

    I'm having trouble with an install of RAC 10gR2 (10.0.2.0.1.0). It's a 2-node system running on vmware. The OS is RHEL 4.

    I'm using two shared raw drives (virtual of course) as ocr, voting.

    When I run root.sh I get the following:
    Code:
    Setting the permissions on OCR backup directory
    Setting up NS directories
    Oracle Cluster Registry configuration upgraded successfully
    WARNING: directory '/home/oracle/oracle/product/10.2.0' is not owned by root
    WARNING: directory '/home/oracle/oracle/product' is not owned by root
    WARNING: directory '/home/oracle/oracle' is not owned by root
    WARNING: directory '/home/oracle' is not owned by root
    clscfg: EXISTING configuration version 3 detected.
    clscfg: version 3 is 10G Release 2.
    assigning default hostname docrac1 for node 1.
    assigning default hostname docrac2 for node 2.
    Successfully accumulated necessary OCR keys.
    Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
    node <nodenumber>: <nodename> <private interconnect name> <hostname>
    node 1: docrac1 docrac1-priv docrac1
    node 2: docrac2 docrac2-priv docrac2
    clscfg: Arguments check out successfully.
    
    NO KEYS WERE WRITTEN. Supply -force parameter to override.
    -force is destructive and will destroy any previous cluster
    configuration.
    Oracle Cluster Registry for cluster has already been initialized
    Startup will be queued to init within 90 seconds.
    After which it hangs. Typing exit does not do anything, I have to Ctrl+C to get out. I have let it be for nearly 20 minutes to ensure that nothing was waiting.

    Running ps -ef | grep crs shows me that crs isn't running.

    Running ps-ef | grep cssd gives me:
    Code:
    root 5857 5583 0 11:30 pts/2 00:00:00 /bin/sh /etc/init.d/init.cssd startcheck CSS
    Running ps -ef | grep crs fives me:
    Code:
    root 5583 5524 0 11:30 pts/2 00:00:00 /bin/sh /home/oracle/oracle/product/10.2.0/crs/install/rootconfig
    I've tried running sh -x /etc/init.d/init/cssd startcheck and I get the following:
    Code:
    + unset OPROCD_EXISTS
    + '[' true = false ']'
    + '[' startcheck = daemon ']'
    + '[' startcheck = run ']'
    + case $1 in
    + /etc/init.d/init.cssd runcheck
    + STATUS=0
    + '[' 0 '!=' 0 ']'
    + '[' -f /home/oracle/oracle/product/10.2.0/crs/lib/INVALID_DIRECTORY ']'
    + '[' '!' -r /home/oracle/oracle/product/10.2.0/crs/bin/crsctl ']'
    + '[' '' = CSS ']'
    + /bin/su -l oracle -c '/home/oracle/oracle/product/10.2.0/crs/bin/crsctl check boot > /tmp/crsctl.6626'
    + RC=6
    + '[' 6 '!=' 0 ']'
    + /usr/bin/logger -puser.err Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.6626.
    + /bin/sleep 60
    exit
    + /bin/su -l oracle -c '/home/oracle/oracle/product/10.2.0/crs/bin/crsctl check boot > /tmp/crsctl.6626'
    + RC=6
    + '[' 6 '!=' 0 ']'
    + /usr/bin/logger -puser.err Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.6626.
    + /bin/sleep 60
    Each time pausing on the /bin/sleep 60 for a minute, and nothing happening. I ctrl+c'd out of this after 4 iterations.

    I checked /var/log/messages and got:
    Code:
    Aug 10 04:02:17 docrac2 syslogd 1.4.1: restart.
    Aug 10 04:02:20 docrac2 crond(pam_unix)[29720]: session closed for user root
    Aug 10 04:02:21 docrac2 dbus: Can't send to audit system: USER_AVC pid=2834 uid=81 loginuid=-1 message=avc: denied { send_msg } for scontext=user_u:system_r:unconfined_t tcontext=user_u:system_r:initrc_t tclass=dbus
    Aug 10 04:02:56 docrac2 last message repeated 7 times
    Aug 10 04:04:01 docrac2 last message repeated 13 times
    Aug 10 04:05:06 docrac2 last message repeated 13 times
    Aug 10 04:06:07 docrac2 last message repeated 12 times
    Aug 10 04:07:12 docrac2 last message repeated 13 times
    Aug 10 04:08:17 docrac2 last message repeated 13 times
    Aug 10 04:09:22 docrac2 last message repeated 13 times
    Aug 10 04:10:27 docrac2 last message repeated 13 times
    Aug 10 04:11:32 docrac2 last message repeated 13 times
    Aug 10 04:12:37 docrac2 last message repeated 13 times
    Aug 10 04:13:42 docrac2 last message repeated 13 times
    Aug 10 04:14:47 docrac2 last message repeated 13 times
    Aug 10 04:15:52 docrac2 last message repeated 13 times
    Aug 10 04:16:57 docrac2 last message repeated 13 times
    Aug 10 04:18:02 docrac2 last message repeated 13 times
    Aug 10 04:19:07 docrac2 last message repeated 13 times
    Aug 10 04:20:12 docrac2 last message repeated 13 times
    Aug 10 04:21:17 docrac2 last message repeated 13 times
    My .bash_profile hardly has anything in it as it was a fresh red hat install.

    Running /bin/su -l oracle -c ls > /tmp/lsout does not hang.

    The /tmp/crsctl.6626 file (referenced above) contains the following:

    Code:
    Failure -2 opening file handle for (votingdisk)
    Failure 1 checking the CSS voting disk 'votingdisk'.
    Not able to read adequate number of voting disks

    Just so there's no confusion, here's what votingdisk is (same on both nodes):
    Code:
    lrwxrwxrwx 1 root root 13 Aug 11 14:50 asm -> /dev/raw/raw3
    lrwxrwxrwx 1 root root 13 Aug 11 14:50 ocr -> /dev/raw/raw1
    lrwxrwxrwx 1 root root 13 Aug 11 14:50 votingdisk -> /dev/raw/raw2
    And to make sure there was no permissions problem, before running the installer, I ensured the permissions on the raw drives were as follows:

    Code:
    root@docrac2:/home/oracle/oradata $ ls /dev/raw -al
    total 0
    drwxr-xr-x 2 root root 100 Aug 11 16:13 .
    drwxr-xr-x 10 root root 5960 Aug 11 16:13 ..
    crw-rw-r-- 1 oracle oinstall 162, 1 Aug 11 16:13 raw1
    crw-rw-r-- 1 oracle oinstall 162, 2 Aug 11 16:13 raw2
    crw-rw-r-- 1 oracle oinstall 162, 3 Aug 11 16:13 raw3
    The raw drives are bound to a shared partition:

    Code:
    oracle@docrac1:~ $ sudo raw -qa
    /dev/raw/raw1: bound to major 8, minor 129
    /dev/raw/raw2: bound to major 8, minor 145
    /dev/raw/raw3: bound to major 8, minor 161
    The way I have this set up is that both nodes are virtual machines running in VMware. I disabled locking on both virtual machines and added the same hard drive files to each machine to simulate shared raw devices. Here's the contents of the /etc/sysconfig/rawdevices file:
    Code:
    /dev/raw/raw1 /dev/sdi1
    /dev/raw/raw2 /dev/sdj1
    /dev/raw/raw3 /dev/sdk1
    I ran
    Code:
    dd if=/dev/zero of=votingdisk bs=1M count=256
    and it made no difference.

    I really have no idea what's going on here, I really need to get this cluster running. I've provided all the debug information I can think of. Any help?

  2. #2
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Let me guess.
    You placed the Cluster Registry on OCFS2 volume. Right?

    Note:329450.1
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  3. #3
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  4. #4
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  5. #5
    Join Date
    Aug 2008
    Posts
    2
    No, it's not on an OCFS2 volume, they're raw drives, and they're shared by virtue of the hard drive files being referred to on the vmware host computer. Yes, file locking is turned off.

  6. #6
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  7. #7
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  8. #8
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  9. #9
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  10. #10
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  11. #11
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  12. #12
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  13. #13
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  14. #14
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Does Note:329450.1 give you any clues?
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

  15. #15
    Join Date
    Aug 2003
    Location
    Where the Surf Meets the Turf @Del Mar, CA
    Posts
    7,776
    Provided Answers: 1
    Folks,
    I apologize for spamming this forum.
    My browser was having a brain cramp.
    I could not see that my attempts were actually succeeding.

    Sorry about the mess I made.
    It really was not intentional.

    If any moderator wishes to clean up, I'll understand.
    You can lead some folks to knowledge, but you can not make them think.
    The average person thinks he's above average!
    For most folks, they don't know, what they don't know.
    Good judgement comes from experience. Experience comes from bad judgement.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •