Multipath and getuid_callout issues with HP XP1024 disk array

Multipath and getuid_callout issues with HP XP1024 disk array

[Greene, Rick]

[-- Attachment #1.1: Type: text/plain, Size: 697 bytes --]

I've done what I can to try to understand how all this works, but I keep
getting "error calling out /sbin/scsi_id -g -u -s /block/sda" when I run
the command "multipath -v2"

 

I've tried a number of different things in the /etc/multipath.conf file,
but keep coming back to this same error.  If I run the command manually
I get the following:

 

# /sbin/scsi_id -g -u -s /block/sda

0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100

 

What's missing?  Any help greatly appreciated.

 

Thanks in advance,

 

Rick Greene

Unix Support

NCO Group

507 Prudential Road

Horsham  PA  19044

office: 215-441-3529

   fax: 215-441-3886

 


[-- Attachment #1.2: Type: text/html, Size: 4122 bytes --]

[-- Attachment #2: Type: text/plain, Size: 0 bytes --]

Re: Multipath and getuid_callout issues with HP XP1024 disk array

[malahal]

Greene, Rick [rick.greene@ncogroup.com] wrote:
>    I've done what I can to try to understand how all this works, but I keep
>    getting "error calling out /sbin/scsi_id -g -u -s /block/sda" when I run
>    the command "multipath -v2"
> 
> 
> 
>    I've tried a number of different things in the /etc/multipath.conf file,
>    but keep coming back to this same error.  If I run the command manually I
>    get the following:
> 
> 
> 
>    # /sbin/scsi_id -g -u -s /block/sda
> 
>    0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
> 
> 
> 
>    What's missing?  Any help greatly appreciated.

You are not missing anything. The device id is too big to fit in
multipath tools allocated memory. The program incorrectly prints that
there is a problem while executing /sbin/scsi_id but in fact the problem
lies in the program itself. You may have some old version of multipath
tools. WWID_SIZE was set to 64 bytes and that is small for your device.
Get the latest version where that macro is set to 128 or so.

Hope that helps!

--Malahal.

RE: Multipath and getuid_callout issues with HP XP1024disk array

[Greene, Rick]

[-- Attachment #1: Type: text/plain, Size: 2294 bytes --]

Ok, some more background first:

System is an HP Proliant DL380 (or maybe DL580?), using Emulex fibre
channel cards (don't know exact model off-hand).

Running Red Hat Enterprise Linux 4, update 5.

Device-mapper-multipath was version 0.4.5-21, just updated it to
0.4.5-27

There are 4 LUNs from an HP XP1024 disk array, each pathed to be visible
on each fibre channel.  LUN type is OPEN-E.
 
Multipath now seems to accept the longer string returned by scsi_id, but
it doesn't seem able to tell that certain disks are the same.

Attached is the multipath.conf file I'm using and the output from
"multipath -v3". If the attachments don't come through, I'll send
separate emails with just the contents for each file.

Any aide gladly received, I'm in over my head on this one.

Thanks,
Rick


-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of malahal@us.ibm.com
Sent: Tuesday, January 29, 2008 5:19 PM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath and getuid_callout issues with HP
XP1024disk array

Greene, Rick [rick.greene@ncogroup.com] wrote:
>    I've done what I can to try to understand how all this works, but I
keep
>    getting "error calling out /sbin/scsi_id -g -u -s /block/sda" when
I run
>    the command "multipath -v2"
> 
> 
> 
>    I've tried a number of different things in the /etc/multipath.conf
file,
>    but keep coming back to this same error.  If I run the command
manually I
>    get the following:
> 
> 
> 
>    # /sbin/scsi_id -g -u -s /block/sda
> 
>    0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
> 
> 
> 
>    What's missing?  Any help greatly appreciated.

You are not missing anything. The device id is too big to fit in
multipath tools allocated memory. The program incorrectly prints that
there is a problem while executing /sbin/scsi_id but in fact the problem
lies in the program itself. You may have some old version of multipath
tools. WWID_SIZE was set to 64 bytes and that is small for your device.
Get the latest version where that macro is set to 128 or so.

Hope that helps!

--Malahal.

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

[-- Attachment #2: multipath.out --]
[-- Type: application/octet-stream, Size: 11821 bytes --]

load path identifiers cache
ux_socket_connect error
#
# all paths in cache :
#
path cciss!c0d0 not found in pathvec

===== path info cciss!c0d0 (mask 0x1f) =====
path cciss!c0d1 not found in pathvec

===== path info cciss!c0d1 (mask 0x1f) =====
dm-0 blacklisted
dm-1 blacklisted
dm-2 blacklisted
dm-3 blacklisted
dm-4 blacklisted
dm-5 blacklisted
dm-6 blacklisted
dm-7 blacklisted
fd0 blacklisted
hda blacklisted
md0 blacklisted
ram0 blacklisted
ram10 blacklisted
ram11 blacklisted
ram12 blacklisted
ram13 blacklisted
ram14 blacklisted
ram15 blacklisted
ram1 blacklisted
ram2 blacklisted
ram3 blacklisted
ram4 blacklisted
ram5 blacklisted
ram6 blacklisted
ram7 blacklisted
ram8 blacklisted
ram9 blacklisted
path sda not found in pathvec

===== path info sda (mask 0x1f) =====
bus = 1
dev_t = 8:0
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 1:0:0:0
tgt_node_name = 0x50060e80039c5a04
serial = 40026 
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/scsi_id -g -u -s /block/%n (internal default)
uid = 0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100 (callout)
path sdb not found in pathvec

===== path info sdb (mask 0x1f) =====
bus = 1
dev_t = 8:16
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 1:0:0:1
tgt_node_name = 0x50060e80039c5a04
serial = 40026 
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/scsi_id -g -u -s /block/%n (internal default)
uid = 0HP______OPEN-E__________50060e80039c5a0400010000000000000000e100 (callout)
path sdc not found in pathvec

===== path info sdc (mask 0x1f) =====
bus = 1
dev_t = 8:32
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 1:0:0:2
tgt_node_name = 0x50060e80039c5a04
serial = 40026 
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/scsi_id -g -u -s /block/%n (internal default)
uid = 0HP______OPEN-E__________50060e80039c5a0400020000000000000000e100 (callout)
path sdd not found in pathvec

===== path info sdd (mask 0x1f) =====
bus = 1
dev_t = 8:48
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 1:0:0:3
tgt_node_name = 0x50060e80039c5a04
serial = 40026 
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/scsi_id -g -u -s /block/%n (internal default)
uid = 0HP______OPEN-E__________50060e80039c5a0400030000000000000000e100 (callout)
path sde not found in pathvec

===== path info sde (mask 0x1f) =====
bus = 1
dev_t = 8:64
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:0
tgt_node_name = 0x50060e80039c5a14
serial = 40026 
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/scsi_id -g -u -s /block/%n (internal default)
uid = 0HP______OPEN-E__________50060e80039c5a1400000000000000000000c900 (callout)
path sdf not found in pathvec

===== path info sdf (mask 0x1f) =====
bus = 1
dev_t = 8:80
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:1
tgt_node_name = 0x50060e80039c5a14
serial = 40026 
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/scsi_id -g -u -s /block/%n (internal default)
uid = 0HP______OPEN-E__________50060e80039c5a1400010000000000000000c900 (callout)
path sdg not found in pathvec

===== path info sdg (mask 0x1f) =====
bus = 1
dev_t = 8:96
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:2
tgt_node_name = 0x50060e80039c5a14
serial = 40026 
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/scsi_id -g -u -s /block/%n (internal default)
uid = 0HP______OPEN-E__________50060e80039c5a1400020000000000000000c900 (callout)
path sdh not found in pathvec

===== path info sdh (mask 0x1f) =====
bus = 1
dev_t = 8:112
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:3
tgt_node_name = 0x50060e80039c5a14
serial = 40026 
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/scsi_id -g -u -s /block/%n (internal default)
uid = 0HP______OPEN-E__________50060e80039c5a1400030000000000000000c900 (callout)
#
# all paths :
#
0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100  1:0:0:0 sda
0HP______OPEN-E__________50060e80039c5a0400010000000000000000e100  1:0:0:1 sdb
0HP______OPEN-E__________50060e80039c5a0400020000000000000000e100  1:0:0:2 sdc
0HP______OPEN-E__________50060e80039c5a0400030000000000000000e100  1:0:0:3 sdd
0HP______OPEN-E__________50060e80039c5a1400000000000000000000c900  2:0:0:0 sde
0HP______OPEN-E__________50060e80039c5a1400010000000000000000c900  2:0:0:1 sdf
0HP______OPEN-E__________50060e80039c5a1400020000000000000000c900  2:0:0:2 sdg
0HP______OPEN-E__________50060e80039c5a1400030000000000000000c900  2:0:0:3 sdh
No matching wwid [0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100] in bindings file.
Created new binding [mpath0] for WWID [0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100]
pgpolicy = multibus (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:0 100
set ACT_CREATE: map does not exists
message mpath0 0 switch_group 1

create: mpath0 (0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:0 sda 8:0   [ready]

reloading features
No matching wwid [0HP______OPEN-E__________50060e80039c5a0400010000000000000000e100] in bindings file.
Created new binding [mpath1] for WWID [0HP______OPEN-E__________50060e80039c5a0400010000000000000000e100]
pgpolicy = multibus (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:16 100
set ACT_CREATE: map does not exists
message mpath1 0 switch_group 1

create: mpath1 (0HP______OPEN-E__________50060e80039c5a0400010000000000000000e100)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:1 sdb 8:16  [ready]

reloading features
No matching wwid [0HP______OPEN-E__________50060e80039c5a0400020000000000000000e100] in bindings file.
Created new binding [mpath2] for WWID [0HP______OPEN-E__________50060e80039c5a0400020000000000000000e100]
pgpolicy = multibus (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:32 100
set ACT_CREATE: map does not exists
message mpath2 0 switch_group 1

create: mpath2 (0HP______OPEN-E__________50060e80039c5a0400020000000000000000e100)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:2 sdc 8:32  [ready]

reloading features
No matching wwid [0HP______OPEN-E__________50060e80039c5a0400030000000000000000e100] in bindings file.
Created new binding [mpath3] for WWID [0HP______OPEN-E__________50060e80039c5a0400030000000000000000e100]
pgpolicy = multibus (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:48 100
set ACT_CREATE: map does not exists
message mpath3 0 switch_group 1

create: mpath3 (0HP______OPEN-E__________50060e80039c5a0400030000000000000000e100)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:3 sdd 8:48  [ready]

reloading features
No matching wwid [0HP______OPEN-E__________50060e80039c5a1400000000000000000000c900] in bindings file.
Created new binding [mpath4] for WWID [0HP______OPEN-E__________50060e80039c5a1400000000000000000000c900]
pgpolicy = multibus (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:64 100
set ACT_CREATE: map does not exists
message mpath4 0 switch_group 1

create: mpath4 (0HP______OPEN-E__________50060e80039c5a1400000000000000000000c900)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 2:0:0:0 sde 8:64  [ready]

reloading features
No matching wwid [0HP______OPEN-E__________50060e80039c5a1400010000000000000000c900] in bindings file.
Created new binding [mpath5] for WWID [0HP______OPEN-E__________50060e80039c5a1400010000000000000000c900]
pgpolicy = multibus (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:80 100
set ACT_CREATE: map does not exists
message mpath5 0 switch_group 1

create: mpath5 (0HP______OPEN-E__________50060e80039c5a1400010000000000000000c900)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 2:0:0:1 sdf 8:80  [ready]

reloading features
No matching wwid [0HP______OPEN-E__________50060e80039c5a1400020000000000000000c900] in bindings file.
Created new binding [mpath6] for WWID [0HP______OPEN-E__________50060e80039c5a1400020000000000000000c900]
pgpolicy = multibus (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:96 100
set ACT_CREATE: map does not exists
message mpath6 0 switch_group 1

create: mpath6 (0HP______OPEN-E__________50060e80039c5a1400020000000000000000c900)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 2:0:0:2 sdg 8:96  [ready]

reloading features
No matching wwid [0HP______OPEN-E__________50060e80039c5a1400030000000000000000c900] in bindings file.
Created new binding [mpath7] for WWID [0HP______OPEN-E__________50060e80039c5a1400030000000000000000c900]
pgpolicy = multibus (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:112 100
set ACT_CREATE: map does not exists
message mpath7 0 switch_group 1

create: mpath7 (0HP______OPEN-E__________50060e80039c5a1400030000000000000000c900)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 2:0:0:3 sdh 8:112 [ready]

reloading features

[-- Attachment #3: multipath.conf --]
[-- Type: application/octet-stream, Size: 2877 bytes --]

# This is an example configuration file for device mapper multipath.
# For a complete list of the default configuration values, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.defaults
# For a list of configuration options with descriptions, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.annotated


# Blacklist all devices by default. Remove this to enable multipathing
# on the default devices. 
#devnode_blacklist {
#        devnode "*"
#}

## Use user friendly names, instead of using WWIDs as names.
defaults {
	user_friendly_names yes
}


## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.
#devices {
#	device {
#		vendor                  "IBM"
#		product                 "S/390 DASD ECKD"
#		path_grouping_policy    multibus
#		getuid_callout          "/sbin/dasdview -j -f /dev/%n"
#		path_checker            directio
#	}
#}


##
## This is a template multipath-tools configuration file
## Uncomment the lines relevent to your environment
##
defaults {
	udev_dir		/dev
	polling_interval 	10
	selector		"round-robin 0"
	path_grouping_policy	multibus
	getuid_callout		"/sbin/scsi_id -g -u -s /block/%n"
	prio_callout		/bin/true
	path_checker		readsector0
	rr_min_io		100
	rr_weight		priorities
	failback		immediate
	no_path_retry		fail
	user_friendly_name	yes
}
##
## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid.  The 3 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line.  Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
devnode_blacklist {
       wwid 26353900f02796769
	devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
	devnode "^hd[a-z]"
}
#multipaths {
#	multipath {
#		wwid			3600508b4000156d700012000000b0000
#		alias			yellow
#		path_grouping_policy	multibus
#		path_checker		readsector0
#		path_selector		"round-robin 0"
#		failback		manual
#		rr_weight		priorities
#		no_path_retry		5
#	}
#	multipath {
#		wwid			1DEC_____321816758474
#		alias			red
#	}
#}
#devices {
#	device {
#		vendor			"COMPAQ  "
#		product			"HSV110 (C)COMPAQ"
#		path_grouping_policy	multibus
#		getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
#		path_checker		readsector0
#		path_selector		"round-robin 0"
#		hardware_handler	"0"
#		failback		15
#		rr_weight		priorities
#		no_path_retry		queue
#	}
#	device {
#		vendor			"COMPAQ  "
#		product			"MSA1000         "
#		path_grouping_policy	multibus
#	}
#}

[-- Attachment #4: Type: text/plain, Size: 0 bytes --]

Re: Multipath and getuid_callout issues with HP XP1024disk array

[malahal]

You have two default sections in your multipath.conf file, but that is not
the problem though. The scsi_id output from each path looks different,
that is why multipath treats them as different LUNs.

Make sure you configure your storage properly or change the default
getuid string that works for your storage.

Thanks, Malahal.

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Ok, some more background first:
> 
> System is an HP Proliant DL380 (or maybe DL580?), using Emulex fibre
> channel cards (don't know exact model off-hand).
> 
> Running Red Hat Enterprise Linux 4, update 5.
> 
> Device-mapper-multipath was version 0.4.5-21, just updated it to
> 0.4.5-27
> 
> There are 4 LUNs from an HP XP1024 disk array, each pathed to be visible
> on each fibre channel.  LUN type is OPEN-E.
>  
> Multipath now seems to accept the longer string returned by scsi_id, but
> it doesn't seem able to tell that certain disks are the same.
> 
> Attached is the multipath.conf file I'm using and the output from
> "multipath -v3". If the attachments don't come through, I'll send
> separate emails with just the contents for each file.
> 
> Any aide gladly received, I'm in over my head on this one.
> 
> Thanks,
> Rick
> 
> 
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of malahal@us.ibm.com
> Sent: Tuesday, January 29, 2008 5:19 PM
> To: dm-devel@redhat.com
> Subject: Re: [dm-devel] Multipath and getuid_callout issues with HP
> XP1024disk array
> 
> Greene, Rick [rick.greene@ncogroup.com] wrote:
> >    I've done what I can to try to understand how all this works, but I
> keep
> >    getting "error calling out /sbin/scsi_id -g -u -s /block/sda" when
> I run
> >    the command "multipath -v2"
> > 
> > 
> > 
> >    I've tried a number of different things in the /etc/multipath.conf
> file,
> >    but keep coming back to this same error.  If I run the command
> manually I
> >    get the following:
> > 
> > 
> > 
> >    # /sbin/scsi_id -g -u -s /block/sda
> > 
> >    0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
> > 
> > 
> > 
> >    What's missing?  Any help greatly appreciated.
> 
> You are not missing anything. The device id is too big to fit in
> multipath tools allocated memory. The program incorrectly prints that
> there is a problem while executing /sbin/scsi_id but in fact the problem
> lies in the program itself. You may have some old version of multipath
> tools. WWID_SIZE was set to 64 bytes and that is small for your device.
> Get the latest version where that macro is set to 128 or so.
> 
> Hope that helps!
> 
> --Malahal.
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel



> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

RE: Multipath and getuid_callout issues with HPXP1024disk array

[Greene, Rick]

I've been trying to play with using a different command in the
getuid_callout, but everything I try comes up with "error calling out".
For example, I wrote my own little shell script that pushes out the same
scsi_id string, plus some output from a vendor-supplied disk querying
command, and this is what "multipath -v3" shows for one of the devices
(they all display similar results):

===== path info sda (mask 0x1f) =====
bus = 1
dev_t = 8:0
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:0
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /sbin/xpdisk %n (internal default)
error calling out /sbin/xpdisk sda
uid =  (callout)

Run manually, it looks like this:
# /sbin/xpdisk sda
0HP_OPEN-E_50060e80039c5a0400000000000000000000e100_05:83

I've tried various things with the script I wrote, including just
spitting out the 05:83 (which is the CU:LDev values from the disk array,
pretty much the most unique disk identifying info I can find)

Not sure what else to do.

Thanks,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of malahal@us.ibm.com
Sent: Wednesday, January 30, 2008 1:50 PM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath and getuid_callout issues with
HPXP1024disk array

You have two default sections in your multipath.conf file, but that is
not
the problem though. The scsi_id output from each path looks different,
that is why multipath treats them as different LUNs.

Make sure you configure your storage properly or change the default
getuid string that works for your storage.

Thanks, Malahal.

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Ok, some more background first:
> 
> System is an HP Proliant DL380 (or maybe DL580?), using Emulex fibre
> channel cards (don't know exact model off-hand).
> 
> Running Red Hat Enterprise Linux 4, update 5.
> 
> Device-mapper-multipath was version 0.4.5-21, just updated it to
> 0.4.5-27
> 
> There are 4 LUNs from an HP XP1024 disk array, each pathed to be
visible
> on each fibre channel.  LUN type is OPEN-E.
>  
> Multipath now seems to accept the longer string returned by scsi_id,
but
> it doesn't seem able to tell that certain disks are the same.
> 
> Attached is the multipath.conf file I'm using and the output from
> "multipath -v3". If the attachments don't come through, I'll send
> separate emails with just the contents for each file.
> 
> Any aide gladly received, I'm in over my head on this one.
> 
> Thanks,
> Rick
> 
> 
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of malahal@us.ibm.com
> Sent: Tuesday, January 29, 2008 5:19 PM
> To: dm-devel@redhat.com
> Subject: Re: [dm-devel] Multipath and getuid_callout issues with HP
> XP1024disk array
> 
> Greene, Rick [rick.greene@ncogroup.com] wrote:
> >    I've done what I can to try to understand how all this works, but
I
> keep
> >    getting "error calling out /sbin/scsi_id -g -u -s /block/sda"
when
> I run
> >    the command "multipath -v2"
> > 
> > 
> > 
> >    I've tried a number of different things in the
/etc/multipath.conf
> file,
> >    but keep coming back to this same error.  If I run the command
> manually I
> >    get the following:
> > 
> > 
> > 
> >    # /sbin/scsi_id -g -u -s /block/sda
> > 
> >    0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
> > 
> > 
> > 
> >    What's missing?  Any help greatly appreciated.
> 
> You are not missing anything. The device id is too big to fit in
> multipath tools allocated memory. The program incorrectly prints that
> there is a problem while executing /sbin/scsi_id but in fact the
problem
> lies in the program itself. You may have some old version of multipath
> tools. WWID_SIZE was set to 64 bytes and that is small for your
device.
> Get the latest version where that macro is set to 128 or so.
> 
> Hope that helps!
> 
> --Malahal.
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel



> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

Re: Multipath and getuid_callout issues with HPXP1024disk array

[malahal]

Greene, Rick [rick.greene@ncogroup.com] wrote:
> getuid = /sbin/xpdisk %n (internal default)
> error calling out /sbin/xpdisk sda
> uid =  (callout)

It prints your getuid call as "internal default", that is odd.  That
looks like a bug if you are just changing multipath.conf. I just tested
my SLES10 SP1 system (multipath-tools-0.4.7-34.18) with /sbin/uid shell
script that contains the following two lines. The first line is needed,
do you have that in your shell script?

#!/bin/sh
echo $1

It woks and few lines of multipath -v3 output:

sda: serial = 3EL0585G00007115JK65
sda: getprio = NULL (internal default)
sda: prio = 1
sda: getuid = /sbin/uid %n (config file default)
sda: uid = sda (callout)


> 
> Run manually, it looks like this:
> # /sbin/xpdisk sda
> 0HP_OPEN-E_50060e80039c5a0400000000000000000000e100_05:83
> 
> I've tried various things with the script I wrote, including just
> spitting out the 05:83 (which is the CU:LDev values from the disk array,
> pretty much the most unique disk identifying info I can find)
> 
> Not sure what else to do.
> 
> Thanks,
> Rick
> 
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of malahal@us.ibm.com
> Sent: Wednesday, January 30, 2008 1:50 PM
> To: dm-devel@redhat.com
> Subject: Re: [dm-devel] Multipath and getuid_callout issues with
> HPXP1024disk array
> 
> You have two default sections in your multipath.conf file, but that is
> not
> the problem though. The scsi_id output from each path looks different,
> that is why multipath treats them as different LUNs.
> 
> Make sure you configure your storage properly or change the default
> getuid string that works for your storage.
> 
> Thanks, Malahal.
> 
> Greene, Rick [rick.greene@ncogroup.com] wrote:
> > Ok, some more background first:
> > 
> > System is an HP Proliant DL380 (or maybe DL580?), using Emulex fibre
> > channel cards (don't know exact model off-hand).
> > 
> > Running Red Hat Enterprise Linux 4, update 5.
> > 
> > Device-mapper-multipath was version 0.4.5-21, just updated it to
> > 0.4.5-27
> > 
> > There are 4 LUNs from an HP XP1024 disk array, each pathed to be
> visible
> > on each fibre channel.  LUN type is OPEN-E.
> >  
> > Multipath now seems to accept the longer string returned by scsi_id,
> but
> > it doesn't seem able to tell that certain disks are the same.
> > 
> > Attached is the multipath.conf file I'm using and the output from
> > "multipath -v3". If the attachments don't come through, I'll send
> > separate emails with just the contents for each file.
> > 
> > Any aide gladly received, I'm in over my head on this one.
> > 
> > Thanks,
> > Rick
> > 
> > 
> > -----Original Message-----
> > From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> > On Behalf Of malahal@us.ibm.com
> > Sent: Tuesday, January 29, 2008 5:19 PM
> > To: dm-devel@redhat.com
> > Subject: Re: [dm-devel] Multipath and getuid_callout issues with HP
> > XP1024disk array
> > 
> > Greene, Rick [rick.greene@ncogroup.com] wrote:
> > >    I've done what I can to try to understand how all this works, but
> I
> > keep
> > >    getting "error calling out /sbin/scsi_id -g -u -s /block/sda"
> when
> > I run
> > >    the command "multipath -v2"
> > > 
> > > 
> > > 
> > >    I've tried a number of different things in the
> /etc/multipath.conf
> > file,
> > >    but keep coming back to this same error.  If I run the command
> > manually I
> > >    get the following:
> > > 
> > > 
> > > 
> > >    # /sbin/scsi_id -g -u -s /block/sda
> > > 
> > >    0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
> > > 
> > > 
> > > 
> > >    What's missing?  Any help greatly appreciated.
> > 
> > You are not missing anything. The device id is too big to fit in
> > multipath tools allocated memory. The program incorrectly prints that
> > there is a problem while executing /sbin/scsi_id but in fact the
> problem
> > lies in the program itself. You may have some old version of multipath
> > tools. WWID_SIZE was set to 64 bytes and that is small for your
> device.
> > Get the latest version where that macro is set to 128 or so.
> > 
> > Hope that helps!
> > 
> > --Malahal.
> > 
> > --
> > dm-devel mailing list
> > dm-devel@redhat.com
> > https://www.redhat.com/mailman/listinfo/dm-devel
> 
> 
> 
> > --
> > dm-devel mailing list
> > dm-devel@redhat.com
> > https://www.redhat.com/mailman/listinfo/dm-devel
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

RE: Multipath and getuid_callout issues withHPXP1024disk array

[Greene, Rick]

Thanks Malahal, you just put me in a "Ok, that's my 'dumb guy' moment
for the day."

I added "#!/bin/bash" as the first line of my /sbin/xpdisk script, and
then modified the script to just spit out the CU:LDev info from the
HP-supplied-but-not-supported xpinfo command, and now it looks like it's
working:
===== path info sda (mask 0x1f) =====
bus = 1
dev_t = 8:0
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:0
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = readsector0 (internal default)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 05:83 (cache)

and:
No matching wwid [05:83] in bindings file.
Created new binding [mpath0] for WWID [05:83]
pgpolicy = failover (config file default)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 2 1 round-robin 0 1 1 8:0 100 round-robin 0 1 1
8:64 100
set ACT_CREATE: map does not exists
message mpath0 0 switch_group 1

create: mpath0 (05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:0 sda 8:0   [ready]
\_ round-robin 0
 \_ 2:0:0:0 sde 8:64  [ready]

Some (hopefully) final questions for you (or whoever knows)...

1) does the actual WWID need to be in the "uid" value that multipath
gets from the callout, or is any value that is unique to the disk good
enough?

2) what is the character limit to the return value from the
getuid_callout?

3) is there a specific format that multipath is looking at for parsing
the info in the uid value (such as vendor, model, type, serial number,
etc), or is the unique disk identifier all that is needed?

With those answers, I think I'll have a lock on this.

Thanks,
Rick

-----Original Message-----
From: malahal@us.ibm.com [mailto:malahal@us.ibm.com] 
Sent: Wednesday, January 30, 2008 3:11 PM
To: Greene, Rick
Cc: device-mapper development
Subject: Re: [dm-devel] Multipath and getuid_callout issues
withHPXP1024disk array

Greene, Rick [rick.greene@ncogroup.com] wrote:
> getuid = /sbin/xpdisk %n (internal default)
> error calling out /sbin/xpdisk sda
> uid =  (callout)

It prints your getuid call as "internal default", that is odd.  That
looks like a bug if you are just changing multipath.conf. I just tested
my SLES10 SP1 system (multipath-tools-0.4.7-34.18) with /sbin/uid shell
script that contains the following two lines. The first line is needed,
do you have that in your shell script?

#!/bin/sh
echo $1

It woks and few lines of multipath -v3 output:

sda: serial = 3EL0585G00007115JK65
sda: getprio = NULL (internal default)
sda: prio = 1
sda: getuid = /sbin/uid %n (config file default)
sda: uid = sda (callout)


> 
> Run manually, it looks like this:
> # /sbin/xpdisk sda
> 0HP_OPEN-E_50060e80039c5a0400000000000000000000e100_05:83
> 
> I've tried various things with the script I wrote, including just
> spitting out the 05:83 (which is the CU:LDev values from the disk
array,
> pretty much the most unique disk identifying info I can find)
> 
> Not sure what else to do.
> 
> Thanks,
> Rick
> 
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of malahal@us.ibm.com
> Sent: Wednesday, January 30, 2008 1:50 PM
> To: dm-devel@redhat.com
> Subject: Re: [dm-devel] Multipath and getuid_callout issues with
> HPXP1024disk array
> 
> You have two default sections in your multipath.conf file, but that is
> not
> the problem though. The scsi_id output from each path looks different,
> that is why multipath treats them as different LUNs.
> 
> Make sure you configure your storage properly or change the default
> getuid string that works for your storage.
> 
> Thanks, Malahal.
> 
> Greene, Rick [rick.greene@ncogroup.com] wrote:
> > Ok, some more background first:
> > 
> > System is an HP Proliant DL380 (or maybe DL580?), using Emulex fibre
> > channel cards (don't know exact model off-hand).
> > 
> > Running Red Hat Enterprise Linux 4, update 5.
> > 
> > Device-mapper-multipath was version 0.4.5-21, just updated it to
> > 0.4.5-27
> > 
> > There are 4 LUNs from an HP XP1024 disk array, each pathed to be
> visible
> > on each fibre channel.  LUN type is OPEN-E.
> >  
> > Multipath now seems to accept the longer string returned by scsi_id,
> but
> > it doesn't seem able to tell that certain disks are the same.
> > 
> > Attached is the multipath.conf file I'm using and the output from
> > "multipath -v3". If the attachments don't come through, I'll send
> > separate emails with just the contents for each file.
> > 
> > Any aide gladly received, I'm in over my head on this one.
> > 
> > Thanks,
> > Rick
> > 
> > 
> > -----Original Message-----
> > From: dm-devel-bounces@redhat.com
[mailto:dm-devel-bounces@redhat.com]
> > On Behalf Of malahal@us.ibm.com
> > Sent: Tuesday, January 29, 2008 5:19 PM
> > To: dm-devel@redhat.com
> > Subject: Re: [dm-devel] Multipath and getuid_callout issues with HP
> > XP1024disk array
> > 
> > Greene, Rick [rick.greene@ncogroup.com] wrote:
> > >    I've done what I can to try to understand how all this works,
but
> I
> > keep
> > >    getting "error calling out /sbin/scsi_id -g -u -s /block/sda"
> when
> > I run
> > >    the command "multipath -v2"
> > > 
> > > 
> > > 
> > >    I've tried a number of different things in the
> /etc/multipath.conf
> > file,
> > >    but keep coming back to this same error.  If I run the command
> > manually I
> > >    get the following:
> > > 
> > > 
> > > 
> > >    # /sbin/scsi_id -g -u -s /block/sda
> > > 
> > >
0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
> > > 
> > > 
> > > 
> > >    What's missing?  Any help greatly appreciated.
> > 
> > You are not missing anything. The device id is too big to fit in
> > multipath tools allocated memory. The program incorrectly prints
that
> > there is a problem while executing /sbin/scsi_id but in fact the
> problem
> > lies in the program itself. You may have some old version of
multipath
> > tools. WWID_SIZE was set to 64 bytes and that is small for your
> device.
> > Get the latest version where that macro is set to 128 or so.
> > 
> > Hope that helps!
> > 
> > --Malahal.

HPDMmultipath-tools-3.0.0.xxx with HP XP12000 diskarray

[Hagmann, Michael]

Hi 

Does anyone has some experience with the "HPDMmultipath-tools-3.0.0.xxx"
and a HP XP12000 Diskarray?

For me it's total unclear what's the difference between
"HPDMmultipath-tools-3.0.0.xxx" and the normal "device-mapper-multipath"
or the added value.

thx mike

Michael Hagmann
UNIX Systems Engineering
Enterprise Systems Technology

Hilti Corporation
9494 Schaan  Liechtenstein

Department FIBS
Feldkircherstrasse 100   P.O.Box 333
P +423-234 2467  F +423-234 6467
E michael.hagmann@hilti.com
www.hilti.com

Re: Multipath and getuid_callout issues withHPXP1024disk array

[malahal]

Greene, Rick [rick.greene@ncogroup.com] wrote:
> create: mpath0 (05:83)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:0 sda 8:0   [ready]
> \_ round-robin 0
>  \_ 2:0:0:0 sde 8:64  [ready]

The above out displays two states for me. Maybe your version only
displays one.

> 1) does the actual WWID need to be in the "uid" value that multipath
> gets from the callout, or is any value that is unique to the disk good
> enough?
 
I think, it can be anything. Doesn't need to match actual WWID.

> 2) what is the character limit to the return value from the
> getuid_callout?

Old versions had it as 64 (63 actual chars) and the latest code has it
set to 128 (maybe 127 real chars)

> 3) is there a specific format that multipath is looking at for parsing
> the info in the uid value (such as vendor, model, type, serial number,
> etc), or is the unique disk identifier all that is needed?

As far as I know, it doesn't parse anything inside WWID. Make sure you
don't have any blanks in the WWID as the bindings file parser will have
trouble if you do have.

RE: Multipath and getuid_callout issueswithHPXP1024disk array

[Greene, Rick]

Thanks for the answers Malahal, you are a credit to the open source
community!

Not sure I understand your comment here, can you clarify?

>Greene, Rick [rick.greene@ncogroup.com] wrote:
>> create: mpath0 (05:83)
>> [size=13 GB][features="0"][hwhandler="0"]
>> \_ round-robin 0
>>  \_ 1:0:0:0 sda 8:0   [ready]
>> \_ round-robin 0
>>  \_ 2:0:0:0 sde 8:64  [ready]
>
>The above out displays two states for me. Maybe your version only
>displays one.

Rick

Re: Multipath and getuid_callout issueswithHPXP1024disk array

[malahal]

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Thanks for the answers Malahal, you are a credit to the open source
> community!
> 
> Not sure I understand your comment here, can you clarify?
> 
> >Greene, Rick [rick.greene@ncogroup.com] wrote:
> >> create: mpath0 (05:83)
> >> [size=13 GB][features="0"][hwhandler="0"]
> >> \_ round-robin 0
> >>  \_ 1:0:0:0 sda 8:0   [ready]
> >> \_ round-robin 0
> >>  \_ 2:0:0:0 sde 8:64  [ready]
> >
> >The above out displays two states for me. Maybe your version only
> >displays one.


Thank you for the kind words!  On my system, the following is the output.
Notice that the "undef" state is printed as "DM state" of the device. Maybe,
your version of multipath tool doesn't print if it is "undef"

create: mpath3 (320000004cf311021)  IBM-ESXS,ST318453FC    
[size=17G][features=0][hwhandler=0]
\_ round-robin 0 [prio=1][undef]
 \_ 0:0:4:0 sde 8:64  [undef][ready]
\_ round-robin 0 [prio=1][undef]
 \_ 0:0:9:0 sdj 8:144 [undef][ready]

RE: Multipath and getuid_callout issueswithHPXP1024diskarray

[Greene, Rick]

If I do "multipath -ll" then I see [ready][active] as the state...my
prior output was from just "multipath -l"

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of malahal@us.ibm.com
Sent: Thursday, January 31, 2008 1:33 PM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath and getuid_callout
issueswithHPXP1024diskarray

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Thanks for the answers Malahal, you are a credit to the open source
> community!
> 
> Not sure I understand your comment here, can you clarify?
> 
> >Greene, Rick [rick.greene@ncogroup.com] wrote:
> >> create: mpath0 (05:83)
> >> [size=13 GB][features="0"][hwhandler="0"]
> >> \_ round-robin 0
> >>  \_ 1:0:0:0 sda 8:0   [ready]
> >> \_ round-robin 0
> >>  \_ 2:0:0:0 sde 8:64  [ready]
> >
> >The above out displays two states for me. Maybe your version only
> >displays one.


Thank you for the kind words!  On my system, the following is the
output.
Notice that the "undef" state is printed as "DM state" of the device.
Maybe,
your version of multipath tool doesn't print if it is "undef"

create: mpath3 (320000004cf311021)  IBM-ESXS,ST318453FC    
[size=17G][features=0][hwhandler=0]
\_ round-robin 0 [prio=1][undef]
 \_ 0:0:4:0 sde 8:64  [undef][ready]
\_ round-robin 0 [prio=1][undef]
 \_ 0:0:9:0 sdj 8:144 [undef][ready]

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

Multipath not rebuilding correctly on reboot

[Greene, Rick]

[-- Attachment #1: Type: text/plain, Size: 1749 bytes --]

Now that I seem to have multipath and my XP 1024 working together, I've
found a new issue.  Someone recently had a similar thread going, but I
saw no ultimate resolution.

My problem is that when I reboot my server, the multipath configuration
is not coming back the way it was before.  I moved the two external
tools I use to find the UID into /etc (they had bin in /usr/bin and
/sbin), updated the multipath.conf file (and one of the scripts) to
reflect this, but odd things are still happening.

Attached is initial_view.txt, which shows what multipath is coming up
with when I do the commands shown (the bulk of the file is multipath -v3
output, but at the bottom of the file is a multipath -ll output as
well).  It (seems to) correctly shows that I have 4 disks, each visible
via two separate paths.

After I reboot, however, I get different results.  Once it showed 4
paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
correctly showed mpath0, mpath1, and mpath3, but didn't show mpath2 at
all.  On the next attempt I got everything correct, and the very next
one only showed mpath0 and mpath1.

The post_reboot.txt file shows the contents of the /var/log/boot.log
file and the output of the dmesg command, along with the "multipath -ll"
view from the most recent reboot.

I then manually did a "multipath -v2" and the missing two paths then
came back.  The file manual_run.txt shows those results plus the updated
"multipath -ll".

Do I need to just make my own /etc/init.d script to do a "multipath -v2"
at the end of booting to make sure it all gets covered, along with the
requisite LVM & mount commands to get the VG that is on these disks
working right?

Thanks in advance,
Rick




[-- Attachment #2: initial_view.txt --]
[-- Type: text/plain, Size: 8139 bytes --]

# service multipathd stop
# multipath -F
# service multipathd start
# multipath -v3
load path identifiers cache
#
# all paths in cache :
#
00040026_05:83  1:0:0:0 sda 8:0   HP      /OPEN-E          /2114
00040026_05:84  1:0:0:1 sdb 8:16   HP      /OPEN-E          /2114
00040026_05:85  1:0:0:2 sdc 8:32   HP      /OPEN-E          /2114
00040026_05:86  1:0:0:3 sdd 8:48   HP      /OPEN-E          /2114
00040026_05:83  2:0:0:0 sde 8:64   HP      /OPEN-E          /2114
00040026_05:84  2:0:0:1 sdf 8:80   HP      /OPEN-E          /2114
00040026_05:85  2:0:0:2 sdg 8:96   HP      /OPEN-E          /2114
00040026_05:86  2:0:0:3 sdh 8:112   HP      /OPEN-E          /2114
cciss!c0d0 blacklisted
cciss!c0d1 blacklisted
dm-0 blacklisted
dm-1 blacklisted
dm-2 blacklisted
dm-3 blacklisted
dm-4 blacklisted
dm-5 blacklisted
dm-6 blacklisted
dm-7 blacklisted
fd0 blacklisted
hda blacklisted
md0 blacklisted
ram0 blacklisted
ram10 blacklisted
ram11 blacklisted
ram12 blacklisted
ram13 blacklisted
ram14 blacklisted
ram15 blacklisted
ram1 blacklisted
ram2 blacklisted
ram3 blacklisted
ram4 blacklisted
ram5 blacklisted
ram6 blacklisted
ram7 blacklisted
ram8 blacklisted
ram9 blacklisted
===== path info sda (mask 0x1f) =====
bus = 1
dev_t = 8:0
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:0
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:83 (cache)
===== path info sdb (mask 0x1f) =====
bus = 1
dev_t = 8:16
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:1
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:84 (cache)
===== path info sdc (mask 0x1f) =====
bus = 1
dev_t = 8:32
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:2
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:85 (cache)
===== path info sdd (mask 0x1f) =====
bus = 1
dev_t = 8:48
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:3
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:86 (cache)
===== path info sde (mask 0x1f) =====
bus = 1
dev_t = 8:64
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 2:0:0:0
tgt_node_name = 0x50060e80039c5a14
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:83 (cache)
===== path info sdf (mask 0x1f) =====
bus = 1
dev_t = 8:80
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 2:0:0:1
tgt_node_name = 0x50060e80039c5a14
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:84 (cache)
===== path info sdg (mask 0x1f) =====
bus = 1
dev_t = 8:96
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 2:0:0:2
tgt_node_name = 0x50060e80039c5a14
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:85 (cache)
===== path info sdh (mask 0x1f) =====
bus = 1
dev_t = 8:112
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 2:0:0:3
tgt_node_name = 0x50060e80039c5a14
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:86 (cache)
#
# all paths :
#
00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E          /2114
00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E          /2114
00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E          /2114
00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E          /2114
00040026_05:83  2:0:0:0 sde 8:64  [ready] HP      /OPEN-E          /2114
00040026_05:84  2:0:0:1 sdf 8:80  [ready] HP      /OPEN-E          /2114
00040026_05:85  2:0:0:2 sdg 8:96  [ready] HP      /OPEN-E          /2114
00040026_05:86  2:0:0:3 sdh 8:112  [ready] HP      /OPEN-E          /2114
Initialized new bindings file [/var/lib/multipath/bindings]
No matching wwid [00040026_05:83] in bindings file.
Created new binding [mpath0] for WWID [00040026_05:83]
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:0 100 8:64 100
set ACT_CREATE: map does not exists
message mpath0 0 switch_group 1

create: mpath0 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:0 sda 8:0   [ready]
 \_ 2:0:0:0 sde 8:64  [ready]

reloading features
No matching wwid [00040026_05:84] in bindings file.
Created new binding [mpath1] for WWID [00040026_05:84]
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:16 100 8:80 100
set ACT_CREATE: map does not exists
message mpath1 0 switch_group 1

create: mpath1 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:1 sdb 8:16  [ready]
 \_ 2:0:0:1 sdf 8:80  [ready]

reloading features
No matching wwid [00040026_05:85] in bindings file.
Created new binding [mpath2] for WWID [00040026_05:85]
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:32 100 8:96 100
set ACT_CREATE: map does not exists
message mpath2 0 switch_group 1

create: mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:2 sdc 8:32  [ready]
 \_ 2:0:0:2 sdg 8:96  [ready]

reloading features
No matching wwid [00040026_05:86] in bindings file.
Created new binding [mpath3] for WWID [00040026_05:86]
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:48 100 8:112 100
set ACT_CREATE: map does not exists
message mpath3 0 switch_group 1

create: mpath3 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:3 sdd 8:48  [ready]
 \_ 2:0:0:3 sdh 8:112 [ready]

reloading features

# multipath -ll
mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:2 sdc 8:32  [active][ready]
 \_ 2:0:0:2 sdg 8:96  [active][ready]

mpath1 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:1 sdb 8:16  [active][ready]
 \_ 2:0:0:1 sdf 8:80  [active][ready]

mpath0 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:0 sda 8:0   [active][ready]
 \_ 2:0:0:0 sde 8:64  [active][ready]

mpath3 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:3 sdd 8:48  [active][ready]
 \_ 2:0:0:3 sdh 8:112 [active][ready]

[-- Attachment #3: post_reboot.txt --]
[-- Type: text/plain, Size: 37818 bytes --]

# dmesg
Bootdata ok (command line is ro root=/dev/vg00/root rhgb quiet)
Linux version 2.6.9-55.ELsmp (brewbuilder@hs20-bc2-4.build.redhat.com) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Fri Apr 20 16:36:54 EDT 2007
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
 BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bfff3000 (usable)
 BIOS-e820: 00000000bfff3000 - 00000000bfffb000 (ACPI data)
 BIOS-e820: 00000000bfffb000 - 00000000c0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fed00000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
 BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
ACPI: RSDP (v002 HP                                    ) @ 0x00000000000f4f00
ACPI: XSDT (v001 HP     P51      0x00000002 Ò 0x0000162e) @ 0x00000000bfff3300
ACPI: FADT (v003 HP     P51      0x00000002 Ò 0x0000162e) @ 0x00000000bfff3380
ACPI: SPCR (v001 HP     SPCRRBSU 0x00000001 Ò 0x0000162e) @ 0x00000000bfff3140
ACPI: MCFG (v001 HP     ProLiant 0x00000001  0x00000000) @ 0x00000000bfff31c0
ACPI: MADT (v001 HP     00000083 0x00000002  0x00000000) @ 0x00000000bfff3200
ACPI: SSDT (v001 HP        SSDTP 0x00000001 INTL 0x20030228) @ 0x00000000bfff8000
ACPI: DSDT (v001 HP         DSDT 0x00000001 INTL 0x20030228) @ 0x0000000000000000
No NUMA configuration found
Faking a node at 0000000000000000-00000000bfff3000
Bootmem setup node 0 0000000000000000-00000000bfff3000
On node 0 totalpages: 786419
  DMA zone: 4096 pages, LIFO batch:1
  Normal zone: 782323 pages, LIFO batch:16
  HighMem zone: 0 pages, LIFO batch:1
DMI 2.3 present.
ACPI: PM-Timer IO Port: 0x908
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:4 APIC version 16
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
Processor #6 15:4 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 15:4 APIC version 16
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
Processor #7 15:4 APIC version 16
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
Setting APIC routing to flat
ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
ACPI: IOAPIC (id[0x0a] address[0xfec80400] gsi_base[48])
IOAPIC[2]: apic_id 10, version 32, address 0xfec80400, GSI 48-71
ACPI: IOAPIC (id[0x0b] address[0xfec84000] gsi_base[72])
IOAPIC[3]: apic_id 11, version 32, address 0xfec84000, GSI 72-95
ACPI: IOAPIC (id[0x0c] address[0xfec84400] gsi_base[96])
IOAPIC[4]: apic_id 12, version 32, address 0xfec84400, GSI 96-119
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ9 used by override.
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at c4000000 (gap: c0000000:3ec00000)
Checking aperture...
Built 1 zonelists
Kernel command line: ro root=/dev/vg00/root rhgb quiet console=tty0
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 131072 bytes)
time.c: Using 3.579545 MHz PM timer.
time.c: Detected 3400.312 MHz processor.
Console: colour VGA+ 80x25
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Memory: 3089236k/3145676k available (2112k kernel code, 0k reserved, 1305k data, 208k init)
Calibrating delay using timer specific routine.. 6807.48 BogoMIPS (lpj=3403744)
Security Scaffold v1.0.0 initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
There is already a security framework initialized, register_security failed.
selinux_register_security:  Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 256 (order: 0, 4096 bytes)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
using mwait in idle threads.
CPU0: Initial APIC ID: 0, Physical Processor ID: 0
Using IO APIC NMI watchdog
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU0: Initial APIC ID: 0, Physical Processor ID: 0
CPU0:                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
per-CPU timeslice cutoff: 1023.90 usecs.
task migration cache decay timeout: 1 msecs.
Booting processor 1/6 rip 6000 rsp 10037e05f58
Initializing CPU#1
Calibrating delay using timer specific routine.. 6799.32 BogoMIPS (lpj=3399660)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU1: Initial APIC ID: 6, Physical Processor ID: 3
                  Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
Booting processor 2/1 rip 6000 rsp 10037e3df58
Initializing CPU#2
Calibrating delay using timer specific routine.. 6799.31 BogoMIPS (lpj=3399655)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU2: Initial APIC ID: 1, Physical Processor ID: 0
                  Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
Booting processor 3/7 rip 6000 rsp 100016f3f58
Initializing CPU#3
Calibrating delay using timer specific routine.. 6799.18 BogoMIPS (lpj=3399591)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU3: Initial APIC ID: 7, Physical Processor ID: 3
                  Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
Total of 4 processors activated (27205.30 BogoMIPS).
activating NMI Watchdog ... done.
testing NMI watchdog ... OK.
Using local APIC timer interrupts.
Detected 12.501 MHz APIC timer.
checking TSC synchronization across 4 CPUs: passed.
Brought up 4 CPUs
time.c: Using PIT/TSC based timekeeping.
checking if image is initramfs... it is
NET: Registered protocol family 16
PCI: Using configuration type 1
PCI: Using MMCONFIG at e0000000
mtrr: v2.0 (20020519)
mtrr: your CPUs had inconsistent fixed MTRR settings
mtrr: probably your BIOS does not setup all CPUs.
mtrr: corrected configuration.
ACPI: Subsystem revision 20040816
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (00:00)
PCI: Probing PCI hardware (bus 00)
PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: Transparent bridge - 0000:00:1e.0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.IP2P._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXA._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXB._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXC._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXD._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKC] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKD] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKE] (IRQs 5 7 10 11) *0, disabled.
ACPI: PCI Interrupt Link [LNKF] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKG] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKH] (IRQs *5 7 10 11)
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
GSI 16 sharing vector 0xA9 and IRQ 16
ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 169
ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 169
ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
GSI 17 sharing vector 0xB1 and IRQ 17
ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
GSI 18 sharing vector 0xB9 and IRQ 18
ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
GSI 19 sharing vector 0xC1 and IRQ 19
ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
GSI 20 sharing vector 0xC9 and IRQ 20
ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
GSI 21 sharing vector 0xD1 and IRQ 21
ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
GSI 22 sharing vector 0xD9 and IRQ 22
ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
GSI 23 sharing vector 0xE1 and IRQ 23
ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
GSI 24 sharing vector 0xE9 and IRQ 24
ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
GSI 25 sharing vector 0x32 and IRQ 25
ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
GSI 26 sharing vector 0x3A and IRQ 26
ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
GSI 27 sharing vector 0x42 and IRQ 27
ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
GSI 28 sharing vector 0x4A and IRQ 28
ACPI: PCI Interrupt 0000:01:04.0[A] -> GSI 21 (level, low) -> IRQ 74
GSI 29 sharing vector 0x52 and IRQ 29
ACPI: PCI Interrupt 0000:01:04.2[B] -> GSI 22 (level, low) -> IRQ 82
PCI-DMA: Disabling IOMMU.
IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
audit: initializing netlink socket (disabled)
audit(1201791896.599:1): initialized
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
SELinux:  Registering netfilter hooks
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key B7CA3C9BE2FAFC39
- User ID: Red Hat, Inc. (Kernel Module GPG key)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
ACPI: Processor [CPU0] (supports C1)
ACPI: Processor [CPU1] (supports C1)
ACPI: Processor [CPU2] (supports C1)
ACPI: Processor [CPU3] (supports C1)
ACPI: Thermal Zone [THM0] (8 C)
Real Time Clock Driver v1.12
Linux agpgart interface v0.100 (c) Dave Jones
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 68 ports, IRQ sharing enabled
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
divert: not allocating divert_blk for non-ethernet device lo
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
ICH5: IDE controller at PCI slot 0000:00:1f.1
PCI: Enabling device 0000:00:1f.1 (0005 -> 0007)
ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
ICH5: chipset revision 2
ICH5: not 100% native mode: will probe irqs later
    ide0: BM-DMA at 0x0500-0x0507, BIOS settings: hda:DMA, hdb:pio
    ide1: BM-DMA at 0x0508-0x050f, BIOS settings: hdc:pio, hdd:pio
Probing IDE interface ide0...
hda: DV-28E-N, ATAPI CD/DVD-ROM drive
Using cfq io scheduler
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Probing IDE interface ide1...
Probing IDE interface ide1...
Probing IDE interface ide2...
Probing IDE interface ide3...
Probing IDE interface ide4...
Probing IDE interface ide5...
hda: ATAPI 24X DVD-ROM drive, 256kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
ide-floppy driver 0.99.newide
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.0:USB HID core driver
mice: PS/2 mouse device common for all mice
input: AT Translated Set 2 keyboard on isa0060/serio0
input: PS/2 Generic Mouse on isa0060/serio1
md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
NET: Registered protocol family 2
IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
TCP bind hash table entries: 262144 (order: 10, 4194304 bytes)
TCP: Hash tables configured (established 262144 bind 262144)
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
cpufreq: CPU0 - ACPI performance management activated.
cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
cpufreq: CPU1 - ACPI performance management activated.
cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
cpufreq: CPU2 - ACPI performance management activated.
cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
cpufreq: CPU3 - ACPI performance management activated.
cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
ACPI wakeup devices:

ACPI: (supports S0 S4 S5)
Freeing unused kernel memory: 208k freed
SCSI subsystem initialized
HP CISS Driver (v 2.6.14.RH2)
cciss: Device 0x46 has been found at bus 4 dev 3 func 0
ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
cciss: using DAC cycles
      blocks= 71122559 block_size= 512
      heads= 255, sectors= 32, cylinders= 8716

      blocks= 71122559 block_size= 512
      heads= 255, sectors= 32, cylinders= 8716

      blocks= 71122559 block_size= 512
      heads= 255, sectors= 32, cylinders= 8716

 cciss/c0d0: p1 p2
      blocks= 71122559 block_size= 512
      heads= 255, sectors= 32, cylinders= 8716

 cciss/c0d1: unknown partition table
device-mapper: 4.5.5-ioctl (2006-12-01) initialised: dm-devel@redhat.com
hda: packet command error: status=0x51 { DriveReady SeekComplete Error }
hda: packet command error: error=0x50
ide: failed opcode was 100
cdrom: open failed.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
security:  3 users, 4 roles, 355 types, 26 bools
security:  55 classes, 22610 rules
SELinux:  Completing initialization.
SELinux:  Setting up existing superblocks.
SELinux: initialized (dev dm-0, type ext3), uses xattr
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
SELinux: initialized (dev mqueue, type mqueue), not configured for labeling
SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses genfs_contexts
SELinux: initialized (dev devpts, type devpts), uses transition SIDs
SELinux: initialized (dev eventpollfs, type eventpollfs), uses genfs_contexts
SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
SELinux: initialized (dev proc, type proc), uses genfs_contexts
SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
libata version 2.00 loaded.
Emulex LightPulse Fibre Channel SCSI driver 8.0.16.27
Copyright(c) 2003-2006 Emulex.  All rights reserved.
ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
lpfc 0000:06:02.0: 0:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
scsi0 : Emulex LP9002L-F2 2Gb PCI Fibre Channel Adapter on PCI bus 06 device 10 irq 225
ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
lpfc 0000:07:04.0: 1:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
scsi1 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07 device 20 irq 233
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sda: drive cache: write back
 sda: sda1
Attached scsi disk sda at scsi1, channel 0, id 0, lun 0
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdb: drive cache: write back
SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdb: drive cache: write back
 sdb: unknown partition table
Attached scsi disk sdb at scsi1, channel 0, id 0, lun 1
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdc: drive cache: write back
SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdc: drive cache: write back
 sdc: unknown partition table
Attached scsi disk sdc at scsi1, channel 0, id 0, lun 2
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdd: drive cache: write back
SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdd: drive cache: write back
 sdd: unknown partition table
Attached scsi disk sdd at scsi1, channel 0, id 0, lun 3
ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
Losing some ticks... checking if CPU frequency changed.
lpfc 0000:07:05.0: 2:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
scsi2 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07 device 28 irq 50
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sde: drive cache: write back
SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sde: drive cache: write back
 sde: sde1
Attached scsi disk sde at scsi2, channel 0, id 0, lun 0
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdf: drive cache: write back
SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdf: drive cache: write back
 sdf: unknown partition table
Attached scsi disk sdf at scsi2, channel 0, id 0, lun 1
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdg: drive cache: write back
SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdg: drive cache: write back
 sdg: unknown partition table
Attached scsi disk sdg at scsi2, channel 0, id 0, lun 2
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdh: drive cache: write back
SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdh: drive cache: write back
 sdh: unknown partition table
Attached scsi disk sdh at scsi2, channel 0, id 0, lun 3
inserting floppy driver for 2.6.9-55.ELsmp
Floppy drive(s): fd0 is 1.44M
FDC 0 is a National Semiconductor PC87306
Intel(R) PRO/1000 Network Driver - version 7.2.7-k2-NAPI
Copyright (c) 1999-2006 Intel Corporation.
ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
e1000: 0000:0a:01.0: e1000_probe: (PCI-X:133MHz:64-bit) 00:11:0a:64:7e:da
divert: allocating divert_blk for eth0
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
e1000: 0000:0a:01.1: e1000_probe: (PCI-X:133MHz:64-bit) 00:11:0a:64:7e:db
divert: allocating divert_blk for eth1
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
tg3.c:v3.64-rh (July 31, 2006)
ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
divert: allocating divert_blk for eth2
eth2: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:14:38:bf:5a:51
eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] Split[0] WireSpeed[1] TSOcap[0]
eth2: dma_rwctrl[769f4000] dma_mask[64-bit]
ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
divert: allocating divert_blk for eth3
eth3: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:14:38:bf:5a:50
eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1] TSOcap[1]
eth3: dma_rwctrl[769f4000] dma_mask[64-bit]
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
hw_random hardware driver 1.0.0 loaded
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
ehci_hcd 0000:00:1d.7: EHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.7 to 64
ehci_hcd 0000:00:1d.7: irq 193, pci mem ffffff0010086000
SELinux: initialized (dev usbdevfs, type usbdevfs), uses genfs_contexts
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
PCI: cache line size of 128 is not supported by device 0000:00:1d.7
ehci_hcd 0000:00:1d.7: USB 2.0 enabled, EHCI 1.00, driver 2004-May-10
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 8 ports detected
USB Universal Host Controller Interface driver v2.2
ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
uhci_hcd 0000:00:1d.0: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.0 to 64
uhci_hcd 0000:00:1d.0: irq 169, io base 0000000000002000
uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
uhci_hcd 0000:00:1d.1: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.1 to 64
uhci_hcd 0000:00:1d.1: irq 177, io base 0000000000002020
uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
uhci_hcd 0000:00:1d.2: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.2 to 64
uhci_hcd 0000:00:1d.2: irq 185, io base 0000000000002040
uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
uhci_hcd 0000:00:1d.3: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.3 to 64
uhci_hcd 0000:00:1d.3: irq 169, io base 0000000000002060
uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
hub 5-0:1.0: USB hub found
hub 5-0:1.0: 2 ports detected
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
ACPI: Power Button (FF) [PWRF]
EXT3 FS on dm-0, internal journal
device-mapper: dm-multipath version 1.0.5 loaded
device-mapper: dm-round-robin version 1.0.0 loaded
kjournald starting.  Commit interval 5 seconds
EXT3 FS on cciss/c0d0p1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev cciss/c0d0p1, type ext3), uses xattr
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-1, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-2, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-2, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-3, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-3, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-4, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-4, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-5, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-5, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-6, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-6, type ext3), uses xattr
Adding 2097144k swap on /dev/vg00/swap1.  Priority:-1 extents:1
SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
IA-32 Microcode Update Driver: v1.14 <tigran@veritas.com>
microcode: CPU0 already at revision 0x12 (current=0x12)
microcode: CPU1 already at revision 0x12 (current=0x12)
microcode: CPU2 already at revision 0x12 (current=0x12)
microcode: CPU3 already at revision 0x12 (current=0x12)
microcode: No new microdata for cpu 1
microcode: No new microdata for cpu 2
microcode: No new microdata for cpu 0
microcode: No new microdata for cpu 3
IA-32 Microcode Update Driver v1.14 unregistered
ip_tables: (C) 2000-2002 Netfilter core team
ip_conntrack version 2.1 (8192 buckets, 65536 max) - 456 bytes per conntrack
e1000: eth1: e1000_watchdog_task: NIC Link is Up 100 Mbps Half Duplex
i2c /dev entries driver
NET: Registered protocol family 10
Disabled Privacy Extensions on device ffffffff80408540(lo)
IPv6 over IPv4 tunneling driver
divert: not allocating divert_blk for non-ethernet device sit0
eth1: no IPv6 routers present


# cat /var/log/boot.log
Jan 31 15:02:31 corux38 syslog: syslogd startup succeeded
Jan 31 15:02:31 corux38 syslog: klogd startup succeeded
Jan 31 15:02:31 corux38 irqbalance: irqbalance startup succeeded
Jan 31 15:02:31 corux38 multipathd: multipathd startup succeeded
Jan 31 15:02:31 corux38 portmap: portmap startup succeeded
Jan 31 15:02:32 corux38 rc: Starting lm_sensors:  succeeded
Jan 31 15:02:32 corux38 xinetd: xinetd startup succeeded
Jan 31 15:02:32 corux38 ntpd: ntpd startup succeeded
Jan 31 15:02:32 corux38 vsftpd: vsftpd vsftpd succeeded
Jan 31 15:02:33 corux38 ssh-server-g3: Starting ssh-server-g3
Jan 31 10:01:59 corux38 rc.sysinit: -e
Jan 31 10:02:01 corux38 start_udev: Starting udev:  succeeded
Jan 31 10:02:25 corux38 rc.sysinit: -e
Jan 31 10:02:25 corux38 sysctl: net.ipv4.ip_forward = 0
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
Jan 31 10:02:25 corux38 sysctl: kernel.sysrq = 0
Jan 31 10:02:25 corux38 sysctl: kernel.core_uses_pid = 1
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_syncookies = 1
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
Jan 31 10:02:25 corux38 sysctl: fs.file-max = 524288
Jan 31 10:02:25 corux38 sysctl: kernel.sem = 1024 32000 32 4096
Jan 31 10:02:25 corux38 rc.sysinit: Configuring kernel parameters:  succeeded
Jan 31 15:02:26 corux38 date: Thu Jan 31 15:02:26 EST 2008
Jan 31 15:02:26 corux38 rc.sysinit: Setting clock  (localtime): Thu Jan 31 15:02:26 EST 2008 succeeded
Jan 31 15:02:26 corux38 rc.sysinit: Loading default keymap succeeded
Jan 31 15:02:26 corux38 rc.sysinit: Setting hostname corux38:  succeeded
Jan 31 15:02:26 corux38 fsck: /dev/vg00/root: clean, 4335/131072 files, 48559/262144 blocks
Jan 31 15:02:26 corux38 rc.sysinit: Checking root filesystem succeeded
Jan 31 15:02:26 corux38 rc.sysinit: Remounting root filesystem in read-write mode:  succeeded
Jan 31 15:02:26 corux38 lvm.static:   8 logical volume(s) in volume group vg00 now active
Jan 31 15:02:26 corux38 rc.sysinit: Setting up Logical Volume Management: succeeded
Jan 31 15:02:26 corux38 fsck: /boot: clean, 38/26104 files, 17822/104388 blocks
Jan 31 15:02:26 corux38 fsck: /dev/vg00/home: clean, 132/262144 files, 20580/524288 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files, 36957/1048576 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files, 13541/262144 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/usr: clean, 30250/524288 files, 169645/1048576 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368 files, 17525/540672 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files, 49124/2097152 blocks
Jan 31 15:02:27 corux38 rc.sysinit: Checking filesystems succeeded
Jan 31 15:02:27 corux38 rc.sysinit: Mounting local filesystems:  succeeded
Jan 31 15:02:27 corux38 rc.sysinit: Enabling swap space:  succeeded
Jan 31 15:02:28 corux38 microcode_ctl: microcode_ctl startup succeeded
Jan 31 15:02:36 corux38 ssh-server-g3: done.
Jan 31 15:02:28 corux38 vgchange:   8 logical volume(s) in volume group "vg00" monitored
Jan 31 15:02:36 corux38 rc: Starting ssh-server-g3:  succeeded
Jan 31 15:02:28 corux38 lvm2-monitor: Starting monitoring for VG vg00: succeeded
Jan 31 15:02:36 corux38 crond: crond startup succeeded
Jan 31 15:02:28 corux38 cpuspeed: cpuspeed startup succeeded
Jan 31 15:02:28 corux38 iptables:  succeeded
Jan 31 15:02:36 corux38 atd: atd startup succeeded
Jan 31 15:02:29 corux38 sysctl: net.ipv4.ip_forward = 0
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
Jan 31 15:02:36 corux38 messagebus: messagebus startup succeeded
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
Jan 31 15:02:29 corux38 sysctl: kernel.sysrq = 0
Jan 31 15:02:29 corux38 sysctl: kernel.core_uses_pid = 1
Jan 31 15:02:36 corux38 haldaemon: haldaemon startup succeeded
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
Jan 31 15:02:29 corux38 sysctl: fs.file-max = 524288
Jan 31 15:02:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
Jan 31 15:02:29 corux38 network: Setting network parameters:  succeeded
Jan 31 15:02:29 corux38 network: Bringing up loopback interface:  succeeded
Jan 31 15:02:31 corux38 network: Bringing up interface eth1:  succeeded
Jan 31 15:03:08 corux38 haldaemon: haldaemon -TERM succeeded
Jan 31 15:03:08 corux38 messagebus: messagebus -TERM succeeded
Jan 31 15:03:08 corux38 atd: atd shutdown succeeded
Jan 31 15:03:09 corux38 vsftpd: vsftpd shutdown succeeded
Jan 31 15:03:09 corux38 xinetd: xinetd shutdown succeeded
Jan 31 15:03:09 corux38 crond: crond shutdown succeeded
Jan 31 15:03:09 corux38 ntpd: ntpd shutdown succeeded
Jan 31 15:03:09 corux38 irqbalance: irqbalance shutdown succeeded
Jan 31 15:03:09 corux38 multipathd: multipathd shutdown succeeded
Jan 31 15:03:09 corux38 portmap: portmap shutdown succeeded
Jan 31 15:05:36 corux38 syslog: syslogd startup succeeded
Jan 31 15:05:36 corux38 syslog: klogd startup succeeded
Jan 31 15:05:37 corux38 irqbalance: irqbalance startup succeeded
Jan 31 15:05:37 corux38 multipathd: multipathd startup succeeded
Jan 31 15:05:37 corux38 portmap: portmap startup succeeded
Jan 31 15:05:37 corux38 rc: Starting lm_sensors:  succeeded
Jan 31 15:05:37 corux38 xinetd: xinetd startup succeeded
Jan 31 15:05:37 corux38 ntpd: ntpd startup succeeded
Jan 31 15:05:38 corux38 vsftpd: vsftpd vsftpd succeeded
Jan 31 15:05:38 corux38 ssh-server-g3: Starting ssh-server-g3
Jan 31 10:05:03 corux38 rc.sysinit: -e
Jan 31 10:05:05 corux38 start_udev: Starting udev:  succeeded
Jan 31 10:05:29 corux38 rc.sysinit: -e
Jan 31 10:05:29 corux38 sysctl: net.ipv4.ip_forward = 0
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
Jan 31 10:05:29 corux38 sysctl: kernel.sysrq = 0
Jan 31 10:05:29 corux38 sysctl: kernel.core_uses_pid = 1
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
Jan 31 10:05:29 corux38 sysctl: fs.file-max = 524288
Jan 31 10:05:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
Jan 31 10:05:29 corux38 rc.sysinit: Configuring kernel parameters:  succeeded
Jan 31 15:05:30 corux38 date: Thu Jan 31 15:05:30 EST 2008
Jan 31 15:05:30 corux38 rc.sysinit: Setting clock  (localtime): Thu Jan 31 15:05:30 EST 2008 succeeded
Jan 31 15:05:30 corux38 rc.sysinit: Loading default keymap succeeded
Jan 31 15:05:30 corux38 rc.sysinit: Setting hostname corux38:  succeeded
Jan 31 15:05:30 corux38 fsck: /dev/vg00/root: clean, 4335/131072 files, 48559/262144 blocks
Jan 31 15:05:30 corux38 rc.sysinit: Checking root filesystem succeeded
Jan 31 15:05:30 corux38 rc.sysinit: Remounting root filesystem in read-write mode:  succeeded
Jan 31 15:05:30 corux38 lvm.static:   8 logical volume(s) in volume group vg00 now active
Jan 31 15:05:30 corux38 rc.sysinit: Setting up Logical Volume Management: succeeded
Jan 31 15:05:30 corux38 fsck: /boot: clean, 38/26104 files, 17822/104388 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/home: clean, 132/262144 files, 20580/524288 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files, 36957/1048576 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files, 13541/262144 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/usr: clean, 30250/524288 files, 169645/1048576 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368 files, 17525/540672 blocks
Jan 31 15:05:31 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files, 49141/2097152 blocks
Jan 31 15:05:31 corux38 rc.sysinit: Checking filesystems succeeded
Jan 31 15:05:31 corux38 rc.sysinit: Mounting local filesystems:  succeeded
Jan 31 15:05:31 corux38 rc.sysinit: Enabling swap space:  succeeded
Jan 31 15:05:32 corux38 microcode_ctl: microcode_ctl startup succeeded
Jan 31 15:05:32 corux38 vgchange:   8 logical volume(s) in volume group "vg00" monitored
Jan 31 15:05:32 corux38 lvm2-monitor: Starting monitoring for VG vg00: succeeded
Jan 31 15:05:41 corux38 ssh-server-g3: done.
Jan 31 15:05:32 corux38 cpuspeed: cpuspeed startup succeeded
Jan 31 15:05:41 corux38 rc: Starting ssh-server-g3:  succeeded
Jan 31 15:05:32 corux38 iptables:  succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.ip_forward = 0
Jan 31 15:05:41 corux38 crond: crond startup succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
Jan 31 15:05:41 corux38 atd: atd startup succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
Jan 31 15:05:32 corux38 sysctl: kernel.sysrq = 0
Jan 31 15:05:32 corux38 sysctl: kernel.core_uses_pid = 1
Jan 31 15:05:42 corux38 messagebus: messagebus startup succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
Jan 31 15:05:42 corux38 haldaemon: haldaemon startup succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_syncookies = 1
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
Jan 31 15:05:32 corux38 sysctl: fs.file-max = 524288
Jan 31 15:05:32 corux38 sysctl: kernel.sem = 1024 32000 32 4096
Jan 31 15:05:32 corux38 network: Setting network parameters:  succeeded
Jan 31 15:05:32 corux38 network: Bringing up loopback interface:  succeeded
Jan 31 15:05:36 corux38 network: Bringing up interface eth1:  succeeded


# multipath -ll
mpath1 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [enabled]
 \_ 2:0:0:1 sdf 8:80  [active][ready]
 \_ 1:0:0:1 sdb 8:16  [active][ready]

mpath0 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [enabled]
 \_ 2:0:0:0 sde 8:64  [active][ready]
 \_ 1:0:0:0 sda 8:0   [active][ready]

[-- Attachment #4: manual_run.txt --]
[-- Type: text/plain, Size: 0 bytes --]



[-- Attachment #5: Type: text/plain, Size: 0 bytes --]

RE: Multipath not rebuilding correctly on reboot

[Greene, Rick]

[-- Attachment #1: Type: text/plain, Size: 2118 bytes --]

Ah nuts...forgot to save the one file before attaching.  Here is the
missing manual_run.txt file

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Greene, Rick
Sent: Thursday, January 31, 2008 3:20 PM
To: device-mapper development
Subject: [dm-devel] Multipath not rebuilding correctly on reboot

Now that I seem to have multipath and my XP 1024 working together, I've
found a new issue.  Someone recently had a similar thread going, but I
saw no ultimate resolution.

My problem is that when I reboot my server, the multipath configuration
is not coming back the way it was before.  I moved the two external
tools I use to find the UID into /etc (they had bin in /usr/bin and
/sbin), updated the multipath.conf file (and one of the scripts) to
reflect this, but odd things are still happening.

Attached is initial_view.txt, which shows what multipath is coming up
with when I do the commands shown (the bulk of the file is multipath -v3
output, but at the bottom of the file is a multipath -ll output as
well).  It (seems to) correctly shows that I have 4 disks, each visible
via two separate paths.

After I reboot, however, I get different results.  Once it showed 4
paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
correctly showed mpath0, mpath1, and mpath3, but didn't show mpath2 at
all.  On the next attempt I got everything correct, and the very next
one only showed mpath0 and mpath1.

The post_reboot.txt file shows the contents of the /var/log/boot.log
file and the output of the dmesg command, along with the "multipath -ll"
view from the most recent reboot.

I then manually did a "multipath -v2" and the missing two paths then
came back.  The file manual_run.txt shows those results plus the updated
"multipath -ll".

Do I need to just make my own /etc/init.d script to do a "multipath -v2"
at the end of booting to make sure it all gets covered, along with the
requisite LVM & mount commands to get the VG that is on these disks
working right?

Thanks in advance,
Rick




[-- Attachment #2: manual_run.txt --]
[-- Type: text/plain, Size: 1066 bytes --]

# multipath -v2
create: mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:2 sdc 8:32  [ready]
 \_ 2:0:0:2 sdg 8:96  [ready]

create: mpath3 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:3 sdd 8:48  [ready]
 \_ 2:0:0:3 sdh 8:112 [ready]

[root@corux38 ~]# multipath -ll
mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:2 sdc 8:32  [active][ready]
 \_ 2:0:0:2 sdg 8:96  [active][ready]

mpath1 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [enabled]
 \_ 2:0:0:1 sdf 8:80  [active][ready]
 \_ 1:0:0:1 sdb 8:16  [active][ready]

mpath0 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [enabled]
 \_ 2:0:0:0 sde 8:64  [active][ready]
 \_ 1:0:0:0 sda 8:0   [active][ready]

mpath3 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:3 sdd 8:48  [active][ready]
 \_ 2:0:0:3 sdh 8:112 [active][ready]

[-- Attachment #3: Type: text/plain, Size: 0 bytes --]

RE: HPDMmultipath-tools-3.0.0.xxx with HP XP12000 diskarray

[Balasubramanian, Vijayakumar (STSD)]

Mike,
HPDM would provide enablement for HP array products and patches for
issues found during product testing in addition to the normal
device-mapper-multipath. Eventually these patches would go into OS
vendor's multipath and the device mapper multipath development tree.

-Vijay

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Hagmann, Michael
Sent: Thursday, January 31, 2008 4:03 AM
To: device-mapper development
Subject: [dm-devel] HPDMmultipath-tools-3.0.0.xxx with HP XP12000
diskarray

Hi 

Does anyone has some experience with the "HPDMmultipath-tools-3.0.0.xxx"
and a HP XP12000 Diskarray?

For me it's total unclear what's the difference between
"HPDMmultipath-tools-3.0.0.xxx" and the normal "device-mapper-multipath"
or the added value.

thx mike

Michael Hagmann
UNIX Systems Engineering
Enterprise Systems Technology

Hilti Corporation
9494 Schaan  Liechtenstein

Department FIBS
Feldkircherstrasse 100   P.O.Box 333
P +423-234 2467  F +423-234 6467
E michael.hagmann@hilti.com
www.hilti.com


--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

RE: Multipath and getuid_callout issues with HPXP1024diskarray

[Balasubramanian, Vijayakumar (STSD)]

Rick,

scsi_id does give unique id for HP XP array LUNs which can be used by
device mapper. Following is the output that I get on my xp device:
# /sbin/scsi_id -g -u -s /block/sdaq
360060e8005276a000000276a0000030e

Can you verify the LUN presentation/ Host mode settings on the array and
the low level drivers on the host.

Note: If you use XP128/1024, the system modes 140 and 293 must be
switched on, otherwise
the XP array does not respond to a SCSI inquiry to code page 0x83 with a
unique serial number
(scsi_id tool). This prevents the DM Multipath from detecting the
redundant paths.

Hope this helps.

-Vijay


-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Greene, Rick
Sent: Thursday, January 31, 2008 12:26 AM
To: device-mapper development
Subject: RE: [dm-devel] Multipath and getuid_callout issues with
HPXP1024diskarray

I've been trying to play with using a different command in the
getuid_callout, but everything I try comes up with "error calling out".
For example, I wrote my own little shell script that pushes out the same
scsi_id string, plus some output from a vendor-supplied disk querying
command, and this is what "multipath -v3" shows for one of the devices
(they all display similar results):

===== path info sda (mask 0x1f) =====
bus = 1
dev_t = 8:0
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:0
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = readsector0 (internal default) state = 2 getprio =
/bin/true (internal default) prio = 0 getuid = /sbin/xpdisk %n (internal
default) error calling out /sbin/xpdisk sda uid =  (callout)

Run manually, it looks like this:
# /sbin/xpdisk sda
0HP_OPEN-E_50060e80039c5a0400000000000000000000e100_05:83

I've tried various things with the script I wrote, including just
spitting out the 05:83 (which is the CU:LDev values from the disk array,
pretty much the most unique disk identifying info I can find)

Not sure what else to do.

Thanks,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of malahal@us.ibm.com
Sent: Wednesday, January 30, 2008 1:50 PM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath and getuid_callout issues with
HPXP1024disk array

You have two default sections in your multipath.conf file, but that is
not the problem though. The scsi_id output from each path looks
different, that is why multipath treats them as different LUNs.

Make sure you configure your storage properly or change the default
getuid string that works for your storage.

Thanks, Malahal.

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Ok, some more background first:
> 
> System is an HP Proliant DL380 (or maybe DL580?), using Emulex fibre 
> channel cards (don't know exact model off-hand).
> 
> Running Red Hat Enterprise Linux 4, update 5.
> 
> Device-mapper-multipath was version 0.4.5-21, just updated it to
> 0.4.5-27
> 
> There are 4 LUNs from an HP XP1024 disk array, each pathed to be
visible
> on each fibre channel.  LUN type is OPEN-E.
>  
> Multipath now seems to accept the longer string returned by scsi_id,
but
> it doesn't seem able to tell that certain disks are the same.
> 
> Attached is the multipath.conf file I'm using and the output from 
> "multipath -v3". If the attachments don't come through, I'll send 
> separate emails with just the contents for each file.
> 
> Any aide gladly received, I'm in over my head on this one.
> 
> Thanks,
> Rick
> 
> 
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of malahal@us.ibm.com
> Sent: Tuesday, January 29, 2008 5:19 PM
> To: dm-devel@redhat.com
> Subject: Re: [dm-devel] Multipath and getuid_callout issues with HP 
> XP1024disk array
> 
> Greene, Rick [rick.greene@ncogroup.com] wrote:
> >    I've done what I can to try to understand how all this works, but
I
> keep
> >    getting "error calling out /sbin/scsi_id -g -u -s /block/sda"
when
> I run
> >    the command "multipath -v2"
> > 
> > 
> > 
> >    I've tried a number of different things in the
/etc/multipath.conf
> file,
> >    but keep coming back to this same error.  If I run the command
> manually I
> >    get the following:
> > 
> > 
> > 
> >    # /sbin/scsi_id -g -u -s /block/sda
> > 
> >    0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
> > 
> > 
> > 
> >    What's missing?  Any help greatly appreciated.
> 
> You are not missing anything. The device id is too big to fit in 
> multipath tools allocated memory. The program incorrectly prints that 
> there is a problem while executing /sbin/scsi_id but in fact the
problem
> lies in the program itself. You may have some old version of multipath

> tools. WWID_SIZE was set to 64 bytes and that is small for your
device.
> Get the latest version where that macro is set to 128 or so.
> 
> Hope that helps!
> 
> --Malahal.
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel



> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

RE: Multipath and getuid_callout issues withHPXP1024diskarray

[Greene, Rick]

We submitted a ticket to the XP team at HP to set those options, but
they said they didn't know what "system mode" was, and made some
settings match what had been done for some VMWare servers we installed.

I'm still getting results like the following:
# /sbin/scsi_id -g -u -s /block/sda
0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
# /sbin/scsi_id -g -u -s /block/sde
0HP______OPEN-E__________50060e80039c5a1400000000000000000000c900

I know these two are the same LUN, for if I use the xpinfo command it'll
show the same CU:LDev value for both devices.

I've got tickets open with HP now to try to address this from both
angles, will update the dm-devel list if I get an answer different that
what's been proposed.

Thanks,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Balasubramanian, Vijayakumar (STSD)
Sent: Tuesday, February 05, 2008 4:32 AM
To: device-mapper development
Subject: RE: [dm-devel] Multipath and getuid_callout issues
withHPXP1024diskarray


Rick,

scsi_id does give unique id for HP XP array LUNs which can be used by
device mapper. Following is the output that I get on my xp device:
# /sbin/scsi_id -g -u -s /block/sdaq
360060e8005276a000000276a0000030e

Can you verify the LUN presentation/ Host mode settings on the array and
the low level drivers on the host.

Note: If you use XP128/1024, the system modes 140 and 293 must be
switched on, otherwise
the XP array does not respond to a SCSI inquiry to code page 0x83 with a
unique serial number
(scsi_id tool). This prevents the DM Multipath from detecting the
redundant paths.

Hope this helps.

-Vijay


-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Greene, Rick
Sent: Thursday, January 31, 2008 12:26 AM
To: device-mapper development
Subject: RE: [dm-devel] Multipath and getuid_callout issues with
HPXP1024diskarray

I've been trying to play with using a different command in the
getuid_callout, but everything I try comes up with "error calling out".
For example, I wrote my own little shell script that pushes out the same
scsi_id string, plus some output from a vendor-supplied disk querying
command, and this is what "multipath -v3" shows for one of the devices
(they all display similar results):

===== path info sda (mask 0x1f) =====
bus = 1
dev_t = 8:0
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:0
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = readsector0 (internal default) state = 2 getprio =
/bin/true (internal default) prio = 0 getuid = /sbin/xpdisk %n (internal
default) error calling out /sbin/xpdisk sda uid =  (callout)

Run manually, it looks like this:
# /sbin/xpdisk sda
0HP_OPEN-E_50060e80039c5a0400000000000000000000e100_05:83

I've tried various things with the script I wrote, including just
spitting out the 05:83 (which is the CU:LDev values from the disk array,
pretty much the most unique disk identifying info I can find)

Not sure what else to do.

Thanks,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of malahal@us.ibm.com
Sent: Wednesday, January 30, 2008 1:50 PM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath and getuid_callout issues with
HPXP1024disk array

You have two default sections in your multipath.conf file, but that is
not the problem though. The scsi_id output from each path looks
different, that is why multipath treats them as different LUNs.

Make sure you configure your storage properly or change the default
getuid string that works for your storage.

Thanks, Malahal.

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Ok, some more background first:
> 
> System is an HP Proliant DL380 (or maybe DL580?), using Emulex fibre 
> channel cards (don't know exact model off-hand).
> 
> Running Red Hat Enterprise Linux 4, update 5.
> 
> Device-mapper-multipath was version 0.4.5-21, just updated it to
> 0.4.5-27
> 
> There are 4 LUNs from an HP XP1024 disk array, each pathed to be
visible
> on each fibre channel.  LUN type is OPEN-E.
>  
> Multipath now seems to accept the longer string returned by scsi_id,
but
> it doesn't seem able to tell that certain disks are the same.
> 
> Attached is the multipath.conf file I'm using and the output from 
> "multipath -v3". If the attachments don't come through, I'll send 
> separate emails with just the contents for each file.
> 
> Any aide gladly received, I'm in over my head on this one.
> 
> Thanks,
> Rick
> 
> 
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of malahal@us.ibm.com
> Sent: Tuesday, January 29, 2008 5:19 PM
> To: dm-devel@redhat.com
> Subject: Re: [dm-devel] Multipath and getuid_callout issues with HP 
> XP1024disk array
> 
> Greene, Rick [rick.greene@ncogroup.com] wrote:
> >    I've done what I can to try to understand how all this works, but
I
> keep
> >    getting "error calling out /sbin/scsi_id -g -u -s /block/sda"
when
> I run
> >    the command "multipath -v2"
> > 
> > 
> > 
> >    I've tried a number of different things in the
/etc/multipath.conf
> file,
> >    but keep coming back to this same error.  If I run the command
> manually I
> >    get the following:
> > 
> > 
> > 
> >    # /sbin/scsi_id -g -u -s /block/sda
> > 
> >    0HP______OPEN-E__________50060e80039c5a0400000000000000000000e100
> > 
> > 
> > 
> >    What's missing?  Any help greatly appreciated.
> 
> You are not missing anything. The device id is too big to fit in 
> multipath tools allocated memory. The program incorrectly prints that 
> there is a problem while executing /sbin/scsi_id but in fact the
problem
> lies in the program itself. You may have some old version of multipath

> tools. WWID_SIZE was set to 64 bytes and that is small for your
device.
> Get the latest version where that macro is set to 128 or so.
> 
> Hope that helps!
> 
> --Malahal.
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel



> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

Re: Multipath and getuid_callout issues with HPXP1024disk array

[Luca Berra]

On Wed, Jan 30, 2008 at 01:56:09PM -0500, Greene, Rick wrote:
>I've been trying to play with using a different command in the
>getuid_callout, but everything I try comes up with "error calling out".
>For example, I wrote my own little shell script that pushes out the same
>scsi_id string, plus some output from a vendor-supplied disk querying
>command, and this is what "multipath -v3" shows for one of the devices
>(they all display similar results):

can you strace the multipath invocation, so maybe we will see if it
really does execute your callout?

I solved a problem similar to yours by using a custom script myself,
about one year ago for a customer using an xp12000, unfortunately i
don't have a copy of the script or of the multipath configuration at
that site.

L.

-- 
Luca Berra -- bluca@comedia.it
        Communication Media & Services S.r.l.
 /"\
 \ /     ASCII RIBBON CAMPAIGN
  X        AGAINST HTML MAIL
 / \

RE: Multipath and getuid_callout issues with HPXP1024diskarray

[Greene, Rick]

I finally got a support call going with HP, and here's the "official"
resolution:

The XP1024 disk array has to be at a certain firmware version for the
required system modes of 140 and 293 to be available to be turned on.
Additionally, HP states that the configuration is only "blessed" for
certain versions of Red Hat, HBA cards, and drivers.  Oh, one other
thing...you have to load their version of DMM, not the standard version
that comes with RedHat or downloading and compiling your own version.
Their version currently doesn't have the patch for the longer strings in
getuid_callout.

By going to www.hp.com and putting in "device mapper multipath" in the
search box, you should find a link to "Device Mapper Multipath
Enablement Kit for HP StorageWorks Disk Arrays Installation and
Reference Guide", a PDF document which details everything.  Don't want
to quote it here as it'll likely change over time.

After working with a fairly knowledgeable person at HP, my solution is
to use a custom script that parses output from the unsupported "xpinfo"
command from HP to pull out the CU:LDev value of the devices and feed
that back into multipath.

Works fine, except for an odd issue at reboot times, for which I've got
a separate unanswered query out to this list.

Thanks to Malahal, Vijayakumar Balasubramanian, and Luca Berra for their
responses.

Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Luca Berra
Sent: Thursday, February 07, 2008 3:39 AM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath and getuid_callout issues with
HPXP1024diskarray

On Wed, Jan 30, 2008 at 01:56:09PM -0500, Greene, Rick wrote:
>I've been trying to play with using a different command in the
>getuid_callout, but everything I try comes up with "error calling out".
>For example, I wrote my own little shell script that pushes out the
same
>scsi_id string, plus some output from a vendor-supplied disk querying
>command, and this is what "multipath -v3" shows for one of the devices
>(they all display similar results):

can you strace the multipath invocation, so maybe we will see if it
really does execute your callout?

I solved a problem similar to yours by using a custom script myself,
about one year ago for a customer using an xp12000, unfortunately i
don't have a copy of the script or of the multipath configuration at
that site.

L.

-- 
Luca Berra -- bluca@comedia.it
        Communication Media & Services S.r.l.
 /"\
 \ /     ASCII RIBBON CAMPAIGN
  X        AGAINST HTML MAIL
 / \

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

Re: Multipath and getuid_callout issues with HPXP1024diskarray

[malahal]

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Works fine, except for an odd issue at reboot times, for which I've got
> a separate unanswered query out to this list.

Is it possible that your paths were not ready when multipath tried to
configure your paths as part of the boot process? Will they get
configured correctly when you restart the rc service (multipathd)?
If they get configured correctly when you run 'service multipathd
restart', I would assume that the problem is udev related, and a
udevsettle in the /etc/init.d/multipathd init script may help!

I am out of ideas and just shooting in the dark! :-)

--Malahal.

RE: Multipath and getuid_callout issues withHPXP1024diskarray

[Greene, Rick]

The multipathd, on boot, seems to get some of the devices, but not all.
To keep the thread clean, can you look for my email dated January 31
with the subject "Multipath not rebuilding correctly on reboot"?  There
is a full description there with output files showing the state things
appear in at a several key points.

If you can't find that email, I'll resend.

Thanks,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of malahal@us.ibm.com
Sent: Thursday, February 07, 2008 2:53 PM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath and getuid_callout issues
withHPXP1024diskarray

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Works fine, except for an odd issue at reboot times, for which I've
got
> a separate unanswered query out to this list.

Is it possible that your paths were not ready when multipath tried to
configure your paths as part of the boot process? Will they get
configured correctly when you restart the rc service (multipathd)?
If they get configured correctly when you run 'service multipathd
restart', I would assume that the problem is udev related, and a
udevsettle in the /etc/init.d/multipathd init script may help!

I am out of ideas and just shooting in the dark! :-)

--Malahal.

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

RE: Multipath not rebuilding correctly on reboot

[Greene, Rick]

[-- Attachment #1: Type: text/plain, Size: 2275 bytes --]

I never saw any response on this, though a side comment on my other
thread did get one query that I tried to direct to here, so I figured
I'd repost and see if anyone had any ideas.

Re-attaching the original docs as well.

Thanks in advance,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Greene, Rick
Sent: Thursday, January 31, 2008 3:20 PM
To: device-mapper development
Subject: [dm-devel] Multipath not rebuilding correctly on reboot

Now that I seem to have multipath and my XP 1024 working together, I've
found a new issue.  Someone recently had a similar thread going, but I
saw no ultimate resolution.

My problem is that when I reboot my server, the multipath configuration
is not coming back the way it was before.  I moved the two external
tools I use to find the UID into /etc (they had bin in /usr/bin and
/sbin), updated the multipath.conf file (and one of the scripts) to
reflect this, but odd things are still happening.

Attached is initial_view.txt, which shows what multipath is coming up
with when I do the commands shown (the bulk of the file is multipath -v3
output, but at the bottom of the file is a multipath -ll output as
well).  It (seems to) correctly shows that I have 4 disks, each visible
via two separate paths.

After I reboot, however, I get different results.  Once it showed 4
paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
correctly showed mpath0, mpath1, and mpath3, but didn't show mpath2 at
all.  On the next attempt I got everything correct, and the very next
one only showed mpath0 and mpath1.

The post_reboot.txt file shows the contents of the /var/log/boot.log
file and the output of the dmesg command, along with the "multipath -ll"
view from the most recent reboot.

I then manually did a "multipath -v2" and the missing two paths then
came back.  The file manual_run.txt shows those results plus the updated
"multipath -ll".

Do I need to just make my own /etc/init.d script to do a "multipath -v2"
at the end of booting to make sure it all gets covered, along with the
requisite LVM & mount commands to get the VG that is on these disks
working right?

Thanks in advance,
Rick




[-- Attachment #2: manual_run.txt --]
[-- Type: text/plain, Size: 1066 bytes --]

# multipath -v2
create: mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:2 sdc 8:32  [ready]
 \_ 2:0:0:2 sdg 8:96  [ready]

create: mpath3 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:3 sdd 8:48  [ready]
 \_ 2:0:0:3 sdh 8:112 [ready]

[root@corux38 ~]# multipath -ll
mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:2 sdc 8:32  [active][ready]
 \_ 2:0:0:2 sdg 8:96  [active][ready]

mpath1 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [enabled]
 \_ 2:0:0:1 sdf 8:80  [active][ready]
 \_ 1:0:0:1 sdb 8:16  [active][ready]

mpath0 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [enabled]
 \_ 2:0:0:0 sde 8:64  [active][ready]
 \_ 1:0:0:0 sda 8:0   [active][ready]

mpath3 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:3 sdd 8:48  [active][ready]
 \_ 2:0:0:3 sdh 8:112 [active][ready]

[-- Attachment #3: post_reboot.txt --]
[-- Type: text/plain, Size: 37818 bytes --]

# dmesg
Bootdata ok (command line is ro root=/dev/vg00/root rhgb quiet)
Linux version 2.6.9-55.ELsmp (brewbuilder@hs20-bc2-4.build.redhat.com) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Fri Apr 20 16:36:54 EDT 2007
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
 BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bfff3000 (usable)
 BIOS-e820: 00000000bfff3000 - 00000000bfffb000 (ACPI data)
 BIOS-e820: 00000000bfffb000 - 00000000c0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fed00000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
 BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
ACPI: RSDP (v002 HP                                    ) @ 0x00000000000f4f00
ACPI: XSDT (v001 HP     P51      0x00000002 Ò 0x0000162e) @ 0x00000000bfff3300
ACPI: FADT (v003 HP     P51      0x00000002 Ò 0x0000162e) @ 0x00000000bfff3380
ACPI: SPCR (v001 HP     SPCRRBSU 0x00000001 Ò 0x0000162e) @ 0x00000000bfff3140
ACPI: MCFG (v001 HP     ProLiant 0x00000001  0x00000000) @ 0x00000000bfff31c0
ACPI: MADT (v001 HP     00000083 0x00000002  0x00000000) @ 0x00000000bfff3200
ACPI: SSDT (v001 HP        SSDTP 0x00000001 INTL 0x20030228) @ 0x00000000bfff8000
ACPI: DSDT (v001 HP         DSDT 0x00000001 INTL 0x20030228) @ 0x0000000000000000
No NUMA configuration found
Faking a node at 0000000000000000-00000000bfff3000
Bootmem setup node 0 0000000000000000-00000000bfff3000
On node 0 totalpages: 786419
  DMA zone: 4096 pages, LIFO batch:1
  Normal zone: 782323 pages, LIFO batch:16
  HighMem zone: 0 pages, LIFO batch:1
DMI 2.3 present.
ACPI: PM-Timer IO Port: 0x908
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:4 APIC version 16
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
Processor #6 15:4 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 15:4 APIC version 16
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
Processor #7 15:4 APIC version 16
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
Setting APIC routing to flat
ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
ACPI: IOAPIC (id[0x0a] address[0xfec80400] gsi_base[48])
IOAPIC[2]: apic_id 10, version 32, address 0xfec80400, GSI 48-71
ACPI: IOAPIC (id[0x0b] address[0xfec84000] gsi_base[72])
IOAPIC[3]: apic_id 11, version 32, address 0xfec84000, GSI 72-95
ACPI: IOAPIC (id[0x0c] address[0xfec84400] gsi_base[96])
IOAPIC[4]: apic_id 12, version 32, address 0xfec84400, GSI 96-119
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ9 used by override.
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at c4000000 (gap: c0000000:3ec00000)
Checking aperture...
Built 1 zonelists
Kernel command line: ro root=/dev/vg00/root rhgb quiet console=tty0
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 131072 bytes)
time.c: Using 3.579545 MHz PM timer.
time.c: Detected 3400.312 MHz processor.
Console: colour VGA+ 80x25
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Memory: 3089236k/3145676k available (2112k kernel code, 0k reserved, 1305k data, 208k init)
Calibrating delay using timer specific routine.. 6807.48 BogoMIPS (lpj=3403744)
Security Scaffold v1.0.0 initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
There is already a security framework initialized, register_security failed.
selinux_register_security:  Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 256 (order: 0, 4096 bytes)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
using mwait in idle threads.
CPU0: Initial APIC ID: 0, Physical Processor ID: 0
Using IO APIC NMI watchdog
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU0: Initial APIC ID: 0, Physical Processor ID: 0
CPU0:                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
per-CPU timeslice cutoff: 1023.90 usecs.
task migration cache decay timeout: 1 msecs.
Booting processor 1/6 rip 6000 rsp 10037e05f58
Initializing CPU#1
Calibrating delay using timer specific routine.. 6799.32 BogoMIPS (lpj=3399660)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU1: Initial APIC ID: 6, Physical Processor ID: 3
                  Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
Booting processor 2/1 rip 6000 rsp 10037e3df58
Initializing CPU#2
Calibrating delay using timer specific routine.. 6799.31 BogoMIPS (lpj=3399655)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU2: Initial APIC ID: 1, Physical Processor ID: 0
                  Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
Booting processor 3/7 rip 6000 rsp 100016f3f58
Initializing CPU#3
Calibrating delay using timer specific routine.. 6799.18 BogoMIPS (lpj=3399591)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU3: Initial APIC ID: 7, Physical Processor ID: 3
                  Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
Total of 4 processors activated (27205.30 BogoMIPS).
activating NMI Watchdog ... done.
testing NMI watchdog ... OK.
Using local APIC timer interrupts.
Detected 12.501 MHz APIC timer.
checking TSC synchronization across 4 CPUs: passed.
Brought up 4 CPUs
time.c: Using PIT/TSC based timekeeping.
checking if image is initramfs... it is
NET: Registered protocol family 16
PCI: Using configuration type 1
PCI: Using MMCONFIG at e0000000
mtrr: v2.0 (20020519)
mtrr: your CPUs had inconsistent fixed MTRR settings
mtrr: probably your BIOS does not setup all CPUs.
mtrr: corrected configuration.
ACPI: Subsystem revision 20040816
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (00:00)
PCI: Probing PCI hardware (bus 00)
PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: Transparent bridge - 0000:00:1e.0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.IP2P._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXA._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXB._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXC._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXD._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKC] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKD] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKE] (IRQs 5 7 10 11) *0, disabled.
ACPI: PCI Interrupt Link [LNKF] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKG] (IRQs *5 7 10 11)
ACPI: PCI Interrupt Link [LNKH] (IRQs *5 7 10 11)
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
GSI 16 sharing vector 0xA9 and IRQ 16
ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 169
ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 169
ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
GSI 17 sharing vector 0xB1 and IRQ 17
ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
GSI 18 sharing vector 0xB9 and IRQ 18
ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
GSI 19 sharing vector 0xC1 and IRQ 19
ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
GSI 20 sharing vector 0xC9 and IRQ 20
ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
GSI 21 sharing vector 0xD1 and IRQ 21
ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
GSI 22 sharing vector 0xD9 and IRQ 22
ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
GSI 23 sharing vector 0xE1 and IRQ 23
ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
GSI 24 sharing vector 0xE9 and IRQ 24
ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
GSI 25 sharing vector 0x32 and IRQ 25
ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
GSI 26 sharing vector 0x3A and IRQ 26
ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
GSI 27 sharing vector 0x42 and IRQ 27
ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
GSI 28 sharing vector 0x4A and IRQ 28
ACPI: PCI Interrupt 0000:01:04.0[A] -> GSI 21 (level, low) -> IRQ 74
GSI 29 sharing vector 0x52 and IRQ 29
ACPI: PCI Interrupt 0000:01:04.2[B] -> GSI 22 (level, low) -> IRQ 82
PCI-DMA: Disabling IOMMU.
IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
audit: initializing netlink socket (disabled)
audit(1201791896.599:1): initialized
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
SELinux:  Registering netfilter hooks
Initializing Cryptographic API
ksign: Installing public key data
Loading keyring
- Added public key B7CA3C9BE2FAFC39
- User ID: Red Hat, Inc. (Kernel Module GPG key)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
ACPI: Processor [CPU0] (supports C1)
ACPI: Processor [CPU1] (supports C1)
ACPI: Processor [CPU2] (supports C1)
ACPI: Processor [CPU3] (supports C1)
ACPI: Thermal Zone [THM0] (8 C)
Real Time Clock Driver v1.12
Linux agpgart interface v0.100 (c) Dave Jones
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 68 ports, IRQ sharing enabled
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
divert: not allocating divert_blk for non-ethernet device lo
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
ICH5: IDE controller at PCI slot 0000:00:1f.1
PCI: Enabling device 0000:00:1f.1 (0005 -> 0007)
ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
ICH5: chipset revision 2
ICH5: not 100% native mode: will probe irqs later
    ide0: BM-DMA at 0x0500-0x0507, BIOS settings: hda:DMA, hdb:pio
    ide1: BM-DMA at 0x0508-0x050f, BIOS settings: hdc:pio, hdd:pio
Probing IDE interface ide0...
hda: DV-28E-N, ATAPI CD/DVD-ROM drive
Using cfq io scheduler
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Probing IDE interface ide1...
Probing IDE interface ide1...
Probing IDE interface ide2...
Probing IDE interface ide3...
Probing IDE interface ide4...
Probing IDE interface ide5...
hda: ATAPI 24X DVD-ROM drive, 256kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
ide-floppy driver 0.99.newide
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.0:USB HID core driver
mice: PS/2 mouse device common for all mice
input: AT Translated Set 2 keyboard on isa0060/serio0
input: PS/2 Generic Mouse on isa0060/serio1
md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
NET: Registered protocol family 2
IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
TCP bind hash table entries: 262144 (order: 10, 4194304 bytes)
TCP: Hash tables configured (established 262144 bind 262144)
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
cpufreq: CPU0 - ACPI performance management activated.
cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
cpufreq: CPU1 - ACPI performance management activated.
cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
cpufreq: CPU2 - ACPI performance management activated.
cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
cpufreq: CPU3 - ACPI performance management activated.
cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
ACPI wakeup devices:

ACPI: (supports S0 S4 S5)
Freeing unused kernel memory: 208k freed
SCSI subsystem initialized
HP CISS Driver (v 2.6.14.RH2)
cciss: Device 0x46 has been found at bus 4 dev 3 func 0
ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
cciss: using DAC cycles
      blocks= 71122559 block_size= 512
      heads= 255, sectors= 32, cylinders= 8716

      blocks= 71122559 block_size= 512
      heads= 255, sectors= 32, cylinders= 8716

      blocks= 71122559 block_size= 512
      heads= 255, sectors= 32, cylinders= 8716

 cciss/c0d0: p1 p2
      blocks= 71122559 block_size= 512
      heads= 255, sectors= 32, cylinders= 8716

 cciss/c0d1: unknown partition table
device-mapper: 4.5.5-ioctl (2006-12-01) initialised: dm-devel@redhat.com
hda: packet command error: status=0x51 { DriveReady SeekComplete Error }
hda: packet command error: error=0x50
ide: failed opcode was 100
cdrom: open failed.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
security:  3 users, 4 roles, 355 types, 26 bools
security:  55 classes, 22610 rules
SELinux:  Completing initialization.
SELinux:  Setting up existing superblocks.
SELinux: initialized (dev dm-0, type ext3), uses xattr
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
SELinux: initialized (dev mqueue, type mqueue), not configured for labeling
SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses genfs_contexts
SELinux: initialized (dev devpts, type devpts), uses transition SIDs
SELinux: initialized (dev eventpollfs, type eventpollfs), uses genfs_contexts
SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
SELinux: initialized (dev proc, type proc), uses genfs_contexts
SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
libata version 2.00 loaded.
Emulex LightPulse Fibre Channel SCSI driver 8.0.16.27
Copyright(c) 2003-2006 Emulex.  All rights reserved.
ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
lpfc 0000:06:02.0: 0:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
scsi0 : Emulex LP9002L-F2 2Gb PCI Fibre Channel Adapter on PCI bus 06 device 10 irq 225
ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
lpfc 0000:07:04.0: 1:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
scsi1 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07 device 20 irq 233
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sda: drive cache: write back
 sda: sda1
Attached scsi disk sda at scsi1, channel 0, id 0, lun 0
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdb: drive cache: write back
SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdb: drive cache: write back
 sdb: unknown partition table
Attached scsi disk sdb at scsi1, channel 0, id 0, lun 1
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdc: drive cache: write back
SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdc: drive cache: write back
 sdc: unknown partition table
Attached scsi disk sdc at scsi1, channel 0, id 0, lun 2
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdd: drive cache: write back
SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdd: drive cache: write back
 sdd: unknown partition table
Attached scsi disk sdd at scsi1, channel 0, id 0, lun 3
ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
Losing some ticks... checking if CPU frequency changed.
lpfc 0000:07:05.0: 2:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
scsi2 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07 device 28 irq 50
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sde: drive cache: write back
SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sde: drive cache: write back
 sde: sde1
Attached scsi disk sde at scsi2, channel 0, id 0, lun 0
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdf: drive cache: write back
SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdf: drive cache: write back
 sdf: unknown partition table
Attached scsi disk sdf at scsi2, channel 0, id 0, lun 1
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdg: drive cache: write back
SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdg: drive cache: write back
 sdg: unknown partition table
Attached scsi disk sdg at scsi2, channel 0, id 0, lun 2
  Vendor: HP        Model: OPEN-E            Rev: 2114
  Type:   Direct-Access                      ANSI SCSI revision: 02
SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdh: drive cache: write back
SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
SCSI device sdh: drive cache: write back
 sdh: unknown partition table
Attached scsi disk sdh at scsi2, channel 0, id 0, lun 3
inserting floppy driver for 2.6.9-55.ELsmp
Floppy drive(s): fd0 is 1.44M
FDC 0 is a National Semiconductor PC87306
Intel(R) PRO/1000 Network Driver - version 7.2.7-k2-NAPI
Copyright (c) 1999-2006 Intel Corporation.
ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
e1000: 0000:0a:01.0: e1000_probe: (PCI-X:133MHz:64-bit) 00:11:0a:64:7e:da
divert: allocating divert_blk for eth0
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
e1000: 0000:0a:01.1: e1000_probe: (PCI-X:133MHz:64-bit) 00:11:0a:64:7e:db
divert: allocating divert_blk for eth1
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
tg3.c:v3.64-rh (July 31, 2006)
ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
divert: allocating divert_blk for eth2
eth2: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:14:38:bf:5a:51
eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] Split[0] WireSpeed[1] TSOcap[0]
eth2: dma_rwctrl[769f4000] dma_mask[64-bit]
ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
divert: allocating divert_blk for eth3
eth3: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:14:38:bf:5a:50
eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1] TSOcap[1]
eth3: dma_rwctrl[769f4000] dma_mask[64-bit]
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
hw_random hardware driver 1.0.0 loaded
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
ehci_hcd 0000:00:1d.7: EHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.7 to 64
ehci_hcd 0000:00:1d.7: irq 193, pci mem ffffff0010086000
SELinux: initialized (dev usbdevfs, type usbdevfs), uses genfs_contexts
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
PCI: cache line size of 128 is not supported by device 0000:00:1d.7
ehci_hcd 0000:00:1d.7: USB 2.0 enabled, EHCI 1.00, driver 2004-May-10
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 8 ports detected
USB Universal Host Controller Interface driver v2.2
ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
uhci_hcd 0000:00:1d.0: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.0 to 64
uhci_hcd 0000:00:1d.0: irq 169, io base 0000000000002000
uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
uhci_hcd 0000:00:1d.1: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.1 to 64
uhci_hcd 0000:00:1d.1: irq 177, io base 0000000000002020
uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
uhci_hcd 0000:00:1d.2: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.2 to 64
uhci_hcd 0000:00:1d.2: irq 185, io base 0000000000002040
uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
uhci_hcd 0000:00:1d.3: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1d.3 to 64
uhci_hcd 0000:00:1d.3: irq 169, io base 0000000000002060
uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
hub 5-0:1.0: USB hub found
hub 5-0:1.0: 2 ports detected
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
ACPI: Power Button (FF) [PWRF]
EXT3 FS on dm-0, internal journal
device-mapper: dm-multipath version 1.0.5 loaded
device-mapper: dm-round-robin version 1.0.0 loaded
kjournald starting.  Commit interval 5 seconds
EXT3 FS on cciss/c0d0p1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev cciss/c0d0p1, type ext3), uses xattr
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-1, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-2, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-2, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-3, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-3, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-4, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-4, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-5, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-5, type ext3), uses xattr
kjournald starting.  Commit interval 5 seconds
EXT3 FS on dm-6, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev dm-6, type ext3), uses xattr
Adding 2097144k swap on /dev/vg00/swap1.  Priority:-1 extents:1
SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
IA-32 Microcode Update Driver: v1.14 <tigran@veritas.com>
microcode: CPU0 already at revision 0x12 (current=0x12)
microcode: CPU1 already at revision 0x12 (current=0x12)
microcode: CPU2 already at revision 0x12 (current=0x12)
microcode: CPU3 already at revision 0x12 (current=0x12)
microcode: No new microdata for cpu 1
microcode: No new microdata for cpu 2
microcode: No new microdata for cpu 0
microcode: No new microdata for cpu 3
IA-32 Microcode Update Driver v1.14 unregistered
ip_tables: (C) 2000-2002 Netfilter core team
ip_conntrack version 2.1 (8192 buckets, 65536 max) - 456 bytes per conntrack
e1000: eth1: e1000_watchdog_task: NIC Link is Up 100 Mbps Half Duplex
i2c /dev entries driver
NET: Registered protocol family 10
Disabled Privacy Extensions on device ffffffff80408540(lo)
IPv6 over IPv4 tunneling driver
divert: not allocating divert_blk for non-ethernet device sit0
eth1: no IPv6 routers present


# cat /var/log/boot.log
Jan 31 15:02:31 corux38 syslog: syslogd startup succeeded
Jan 31 15:02:31 corux38 syslog: klogd startup succeeded
Jan 31 15:02:31 corux38 irqbalance: irqbalance startup succeeded
Jan 31 15:02:31 corux38 multipathd: multipathd startup succeeded
Jan 31 15:02:31 corux38 portmap: portmap startup succeeded
Jan 31 15:02:32 corux38 rc: Starting lm_sensors:  succeeded
Jan 31 15:02:32 corux38 xinetd: xinetd startup succeeded
Jan 31 15:02:32 corux38 ntpd: ntpd startup succeeded
Jan 31 15:02:32 corux38 vsftpd: vsftpd vsftpd succeeded
Jan 31 15:02:33 corux38 ssh-server-g3: Starting ssh-server-g3
Jan 31 10:01:59 corux38 rc.sysinit: -e
Jan 31 10:02:01 corux38 start_udev: Starting udev:  succeeded
Jan 31 10:02:25 corux38 rc.sysinit: -e
Jan 31 10:02:25 corux38 sysctl: net.ipv4.ip_forward = 0
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
Jan 31 10:02:25 corux38 sysctl: kernel.sysrq = 0
Jan 31 10:02:25 corux38 sysctl: kernel.core_uses_pid = 1
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_syncookies = 1
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
Jan 31 10:02:25 corux38 sysctl: fs.file-max = 524288
Jan 31 10:02:25 corux38 sysctl: kernel.sem = 1024 32000 32 4096
Jan 31 10:02:25 corux38 rc.sysinit: Configuring kernel parameters:  succeeded
Jan 31 15:02:26 corux38 date: Thu Jan 31 15:02:26 EST 2008
Jan 31 15:02:26 corux38 rc.sysinit: Setting clock  (localtime): Thu Jan 31 15:02:26 EST 2008 succeeded
Jan 31 15:02:26 corux38 rc.sysinit: Loading default keymap succeeded
Jan 31 15:02:26 corux38 rc.sysinit: Setting hostname corux38:  succeeded
Jan 31 15:02:26 corux38 fsck: /dev/vg00/root: clean, 4335/131072 files, 48559/262144 blocks
Jan 31 15:02:26 corux38 rc.sysinit: Checking root filesystem succeeded
Jan 31 15:02:26 corux38 rc.sysinit: Remounting root filesystem in read-write mode:  succeeded
Jan 31 15:02:26 corux38 lvm.static:   8 logical volume(s) in volume group vg00 now active
Jan 31 15:02:26 corux38 rc.sysinit: Setting up Logical Volume Management: succeeded
Jan 31 15:02:26 corux38 fsck: /boot: clean, 38/26104 files, 17822/104388 blocks
Jan 31 15:02:26 corux38 fsck: /dev/vg00/home: clean, 132/262144 files, 20580/524288 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files, 36957/1048576 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files, 13541/262144 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/usr: clean, 30250/524288 files, 169645/1048576 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368 files, 17525/540672 blocks
Jan 31 15:02:27 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files, 49124/2097152 blocks
Jan 31 15:02:27 corux38 rc.sysinit: Checking filesystems succeeded
Jan 31 15:02:27 corux38 rc.sysinit: Mounting local filesystems:  succeeded
Jan 31 15:02:27 corux38 rc.sysinit: Enabling swap space:  succeeded
Jan 31 15:02:28 corux38 microcode_ctl: microcode_ctl startup succeeded
Jan 31 15:02:36 corux38 ssh-server-g3: done.
Jan 31 15:02:28 corux38 vgchange:   8 logical volume(s) in volume group "vg00" monitored
Jan 31 15:02:36 corux38 rc: Starting ssh-server-g3:  succeeded
Jan 31 15:02:28 corux38 lvm2-monitor: Starting monitoring for VG vg00: succeeded
Jan 31 15:02:36 corux38 crond: crond startup succeeded
Jan 31 15:02:28 corux38 cpuspeed: cpuspeed startup succeeded
Jan 31 15:02:28 corux38 iptables:  succeeded
Jan 31 15:02:36 corux38 atd: atd startup succeeded
Jan 31 15:02:29 corux38 sysctl: net.ipv4.ip_forward = 0
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
Jan 31 15:02:36 corux38 messagebus: messagebus startup succeeded
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
Jan 31 15:02:29 corux38 sysctl: kernel.sysrq = 0
Jan 31 15:02:29 corux38 sysctl: kernel.core_uses_pid = 1
Jan 31 15:02:36 corux38 haldaemon: haldaemon startup succeeded
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
Jan 31 15:02:29 corux38 sysctl: fs.file-max = 524288
Jan 31 15:02:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
Jan 31 15:02:29 corux38 network: Setting network parameters:  succeeded
Jan 31 15:02:29 corux38 network: Bringing up loopback interface:  succeeded
Jan 31 15:02:31 corux38 network: Bringing up interface eth1:  succeeded
Jan 31 15:03:08 corux38 haldaemon: haldaemon -TERM succeeded
Jan 31 15:03:08 corux38 messagebus: messagebus -TERM succeeded
Jan 31 15:03:08 corux38 atd: atd shutdown succeeded
Jan 31 15:03:09 corux38 vsftpd: vsftpd shutdown succeeded
Jan 31 15:03:09 corux38 xinetd: xinetd shutdown succeeded
Jan 31 15:03:09 corux38 crond: crond shutdown succeeded
Jan 31 15:03:09 corux38 ntpd: ntpd shutdown succeeded
Jan 31 15:03:09 corux38 irqbalance: irqbalance shutdown succeeded
Jan 31 15:03:09 corux38 multipathd: multipathd shutdown succeeded
Jan 31 15:03:09 corux38 portmap: portmap shutdown succeeded
Jan 31 15:05:36 corux38 syslog: syslogd startup succeeded
Jan 31 15:05:36 corux38 syslog: klogd startup succeeded
Jan 31 15:05:37 corux38 irqbalance: irqbalance startup succeeded
Jan 31 15:05:37 corux38 multipathd: multipathd startup succeeded
Jan 31 15:05:37 corux38 portmap: portmap startup succeeded
Jan 31 15:05:37 corux38 rc: Starting lm_sensors:  succeeded
Jan 31 15:05:37 corux38 xinetd: xinetd startup succeeded
Jan 31 15:05:37 corux38 ntpd: ntpd startup succeeded
Jan 31 15:05:38 corux38 vsftpd: vsftpd vsftpd succeeded
Jan 31 15:05:38 corux38 ssh-server-g3: Starting ssh-server-g3
Jan 31 10:05:03 corux38 rc.sysinit: -e
Jan 31 10:05:05 corux38 start_udev: Starting udev:  succeeded
Jan 31 10:05:29 corux38 rc.sysinit: -e
Jan 31 10:05:29 corux38 sysctl: net.ipv4.ip_forward = 0
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
Jan 31 10:05:29 corux38 sysctl: kernel.sysrq = 0
Jan 31 10:05:29 corux38 sysctl: kernel.core_uses_pid = 1
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
Jan 31 10:05:29 corux38 sysctl: fs.file-max = 524288
Jan 31 10:05:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
Jan 31 10:05:29 corux38 rc.sysinit: Configuring kernel parameters:  succeeded
Jan 31 15:05:30 corux38 date: Thu Jan 31 15:05:30 EST 2008
Jan 31 15:05:30 corux38 rc.sysinit: Setting clock  (localtime): Thu Jan 31 15:05:30 EST 2008 succeeded
Jan 31 15:05:30 corux38 rc.sysinit: Loading default keymap succeeded
Jan 31 15:05:30 corux38 rc.sysinit: Setting hostname corux38:  succeeded
Jan 31 15:05:30 corux38 fsck: /dev/vg00/root: clean, 4335/131072 files, 48559/262144 blocks
Jan 31 15:05:30 corux38 rc.sysinit: Checking root filesystem succeeded
Jan 31 15:05:30 corux38 rc.sysinit: Remounting root filesystem in read-write mode:  succeeded
Jan 31 15:05:30 corux38 lvm.static:   8 logical volume(s) in volume group vg00 now active
Jan 31 15:05:30 corux38 rc.sysinit: Setting up Logical Volume Management: succeeded
Jan 31 15:05:30 corux38 fsck: /boot: clean, 38/26104 files, 17822/104388 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/home: clean, 132/262144 files, 20580/524288 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files, 36957/1048576 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files, 13541/262144 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/usr: clean, 30250/524288 files, 169645/1048576 blocks
Jan 31 15:05:30 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368 files, 17525/540672 blocks
Jan 31 15:05:31 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files, 49141/2097152 blocks
Jan 31 15:05:31 corux38 rc.sysinit: Checking filesystems succeeded
Jan 31 15:05:31 corux38 rc.sysinit: Mounting local filesystems:  succeeded
Jan 31 15:05:31 corux38 rc.sysinit: Enabling swap space:  succeeded
Jan 31 15:05:32 corux38 microcode_ctl: microcode_ctl startup succeeded
Jan 31 15:05:32 corux38 vgchange:   8 logical volume(s) in volume group "vg00" monitored
Jan 31 15:05:32 corux38 lvm2-monitor: Starting monitoring for VG vg00: succeeded
Jan 31 15:05:41 corux38 ssh-server-g3: done.
Jan 31 15:05:32 corux38 cpuspeed: cpuspeed startup succeeded
Jan 31 15:05:41 corux38 rc: Starting ssh-server-g3:  succeeded
Jan 31 15:05:32 corux38 iptables:  succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.ip_forward = 0
Jan 31 15:05:41 corux38 crond: crond startup succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
Jan 31 15:05:41 corux38 atd: atd startup succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
Jan 31 15:05:32 corux38 sysctl: kernel.sysrq = 0
Jan 31 15:05:32 corux38 sysctl: kernel.core_uses_pid = 1
Jan 31 15:05:42 corux38 messagebus: messagebus startup succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
Jan 31 15:05:42 corux38 haldaemon: haldaemon startup succeeded
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_syncookies = 1
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
Jan 31 15:05:32 corux38 sysctl: fs.file-max = 524288
Jan 31 15:05:32 corux38 sysctl: kernel.sem = 1024 32000 32 4096
Jan 31 15:05:32 corux38 network: Setting network parameters:  succeeded
Jan 31 15:05:32 corux38 network: Bringing up loopback interface:  succeeded
Jan 31 15:05:36 corux38 network: Bringing up interface eth1:  succeeded


# multipath -ll
mpath1 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [enabled]
 \_ 2:0:0:1 sdf 8:80  [active][ready]
 \_ 1:0:0:1 sdb 8:16  [active][ready]

mpath0 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [enabled]
 \_ 2:0:0:0 sde 8:64  [active][ready]
 \_ 1:0:0:0 sda 8:0   [active][ready]

[-- Attachment #4: initial_view.txt --]
[-- Type: text/plain, Size: 8139 bytes --]

# service multipathd stop
# multipath -F
# service multipathd start
# multipath -v3
load path identifiers cache
#
# all paths in cache :
#
00040026_05:83  1:0:0:0 sda 8:0   HP      /OPEN-E          /2114
00040026_05:84  1:0:0:1 sdb 8:16   HP      /OPEN-E          /2114
00040026_05:85  1:0:0:2 sdc 8:32   HP      /OPEN-E          /2114
00040026_05:86  1:0:0:3 sdd 8:48   HP      /OPEN-E          /2114
00040026_05:83  2:0:0:0 sde 8:64   HP      /OPEN-E          /2114
00040026_05:84  2:0:0:1 sdf 8:80   HP      /OPEN-E          /2114
00040026_05:85  2:0:0:2 sdg 8:96   HP      /OPEN-E          /2114
00040026_05:86  2:0:0:3 sdh 8:112   HP      /OPEN-E          /2114
cciss!c0d0 blacklisted
cciss!c0d1 blacklisted
dm-0 blacklisted
dm-1 blacklisted
dm-2 blacklisted
dm-3 blacklisted
dm-4 blacklisted
dm-5 blacklisted
dm-6 blacklisted
dm-7 blacklisted
fd0 blacklisted
hda blacklisted
md0 blacklisted
ram0 blacklisted
ram10 blacklisted
ram11 blacklisted
ram12 blacklisted
ram13 blacklisted
ram14 blacklisted
ram15 blacklisted
ram1 blacklisted
ram2 blacklisted
ram3 blacklisted
ram4 blacklisted
ram5 blacklisted
ram6 blacklisted
ram7 blacklisted
ram8 blacklisted
ram9 blacklisted
===== path info sda (mask 0x1f) =====
bus = 1
dev_t = 8:0
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:0
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:83 (cache)
===== path info sdb (mask 0x1f) =====
bus = 1
dev_t = 8:16
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:1
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:84 (cache)
===== path info sdc (mask 0x1f) =====
bus = 1
dev_t = 8:32
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:2
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:85 (cache)
===== path info sdd (mask 0x1f) =====
bus = 1
dev_t = 8:48
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 1:0:0:3
tgt_node_name = 0x50060e80039c5a04
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:86 (cache)
===== path info sde (mask 0x1f) =====
bus = 1
dev_t = 8:64
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 2:0:0:0
tgt_node_name = 0x50060e80039c5a14
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:83 (cache)
===== path info sdf (mask 0x1f) =====
bus = 1
dev_t = 8:80
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 2:0:0:1
tgt_node_name = 0x50060e80039c5a14
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:84 (cache)
===== path info sdg (mask 0x1f) =====
bus = 1
dev_t = 8:96
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 2:0:0:2
tgt_node_name = 0x50060e80039c5a14
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:85 (cache)
===== path info sdh (mask 0x1f) =====
bus = 1
dev_t = 8:112
size = 28452960
vendor = HP
product = OPEN-E
rev = 2114
h:b:t:l = 2:0:0:3
tgt_node_name = 0x50060e80039c5a14
serial = 40026
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
uid = 00040026_05:86 (cache)
#
# all paths :
#
00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E          /2114
00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E          /2114
00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E          /2114
00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E          /2114
00040026_05:83  2:0:0:0 sde 8:64  [ready] HP      /OPEN-E          /2114
00040026_05:84  2:0:0:1 sdf 8:80  [ready] HP      /OPEN-E          /2114
00040026_05:85  2:0:0:2 sdg 8:96  [ready] HP      /OPEN-E          /2114
00040026_05:86  2:0:0:3 sdh 8:112  [ready] HP      /OPEN-E          /2114
Initialized new bindings file [/var/lib/multipath/bindings]
No matching wwid [00040026_05:83] in bindings file.
Created new binding [mpath0] for WWID [00040026_05:83]
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:0 100 8:64 100
set ACT_CREATE: map does not exists
message mpath0 0 switch_group 1

create: mpath0 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:0 sda 8:0   [ready]
 \_ 2:0:0:0 sde 8:64  [ready]

reloading features
No matching wwid [00040026_05:84] in bindings file.
Created new binding [mpath1] for WWID [00040026_05:84]
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:16 100 8:80 100
set ACT_CREATE: map does not exists
message mpath1 0 switch_group 1

create: mpath1 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:1 sdb 8:16  [ready]
 \_ 2:0:0:1 sdf 8:80  [ready]

reloading features
No matching wwid [00040026_05:85] in bindings file.
Created new binding [mpath2] for WWID [00040026_05:85]
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:32 100 8:96 100
set ACT_CREATE: map does not exists
message mpath2 0 switch_group 1

create: mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:2 sdc 8:32  [ready]
 \_ 2:0:0:2 sdg 8:96  [ready]

reloading features
No matching wwid [00040026_05:86] in bindings file.
Created new binding [mpath3] for WWID [00040026_05:86]
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:48 100 8:112 100
set ACT_CREATE: map does not exists
message mpath3 0 switch_group 1

create: mpath3 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0
 \_ 1:0:0:3 sdd 8:48  [ready]
 \_ 2:0:0:3 sdh 8:112 [ready]

reloading features

# multipath -ll
mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:2 sdc 8:32  [active][ready]
 \_ 2:0:0:2 sdg 8:96  [active][ready]

mpath1 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:1 sdb 8:16  [active][ready]
 \_ 2:0:0:1 sdf 8:80  [active][ready]

mpath0 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:0 sda 8:0   [active][ready]
 \_ 2:0:0:0 sde 8:64  [active][ready]

mpath3 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 [active]
 \_ 1:0:0:3 sdd 8:48  [active][ready]
 \_ 2:0:0:3 sdh 8:112 [active][ready]

[-- Attachment #5: Type: text/plain, Size: 0 bytes --]

Re: Multipath not rebuilding correctly on reboot

[Pradipmaya Maharana]

Could you also share your multipath.conf file.

Regards,
Pradipmaya.

2008/2/12 Greene, Rick <rick.greene@ncogroup.com>:
> I never saw any response on this, though a side comment on my other
> thread did get one query that I tried to direct to here, so I figured
> I'd repost and see if anyone had any ideas.
>
> Re-attaching the original docs as well.
>
> Thanks in advance,
> Rick
>
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of Greene, Rick
> Sent: Thursday, January 31, 2008 3:20 PM
> To: device-mapper development
> Subject: [dm-devel] Multipath not rebuilding correctly on reboot
>
> Now that I seem to have multipath and my XP 1024 working together, I've
> found a new issue.  Someone recently had a similar thread going, but I
> saw no ultimate resolution.
>
> My problem is that when I reboot my server, the multipath configuration
> is not coming back the way it was before.  I moved the two external
> tools I use to find the UID into /etc (they had bin in /usr/bin and
> /sbin), updated the multipath.conf file (and one of the scripts) to
> reflect this, but odd things are still happening.
>
> Attached is initial_view.txt, which shows what multipath is coming up
> with when I do the commands shown (the bulk of the file is multipath -v3
> output, but at the bottom of the file is a multipath -ll output as
> well).  It (seems to) correctly shows that I have 4 disks, each visible
> via two separate paths.
>
> After I reboot, however, I get different results.  Once it showed 4
> paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
> correctly showed mpath0, mpath1, and mpath3, but didn't show mpath2 at
> all.  On the next attempt I got everything correct, and the very next
> one only showed mpath0 and mpath1.
>
> The post_reboot.txt file shows the contents of the /var/log/boot.log
> file and the output of the dmesg command, along with the "multipath -ll"
> view from the most recent reboot.
>
> I then manually did a "multipath -v2" and the missing two paths then
> came back.  The file manual_run.txt shows those results plus the updated
> "multipath -ll".
>
> Do I need to just make my own /etc/init.d script to do a "multipath -v2"
> at the end of booting to make sure it all gets covered, along with the
> requisite LVM & mount commands to get the VG that is on these disks
> working right?
>
> Thanks in advance,
> Rick
>
>
>
>
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel
>

RE: Multipath not rebuilding correctly on reboot

[Greene, Rick]

[-- Attachment #1: Type: text/plain, Size: 365 bytes --]

Attached

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Pradipmaya Maharana
Sent: Tuesday, February 12, 2008 12:42 PM
To: device-mapper development
Subject: Re: [dm-devel] Multipath not rebuilding correctly on reboot

Could you also share your multipath.conf file.

Regards,
Pradipmaya.

[-- Attachment #2: multipath.conf --]
[-- Type: application/octet-stream, Size: 4395 bytes --]

# This is an example configuration file for device mapper multipath.
# For a complete list of the default configuration values, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.defaults
# For a list of configuration options with descriptions, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.annotated


# Blacklist all devices by default. Remove this to enable multipathing
# on the default devices.
#devnode_blacklist {
#        devnode "*"
#}

## Use user friendly names, instead of using WWIDs as names.
defaults {
        user_friendly_names yes
}


## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.
#devices {
#       device {
#               vendor                  "IBM"
#               product                 "S/390 DASD ECKD"
#               path_grouping_policy    multibus
#               getuid_callout          "/sbin/dasdview -j /dev/%n"
#               path_checker            directio
#       }
#}


##
## This is a template multipath-tools configuration file
## Uncomment the lines relevent to your environment
##
#       path_grouping_policy    multibus
#       getuid_callout          "/sbin/scsi_id -g -u -p 0x83 -s /block/%n"
defaults {
        udev_dir                /dev
        polling_interval        10
        selector                "round-robin 0"
        path_grouping_policy    failover
        getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
#       getuid_callout          "/etc/xpdisk %n"
        prio_callout            /bin/true
        path_checker            readsector0
        rr_min_io               100
        rr_weight               priorities
        failback                immediate
        no_path_retry           fail
        user_friendly_name      yes
}
##
## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid.  The 3 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line.  Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
devnode_blacklist {
        wwid 26353900f02796769
        devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
        devnode "^hd[a-z]"
        devnode "^cciss!c[0-9]d[0-9]*"
}
#multipaths {
#       multipath {
#               wwid                    3600508b4000156d700012000000b0000
#               alias                   yellow
#               path_grouping_policy    multibus
#               path_checker            readsector0
#               path_selector           "round-robin 0"
#               failback                manual
#               rr_weight               priorities
#               no_path_retry           5
#       }
#       multipath {
#               wwid                    1DEC_____321816758474
#               alias                   red
#       }
#}

devices {
        device {
                vendor                  "{HITACHI|HP|0HP|SHP}"
                product                 "OPEN-*"
                getuid_callout          "/etc/xpdisk %n"
                path_grouping_policy    multibus
                path_checker            tur
        }
}

#devices {
#       device {
#               vendor                  "COMPAQ  "
#               product                 "HSV110 (C)COMPAQ"
#               path_grouping_policy    multibus
#               getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
#               path_checker            readsector0
#               path_selector           "round-robin 0"
#               hardware_handler        "0"
#               failback                15
#               rr_weight               priorities
#               no_path_retry           queue
#       }
#       device {
#               vendor                  "COMPAQ  "
#               product                 "MSA1000         "
#               path_grouping_policy    multibus
#       }
#}

[-- Attachment #3: Type: text/plain, Size: 0 bytes --]

Re: Multipath not rebuilding correctly on reboot

[Benjamin Marzinski]

On Thu, Jan 31, 2008 at 03:20:04PM -0500, Greene, Rick wrote:
> Now that I seem to have multipath and my XP 1024 working together, I've
> found a new issue.  Someone recently had a similar thread going, but I
> saw no ultimate resolution.
> 
> My problem is that when I reboot my server, the multipath configuration
> is not coming back the way it was before.  I moved the two external
> tools I use to find the UID into /etc (they had bin in /usr/bin and
> /sbin), updated the multipath.conf file (and one of the scripts) to
> reflect this, but odd things are still happening.
> 
> Attached is initial_view.txt, which shows what multipath is coming up
> with when I do the commands shown (the bulk of the file is multipath -v3
> output, but at the bottom of the file is a multipath -ll output as
> well).  It (seems to) correctly shows that I have 4 disks, each visible
> via two separate paths.
> 
> After I reboot, however, I get different results.  Once it showed 4
> paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
> correctly showed mpath0, mpath1, and mpath3, but didn't show mpath2 at
> all.  On the next attempt I got everything correct, and the very next
> one only showed mpath0 and mpath1.
> 
> The post_reboot.txt file shows the contents of the /var/log/boot.log
> file and the output of the dmesg command, along with the "multipath -ll"
> view from the most recent reboot.
> 
> I then manually did a "multipath -v2" and the missing two paths then
> came back.  The file manual_run.txt shows those results plus the updated
> "multipath -ll".
> 
> Do I need to just make my own /etc/init.d script to do a "multipath -v2"
> at the end of booting to make sure it all gets covered, along with the
> requisite LVM & mount commands to get the VG that is on these disks
> working right?

Hopefully, you can just add the line

multipath -v 0 

to /etc/rc.local and fix this.  However, if you want to dig into
what's going wrong:

There are two places were multipath gets called to create devices during
bootup.  One is in /etc/rc.sysinit and one in
/etc/dev.d/block/multipath.dev.  /etc/rc.sysinit will always be run as
one of the first things during the boot process, and it just calls
multipath.static -v 0, which should correctly set up multipath devices
on all of the available paths.  /etc/dev.d/block/multipath.dev gets
called by udev, and is a lot more suspect.

If you feel confortable editting boot scripts, you can do some debugging
to figure out what's going on.

in /etc/rc.sysinit (assuming you aren't using md or raid), you can change
the first line with:
/sbin/multipath.static -v 0
to:
/sbin/multipath.static -v 3 >> /tmp/multipath_boot_log 2>&1

the other lines that call multipath.static are only run if you have
the files /etc/raidtab or /etc/mdadm.conf, which you probably don't.

in /etc/dev.d/block/multipath.dev just add the following line right
after the #!/bin/sh line:

echo "${ACTION} ${DEVPATH}" >> /tmp/multipath_boot_log

Then reboot and look at /tmp/multipath_boot_log

You should see something that looks like the output of running
# multipath -v 3
along with a bunch of lines like:

add /block/md0
add /block/loop1
add /block/loop0
add /block/dm-7

The multipath run is from rc.sysinit, and the "add" lines are devices
that udev is trying to create a multipath device on.  On systems where
everthing comes up fine during boot up, all of the devices that aren't
dealt with by the multipath call in rc.sysinit should be added by udev.

I'm assuming that this won't be the case on your box. If udev isn't
running /etc/dev.d/block/multipath.dev, there's not much you can do
to fix it, besides filing a bug against udev.  However you may be able to
make it more likely that your scsi devices will all be up by the time
rc.sysinit is run.  If your device drivers aren't getting loaded by the
initrd, you can add them to /etc/modprobe.conf, run mkinitrd.  If you do
this, it's always wise to back up your existing initrd, and make sure
that grub can boot with it.

Otherwise, just try adding the line to rc.local

Hope this helps

-Ben
 
> Thanks in advance,
> Rick
> 
> 
> 

Content-Description: initial_view.txt
> # service multipathd stop
> # multipath -F
> # service multipathd start
> # multipath -v3
> load path identifiers cache
> #
> # all paths in cache :
> #
> 00040026_05:83  1:0:0:0 sda 8:0   HP      /OPEN-E          /2114
> 00040026_05:84  1:0:0:1 sdb 8:16   HP      /OPEN-E          /2114
> 00040026_05:85  1:0:0:2 sdc 8:32   HP      /OPEN-E          /2114
> 00040026_05:86  1:0:0:3 sdd 8:48   HP      /OPEN-E          /2114
> 00040026_05:83  2:0:0:0 sde 8:64   HP      /OPEN-E          /2114
> 00040026_05:84  2:0:0:1 sdf 8:80   HP      /OPEN-E          /2114
> 00040026_05:85  2:0:0:2 sdg 8:96   HP      /OPEN-E          /2114
> 00040026_05:86  2:0:0:3 sdh 8:112   HP      /OPEN-E          /2114
> cciss!c0d0 blacklisted
> cciss!c0d1 blacklisted
> dm-0 blacklisted
> dm-1 blacklisted
> dm-2 blacklisted
> dm-3 blacklisted
> dm-4 blacklisted
> dm-5 blacklisted
> dm-6 blacklisted
> dm-7 blacklisted
> fd0 blacklisted
> hda blacklisted
> md0 blacklisted
> ram0 blacklisted
> ram10 blacklisted
> ram11 blacklisted
> ram12 blacklisted
> ram13 blacklisted
> ram14 blacklisted
> ram15 blacklisted
> ram1 blacklisted
> ram2 blacklisted
> ram3 blacklisted
> ram4 blacklisted
> ram5 blacklisted
> ram6 blacklisted
> ram7 blacklisted
> ram8 blacklisted
> ram9 blacklisted
> ===== path info sda (mask 0x1f) =====
> bus = 1
> dev_t = 8:0
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 1:0:0:0
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:83 (cache)
> ===== path info sdb (mask 0x1f) =====
> bus = 1
> dev_t = 8:16
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 1:0:0:1
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:84 (cache)
> ===== path info sdc (mask 0x1f) =====
> bus = 1
> dev_t = 8:32
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 1:0:0:2
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:85 (cache)
> ===== path info sdd (mask 0x1f) =====
> bus = 1
> dev_t = 8:48
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 1:0:0:3
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:86 (cache)
> ===== path info sde (mask 0x1f) =====
> bus = 1
> dev_t = 8:64
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 2:0:0:0
> tgt_node_name = 0x50060e80039c5a14
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:83 (cache)
> ===== path info sdf (mask 0x1f) =====
> bus = 1
> dev_t = 8:80
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 2:0:0:1
> tgt_node_name = 0x50060e80039c5a14
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:84 (cache)
> ===== path info sdg (mask 0x1f) =====
> bus = 1
> dev_t = 8:96
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 2:0:0:2
> tgt_node_name = 0x50060e80039c5a14
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:85 (cache)
> ===== path info sdh (mask 0x1f) =====
> bus = 1
> dev_t = 8:112
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 2:0:0:3
> tgt_node_name = 0x50060e80039c5a14
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:86 (cache)
> #
> # all paths :
> #
> 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E          /2114
> 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E          /2114
> 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E          /2114
> 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E          /2114
> 00040026_05:83  2:0:0:0 sde 8:64  [ready] HP      /OPEN-E          /2114
> 00040026_05:84  2:0:0:1 sdf 8:80  [ready] HP      /OPEN-E          /2114
> 00040026_05:85  2:0:0:2 sdg 8:96  [ready] HP      /OPEN-E          /2114
> 00040026_05:86  2:0:0:3 sdh 8:112  [ready] HP      /OPEN-E          /2114
> Initialized new bindings file [/var/lib/multipath/bindings]
> No matching wwid [00040026_05:83] in bindings file.
> Created new binding [mpath0] for WWID [00040026_05:83]
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:0 100 8:64 100
> set ACT_CREATE: map does not exists
> message mpath0 0 switch_group 1
> 
> create: mpath0 (00040026_05:83)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:0 sda 8:0   [ready]
>  \_ 2:0:0:0 sde 8:64  [ready]
> 
> reloading features
> No matching wwid [00040026_05:84] in bindings file.
> Created new binding [mpath1] for WWID [00040026_05:84]
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:16 100 8:80 100
> set ACT_CREATE: map does not exists
> message mpath1 0 switch_group 1
> 
> create: mpath1 (00040026_05:84)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:1 sdb 8:16  [ready]
>  \_ 2:0:0:1 sdf 8:80  [ready]
> 
> reloading features
> No matching wwid [00040026_05:85] in bindings file.
> Created new binding [mpath2] for WWID [00040026_05:85]
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:32 100 8:96 100
> set ACT_CREATE: map does not exists
> message mpath2 0 switch_group 1
> 
> create: mpath2 (00040026_05:85)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:2 sdc 8:32  [ready]
>  \_ 2:0:0:2 sdg 8:96  [ready]
> 
> reloading features
> No matching wwid [00040026_05:86] in bindings file.
> Created new binding [mpath3] for WWID [00040026_05:86]
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:48 100 8:112 100
> set ACT_CREATE: map does not exists
> message mpath3 0 switch_group 1
> 
> create: mpath3 (00040026_05:86)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:3 sdd 8:48  [ready]
>  \_ 2:0:0:3 sdh 8:112 [ready]
> 
> reloading features
> 
> # multipath -ll
> mpath2 (00040026_05:85)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [active]
>  \_ 1:0:0:2 sdc 8:32  [active][ready]
>  \_ 2:0:0:2 sdg 8:96  [active][ready]
> 
> mpath1 (00040026_05:84)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [active]
>  \_ 1:0:0:1 sdb 8:16  [active][ready]
>  \_ 2:0:0:1 sdf 8:80  [active][ready]
> 
> mpath0 (00040026_05:83)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [active]
>  \_ 1:0:0:0 sda 8:0   [active][ready]
>  \_ 2:0:0:0 sde 8:64  [active][ready]
> 
> mpath3 (00040026_05:86)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [active]
>  \_ 1:0:0:3 sdd 8:48  [active][ready]
>  \_ 2:0:0:3 sdh 8:112 [active][ready]

Content-Description: post_reboot.txt
> # dmesg
> Bootdata ok (command line is ro root=/dev/vg00/root rhgb quiet)
> Linux version 2.6.9-55.ELsmp (brewbuilder@hs20-bc2-4.build.redhat.com) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Fri Apr 20 16:36:54 EDT 2007
> BIOS-provided physical RAM map:
>  BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
>  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
>  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
>  BIOS-e820: 0000000000100000 - 00000000bfff3000 (usable)
>  BIOS-e820: 00000000bfff3000 - 00000000bfffb000 (ACPI data)
>  BIOS-e820: 00000000bfffb000 - 00000000c0000000 (reserved)
>  BIOS-e820: 00000000fec00000 - 00000000fed00000 (reserved)
>  BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
>  BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
> ACPI: RSDP (v002 HP                                    ) @ 0x00000000000f4f00
> ACPI: XSDT (v001 HP     P51      0x00000002 ? 0x0000162e) @ 0x00000000bfff3300
> ACPI: FADT (v003 HP     P51      0x00000002 ? 0x0000162e) @ 0x00000000bfff3380
> ACPI: SPCR (v001 HP     SPCRRBSU 0x00000001 ? 0x0000162e) @ 0x00000000bfff3140
> ACPI: MCFG (v001 HP     ProLiant 0x00000001  0x00000000) @ 0x00000000bfff31c0
> ACPI: MADT (v001 HP     00000083 0x00000002  0x00000000) @ 0x00000000bfff3200
> ACPI: SSDT (v001 HP        SSDTP 0x00000001 INTL 0x20030228) @ 0x00000000bfff8000
> ACPI: DSDT (v001 HP         DSDT 0x00000001 INTL 0x20030228) @ 0x0000000000000000
> No NUMA configuration found
> Faking a node at 0000000000000000-00000000bfff3000
> Bootmem setup node 0 0000000000000000-00000000bfff3000
> On node 0 totalpages: 786419
>   DMA zone: 4096 pages, LIFO batch:1
>   Normal zone: 782323 pages, LIFO batch:16
>   HighMem zone: 0 pages, LIFO batch:1
> DMI 2.3 present.
> ACPI: PM-Timer IO Port: 0x908
> ACPI: Local APIC address 0xfee00000
> ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> Processor #0 15:4 APIC version 16
> ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
> ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
> ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
> Processor #6 15:4 APIC version 16
> ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> Processor #1 15:4 APIC version 16
> ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
> ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
> ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
> Processor #7 15:4 APIC version 16
> ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
> Setting APIC routing to flat
> ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
> IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
> ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
> IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
> ACPI: IOAPIC (id[0x0a] address[0xfec80400] gsi_base[48])
> IOAPIC[2]: apic_id 10, version 32, address 0xfec80400, GSI 48-71
> ACPI: IOAPIC (id[0x0b] address[0xfec84000] gsi_base[72])
> IOAPIC[3]: apic_id 11, version 32, address 0xfec84000, GSI 72-95
> ACPI: IOAPIC (id[0x0c] address[0xfec84400] gsi_base[96])
> IOAPIC[4]: apic_id 12, version 32, address 0xfec84400, GSI 96-119
> ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> ACPI: IRQ0 used by override.
> ACPI: IRQ2 used by override.
> ACPI: IRQ9 used by override.
> Using ACPI (MADT) for SMP configuration information
> Allocating PCI resources starting at c4000000 (gap: c0000000:3ec00000)
> Checking aperture...
> Built 1 zonelists
> Kernel command line: ro root=/dev/vg00/root rhgb quiet console=tty0
> Initializing CPU#0
> PID hash table entries: 4096 (order: 12, 131072 bytes)
> time.c: Using 3.579545 MHz PM timer.
> time.c: Detected 3400.312 MHz processor.
> Console: colour VGA+ 80x25
> Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> Memory: 3089236k/3145676k available (2112k kernel code, 0k reserved, 1305k data, 208k init)
> Calibrating delay using timer specific routine.. 6807.48 BogoMIPS (lpj=3403744)
> Security Scaffold v1.0.0 initialized
> SELinux:  Initializing.
> SELinux:  Starting in permissive mode
> There is already a security framework initialized, register_security failed.
> selinux_register_security:  Registering secondary module capability
> Capability LSM initialized as secondary
> Mount-cache hash table entries: 256 (order: 0, 4096 bytes)
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> using mwait in idle threads.
> CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> Using IO APIC NMI watchdog
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> CPU0:                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> per-CPU timeslice cutoff: 1023.90 usecs.
> task migration cache decay timeout: 1 msecs.
> Booting processor 1/6 rip 6000 rsp 10037e05f58
> Initializing CPU#1
> Calibrating delay using timer specific routine.. 6799.32 BogoMIPS (lpj=3399660)
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU1: Initial APIC ID: 6, Physical Processor ID: 3
>                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> Booting processor 2/1 rip 6000 rsp 10037e3df58
> Initializing CPU#2
> Calibrating delay using timer specific routine.. 6799.31 BogoMIPS (lpj=3399655)
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU2: Initial APIC ID: 1, Physical Processor ID: 0
>                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> Booting processor 3/7 rip 6000 rsp 100016f3f58
> Initializing CPU#3
> Calibrating delay using timer specific routine.. 6799.18 BogoMIPS (lpj=3399591)
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU3: Initial APIC ID: 7, Physical Processor ID: 3
>                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> Total of 4 processors activated (27205.30 BogoMIPS).
> activating NMI Watchdog ... done.
> testing NMI watchdog ... OK.
> Using local APIC timer interrupts.
> Detected 12.501 MHz APIC timer.
> checking TSC synchronization across 4 CPUs: passed.
> Brought up 4 CPUs
> time.c: Using PIT/TSC based timekeeping.
> checking if image is initramfs... it is
> NET: Registered protocol family 16
> PCI: Using configuration type 1
> PCI: Using MMCONFIG at e0000000
> mtrr: v2.0 (20020519)
> mtrr: your CPUs had inconsistent fixed MTRR settings
> mtrr: probably your BIOS does not setup all CPUs.
> mtrr: corrected configuration.
> ACPI: Subsystem revision 20040816
> ACPI: Interpreter enabled
> ACPI: Using IOAPIC for interrupt routing
> ACPI: PCI Root Bridge [PCI0] (00:00)
> PCI: Probing PCI hardware (bus 00)
> PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
> PCI: PXH quirk detected, disabling MSI for SHPC device
> PCI: PXH quirk detected, disabling MSI for SHPC device
> PCI: PXH quirk detected, disabling MSI for SHPC device
> PCI: PXH quirk detected, disabling MSI for SHPC device
> PCI: Transparent bridge - 0000:00:1e.0
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.IP2P._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXA._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXB._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXC._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXD._PRT]
> ACPI: PCI Interrupt Link [LNKA] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKB] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKC] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKD] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKE] (IRQs 5 7 10 11) *0, disabled.
> ACPI: PCI Interrupt Link [LNKF] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKG] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKH] (IRQs *5 7 10 11)
> usbcore: registered new driver usbfs
> usbcore: registered new driver hub
> PCI: Using ACPI for IRQ routing
> GSI 16 sharing vector 0xA9 and IRQ 16
> ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 169
> ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 169
> ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
> GSI 17 sharing vector 0xB1 and IRQ 17
> ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
> GSI 18 sharing vector 0xB9 and IRQ 18
> ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
> ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
> GSI 19 sharing vector 0xC1 and IRQ 19
> ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
> ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> GSI 20 sharing vector 0xC9 and IRQ 20
> ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
> GSI 21 sharing vector 0xD1 and IRQ 21
> ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
> GSI 22 sharing vector 0xD9 and IRQ 22
> ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
> GSI 23 sharing vector 0xE1 and IRQ 23
> ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
> GSI 24 sharing vector 0xE9 and IRQ 24
> ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
> GSI 25 sharing vector 0x32 and IRQ 25
> ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
> GSI 26 sharing vector 0x3A and IRQ 26
> ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
> GSI 27 sharing vector 0x42 and IRQ 27
> ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
> GSI 28 sharing vector 0x4A and IRQ 28
> ACPI: PCI Interrupt 0000:01:04.0[A] -> GSI 21 (level, low) -> IRQ 74
> GSI 29 sharing vector 0x52 and IRQ 29
> ACPI: PCI Interrupt 0000:01:04.2[B] -> GSI 22 (level, low) -> IRQ 82
> PCI-DMA: Disabling IOMMU.
> IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
> audit: initializing netlink socket (disabled)
> audit(1201791896.599:1): initialized
> Total HugeTLB memory allocated, 0
> VFS: Disk quotas dquot_6.5.1
> Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
> SELinux:  Registering netfilter hooks
> Initializing Cryptographic API
> ksign: Installing public key data
> Loading keyring
> - Added public key B7CA3C9BE2FAFC39
> - User ID: Red Hat, Inc. (Kernel Module GPG key)
> pci_hotplug: PCI Hot Plug PCI Core version: 0.5
> ACPI: Processor [CPU0] (supports C1)
> ACPI: Processor [CPU1] (supports C1)
> ACPI: Processor [CPU2] (supports C1)
> ACPI: Processor [CPU3] (supports C1)
> ACPI: Thermal Zone [THM0] (8 C)
> Real Time Clock Driver v1.12
> Linux agpgart interface v0.100 (c) Dave Jones
> serio: i8042 AUX port at 0x60,0x64 irq 12
> serio: i8042 KBD port at 0x60,0x64 irq 1
> Serial: 8250/16550 driver $Revision: 1.90 $ 68 ports, IRQ sharing enabled
> ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
> divert: not allocating divert_blk for non-ethernet device lo
> Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
> ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
> ICH5: IDE controller at PCI slot 0000:00:1f.1
> PCI: Enabling device 0000:00:1f.1 (0005 -> 0007)
> ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> ICH5: chipset revision 2
> ICH5: not 100% native mode: will probe irqs later
>     ide0: BM-DMA at 0x0500-0x0507, BIOS settings: hda:DMA, hdb:pio
>     ide1: BM-DMA at 0x0508-0x050f, BIOS settings: hdc:pio, hdd:pio
> Probing IDE interface ide0...
> hda: DV-28E-N, ATAPI CD/DVD-ROM drive
> Using cfq io scheduler
> ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
> Probing IDE interface ide1...
> Probing IDE interface ide1...
> Probing IDE interface ide2...
> Probing IDE interface ide3...
> Probing IDE interface ide4...
> Probing IDE interface ide5...
> hda: ATAPI 24X DVD-ROM drive, 256kB Cache, UDMA(33)
> Uniform CD-ROM driver Revision: 3.20
> ide-floppy driver 0.99.newide
> usbcore: registered new driver hiddev
> usbcore: registered new driver usbhid
> drivers/usb/input/hid-core.c: v2.0:USB HID core driver
> mice: PS/2 mouse device common for all mice
> input: AT Translated Set 2 keyboard on isa0060/serio0
> input: PS/2 Generic Mouse on isa0060/serio1
> md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
> NET: Registered protocol family 2
> IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
> TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
> TCP bind hash table entries: 262144 (order: 10, 4194304 bytes)
> TCP: Hash tables configured (established 262144 bind 262144)
> Initializing IPsec netlink socket
> NET: Registered protocol family 1
> NET: Registered protocol family 17
> cpufreq: CPU0 - ACPI performance management activated.
> cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> cpufreq: CPU1 - ACPI performance management activated.
> cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> cpufreq: CPU2 - ACPI performance management activated.
> cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> cpufreq: CPU3 - ACPI performance management activated.
> cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> ACPI wakeup devices:
> 
> ACPI: (supports S0 S4 S5)
> Freeing unused kernel memory: 208k freed
> SCSI subsystem initialized
> HP CISS Driver (v 2.6.14.RH2)
> cciss: Device 0x46 has been found at bus 4 dev 3 func 0
> ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
> cciss: using DAC cycles
>       blocks= 71122559 block_size= 512
>       heads= 255, sectors= 32, cylinders= 8716
> 
>       blocks= 71122559 block_size= 512
>       heads= 255, sectors= 32, cylinders= 8716
> 
>       blocks= 71122559 block_size= 512
>       heads= 255, sectors= 32, cylinders= 8716
> 
>  cciss/c0d0: p1 p2
>       blocks= 71122559 block_size= 512
>       heads= 255, sectors= 32, cylinders= 8716
> 
>  cciss/c0d1: unknown partition table
> device-mapper: 4.5.5-ioctl (2006-12-01) initialised: dm-devel@redhat.com
> hda: packet command error: status=0x51 { DriveReady SeekComplete Error }
> hda: packet command error: error=0x50
> ide: failed opcode was 100
> cdrom: open failed.
> kjournald starting.  Commit interval 5 seconds
> EXT3-fs: mounted filesystem with ordered data mode.
> security:  3 users, 4 roles, 355 types, 26 bools
> security:  55 classes, 22610 rules
> SELinux:  Completing initialization.
> SELinux:  Setting up existing superblocks.
> SELinux: initialized (dev dm-0, type ext3), uses xattr
> SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
> SELinux: initialized (dev mqueue, type mqueue), not configured for labeling
> SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses genfs_contexts
> SELinux: initialized (dev devpts, type devpts), uses transition SIDs
> SELinux: initialized (dev eventpollfs, type eventpollfs), uses genfs_contexts
> SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
> SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
> SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
> SELinux: initialized (dev proc, type proc), uses genfs_contexts
> SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
> SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
> SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
> SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
> libata version 2.00 loaded.
> Emulex LightPulse Fibre Channel SCSI driver 8.0.16.27
> Copyright(c) 2003-2006 Emulex.  All rights reserved.
> ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
> lpfc 0000:06:02.0: 0:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> scsi0 : Emulex LP9002L-F2 2Gb PCI Fibre Channel Adapter on PCI bus 06 device 10 irq 225
> ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
> lpfc 0000:07:04.0: 1:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> scsi1 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07 device 20 irq 233
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sda: drive cache: write back
> SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sda: drive cache: write back
>  sda: sda1
> Attached scsi disk sda at scsi1, channel 0, id 0, lun 0
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdb: drive cache: write back
> SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdb: drive cache: write back
>  sdb: unknown partition table
> Attached scsi disk sdb at scsi1, channel 0, id 0, lun 1
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdc: drive cache: write back
> SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdc: drive cache: write back
>  sdc: unknown partition table
> Attached scsi disk sdc at scsi1, channel 0, id 0, lun 2
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdd: drive cache: write back
> SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdd: drive cache: write back
>  sdd: unknown partition table
> Attached scsi disk sdd at scsi1, channel 0, id 0, lun 3
> ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
> Losing some ticks... checking if CPU frequency changed.
> lpfc 0000:07:05.0: 2:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> scsi2 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07 device 28 irq 50
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sde: drive cache: write back
> SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sde: drive cache: write back
>  sde: sde1
> Attached scsi disk sde at scsi2, channel 0, id 0, lun 0
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdf: drive cache: write back
> SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdf: drive cache: write back
>  sdf: unknown partition table
> Attached scsi disk sdf at scsi2, channel 0, id 0, lun 1
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdg: drive cache: write back
> SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdg: drive cache: write back
>  sdg: unknown partition table
> Attached scsi disk sdg at scsi2, channel 0, id 0, lun 2
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdh: drive cache: write back
> SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdh: drive cache: write back
>  sdh: unknown partition table
> Attached scsi disk sdh at scsi2, channel 0, id 0, lun 3
> inserting floppy driver for 2.6.9-55.ELsmp
> Floppy drive(s): fd0 is 1.44M
> FDC 0 is a National Semiconductor PC87306
> Intel(R) PRO/1000 Network Driver - version 7.2.7-k2-NAPI
> Copyright (c) 1999-2006 Intel Corporation.
> ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
> e1000: 0000:0a:01.0: e1000_probe: (PCI-X:133MHz:64-bit) 00:11:0a:64:7e:da
> divert: allocating divert_blk for eth0
> e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
> ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
> e1000: 0000:0a:01.1: e1000_probe: (PCI-X:133MHz:64-bit) 00:11:0a:64:7e:db
> divert: allocating divert_blk for eth1
> e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
> tg3.c:v3.64-rh (July 31, 2006)
> ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
> divert: allocating divert_blk for eth2
> eth2: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:14:38:bf:5a:51
> eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] Split[0] WireSpeed[1] TSOcap[0]
> eth2: dma_rwctrl[769f4000] dma_mask[64-bit]
> ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
> divert: allocating divert_blk for eth3
> eth3: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:14:38:bf:5a:50
> eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1] TSOcap[1]
> eth3: dma_rwctrl[769f4000] dma_mask[64-bit]
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> hw_random hardware driver 1.0.0 loaded
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
> ehci_hcd 0000:00:1d.7: EHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.7 to 64
> ehci_hcd 0000:00:1d.7: irq 193, pci mem ffffff0010086000
> SELinux: initialized (dev usbdevfs, type usbdevfs), uses genfs_contexts
> ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
> PCI: cache line size of 128 is not supported by device 0000:00:1d.7
> ehci_hcd 0000:00:1d.7: USB 2.0 enabled, EHCI 1.00, driver 2004-May-10
> hub 1-0:1.0: USB hub found
> hub 1-0:1.0: 8 ports detected
> USB Universal Host Controller Interface driver v2.2
> ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
> uhci_hcd 0000:00:1d.0: UHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.0 to 64
> uhci_hcd 0000:00:1d.0: irq 169, io base 0000000000002000
> uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
> hub 2-0:1.0: USB hub found
> hub 2-0:1.0: 2 ports detected
> ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
> uhci_hcd 0000:00:1d.1: UHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.1 to 64
> uhci_hcd 0000:00:1d.1: irq 177, io base 0000000000002020
> uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
> hub 3-0:1.0: USB hub found
> hub 3-0:1.0: 2 ports detected
> ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
> uhci_hcd 0000:00:1d.2: UHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.2 to 64
> uhci_hcd 0000:00:1d.2: irq 185, io base 0000000000002040
> uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
> hub 4-0:1.0: USB hub found
> hub 4-0:1.0: 2 ports detected
> ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
> uhci_hcd 0000:00:1d.3: UHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.3 to 64
> uhci_hcd 0000:00:1d.3: irq 169, io base 0000000000002060
> uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
> hub 5-0:1.0: USB hub found
> hub 5-0:1.0: 2 ports detected
> md: Autodetecting RAID arrays.
> md: autorun ...
> md: ... autorun DONE.
> ACPI: Power Button (FF) [PWRF]
> EXT3 FS on dm-0, internal journal
> device-mapper: dm-multipath version 1.0.5 loaded
> device-mapper: dm-round-robin version 1.0.0 loaded
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on cciss/c0d0p1, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev cciss/c0d0p1, type ext3), uses xattr
> SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-1, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-1, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-2, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-2, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-3, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-3, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-4, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-4, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-5, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-5, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-6, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-6, type ext3), uses xattr
> Adding 2097144k swap on /dev/vg00/swap1.  Priority:-1 extents:1
> SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
> IA-32 Microcode Update Driver: v1.14 <tigran@veritas.com>
> microcode: CPU0 already at revision 0x12 (current=0x12)
> microcode: CPU1 already at revision 0x12 (current=0x12)
> microcode: CPU2 already at revision 0x12 (current=0x12)
> microcode: CPU3 already at revision 0x12 (current=0x12)
> microcode: No new microdata for cpu 1
> microcode: No new microdata for cpu 2
> microcode: No new microdata for cpu 0
> microcode: No new microdata for cpu 3
> IA-32 Microcode Update Driver v1.14 unregistered
> ip_tables: (C) 2000-2002 Netfilter core team
> ip_conntrack version 2.1 (8192 buckets, 65536 max) - 456 bytes per conntrack
> e1000: eth1: e1000_watchdog_task: NIC Link is Up 100 Mbps Half Duplex
> i2c /dev entries driver
> NET: Registered protocol family 10
> Disabled Privacy Extensions on device ffffffff80408540(lo)
> IPv6 over IPv4 tunneling driver
> divert: not allocating divert_blk for non-ethernet device sit0
> eth1: no IPv6 routers present
> 
> 
> # cat /var/log/boot.log
> Jan 31 15:02:31 corux38 syslog: syslogd startup succeeded
> Jan 31 15:02:31 corux38 syslog: klogd startup succeeded
> Jan 31 15:02:31 corux38 irqbalance: irqbalance startup succeeded
> Jan 31 15:02:31 corux38 multipathd: multipathd startup succeeded
> Jan 31 15:02:31 corux38 portmap: portmap startup succeeded
> Jan 31 15:02:32 corux38 rc: Starting lm_sensors:  succeeded
> Jan 31 15:02:32 corux38 xinetd: xinetd startup succeeded
> Jan 31 15:02:32 corux38 ntpd: ntpd startup succeeded
> Jan 31 15:02:32 corux38 vsftpd: vsftpd vsftpd succeeded
> Jan 31 15:02:33 corux38 ssh-server-g3: Starting ssh-server-g3
> Jan 31 10:01:59 corux38 rc.sysinit: -e
> Jan 31 10:02:01 corux38 start_udev: Starting udev:  succeeded
> Jan 31 10:02:25 corux38 rc.sysinit: -e
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.ip_forward = 0
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
> Jan 31 10:02:25 corux38 sysctl: kernel.sysrq = 0
> Jan 31 10:02:25 corux38 sysctl: kernel.core_uses_pid = 1
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
> Jan 31 10:02:25 corux38 sysctl: fs.file-max = 524288
> Jan 31 10:02:25 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> Jan 31 10:02:25 corux38 rc.sysinit: Configuring kernel parameters:  succeeded
> Jan 31 15:02:26 corux38 date: Thu Jan 31 15:02:26 EST 2008
> Jan 31 15:02:26 corux38 rc.sysinit: Setting clock  (localtime): Thu Jan 31 15:02:26 EST 2008 succeeded
> Jan 31 15:02:26 corux38 rc.sysinit: Loading default keymap succeeded
> Jan 31 15:02:26 corux38 rc.sysinit: Setting hostname corux38:  succeeded
> Jan 31 15:02:26 corux38 fsck: /dev/vg00/root: clean, 4335/131072 files, 48559/262144 blocks
> Jan 31 15:02:26 corux38 rc.sysinit: Checking root filesystem succeeded
> Jan 31 15:02:26 corux38 rc.sysinit: Remounting root filesystem in read-write mode:  succeeded
> Jan 31 15:02:26 corux38 lvm.static:   8 logical volume(s) in volume group vg00 now active
> Jan 31 15:02:26 corux38 rc.sysinit: Setting up Logical Volume Management: succeeded
> Jan 31 15:02:26 corux38 fsck: /boot: clean, 38/26104 files, 17822/104388 blocks
> Jan 31 15:02:26 corux38 fsck: /dev/vg00/home: clean, 132/262144 files, 20580/524288 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files, 36957/1048576 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files, 13541/262144 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/usr: clean, 30250/524288 files, 169645/1048576 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368 files, 17525/540672 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files, 49124/2097152 blocks
> Jan 31 15:02:27 corux38 rc.sysinit: Checking filesystems succeeded
> Jan 31 15:02:27 corux38 rc.sysinit: Mounting local filesystems:  succeeded
> Jan 31 15:02:27 corux38 rc.sysinit: Enabling swap space:  succeeded
> Jan 31 15:02:28 corux38 microcode_ctl: microcode_ctl startup succeeded
> Jan 31 15:02:36 corux38 ssh-server-g3: done.
> Jan 31 15:02:28 corux38 vgchange:   8 logical volume(s) in volume group "vg00" monitored
> Jan 31 15:02:36 corux38 rc: Starting ssh-server-g3:  succeeded
> Jan 31 15:02:28 corux38 lvm2-monitor: Starting monitoring for VG vg00: succeeded
> Jan 31 15:02:36 corux38 crond: crond startup succeeded
> Jan 31 15:02:28 corux38 cpuspeed: cpuspeed startup succeeded
> Jan 31 15:02:28 corux38 iptables:  succeeded
> Jan 31 15:02:36 corux38 atd: atd startup succeeded
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.ip_forward = 0
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> Jan 31 15:02:36 corux38 messagebus: messagebus startup succeeded
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
> Jan 31 15:02:29 corux38 sysctl: kernel.sysrq = 0
> Jan 31 15:02:29 corux38 sysctl: kernel.core_uses_pid = 1
> Jan 31 15:02:36 corux38 haldaemon: haldaemon startup succeeded
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
> Jan 31 15:02:29 corux38 sysctl: fs.file-max = 524288
> Jan 31 15:02:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> Jan 31 15:02:29 corux38 network: Setting network parameters:  succeeded
> Jan 31 15:02:29 corux38 network: Bringing up loopback interface:  succeeded
> Jan 31 15:02:31 corux38 network: Bringing up interface eth1:  succeeded
> Jan 31 15:03:08 corux38 haldaemon: haldaemon -TERM succeeded
> Jan 31 15:03:08 corux38 messagebus: messagebus -TERM succeeded
> Jan 31 15:03:08 corux38 atd: atd shutdown succeeded
> Jan 31 15:03:09 corux38 vsftpd: vsftpd shutdown succeeded
> Jan 31 15:03:09 corux38 xinetd: xinetd shutdown succeeded
> Jan 31 15:03:09 corux38 crond: crond shutdown succeeded
> Jan 31 15:03:09 corux38 ntpd: ntpd shutdown succeeded
> Jan 31 15:03:09 corux38 irqbalance: irqbalance shutdown succeeded
> Jan 31 15:03:09 corux38 multipathd: multipathd shutdown succeeded
> Jan 31 15:03:09 corux38 portmap: portmap shutdown succeeded
> Jan 31 15:05:36 corux38 syslog: syslogd startup succeeded
> Jan 31 15:05:36 corux38 syslog: klogd startup succeeded
> Jan 31 15:05:37 corux38 irqbalance: irqbalance startup succeeded
> Jan 31 15:05:37 corux38 multipathd: multipathd startup succeeded
> Jan 31 15:05:37 corux38 portmap: portmap startup succeeded
> Jan 31 15:05:37 corux38 rc: Starting lm_sensors:  succeeded
> Jan 31 15:05:37 corux38 xinetd: xinetd startup succeeded
> Jan 31 15:05:37 corux38 ntpd: ntpd startup succeeded
> Jan 31 15:05:38 corux38 vsftpd: vsftpd vsftpd succeeded
> Jan 31 15:05:38 corux38 ssh-server-g3: Starting ssh-server-g3
> Jan 31 10:05:03 corux38 rc.sysinit: -e
> Jan 31 10:05:05 corux38 start_udev: Starting udev:  succeeded
> Jan 31 10:05:29 corux38 rc.sysinit: -e
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.ip_forward = 0
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
> Jan 31 10:05:29 corux38 sysctl: kernel.sysrq = 0
> Jan 31 10:05:29 corux38 sysctl: kernel.core_uses_pid = 1
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
> Jan 31 10:05:29 corux38 sysctl: fs.file-max = 524288
> Jan 31 10:05:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> Jan 31 10:05:29 corux38 rc.sysinit: Configuring kernel parameters:  succeeded
> Jan 31 15:05:30 corux38 date: Thu Jan 31 15:05:30 EST 2008
> Jan 31 15:05:30 corux38 rc.sysinit: Setting clock  (localtime): Thu Jan 31 15:05:30 EST 2008 succeeded
> Jan 31 15:05:30 corux38 rc.sysinit: Loading default keymap succeeded
> Jan 31 15:05:30 corux38 rc.sysinit: Setting hostname corux38:  succeeded
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/root: clean, 4335/131072 files, 48559/262144 blocks
> Jan 31 15:05:30 corux38 rc.sysinit: Checking root filesystem succeeded
> Jan 31 15:05:30 corux38 rc.sysinit: Remounting root filesystem in read-write mode:  succeeded
> Jan 31 15:05:30 corux38 lvm.static:   8 logical volume(s) in volume group vg00 now active
> Jan 31 15:05:30 corux38 rc.sysinit: Setting up Logical Volume Management: succeeded
> Jan 31 15:05:30 corux38 fsck: /boot: clean, 38/26104 files, 17822/104388 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/home: clean, 132/262144 files, 20580/524288 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files, 36957/1048576 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files, 13541/262144 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/usr: clean, 30250/524288 files, 169645/1048576 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368 files, 17525/540672 blocks
> Jan 31 15:05:31 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files, 49141/2097152 blocks
> Jan 31 15:05:31 corux38 rc.sysinit: Checking filesystems succeeded
> Jan 31 15:05:31 corux38 rc.sysinit: Mounting local filesystems:  succeeded
> Jan 31 15:05:31 corux38 rc.sysinit: Enabling swap space:  succeeded
> Jan 31 15:05:32 corux38 microcode_ctl: microcode_ctl startup succeeded
> Jan 31 15:05:32 corux38 vgchange:   8 logical volume(s) in volume group "vg00" monitored
> Jan 31 15:05:32 corux38 lvm2-monitor: Starting monitoring for VG vg00: succeeded
> Jan 31 15:05:41 corux38 ssh-server-g3: done.
> Jan 31 15:05:32 corux38 cpuspeed: cpuspeed startup succeeded
> Jan 31 15:05:41 corux38 rc: Starting ssh-server-g3:  succeeded
> Jan 31 15:05:32 corux38 iptables:  succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.ip_forward = 0
> Jan 31 15:05:41 corux38 crond: crond startup succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> Jan 31 15:05:41 corux38 atd: atd startup succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_source_route = 0
> Jan 31 15:05:32 corux38 sysctl: kernel.sysrq = 0
> Jan 31 15:05:32 corux38 sysctl: kernel.core_uses_pid = 1
> Jan 31 15:05:42 corux38 messagebus: messagebus startup succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_source_route = 0
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> Jan 31 15:05:42 corux38 haldaemon: haldaemon startup succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_redirects = 0
> Jan 31 15:05:32 corux38 sysctl: fs.file-max = 524288
> Jan 31 15:05:32 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> Jan 31 15:05:32 corux38 network: Setting network parameters:  succeeded
> Jan 31 15:05:32 corux38 network: Bringing up loopback interface:  succeeded
> Jan 31 15:05:36 corux38 network: Bringing up interface eth1:  succeeded
> 
> 
> # multipath -ll
> mpath1 (00040026_05:84)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [enabled]
>  \_ 2:0:0:1 sdf 8:80  [active][ready]
>  \_ 1:0:0:1 sdb 8:16  [active][ready]
> 
> mpath0 (00040026_05:83)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [enabled]
>  \_ 2:0:0:0 sde 8:64  [active][ready]
>  \_ 1:0:0:0 sda 8:0   [active][ready]
Content-Description: manual_run.txt

> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

RE: Multipath not rebuilding correctly on reboot

[Greene, Rick]

[-- Attachment #1: Type: text/plain, Size: 53631 bytes --]

I tried Benjamin's suggestions, and with a little poking around I
basically got nowhere.

I did have to make one other adjustment to the system, I modified
/etc/lvm/lvm.conf to only try activating the vg00 volume group (local
disk) and not the vgftp volume group (built on the disk running through
multipath).

I'm still left with the same state, it takes that extra "multipath -v 2"
to get everything fully activated.  I do have that in rc.local at the
moment, but I'm hoping someone can figure out what is going on so I
don't have to have that extra step.

Attached is the log file generated during the boot process, including
the results of the extra step.  If you look for lines starting with %%,
you'll see comments showing what has generated each section of the long.

Any further advice greatly appreciated,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of Benjamin Marzinski
Sent: Tuesday, February 12, 2008 5:22 PM
To: device-mapper development
Subject: Re: [dm-devel] Multipath not rebuilding correctly on reboot

On Thu, Jan 31, 2008 at 03:20:04PM -0500, Greene, Rick wrote:
> Now that I seem to have multipath and my XP 1024 working together,
I've
> found a new issue.  Someone recently had a similar thread going, but I
> saw no ultimate resolution.
> 
> My problem is that when I reboot my server, the multipath
configuration
> is not coming back the way it was before.  I moved the two external
> tools I use to find the UID into /etc (they had bin in /usr/bin and
> /sbin), updated the multipath.conf file (and one of the scripts) to
> reflect this, but odd things are still happening.
> 
> Attached is initial_view.txt, which shows what multipath is coming up
> with when I do the commands shown (the bulk of the file is multipath
-v3
> output, but at the bottom of the file is a multipath -ll output as
> well).  It (seems to) correctly shows that I have 4 disks, each
visible
> via two separate paths.
> 
> After I reboot, however, I get different results.  Once it showed 4
> paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
> correctly showed mpath0, mpath1, and mpath3, but didn't show mpath2 at
> all.  On the next attempt I got everything correct, and the very next
> one only showed mpath0 and mpath1.
> 
> The post_reboot.txt file shows the contents of the /var/log/boot.log
> file and the output of the dmesg command, along with the "multipath
-ll"
> view from the most recent reboot.
> 
> I then manually did a "multipath -v2" and the missing two paths then
> came back.  The file manual_run.txt shows those results plus the
updated
> "multipath -ll".
> 
> Do I need to just make my own /etc/init.d script to do a "multipath
-v2"
> at the end of booting to make sure it all gets covered, along with the
> requisite LVM & mount commands to get the VG that is on these disks
> working right?

Hopefully, you can just add the line

multipath -v 0 

to /etc/rc.local and fix this.  However, if you want to dig into
what's going wrong:

There are two places were multipath gets called to create devices during
bootup.  One is in /etc/rc.sysinit and one in
/etc/dev.d/block/multipath.dev.  /etc/rc.sysinit will always be run as
one of the first things during the boot process, and it just calls
multipath.static -v 0, which should correctly set up multipath devices
on all of the available paths.  /etc/dev.d/block/multipath.dev gets
called by udev, and is a lot more suspect.

If you feel confortable editting boot scripts, you can do some debugging
to figure out what's going on.

in /etc/rc.sysinit (assuming you aren't using md or raid), you can
change
the first line with:
/sbin/multipath.static -v 0
to:
/sbin/multipath.static -v 3 >> /tmp/multipath_boot_log 2>&1

the other lines that call multipath.static are only run if you have
the files /etc/raidtab or /etc/mdadm.conf, which you probably don't.

in /etc/dev.d/block/multipath.dev just add the following line right
after the #!/bin/sh line:

echo "${ACTION} ${DEVPATH}" >> /tmp/multipath_boot_log

Then reboot and look at /tmp/multipath_boot_log

You should see something that looks like the output of running
# multipath -v 3
along with a bunch of lines like:

add /block/md0
add /block/loop1
add /block/loop0
add /block/dm-7

The multipath run is from rc.sysinit, and the "add" lines are devices
that udev is trying to create a multipath device on.  On systems where
everthing comes up fine during boot up, all of the devices that aren't
dealt with by the multipath call in rc.sysinit should be added by udev.

I'm assuming that this won't be the case on your box. If udev isn't
running /etc/dev.d/block/multipath.dev, there's not much you can do
to fix it, besides filing a bug against udev.  However you may be able
to
make it more likely that your scsi devices will all be up by the time
rc.sysinit is run.  If your device drivers aren't getting loaded by the
initrd, you can add them to /etc/modprobe.conf, run mkinitrd.  If you do
this, it's always wise to back up your existing initrd, and make sure
that grub can boot with it.

Otherwise, just try adding the line to rc.local

Hope this helps

-Ben
 
> Thanks in advance,
> Rick
> 
> 
> 

Content-Description: initial_view.txt
> # service multipathd stop
> # multipath -F
> # service multipathd start
> # multipath -v3
> load path identifiers cache
> #
> # all paths in cache :
> #
> 00040026_05:83  1:0:0:0 sda 8:0   HP      /OPEN-E          /2114
> 00040026_05:84  1:0:0:1 sdb 8:16   HP      /OPEN-E          /2114
> 00040026_05:85  1:0:0:2 sdc 8:32   HP      /OPEN-E          /2114
> 00040026_05:86  1:0:0:3 sdd 8:48   HP      /OPEN-E          /2114
> 00040026_05:83  2:0:0:0 sde 8:64   HP      /OPEN-E          /2114
> 00040026_05:84  2:0:0:1 sdf 8:80   HP      /OPEN-E          /2114
> 00040026_05:85  2:0:0:2 sdg 8:96   HP      /OPEN-E          /2114
> 00040026_05:86  2:0:0:3 sdh 8:112   HP      /OPEN-E          /2114
> cciss!c0d0 blacklisted
> cciss!c0d1 blacklisted
> dm-0 blacklisted
> dm-1 blacklisted
> dm-2 blacklisted
> dm-3 blacklisted
> dm-4 blacklisted
> dm-5 blacklisted
> dm-6 blacklisted
> dm-7 blacklisted
> fd0 blacklisted
> hda blacklisted
> md0 blacklisted
> ram0 blacklisted
> ram10 blacklisted
> ram11 blacklisted
> ram12 blacklisted
> ram13 blacklisted
> ram14 blacklisted
> ram15 blacklisted
> ram1 blacklisted
> ram2 blacklisted
> ram3 blacklisted
> ram4 blacklisted
> ram5 blacklisted
> ram6 blacklisted
> ram7 blacklisted
> ram8 blacklisted
> ram9 blacklisted
> ===== path info sda (mask 0x1f) =====
> bus = 1
> dev_t = 8:0
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 1:0:0:0
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:83 (cache)
> ===== path info sdb (mask 0x1f) =====
> bus = 1
> dev_t = 8:16
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 1:0:0:1
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:84 (cache)
> ===== path info sdc (mask 0x1f) =====
> bus = 1
> dev_t = 8:32
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 1:0:0:2
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:85 (cache)
> ===== path info sdd (mask 0x1f) =====
> bus = 1
> dev_t = 8:48
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 1:0:0:3
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:86 (cache)
> ===== path info sde (mask 0x1f) =====
> bus = 1
> dev_t = 8:64
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 2:0:0:0
> tgt_node_name = 0x50060e80039c5a14
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:83 (cache)
> ===== path info sdf (mask 0x1f) =====
> bus = 1
> dev_t = 8:80
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 2:0:0:1
> tgt_node_name = 0x50060e80039c5a14
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:84 (cache)
> ===== path info sdg (mask 0x1f) =====
> bus = 1
> dev_t = 8:96
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 2:0:0:2
> tgt_node_name = 0x50060e80039c5a14
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:85 (cache)
> ===== path info sdh (mask 0x1f) =====
> bus = 1
> dev_t = 8:112
> size = 28452960
> vendor = HP
> product = OPEN-E
> rev = 2114
> h:b:t:l = 2:0:0:3
> tgt_node_name = 0x50060e80039c5a14
> serial = 40026
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> uid = 00040026_05:86 (cache)
> #
> # all paths :
> #
> 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E
/2114
> 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E
/2114
> 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E
/2114
> 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E
/2114
> 00040026_05:83  2:0:0:0 sde 8:64  [ready] HP      /OPEN-E
/2114
> 00040026_05:84  2:0:0:1 sdf 8:80  [ready] HP      /OPEN-E
/2114
> 00040026_05:85  2:0:0:2 sdg 8:96  [ready] HP      /OPEN-E
/2114
> 00040026_05:86  2:0:0:3 sdh 8:112  [ready] HP      /OPEN-E
/2114
> Initialized new bindings file [/var/lib/multipath/bindings]
> No matching wwid [00040026_05:83] in bindings file.
> Created new binding [mpath0] for WWID [00040026_05:83]
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:0 100 8:64 100
> set ACT_CREATE: map does not exists
> message mpath0 0 switch_group 1
> 
> create: mpath0 (00040026_05:83)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:0 sda 8:0   [ready]
>  \_ 2:0:0:0 sde 8:64  [ready]
> 
> reloading features
> No matching wwid [00040026_05:84] in bindings file.
> Created new binding [mpath1] for WWID [00040026_05:84]
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:16 100 8:80 100
> set ACT_CREATE: map does not exists
> message mpath1 0 switch_group 1
> 
> create: mpath1 (00040026_05:84)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:1 sdb 8:16  [ready]
>  \_ 2:0:0:1 sdf 8:80  [ready]
> 
> reloading features
> No matching wwid [00040026_05:85] in bindings file.
> Created new binding [mpath2] for WWID [00040026_05:85]
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:32 100 8:96 100
> set ACT_CREATE: map does not exists
> message mpath2 0 switch_group 1
> 
> create: mpath2 (00040026_05:85)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:2 sdc 8:32  [ready]
>  \_ 2:0:0:2 sdg 8:96  [ready]
> 
> reloading features
> No matching wwid [00040026_05:86] in bindings file.
> Created new binding [mpath3] for WWID [00040026_05:86]
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:48 100 8:112 100
> set ACT_CREATE: map does not exists
> message mpath3 0 switch_group 1
> 
> create: mpath3 (00040026_05:86)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0
>  \_ 1:0:0:3 sdd 8:48  [ready]
>  \_ 2:0:0:3 sdh 8:112 [ready]
> 
> reloading features
> 
> # multipath -ll
> mpath2 (00040026_05:85)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [active]
>  \_ 1:0:0:2 sdc 8:32  [active][ready]
>  \_ 2:0:0:2 sdg 8:96  [active][ready]
> 
> mpath1 (00040026_05:84)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [active]
>  \_ 1:0:0:1 sdb 8:16  [active][ready]
>  \_ 2:0:0:1 sdf 8:80  [active][ready]
> 
> mpath0 (00040026_05:83)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [active]
>  \_ 1:0:0:0 sda 8:0   [active][ready]
>  \_ 2:0:0:0 sde 8:64  [active][ready]
> 
> mpath3 (00040026_05:86)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [active]
>  \_ 1:0:0:3 sdd 8:48  [active][ready]
>  \_ 2:0:0:3 sdh 8:112 [active][ready]

Content-Description: post_reboot.txt
> # dmesg
> Bootdata ok (command line is ro root=/dev/vg00/root rhgb quiet)
> Linux version 2.6.9-55.ELsmp (brewbuilder@hs20-bc2-4.build.redhat.com)
(gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Fri Apr 20
16:36:54 EDT 2007
> BIOS-provided physical RAM map:
>  BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
>  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
>  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
>  BIOS-e820: 0000000000100000 - 00000000bfff3000 (usable)
>  BIOS-e820: 00000000bfff3000 - 00000000bfffb000 (ACPI data)
>  BIOS-e820: 00000000bfffb000 - 00000000c0000000 (reserved)
>  BIOS-e820: 00000000fec00000 - 00000000fed00000 (reserved)
>  BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
>  BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
> ACPI: RSDP (v002 HP                                    ) @
0x00000000000f4f00
> ACPI: XSDT (v001 HP     P51      0x00000002 ? 0x0000162e) @
0x00000000bfff3300
> ACPI: FADT (v003 HP     P51      0x00000002 ? 0x0000162e) @
0x00000000bfff3380
> ACPI: SPCR (v001 HP     SPCRRBSU 0x00000001 ? 0x0000162e) @
0x00000000bfff3140
> ACPI: MCFG (v001 HP     ProLiant 0x00000001  0x00000000) @
0x00000000bfff31c0
> ACPI: MADT (v001 HP     00000083 0x00000002  0x00000000) @
0x00000000bfff3200
> ACPI: SSDT (v001 HP        SSDTP 0x00000001 INTL 0x20030228) @
0x00000000bfff8000
> ACPI: DSDT (v001 HP         DSDT 0x00000001 INTL 0x20030228) @
0x0000000000000000
> No NUMA configuration found
> Faking a node at 0000000000000000-00000000bfff3000
> Bootmem setup node 0 0000000000000000-00000000bfff3000
> On node 0 totalpages: 786419
>   DMA zone: 4096 pages, LIFO batch:1
>   Normal zone: 782323 pages, LIFO batch:16
>   HighMem zone: 0 pages, LIFO batch:1
> DMI 2.3 present.
> ACPI: PM-Timer IO Port: 0x908
> ACPI: Local APIC address 0xfee00000
> ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> Processor #0 15:4 APIC version 16
> ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
> ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
> ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
> Processor #6 15:4 APIC version 16
> ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> Processor #1 15:4 APIC version 16
> ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
> ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
> ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
> Processor #7 15:4 APIC version 16
> ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
> Setting APIC routing to flat
> ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
> IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
> ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
> IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
> ACPI: IOAPIC (id[0x0a] address[0xfec80400] gsi_base[48])
> IOAPIC[2]: apic_id 10, version 32, address 0xfec80400, GSI 48-71
> ACPI: IOAPIC (id[0x0b] address[0xfec84000] gsi_base[72])
> IOAPIC[3]: apic_id 11, version 32, address 0xfec84000, GSI 72-95
> ACPI: IOAPIC (id[0x0c] address[0xfec84400] gsi_base[96])
> IOAPIC[4]: apic_id 12, version 32, address 0xfec84400, GSI 96-119
> ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> ACPI: IRQ0 used by override.
> ACPI: IRQ2 used by override.
> ACPI: IRQ9 used by override.
> Using ACPI (MADT) for SMP configuration information
> Allocating PCI resources starting at c4000000 (gap: c0000000:3ec00000)
> Checking aperture...
> Built 1 zonelists
> Kernel command line: ro root=/dev/vg00/root rhgb quiet console=tty0
> Initializing CPU#0
> PID hash table entries: 4096 (order: 12, 131072 bytes)
> time.c: Using 3.579545 MHz PM timer.
> time.c: Detected 3400.312 MHz processor.
> Console: colour VGA+ 80x25
> Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> Memory: 3089236k/3145676k available (2112k kernel code, 0k reserved,
1305k data, 208k init)
> Calibrating delay using timer specific routine.. 6807.48 BogoMIPS
(lpj=3403744)
> Security Scaffold v1.0.0 initialized
> SELinux:  Initializing.
> SELinux:  Starting in permissive mode
> There is already a security framework initialized, register_security
failed.
> selinux_register_security:  Registering secondary module capability
> Capability LSM initialized as secondary
> Mount-cache hash table entries: 256 (order: 0, 4096 bytes)
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> using mwait in idle threads.
> CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> Using IO APIC NMI watchdog
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> CPU0:                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> per-CPU timeslice cutoff: 1023.90 usecs.
> task migration cache decay timeout: 1 msecs.
> Booting processor 1/6 rip 6000 rsp 10037e05f58
> Initializing CPU#1
> Calibrating delay using timer specific routine.. 6799.32 BogoMIPS
(lpj=3399660)
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU1: Initial APIC ID: 6, Physical Processor ID: 3
>                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> Booting processor 2/1 rip 6000 rsp 10037e3df58
> Initializing CPU#2
> Calibrating delay using timer specific routine.. 6799.31 BogoMIPS
(lpj=3399655)
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU2: Initial APIC ID: 1, Physical Processor ID: 0
>                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> Booting processor 3/7 rip 6000 rsp 100016f3f58
> Initializing CPU#3
> Calibrating delay using timer specific routine.. 6799.18 BogoMIPS
(lpj=3399591)
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU3: Initial APIC ID: 7, Physical Processor ID: 3
>                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> Total of 4 processors activated (27205.30 BogoMIPS).
> activating NMI Watchdog ... done.
> testing NMI watchdog ... OK.
> Using local APIC timer interrupts.
> Detected 12.501 MHz APIC timer.
> checking TSC synchronization across 4 CPUs: passed.
> Brought up 4 CPUs
> time.c: Using PIT/TSC based timekeeping.
> checking if image is initramfs... it is
> NET: Registered protocol family 16
> PCI: Using configuration type 1
> PCI: Using MMCONFIG at e0000000
> mtrr: v2.0 (20020519)
> mtrr: your CPUs had inconsistent fixed MTRR settings
> mtrr: probably your BIOS does not setup all CPUs.
> mtrr: corrected configuration.
> ACPI: Subsystem revision 20040816
> ACPI: Interpreter enabled
> ACPI: Using IOAPIC for interrupt routing
> ACPI: PCI Root Bridge [PCI0] (00:00)
> PCI: Probing PCI hardware (bus 00)
> PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
> PCI: PXH quirk detected, disabling MSI for SHPC device
> PCI: PXH quirk detected, disabling MSI for SHPC device
> PCI: PXH quirk detected, disabling MSI for SHPC device
> PCI: PXH quirk detected, disabling MSI for SHPC device
> PCI: Transparent bridge - 0000:00:1e.0
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.IP2P._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXA._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXB._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXC._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXD._PRT]
> ACPI: PCI Interrupt Link [LNKA] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKB] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKC] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKD] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKE] (IRQs 5 7 10 11) *0, disabled.
> ACPI: PCI Interrupt Link [LNKF] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKG] (IRQs *5 7 10 11)
> ACPI: PCI Interrupt Link [LNKH] (IRQs *5 7 10 11)
> usbcore: registered new driver usbfs
> usbcore: registered new driver hub
> PCI: Using ACPI for IRQ routing
> GSI 16 sharing vector 0xA9 and IRQ 16
> ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 169
> ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 169
> ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
> GSI 17 sharing vector 0xB1 and IRQ 17
> ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
> GSI 18 sharing vector 0xB9 and IRQ 18
> ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
> ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
> GSI 19 sharing vector 0xC1 and IRQ 19
> ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
> ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> GSI 20 sharing vector 0xC9 and IRQ 20
> ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
> GSI 21 sharing vector 0xD1 and IRQ 21
> ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
> GSI 22 sharing vector 0xD9 and IRQ 22
> ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
> GSI 23 sharing vector 0xE1 and IRQ 23
> ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
> GSI 24 sharing vector 0xE9 and IRQ 24
> ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
> GSI 25 sharing vector 0x32 and IRQ 25
> ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
> GSI 26 sharing vector 0x3A and IRQ 26
> ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
> GSI 27 sharing vector 0x42 and IRQ 27
> ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
> GSI 28 sharing vector 0x4A and IRQ 28
> ACPI: PCI Interrupt 0000:01:04.0[A] -> GSI 21 (level, low) -> IRQ 74
> GSI 29 sharing vector 0x52 and IRQ 29
> ACPI: PCI Interrupt 0000:01:04.2[B] -> GSI 22 (level, low) -> IRQ 82
> PCI-DMA: Disabling IOMMU.
> IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
> audit: initializing netlink socket (disabled)
> audit(1201791896.599:1): initialized
> Total HugeTLB memory allocated, 0
> VFS: Disk quotas dquot_6.5.1
> Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
> SELinux:  Registering netfilter hooks
> Initializing Cryptographic API
> ksign: Installing public key data
> Loading keyring
> - Added public key B7CA3C9BE2FAFC39
> - User ID: Red Hat, Inc. (Kernel Module GPG key)
> pci_hotplug: PCI Hot Plug PCI Core version: 0.5
> ACPI: Processor [CPU0] (supports C1)
> ACPI: Processor [CPU1] (supports C1)
> ACPI: Processor [CPU2] (supports C1)
> ACPI: Processor [CPU3] (supports C1)
> ACPI: Thermal Zone [THM0] (8 C)
> Real Time Clock Driver v1.12
> Linux agpgart interface v0.100 (c) Dave Jones
> serio: i8042 AUX port at 0x60,0x64 irq 12
> serio: i8042 KBD port at 0x60,0x64 irq 1
> Serial: 8250/16550 driver $Revision: 1.90 $ 68 ports, IRQ sharing
enabled
> ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
> divert: not allocating divert_blk for non-ethernet device lo
> Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
> ide: Assuming 33MHz system bus speed for PIO modes; override with
idebus=xx
> ICH5: IDE controller at PCI slot 0000:00:1f.1
> PCI: Enabling device 0000:00:1f.1 (0005 -> 0007)
> ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> ICH5: chipset revision 2
> ICH5: not 100% native mode: will probe irqs later
>     ide0: BM-DMA at 0x0500-0x0507, BIOS settings: hda:DMA, hdb:pio
>     ide1: BM-DMA at 0x0508-0x050f, BIOS settings: hdc:pio, hdd:pio
> Probing IDE interface ide0...
> hda: DV-28E-N, ATAPI CD/DVD-ROM drive
> Using cfq io scheduler
> ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
> Probing IDE interface ide1...
> Probing IDE interface ide1...
> Probing IDE interface ide2...
> Probing IDE interface ide3...
> Probing IDE interface ide4...
> Probing IDE interface ide5...
> hda: ATAPI 24X DVD-ROM drive, 256kB Cache, UDMA(33)
> Uniform CD-ROM driver Revision: 3.20
> ide-floppy driver 0.99.newide
> usbcore: registered new driver hiddev
> usbcore: registered new driver usbhid
> drivers/usb/input/hid-core.c: v2.0:USB HID core driver
> mice: PS/2 mouse device common for all mice
> input: AT Translated Set 2 keyboard on isa0060/serio0
> input: PS/2 Generic Mouse on isa0060/serio1
> md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
> NET: Registered protocol family 2
> IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
> TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
> TCP bind hash table entries: 262144 (order: 10, 4194304 bytes)
> TCP: Hash tables configured (established 262144 bind 262144)
> Initializing IPsec netlink socket
> NET: Registered protocol family 1
> NET: Registered protocol family 17
> cpufreq: CPU0 - ACPI performance management activated.
> cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> cpufreq: CPU1 - ACPI performance management activated.
> cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> cpufreq: CPU2 - ACPI performance management activated.
> cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> cpufreq: CPU3 - ACPI performance management activated.
> cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> ACPI wakeup devices:
> 
> ACPI: (supports S0 S4 S5)
> Freeing unused kernel memory: 208k freed
> SCSI subsystem initialized
> HP CISS Driver (v 2.6.14.RH2)
> cciss: Device 0x46 has been found at bus 4 dev 3 func 0
> ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
> cciss: using DAC cycles
>       blocks= 71122559 block_size= 512
>       heads= 255, sectors= 32, cylinders= 8716
> 
>       blocks= 71122559 block_size= 512
>       heads= 255, sectors= 32, cylinders= 8716
> 
>       blocks= 71122559 block_size= 512
>       heads= 255, sectors= 32, cylinders= 8716
> 
>  cciss/c0d0: p1 p2
>       blocks= 71122559 block_size= 512
>       heads= 255, sectors= 32, cylinders= 8716
> 
>  cciss/c0d1: unknown partition table
> device-mapper: 4.5.5-ioctl (2006-12-01) initialised:
dm-devel@redhat.com
> hda: packet command error: status=0x51 { DriveReady SeekComplete Error
}
> hda: packet command error: error=0x50
> ide: failed opcode was 100
> cdrom: open failed.
> kjournald starting.  Commit interval 5 seconds
> EXT3-fs: mounted filesystem with ordered data mode.
> security:  3 users, 4 roles, 355 types, 26 bools
> security:  55 classes, 22610 rules
> SELinux:  Completing initialization.
> SELinux:  Setting up existing superblocks.
> SELinux: initialized (dev dm-0, type ext3), uses xattr
> SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> SELinux: initialized (dev selinuxfs, type selinuxfs), uses
genfs_contexts
> SELinux: initialized (dev mqueue, type mqueue), not configured for
labeling
> SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses
genfs_contexts
> SELinux: initialized (dev devpts, type devpts), uses transition SIDs
> SELinux: initialized (dev eventpollfs, type eventpollfs), uses
genfs_contexts
> SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
> SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
> SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
> SELinux: initialized (dev proc, type proc), uses genfs_contexts
> SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
> SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
> SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
> SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
> libata version 2.00 loaded.
> Emulex LightPulse Fibre Channel SCSI driver 8.0.16.27
> Copyright(c) 2003-2006 Emulex.  All rights reserved.
> ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
> lpfc 0000:06:02.0: 0:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> scsi0 : Emulex LP9002L-F2 2Gb PCI Fibre Channel Adapter on PCI bus 06
device 10 irq 225
> ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
> lpfc 0000:07:04.0: 1:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> scsi1 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07
device 20 irq 233
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sda: drive cache: write back
> SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sda: drive cache: write back
>  sda: sda1
> Attached scsi disk sda at scsi1, channel 0, id 0, lun 0
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdb: drive cache: write back
> SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdb: drive cache: write back
>  sdb: unknown partition table
> Attached scsi disk sdb at scsi1, channel 0, id 0, lun 1
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdc: drive cache: write back
> SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdc: drive cache: write back
>  sdc: unknown partition table
> Attached scsi disk sdc at scsi1, channel 0, id 0, lun 2
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdd: drive cache: write back
> SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdd: drive cache: write back
>  sdd: unknown partition table
> Attached scsi disk sdd at scsi1, channel 0, id 0, lun 3
> ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
> Losing some ticks... checking if CPU frequency changed.
> lpfc 0000:07:05.0: 2:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> scsi2 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07
device 28 irq 50
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sde: drive cache: write back
> SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sde: drive cache: write back
>  sde: sde1
> Attached scsi disk sde at scsi2, channel 0, id 0, lun 0
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdf: drive cache: write back
> SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdf: drive cache: write back
>  sdf: unknown partition table
> Attached scsi disk sdf at scsi2, channel 0, id 0, lun 1
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdg: drive cache: write back
> SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdg: drive cache: write back
>  sdg: unknown partition table
> Attached scsi disk sdg at scsi2, channel 0, id 0, lun 2
>   Vendor: HP        Model: OPEN-E            Rev: 2114
>   Type:   Direct-Access                      ANSI SCSI revision: 02
> SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdh: drive cache: write back
> SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> SCSI device sdh: drive cache: write back
>  sdh: unknown partition table
> Attached scsi disk sdh at scsi2, channel 0, id 0, lun 3
> inserting floppy driver for 2.6.9-55.ELsmp
> Floppy drive(s): fd0 is 1.44M
> FDC 0 is a National Semiconductor PC87306
> Intel(R) PRO/1000 Network Driver - version 7.2.7-k2-NAPI
> Copyright (c) 1999-2006 Intel Corporation.
> ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
> e1000: 0000:0a:01.0: e1000_probe: (PCI-X:133MHz:64-bit)
00:11:0a:64:7e:da
> divert: allocating divert_blk for eth0
> e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
> ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
> e1000: 0000:0a:01.1: e1000_probe: (PCI-X:133MHz:64-bit)
00:11:0a:64:7e:db
> divert: allocating divert_blk for eth1
> e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
> tg3.c:v3.64-rh (July 31, 2006)
> ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
> divert: allocating divert_blk for eth2
> eth2: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit)
10/100/1000BaseT Ethernet 00:14:38:bf:5a:51
> eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] Split[0] WireSpeed[1]
TSOcap[0]
> eth2: dma_rwctrl[769f4000] dma_mask[64-bit]
> ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
> divert: allocating divert_blk for eth3
> eth3: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit)
10/100/1000BaseT Ethernet 00:14:38:bf:5a:50
> eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1]
TSOcap[1]
> eth3: dma_rwctrl[769f4000] dma_mask[64-bit]
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> hw_random hardware driver 1.0.0 loaded
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
> ehci_hcd 0000:00:1d.7: EHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.7 to 64
> ehci_hcd 0000:00:1d.7: irq 193, pci mem ffffff0010086000
> SELinux: initialized (dev usbdevfs, type usbdevfs), uses
genfs_contexts
> ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
> PCI: cache line size of 128 is not supported by device 0000:00:1d.7
> ehci_hcd 0000:00:1d.7: USB 2.0 enabled, EHCI 1.00, driver 2004-May-10
> hub 1-0:1.0: USB hub found
> hub 1-0:1.0: 8 ports detected
> USB Universal Host Controller Interface driver v2.2
> ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
> uhci_hcd 0000:00:1d.0: UHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.0 to 64
> uhci_hcd 0000:00:1d.0: irq 169, io base 0000000000002000
> uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
> hub 2-0:1.0: USB hub found
> hub 2-0:1.0: 2 ports detected
> ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
> uhci_hcd 0000:00:1d.1: UHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.1 to 64
> uhci_hcd 0000:00:1d.1: irq 177, io base 0000000000002020
> uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
> hub 3-0:1.0: USB hub found
> hub 3-0:1.0: 2 ports detected
> ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
> uhci_hcd 0000:00:1d.2: UHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.2 to 64
> uhci_hcd 0000:00:1d.2: irq 185, io base 0000000000002040
> uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
> hub 4-0:1.0: USB hub found
> hub 4-0:1.0: 2 ports detected
> ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
> uhci_hcd 0000:00:1d.3: UHCI Host Controller
> PCI: Setting latency timer of device 0000:00:1d.3 to 64
> uhci_hcd 0000:00:1d.3: irq 169, io base 0000000000002060
> uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
> hub 5-0:1.0: USB hub found
> hub 5-0:1.0: 2 ports detected
> md: Autodetecting RAID arrays.
> md: autorun ...
> md: ... autorun DONE.
> ACPI: Power Button (FF) [PWRF]
> EXT3 FS on dm-0, internal journal
> device-mapper: dm-multipath version 1.0.5 loaded
> device-mapper: dm-round-robin version 1.0.0 loaded
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on cciss/c0d0p1, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev cciss/c0d0p1, type ext3), uses xattr
> SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-1, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-1, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-2, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-2, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-3, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-3, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-4, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-4, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-5, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-5, type ext3), uses xattr
> kjournald starting.  Commit interval 5 seconds
> EXT3 FS on dm-6, internal journal
> EXT3-fs: mounted filesystem with ordered data mode.
> SELinux: initialized (dev dm-6, type ext3), uses xattr
> Adding 2097144k swap on /dev/vg00/swap1.  Priority:-1 extents:1
> SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses
genfs_contexts
> IA-32 Microcode Update Driver: v1.14 <tigran@veritas.com>
> microcode: CPU0 already at revision 0x12 (current=0x12)
> microcode: CPU1 already at revision 0x12 (current=0x12)
> microcode: CPU2 already at revision 0x12 (current=0x12)
> microcode: CPU3 already at revision 0x12 (current=0x12)
> microcode: No new microdata for cpu 1
> microcode: No new microdata for cpu 2
> microcode: No new microdata for cpu 0
> microcode: No new microdata for cpu 3
> IA-32 Microcode Update Driver v1.14 unregistered
> ip_tables: (C) 2000-2002 Netfilter core team
> ip_conntrack version 2.1 (8192 buckets, 65536 max) - 456 bytes per
conntrack
> e1000: eth1: e1000_watchdog_task: NIC Link is Up 100 Mbps Half Duplex
> i2c /dev entries driver
> NET: Registered protocol family 10
> Disabled Privacy Extensions on device ffffffff80408540(lo)
> IPv6 over IPv4 tunneling driver
> divert: not allocating divert_blk for non-ethernet device sit0
> eth1: no IPv6 routers present
> 
> 
> # cat /var/log/boot.log
> Jan 31 15:02:31 corux38 syslog: syslogd startup succeeded
> Jan 31 15:02:31 corux38 syslog: klogd startup succeeded
> Jan 31 15:02:31 corux38 irqbalance: irqbalance startup succeeded
> Jan 31 15:02:31 corux38 multipathd: multipathd startup succeeded
> Jan 31 15:02:31 corux38 portmap: portmap startup succeeded
> Jan 31 15:02:32 corux38 rc: Starting lm_sensors:  succeeded
> Jan 31 15:02:32 corux38 xinetd: xinetd startup succeeded
> Jan 31 15:02:32 corux38 ntpd: ntpd startup succeeded
> Jan 31 15:02:32 corux38 vsftpd: vsftpd vsftpd succeeded
> Jan 31 15:02:33 corux38 ssh-server-g3: Starting ssh-server-g3
> Jan 31 10:01:59 corux38 rc.sysinit: -e
> Jan 31 10:02:01 corux38 start_udev: Starting udev:  succeeded
> Jan 31 10:02:25 corux38 rc.sysinit: -e
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.ip_forward = 0
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> Jan 31 10:02:25 corux38 sysctl:
net.ipv4.conf.default.accept_source_route = 0
> Jan 31 10:02:25 corux38 sysctl: kernel.sysrq = 0
> Jan 31 10:02:25 corux38 sysctl: kernel.core_uses_pid = 1
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_source_route
= 0
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_redirects
= 0
> Jan 31 10:02:25 corux38 sysctl: fs.file-max = 524288
> Jan 31 10:02:25 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> Jan 31 10:02:25 corux38 rc.sysinit: Configuring kernel parameters:
succeeded
> Jan 31 15:02:26 corux38 date: Thu Jan 31 15:02:26 EST 2008
> Jan 31 15:02:26 corux38 rc.sysinit: Setting clock  (localtime): Thu
Jan 31 15:02:26 EST 2008 succeeded
> Jan 31 15:02:26 corux38 rc.sysinit: Loading default keymap succeeded
> Jan 31 15:02:26 corux38 rc.sysinit: Setting hostname corux38:
succeeded
> Jan 31 15:02:26 corux38 fsck: /dev/vg00/root: clean, 4335/131072
files, 48559/262144 blocks
> Jan 31 15:02:26 corux38 rc.sysinit: Checking root filesystem succeeded
> Jan 31 15:02:26 corux38 rc.sysinit: Remounting root filesystem in
read-write mode:  succeeded
> Jan 31 15:02:26 corux38 lvm.static:   8 logical volume(s) in volume
group vg00 now active
> Jan 31 15:02:26 corux38 rc.sysinit: Setting up Logical Volume
Management: succeeded
> Jan 31 15:02:26 corux38 fsck: /boot: clean, 38/26104 files,
17822/104388 blocks
> Jan 31 15:02:26 corux38 fsck: /dev/vg00/home: clean, 132/262144 files,
20580/524288 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files,
36957/1048576 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files,
13541/262144 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/usr: clean, 30250/524288
files, 169645/1048576 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368
files, 17525/540672 blocks
> Jan 31 15:02:27 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files,
49124/2097152 blocks
> Jan 31 15:02:27 corux38 rc.sysinit: Checking filesystems succeeded
> Jan 31 15:02:27 corux38 rc.sysinit: Mounting local filesystems:
succeeded
> Jan 31 15:02:27 corux38 rc.sysinit: Enabling swap space:  succeeded
> Jan 31 15:02:28 corux38 microcode_ctl: microcode_ctl startup succeeded
> Jan 31 15:02:36 corux38 ssh-server-g3: done.
> Jan 31 15:02:28 corux38 vgchange:   8 logical volume(s) in volume
group "vg00" monitored
> Jan 31 15:02:36 corux38 rc: Starting ssh-server-g3:  succeeded
> Jan 31 15:02:28 corux38 lvm2-monitor: Starting monitoring for VG vg00:
succeeded
> Jan 31 15:02:36 corux38 crond: crond startup succeeded
> Jan 31 15:02:28 corux38 cpuspeed: cpuspeed startup succeeded
> Jan 31 15:02:28 corux38 iptables:  succeeded
> Jan 31 15:02:36 corux38 atd: atd startup succeeded
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.ip_forward = 0
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> Jan 31 15:02:36 corux38 messagebus: messagebus startup succeeded
> Jan 31 15:02:29 corux38 sysctl:
net.ipv4.conf.default.accept_source_route = 0
> Jan 31 15:02:29 corux38 sysctl: kernel.sysrq = 0
> Jan 31 15:02:29 corux38 sysctl: kernel.core_uses_pid = 1
> Jan 31 15:02:36 corux38 haldaemon: haldaemon startup succeeded
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route
= 0
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects
= 0
> Jan 31 15:02:29 corux38 sysctl: fs.file-max = 524288
> Jan 31 15:02:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> Jan 31 15:02:29 corux38 network: Setting network parameters:
succeeded
> Jan 31 15:02:29 corux38 network: Bringing up loopback interface:
succeeded
> Jan 31 15:02:31 corux38 network: Bringing up interface eth1:
succeeded
> Jan 31 15:03:08 corux38 haldaemon: haldaemon -TERM succeeded
> Jan 31 15:03:08 corux38 messagebus: messagebus -TERM succeeded
> Jan 31 15:03:08 corux38 atd: atd shutdown succeeded
> Jan 31 15:03:09 corux38 vsftpd: vsftpd shutdown succeeded
> Jan 31 15:03:09 corux38 xinetd: xinetd shutdown succeeded
> Jan 31 15:03:09 corux38 crond: crond shutdown succeeded
> Jan 31 15:03:09 corux38 ntpd: ntpd shutdown succeeded
> Jan 31 15:03:09 corux38 irqbalance: irqbalance shutdown succeeded
> Jan 31 15:03:09 corux38 multipathd: multipathd shutdown succeeded
> Jan 31 15:03:09 corux38 portmap: portmap shutdown succeeded
> Jan 31 15:05:36 corux38 syslog: syslogd startup succeeded
> Jan 31 15:05:36 corux38 syslog: klogd startup succeeded
> Jan 31 15:05:37 corux38 irqbalance: irqbalance startup succeeded
> Jan 31 15:05:37 corux38 multipathd: multipathd startup succeeded
> Jan 31 15:05:37 corux38 portmap: portmap startup succeeded
> Jan 31 15:05:37 corux38 rc: Starting lm_sensors:  succeeded
> Jan 31 15:05:37 corux38 xinetd: xinetd startup succeeded
> Jan 31 15:05:37 corux38 ntpd: ntpd startup succeeded
> Jan 31 15:05:38 corux38 vsftpd: vsftpd vsftpd succeeded
> Jan 31 15:05:38 corux38 ssh-server-g3: Starting ssh-server-g3
> Jan 31 10:05:03 corux38 rc.sysinit: -e
> Jan 31 10:05:05 corux38 start_udev: Starting udev:  succeeded
> Jan 31 10:05:29 corux38 rc.sysinit: -e
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.ip_forward = 0
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> Jan 31 10:05:29 corux38 sysctl:
net.ipv4.conf.default.accept_source_route = 0
> Jan 31 10:05:29 corux38 sysctl: kernel.sysrq = 0
> Jan 31 10:05:29 corux38 sysctl: kernel.core_uses_pid = 1
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route
= 0
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects
= 0
> Jan 31 10:05:29 corux38 sysctl: fs.file-max = 524288
> Jan 31 10:05:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> Jan 31 10:05:29 corux38 rc.sysinit: Configuring kernel parameters:
succeeded
> Jan 31 15:05:30 corux38 date: Thu Jan 31 15:05:30 EST 2008
> Jan 31 15:05:30 corux38 rc.sysinit: Setting clock  (localtime): Thu
Jan 31 15:05:30 EST 2008 succeeded
> Jan 31 15:05:30 corux38 rc.sysinit: Loading default keymap succeeded
> Jan 31 15:05:30 corux38 rc.sysinit: Setting hostname corux38:
succeeded
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/root: clean, 4335/131072
files, 48559/262144 blocks
> Jan 31 15:05:30 corux38 rc.sysinit: Checking root filesystem succeeded
> Jan 31 15:05:30 corux38 rc.sysinit: Remounting root filesystem in
read-write mode:  succeeded
> Jan 31 15:05:30 corux38 lvm.static:   8 logical volume(s) in volume
group vg00 now active
> Jan 31 15:05:30 corux38 rc.sysinit: Setting up Logical Volume
Management: succeeded
> Jan 31 15:05:30 corux38 fsck: /boot: clean, 38/26104 files,
17822/104388 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/home: clean, 132/262144 files,
20580/524288 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files,
36957/1048576 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files,
13541/262144 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/usr: clean, 30250/524288
files, 169645/1048576 blocks
> Jan 31 15:05:30 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368
files, 17525/540672 blocks
> Jan 31 15:05:31 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files,
49141/2097152 blocks
> Jan 31 15:05:31 corux38 rc.sysinit: Checking filesystems succeeded
> Jan 31 15:05:31 corux38 rc.sysinit: Mounting local filesystems:
succeeded
> Jan 31 15:05:31 corux38 rc.sysinit: Enabling swap space:  succeeded
> Jan 31 15:05:32 corux38 microcode_ctl: microcode_ctl startup succeeded
> Jan 31 15:05:32 corux38 vgchange:   8 logical volume(s) in volume
group "vg00" monitored
> Jan 31 15:05:32 corux38 lvm2-monitor: Starting monitoring for VG vg00:
succeeded
> Jan 31 15:05:41 corux38 ssh-server-g3: done.
> Jan 31 15:05:32 corux38 cpuspeed: cpuspeed startup succeeded
> Jan 31 15:05:41 corux38 rc: Starting ssh-server-g3:  succeeded
> Jan 31 15:05:32 corux38 iptables:  succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.ip_forward = 0
> Jan 31 15:05:41 corux38 crond: crond startup succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> Jan 31 15:05:41 corux38 atd: atd startup succeeded
> Jan 31 15:05:32 corux38 sysctl:
net.ipv4.conf.default.accept_source_route = 0
> Jan 31 15:05:32 corux38 sysctl: kernel.sysrq = 0
> Jan 31 15:05:32 corux38 sysctl: kernel.core_uses_pid = 1
> Jan 31 15:05:42 corux38 messagebus: messagebus startup succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_source_route
= 0
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> Jan 31 15:05:42 corux38 haldaemon: haldaemon startup succeeded
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_redirects
= 0
> Jan 31 15:05:32 corux38 sysctl: fs.file-max = 524288
> Jan 31 15:05:32 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> Jan 31 15:05:32 corux38 network: Setting network parameters:
succeeded
> Jan 31 15:05:32 corux38 network: Bringing up loopback interface:
succeeded
> Jan 31 15:05:36 corux38 network: Bringing up interface eth1:
succeeded
> 
> 
> # multipath -ll
> mpath1 (00040026_05:84)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [enabled]
>  \_ 2:0:0:1 sdf 8:80  [active][ready]
>  \_ 1:0:0:1 sdb 8:16  [active][ready]
> 
> mpath0 (00040026_05:83)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 [enabled]
>  \_ 2:0:0:0 sde 8:64  [active][ready]
>  \_ 1:0:0:0 sda 8:0   [active][ready]
Content-Description: manual_run.txt

> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

[-- Attachment #2: multipath_boot_log.txt --]
[-- Type: text/plain, Size: 6947 bytes --]

%%
%% running multipath from rc.sysinit
%%
load path identifiers cache
ux_socket_connect error
#
# all paths in cache :
#
cciss!c0d0 blacklisted
cciss!c0d1 blacklisted
dm-0 blacklisted
dm-1 blacklisted
dm-2 blacklisted
dm-3 blacklisted
dm-4 blacklisted
dm-5 blacklisted
dm-6 blacklisted
dm-7 blacklisted
fd0 blacklisted
hda blacklisted
md0 blacklisted
ram0 blacklisted
ram10 blacklisted
ram11 blacklisted
ram12 blacklisted
ram13 blacklisted
ram14 blacklisted
ram15 blacklisted
ram1 blacklisted
ram2 blacklisted
ram3 blacklisted
ram4 blacklisted
ram5 blacklisted
ram6 blacklisted
ram7 blacklisted
ram8 blacklisted
ram9 blacklisted
path sda not found in pathvec

===== path info sda (mask 0x1f) =====
bus = 1
dev_t = 8:0
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 1:0:0:0
tgt_node_name = 0x50060e80039c5a04
serial = 40026 
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /etc/xpdisk %n (controler setting)
uid = 00040026_05:83 (callout)
path sdb not found in pathvec

===== path info sdb (mask 0x1f) =====
bus = 1
dev_t = 8:16
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 1:0:0:1
tgt_node_name = 0x50060e80039c5a04
serial = 40026 
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /etc/xpdisk %n (controler setting)
uid = 00040026_05:84 (callout)
path sdc not found in pathvec

===== path info sdc (mask 0x1f) =====
bus = 1
dev_t = 8:32
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 1:0:0:2
tgt_node_name = 0x50060e80039c5a04
serial = 40026 
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /etc/xpdisk %n (controler setting)
uid = 00040026_05:85 (callout)
path sdd not found in pathvec

===== path info sdd (mask 0x1f) =====
bus = 1
dev_t = 8:48
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 1:0:0:3
tgt_node_name = 0x50060e80039c5a04
serial = 40026 
path checker = tur (controler setting)
state = 2
getprio = /bin/true (internal default)
prio = 0
getuid = /etc/xpdisk %n (controler setting)
uid = 00040026_05:86 (callout)
path sde not found in pathvec

===== path info sde (mask 0x1f) =====
bus = 1
dev_t = 8:64
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:0
tgt_node_name = 0x50060e80039c5a14
path sdf not found in pathvec

===== path info sdf (mask 0x1f) =====
bus = 1
dev_t = 8:80
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:1
tgt_node_name = 0x50060e80039c5a14
path sdg not found in pathvec

===== path info sdg (mask 0x1f) =====
bus = 1
dev_t = 8:96
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:2
tgt_node_name = 0x50060e80039c5a14
path sdh not found in pathvec

===== path info sdh (mask 0x1f) =====
bus = 1
dev_t = 8:112
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:3
tgt_node_name = 0x50060e80039c5a14
#
# all paths :
#
00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E          /2114
00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E          /2114
00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E          /2114
00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E          /2114
  2:0:0:0 sde 8:64  [faulty] HP      /OPEN-E          /2114
  2:0:0:1 sdf 8:80  [faulty] HP      /OPEN-E          /2114
  2:0:0:2 sdg 8:96  [faulty] HP      /OPEN-E          /2114
  2:0:0:3 sdh 8:112  [faulty] HP      /OPEN-E          /2114
Found matching wwid [00040026_05:83] in bindings file.
Setting alias to mpath1
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:0 100
set ACT_CREATE: map does not exists
message mpath1 0 switch_group 1

create: mpath1 (00040026_05:83)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:0 sda 8:0   [ready]

reloading features
Found matching wwid [00040026_05:84] in bindings file.
Setting alias to mpath2
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:16 100
set ACT_CREATE: map does not exists
message mpath2 0 switch_group 1

create: mpath2 (00040026_05:84)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:1 sdb 8:16  [ready]

reloading features
Found matching wwid [00040026_05:85] in bindings file.
Setting alias to mpath3
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:32 100
set ACT_CREATE: map does not exists
message mpath3 0 switch_group 1

create: mpath3 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:2 sdc 8:32  [ready]

reloading features
Found matching wwid [00040026_05:86] in bindings file.
Setting alias to mpath4
pgpolicy = multibus (controler setting)
selector = round-robin 0 (internal default)
features = 0 (internal default)
hwhandler = 0 (internal default)
rr_weight = 2 (config file default)
rr_min_io = 100 (config file default)
no_path_retry = -1 (config file default)
pg_timeout = NONE (internal default)
0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:48 100
set ACT_CREATE: map does not exists
message mpath4 0 switch_group 1

create: mpath4 (00040026_05:86)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:3 sdd 8:48  [ready]

reloading features
%%
%% running multipath.dev
%%
add /block/sdh
%%
%% running multipath.dev
%%
add /block/md0
%%
%% running multipath.dev
%%
add /block/sdg
%%
%% running multipath.dev
%%
add /block/sde
%%
%% running multipath.dev
%%
add /block/dm-8
%%
%% running multipath.dev
%%
add /block/dm-9
%%
%% running multipath.dev
%%
add /block/dm-10
%%
%% running multipath.dev
%%
add /block/sdf
%%
%% running multipath.dev
%%
add /block/fd0
%%
%% running multipath.dev
%%
add /block/dm-11
%%
%% running multipath from rc.local
%%
create: mpath2 (00040026_05:85)
[size=13 GB][features="0"][hwhandler="0"]
\_ round-robin 0 
 \_ 1:0:0:2 sdc 8:32  [ready]
 \_ 2:0:0:2 sdg 8:96  [ready]

%%
%% running multipath.dev
%%
add /block/dm-10

[-- Attachment #3: Type: text/plain, Size: 0 bytes --]

Re: Multipath not rebuilding correctly on reboot

[Benjamin Marzinski]

[-- Attachment #1: Type: text/plain, Size: 64151 bytes --]

On Thu, Feb 14, 2008 at 01:40:53PM -0500, Greene, Rick wrote:
> I tried Benjamin's suggestions, and with a little poking around I
> basically got nowhere.
> 
> I did have to make one other adjustment to the system, I modified
> /etc/lvm/lvm.conf to only try activating the vg00 volume group (local
> disk) and not the vgftp volume group (built on the disk running through
> multipath).
> 
> I'm still left with the same state, it takes that extra "multipath -v 2"
> to get everything fully activated.  I do have that in rc.local at the
> moment, but I'm hoping someone can figure out what is going on so I
> don't have to have that extra step.
> 
> Attached is the log file generated during the boot process, including
> the results of the extra step.  If you look for lines starting with %%,
> you'll see comments showing what has generated each section of the long.
> 
> Any further advice greatly appreciated,

It seems that all your paths appear early enough to be managed by
rc.sysint.  However, looking at the path info output for sde, sdf, sdg,
and sdh, it looks like multipath can't open their device nodes.  I'm
assuming that it's because udev hasn't created them yet.  In upstream
and RHEL5 there is code to wait up to five seconds for the device node
to be created.  In RHEL4, that code is only run by multipathd. I can't
be sure that this is the cause of your problems, but it seems very likely.

Besides putting sleeps into rc.sysinit, there's not much that can be
done without patching the code.  If you are willing to patch the source
yourself, I've attached a patch.  Otherwise, I can build a test rpm,
although maybe not till early next week, send out a link to it.

Hope this helps
-Ben

===== path info sdh (mask 0x1f) =====
bus = 1
dev_t = 8:112
size = 28452960
vendor = HP      
product = OPEN-E          
rev = 2114
h:b:t:l = 2:0:0:3
tgt_node_name = 0x50060e80039c5a14
#
# all paths :
#
00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E          /2114
00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E          /2114
00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E          /2114
00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E          /2114
  2:0:0:0 sde 8:64  [faulty] HP      /OPEN-E          /2114
  2:0:0:1 sdf 8:80  [faulty] HP      /OPEN-E          /2114
  2:0:0:2 sdg 8:96  [faulty] HP      /OPEN-E          /2114
  2:0:0:3 sdh 8:112  [faulty] HP      /OPEN-E          /2114

> Rick
> 
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of Benjamin Marzinski
> Sent: Tuesday, February 12, 2008 5:22 PM
> To: device-mapper development
> Subject: Re: [dm-devel] Multipath not rebuilding correctly on reboot
> 
> On Thu, Jan 31, 2008 at 03:20:04PM -0500, Greene, Rick wrote:
> > Now that I seem to have multipath and my XP 1024 working together,
> I've
> > found a new issue.  Someone recently had a similar thread going, but I
> > saw no ultimate resolution.
> > 
> > My problem is that when I reboot my server, the multipath
> configuration
> > is not coming back the way it was before.  I moved the two external
> > tools I use to find the UID into /etc (they had bin in /usr/bin and
> > /sbin), updated the multipath.conf file (and one of the scripts) to
> > reflect this, but odd things are still happening.
> > 
> > Attached is initial_view.txt, which shows what multipath is coming up
> > with when I do the commands shown (the bulk of the file is multipath
> -v3
> > output, but at the bottom of the file is a multipath -ll output as
> > well).  It (seems to) correctly shows that I have 4 disks, each
> visible
> > via two separate paths.
> > 
> > After I reboot, however, I get different results.  Once it showed 4
> > paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
> > correctly showed mpath0, mpath1, and mpath3, but didn't show mpath2 at
> > all.  On the next attempt I got everything correct, and the very next
> > one only showed mpath0 and mpath1.
> > 
> > The post_reboot.txt file shows the contents of the /var/log/boot.log
> > file and the output of the dmesg command, along with the "multipath
> -ll"
> > view from the most recent reboot.
> > 
> > I then manually did a "multipath -v2" and the missing two paths then
> > came back.  The file manual_run.txt shows those results plus the
> updated
> > "multipath -ll".
> > 
> > Do I need to just make my own /etc/init.d script to do a "multipath
> -v2"
> > at the end of booting to make sure it all gets covered, along with the
> > requisite LVM & mount commands to get the VG that is on these disks
> > working right?
> 
> Hopefully, you can just add the line
> 
> multipath -v 0 
> 
> to /etc/rc.local and fix this.  However, if you want to dig into
> what's going wrong:
> 
> There are two places were multipath gets called to create devices during
> bootup.  One is in /etc/rc.sysinit and one in
> /etc/dev.d/block/multipath.dev.  /etc/rc.sysinit will always be run as
> one of the first things during the boot process, and it just calls
> multipath.static -v 0, which should correctly set up multipath devices
> on all of the available paths.  /etc/dev.d/block/multipath.dev gets
> called by udev, and is a lot more suspect.
> 
> If you feel confortable editting boot scripts, you can do some debugging
> to figure out what's going on.
> 
> in /etc/rc.sysinit (assuming you aren't using md or raid), you can
> change
> the first line with:
> /sbin/multipath.static -v 0
> to:
> /sbin/multipath.static -v 3 >> /tmp/multipath_boot_log 2>&1
> 
> the other lines that call multipath.static are only run if you have
> the files /etc/raidtab or /etc/mdadm.conf, which you probably don't.
> 
> in /etc/dev.d/block/multipath.dev just add the following line right
> after the #!/bin/sh line:
> 
> echo "${ACTION} ${DEVPATH}" >> /tmp/multipath_boot_log
> 
> Then reboot and look at /tmp/multipath_boot_log
> 
> You should see something that looks like the output of running
> # multipath -v 3
> along with a bunch of lines like:
> 
> add /block/md0
> add /block/loop1
> add /block/loop0
> add /block/dm-7
> 
> The multipath run is from rc.sysinit, and the "add" lines are devices
> that udev is trying to create a multipath device on.  On systems where
> everthing comes up fine during boot up, all of the devices that aren't
> dealt with by the multipath call in rc.sysinit should be added by udev.
> 
> I'm assuming that this won't be the case on your box. If udev isn't
> running /etc/dev.d/block/multipath.dev, there's not much you can do
> to fix it, besides filing a bug against udev.  However you may be able
> to
> make it more likely that your scsi devices will all be up by the time
> rc.sysinit is run.  If your device drivers aren't getting loaded by the
> initrd, you can add them to /etc/modprobe.conf, run mkinitrd.  If you do
> this, it's always wise to back up your existing initrd, and make sure
> that grub can boot with it.
> 
> Otherwise, just try adding the line to rc.local
> 
> Hope this helps
> 
> -Ben
>  
> > Thanks in advance,
> > Rick
> > 
> > 
> > 
> 
> Content-Description: initial_view.txt
> > # service multipathd stop
> > # multipath -F
> > # service multipathd start
> > # multipath -v3
> > load path identifiers cache
> > #
> > # all paths in cache :
> > #
> > 00040026_05:83  1:0:0:0 sda 8:0   HP      /OPEN-E          /2114
> > 00040026_05:84  1:0:0:1 sdb 8:16   HP      /OPEN-E          /2114
> > 00040026_05:85  1:0:0:2 sdc 8:32   HP      /OPEN-E          /2114
> > 00040026_05:86  1:0:0:3 sdd 8:48   HP      /OPEN-E          /2114
> > 00040026_05:83  2:0:0:0 sde 8:64   HP      /OPEN-E          /2114
> > 00040026_05:84  2:0:0:1 sdf 8:80   HP      /OPEN-E          /2114
> > 00040026_05:85  2:0:0:2 sdg 8:96   HP      /OPEN-E          /2114
> > 00040026_05:86  2:0:0:3 sdh 8:112   HP      /OPEN-E          /2114
> > cciss!c0d0 blacklisted
> > cciss!c0d1 blacklisted
> > dm-0 blacklisted
> > dm-1 blacklisted
> > dm-2 blacklisted
> > dm-3 blacklisted
> > dm-4 blacklisted
> > dm-5 blacklisted
> > dm-6 blacklisted
> > dm-7 blacklisted
> > fd0 blacklisted
> > hda blacklisted
> > md0 blacklisted
> > ram0 blacklisted
> > ram10 blacklisted
> > ram11 blacklisted
> > ram12 blacklisted
> > ram13 blacklisted
> > ram14 blacklisted
> > ram15 blacklisted
> > ram1 blacklisted
> > ram2 blacklisted
> > ram3 blacklisted
> > ram4 blacklisted
> > ram5 blacklisted
> > ram6 blacklisted
> > ram7 blacklisted
> > ram8 blacklisted
> > ram9 blacklisted
> > ===== path info sda (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:0
> > size = 28452960
> > vendor = HP
> > product = OPEN-E
> > rev = 2114
> > h:b:t:l = 1:0:0:0
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > uid = 00040026_05:83 (cache)
> > ===== path info sdb (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:16
> > size = 28452960
> > vendor = HP
> > product = OPEN-E
> > rev = 2114
> > h:b:t:l = 1:0:0:1
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > uid = 00040026_05:84 (cache)
> > ===== path info sdc (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:32
> > size = 28452960
> > vendor = HP
> > product = OPEN-E
> > rev = 2114
> > h:b:t:l = 1:0:0:2
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > uid = 00040026_05:85 (cache)
> > ===== path info sdd (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:48
> > size = 28452960
> > vendor = HP
> > product = OPEN-E
> > rev = 2114
> > h:b:t:l = 1:0:0:3
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > uid = 00040026_05:86 (cache)
> > ===== path info sde (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:64
> > size = 28452960
> > vendor = HP
> > product = OPEN-E
> > rev = 2114
> > h:b:t:l = 2:0:0:0
> > tgt_node_name = 0x50060e80039c5a14
> > serial = 40026
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > uid = 00040026_05:83 (cache)
> > ===== path info sdf (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:80
> > size = 28452960
> > vendor = HP
> > product = OPEN-E
> > rev = 2114
> > h:b:t:l = 2:0:0:1
> > tgt_node_name = 0x50060e80039c5a14
> > serial = 40026
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > uid = 00040026_05:84 (cache)
> > ===== path info sdg (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:96
> > size = 28452960
> > vendor = HP
> > product = OPEN-E
> > rev = 2114
> > h:b:t:l = 2:0:0:2
> > tgt_node_name = 0x50060e80039c5a14
> > serial = 40026
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > uid = 00040026_05:85 (cache)
> > ===== path info sdh (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:112
> > size = 28452960
> > vendor = HP
> > product = OPEN-E
> > rev = 2114
> > h:b:t:l = 2:0:0:3
> > tgt_node_name = 0x50060e80039c5a14
> > serial = 40026
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > uid = 00040026_05:86 (cache)
> > #
> > # all paths :
> > #
> > 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E
> /2114
> > 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E
> /2114
> > 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E
> /2114
> > 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E
> /2114
> > 00040026_05:83  2:0:0:0 sde 8:64  [ready] HP      /OPEN-E
> /2114
> > 00040026_05:84  2:0:0:1 sdf 8:80  [ready] HP      /OPEN-E
> /2114
> > 00040026_05:85  2:0:0:2 sdg 8:96  [ready] HP      /OPEN-E
> /2114
> > 00040026_05:86  2:0:0:3 sdh 8:112  [ready] HP      /OPEN-E
> /2114
> > Initialized new bindings file [/var/lib/multipath/bindings]
> > No matching wwid [00040026_05:83] in bindings file.
> > Created new binding [mpath0] for WWID [00040026_05:83]
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:0 100 8:64 100
> > set ACT_CREATE: map does not exists
> > message mpath0 0 switch_group 1
> > 
> > create: mpath0 (00040026_05:83)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0
> >  \_ 1:0:0:0 sda 8:0   [ready]
> >  \_ 2:0:0:0 sde 8:64  [ready]
> > 
> > reloading features
> > No matching wwid [00040026_05:84] in bindings file.
> > Created new binding [mpath1] for WWID [00040026_05:84]
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:16 100 8:80 100
> > set ACT_CREATE: map does not exists
> > message mpath1 0 switch_group 1
> > 
> > create: mpath1 (00040026_05:84)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0
> >  \_ 1:0:0:1 sdb 8:16  [ready]
> >  \_ 2:0:0:1 sdf 8:80  [ready]
> > 
> > reloading features
> > No matching wwid [00040026_05:85] in bindings file.
> > Created new binding [mpath2] for WWID [00040026_05:85]
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:32 100 8:96 100
> > set ACT_CREATE: map does not exists
> > message mpath2 0 switch_group 1
> > 
> > create: mpath2 (00040026_05:85)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0
> >  \_ 1:0:0:2 sdc 8:32  [ready]
> >  \_ 2:0:0:2 sdg 8:96  [ready]
> > 
> > reloading features
> > No matching wwid [00040026_05:86] in bindings file.
> > Created new binding [mpath3] for WWID [00040026_05:86]
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:48 100 8:112 100
> > set ACT_CREATE: map does not exists
> > message mpath3 0 switch_group 1
> > 
> > create: mpath3 (00040026_05:86)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0
> >  \_ 1:0:0:3 sdd 8:48  [ready]
> >  \_ 2:0:0:3 sdh 8:112 [ready]
> > 
> > reloading features
> > 
> > # multipath -ll
> > mpath2 (00040026_05:85)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 [active]
> >  \_ 1:0:0:2 sdc 8:32  [active][ready]
> >  \_ 2:0:0:2 sdg 8:96  [active][ready]
> > 
> > mpath1 (00040026_05:84)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 [active]
> >  \_ 1:0:0:1 sdb 8:16  [active][ready]
> >  \_ 2:0:0:1 sdf 8:80  [active][ready]
> > 
> > mpath0 (00040026_05:83)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 [active]
> >  \_ 1:0:0:0 sda 8:0   [active][ready]
> >  \_ 2:0:0:0 sde 8:64  [active][ready]
> > 
> > mpath3 (00040026_05:86)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 [active]
> >  \_ 1:0:0:3 sdd 8:48  [active][ready]
> >  \_ 2:0:0:3 sdh 8:112 [active][ready]
> 
> Content-Description: post_reboot.txt
> > # dmesg
> > Bootdata ok (command line is ro root=/dev/vg00/root rhgb quiet)
> > Linux version 2.6.9-55.ELsmp (brewbuilder@hs20-bc2-4.build.redhat.com)
> (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Fri Apr 20
> 16:36:54 EDT 2007
> > BIOS-provided physical RAM map:
> >  BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
> >  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
> >  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
> >  BIOS-e820: 0000000000100000 - 00000000bfff3000 (usable)
> >  BIOS-e820: 00000000bfff3000 - 00000000bfffb000 (ACPI data)
> >  BIOS-e820: 00000000bfffb000 - 00000000c0000000 (reserved)
> >  BIOS-e820: 00000000fec00000 - 00000000fed00000 (reserved)
> >  BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
> >  BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
> > ACPI: RSDP (v002 HP                                    ) @
> 0x00000000000f4f00
> > ACPI: XSDT (v001 HP     P51      0x00000002 ? 0x0000162e) @
> 0x00000000bfff3300
> > ACPI: FADT (v003 HP     P51      0x00000002 ? 0x0000162e) @
> 0x00000000bfff3380
> > ACPI: SPCR (v001 HP     SPCRRBSU 0x00000001 ? 0x0000162e) @
> 0x00000000bfff3140
> > ACPI: MCFG (v001 HP     ProLiant 0x00000001  0x00000000) @
> 0x00000000bfff31c0
> > ACPI: MADT (v001 HP     00000083 0x00000002  0x00000000) @
> 0x00000000bfff3200
> > ACPI: SSDT (v001 HP        SSDTP 0x00000001 INTL 0x20030228) @
> 0x00000000bfff8000
> > ACPI: DSDT (v001 HP         DSDT 0x00000001 INTL 0x20030228) @
> 0x0000000000000000
> > No NUMA configuration found
> > Faking a node at 0000000000000000-00000000bfff3000
> > Bootmem setup node 0 0000000000000000-00000000bfff3000
> > On node 0 totalpages: 786419
> >   DMA zone: 4096 pages, LIFO batch:1
> >   Normal zone: 782323 pages, LIFO batch:16
> >   HighMem zone: 0 pages, LIFO batch:1
> > DMI 2.3 present.
> > ACPI: PM-Timer IO Port: 0x908
> > ACPI: Local APIC address 0xfee00000
> > ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> > Processor #0 15:4 APIC version 16
> > ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
> > ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
> > ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
> > Processor #6 15:4 APIC version 16
> > ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> > Processor #1 15:4 APIC version 16
> > ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
> > ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
> > ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
> > Processor #7 15:4 APIC version 16
> > ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
> > Setting APIC routing to flat
> > ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
> > IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
> > ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
> > IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
> > ACPI: IOAPIC (id[0x0a] address[0xfec80400] gsi_base[48])
> > IOAPIC[2]: apic_id 10, version 32, address 0xfec80400, GSI 48-71
> > ACPI: IOAPIC (id[0x0b] address[0xfec84000] gsi_base[72])
> > IOAPIC[3]: apic_id 11, version 32, address 0xfec84000, GSI 72-95
> > ACPI: IOAPIC (id[0x0c] address[0xfec84400] gsi_base[96])
> > IOAPIC[4]: apic_id 12, version 32, address 0xfec84400, GSI 96-119
> > ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> > ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> > ACPI: IRQ0 used by override.
> > ACPI: IRQ2 used by override.
> > ACPI: IRQ9 used by override.
> > Using ACPI (MADT) for SMP configuration information
> > Allocating PCI resources starting at c4000000 (gap: c0000000:3ec00000)
> > Checking aperture...
> > Built 1 zonelists
> > Kernel command line: ro root=/dev/vg00/root rhgb quiet console=tty0
> > Initializing CPU#0
> > PID hash table entries: 4096 (order: 12, 131072 bytes)
> > time.c: Using 3.579545 MHz PM timer.
> > time.c: Detected 3400.312 MHz processor.
> > Console: colour VGA+ 80x25
> > Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> > Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> > Memory: 3089236k/3145676k available (2112k kernel code, 0k reserved,
> 1305k data, 208k init)
> > Calibrating delay using timer specific routine.. 6807.48 BogoMIPS
> (lpj=3403744)
> > Security Scaffold v1.0.0 initialized
> > SELinux:  Initializing.
> > SELinux:  Starting in permissive mode
> > There is already a security framework initialized, register_security
> failed.
> > selinux_register_security:  Registering secondary module capability
> > Capability LSM initialized as secondary
> > Mount-cache hash table entries: 256 (order: 0, 4096 bytes)
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > using mwait in idle threads.
> > CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> > Using IO APIC NMI watchdog
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> > CPU0:                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > per-CPU timeslice cutoff: 1023.90 usecs.
> > task migration cache decay timeout: 1 msecs.
> > Booting processor 1/6 rip 6000 rsp 10037e05f58
> > Initializing CPU#1
> > Calibrating delay using timer specific routine.. 6799.32 BogoMIPS
> (lpj=3399660)
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU1: Initial APIC ID: 6, Physical Processor ID: 3
> >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > Booting processor 2/1 rip 6000 rsp 10037e3df58
> > Initializing CPU#2
> > Calibrating delay using timer specific routine.. 6799.31 BogoMIPS
> (lpj=3399655)
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU2: Initial APIC ID: 1, Physical Processor ID: 0
> >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > Booting processor 3/7 rip 6000 rsp 100016f3f58
> > Initializing CPU#3
> > Calibrating delay using timer specific routine.. 6799.18 BogoMIPS
> (lpj=3399591)
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU3: Initial APIC ID: 7, Physical Processor ID: 3
> >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > Total of 4 processors activated (27205.30 BogoMIPS).
> > activating NMI Watchdog ... done.
> > testing NMI watchdog ... OK.
> > Using local APIC timer interrupts.
> > Detected 12.501 MHz APIC timer.
> > checking TSC synchronization across 4 CPUs: passed.
> > Brought up 4 CPUs
> > time.c: Using PIT/TSC based timekeeping.
> > checking if image is initramfs... it is
> > NET: Registered protocol family 16
> > PCI: Using configuration type 1
> > PCI: Using MMCONFIG at e0000000
> > mtrr: v2.0 (20020519)
> > mtrr: your CPUs had inconsistent fixed MTRR settings
> > mtrr: probably your BIOS does not setup all CPUs.
> > mtrr: corrected configuration.
> > ACPI: Subsystem revision 20040816
> > ACPI: Interpreter enabled
> > ACPI: Using IOAPIC for interrupt routing
> > ACPI: PCI Root Bridge [PCI0] (00:00)
> > PCI: Probing PCI hardware (bus 00)
> > PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
> > PCI: PXH quirk detected, disabling MSI for SHPC device
> > PCI: PXH quirk detected, disabling MSI for SHPC device
> > PCI: PXH quirk detected, disabling MSI for SHPC device
> > PCI: PXH quirk detected, disabling MSI for SHPC device
> > PCI: Transparent bridge - 0000:00:1e.0
> > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
> > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.IP2P._PRT]
> > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0._PRT]
> > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXA._PRT]
> > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXB._PRT]
> > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0._PRT]
> > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXC._PRT]
> > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXD._PRT]
> > ACPI: PCI Interrupt Link [LNKA] (IRQs *5 7 10 11)
> > ACPI: PCI Interrupt Link [LNKB] (IRQs *5 7 10 11)
> > ACPI: PCI Interrupt Link [LNKC] (IRQs *5 7 10 11)
> > ACPI: PCI Interrupt Link [LNKD] (IRQs *5 7 10 11)
> > ACPI: PCI Interrupt Link [LNKE] (IRQs 5 7 10 11) *0, disabled.
> > ACPI: PCI Interrupt Link [LNKF] (IRQs *5 7 10 11)
> > ACPI: PCI Interrupt Link [LNKG] (IRQs *5 7 10 11)
> > ACPI: PCI Interrupt Link [LNKH] (IRQs *5 7 10 11)
> > usbcore: registered new driver usbfs
> > usbcore: registered new driver hub
> > PCI: Using ACPI for IRQ routing
> > GSI 16 sharing vector 0xA9 and IRQ 16
> > ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 169
> > ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 169
> > ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
> > GSI 17 sharing vector 0xB1 and IRQ 17
> > ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
> > GSI 18 sharing vector 0xB9 and IRQ 18
> > ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
> > ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
> > GSI 19 sharing vector 0xC1 and IRQ 19
> > ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
> > ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> > GSI 20 sharing vector 0xC9 and IRQ 20
> > ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
> > GSI 21 sharing vector 0xD1 and IRQ 21
> > ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
> > GSI 22 sharing vector 0xD9 and IRQ 22
> > ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
> > GSI 23 sharing vector 0xE1 and IRQ 23
> > ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
> > GSI 24 sharing vector 0xE9 and IRQ 24
> > ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
> > GSI 25 sharing vector 0x32 and IRQ 25
> > ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
> > GSI 26 sharing vector 0x3A and IRQ 26
> > ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
> > GSI 27 sharing vector 0x42 and IRQ 27
> > ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
> > GSI 28 sharing vector 0x4A and IRQ 28
> > ACPI: PCI Interrupt 0000:01:04.0[A] -> GSI 21 (level, low) -> IRQ 74
> > GSI 29 sharing vector 0x52 and IRQ 29
> > ACPI: PCI Interrupt 0000:01:04.2[B] -> GSI 22 (level, low) -> IRQ 82
> > PCI-DMA: Disabling IOMMU.
> > IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
> > audit: initializing netlink socket (disabled)
> > audit(1201791896.599:1): initialized
> > Total HugeTLB memory allocated, 0
> > VFS: Disk quotas dquot_6.5.1
> > Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
> > SELinux:  Registering netfilter hooks
> > Initializing Cryptographic API
> > ksign: Installing public key data
> > Loading keyring
> > - Added public key B7CA3C9BE2FAFC39
> > - User ID: Red Hat, Inc. (Kernel Module GPG key)
> > pci_hotplug: PCI Hot Plug PCI Core version: 0.5
> > ACPI: Processor [CPU0] (supports C1)
> > ACPI: Processor [CPU1] (supports C1)
> > ACPI: Processor [CPU2] (supports C1)
> > ACPI: Processor [CPU3] (supports C1)
> > ACPI: Thermal Zone [THM0] (8 C)
> > Real Time Clock Driver v1.12
> > Linux agpgart interface v0.100 (c) Dave Jones
> > serio: i8042 AUX port at 0x60,0x64 irq 12
> > serio: i8042 KBD port at 0x60,0x64 irq 1
> > Serial: 8250/16550 driver $Revision: 1.90 $ 68 ports, IRQ sharing
> enabled
> > ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> > ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> > RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
> > divert: not allocating divert_blk for non-ethernet device lo
> > Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
> > ide: Assuming 33MHz system bus speed for PIO modes; override with
> idebus=xx
> > ICH5: IDE controller at PCI slot 0000:00:1f.1
> > PCI: Enabling device 0000:00:1f.1 (0005 -> 0007)
> > ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> > ICH5: chipset revision 2
> > ICH5: not 100% native mode: will probe irqs later
> >     ide0: BM-DMA at 0x0500-0x0507, BIOS settings: hda:DMA, hdb:pio
> >     ide1: BM-DMA at 0x0508-0x050f, BIOS settings: hdc:pio, hdd:pio
> > Probing IDE interface ide0...
> > hda: DV-28E-N, ATAPI CD/DVD-ROM drive
> > Using cfq io scheduler
> > ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
> > Probing IDE interface ide1...
> > Probing IDE interface ide1...
> > Probing IDE interface ide2...
> > Probing IDE interface ide3...
> > Probing IDE interface ide4...
> > Probing IDE interface ide5...
> > hda: ATAPI 24X DVD-ROM drive, 256kB Cache, UDMA(33)
> > Uniform CD-ROM driver Revision: 3.20
> > ide-floppy driver 0.99.newide
> > usbcore: registered new driver hiddev
> > usbcore: registered new driver usbhid
> > drivers/usb/input/hid-core.c: v2.0:USB HID core driver
> > mice: PS/2 mouse device common for all mice
> > input: AT Translated Set 2 keyboard on isa0060/serio0
> > input: PS/2 Generic Mouse on isa0060/serio1
> > md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
> > NET: Registered protocol family 2
> > IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
> > TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
> > TCP bind hash table entries: 262144 (order: 10, 4194304 bytes)
> > TCP: Hash tables configured (established 262144 bind 262144)
> > Initializing IPsec netlink socket
> > NET: Registered protocol family 1
> > NET: Registered protocol family 17
> > cpufreq: CPU0 - ACPI performance management activated.
> > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > cpufreq: CPU1 - ACPI performance management activated.
> > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > cpufreq: CPU2 - ACPI performance management activated.
> > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > cpufreq: CPU3 - ACPI performance management activated.
> > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > ACPI wakeup devices:
> > 
> > ACPI: (supports S0 S4 S5)
> > Freeing unused kernel memory: 208k freed
> > SCSI subsystem initialized
> > HP CISS Driver (v 2.6.14.RH2)
> > cciss: Device 0x46 has been found at bus 4 dev 3 func 0
> > ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
> > cciss: using DAC cycles
> >       blocks= 71122559 block_size= 512
> >       heads= 255, sectors= 32, cylinders= 8716
> > 
> >       blocks= 71122559 block_size= 512
> >       heads= 255, sectors= 32, cylinders= 8716
> > 
> >       blocks= 71122559 block_size= 512
> >       heads= 255, sectors= 32, cylinders= 8716
> > 
> >  cciss/c0d0: p1 p2
> >       blocks= 71122559 block_size= 512
> >       heads= 255, sectors= 32, cylinders= 8716
> > 
> >  cciss/c0d1: unknown partition table
> > device-mapper: 4.5.5-ioctl (2006-12-01) initialised:
> dm-devel@redhat.com
> > hda: packet command error: status=0x51 { DriveReady SeekComplete Error
> }
> > hda: packet command error: error=0x50
> > ide: failed opcode was 100
> > cdrom: open failed.
> > kjournald starting.  Commit interval 5 seconds
> > EXT3-fs: mounted filesystem with ordered data mode.
> > security:  3 users, 4 roles, 355 types, 26 bools
> > security:  55 classes, 22610 rules
> > SELinux:  Completing initialization.
> > SELinux:  Setting up existing superblocks.
> > SELinux: initialized (dev dm-0, type ext3), uses xattr
> > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > SELinux: initialized (dev selinuxfs, type selinuxfs), uses
> genfs_contexts
> > SELinux: initialized (dev mqueue, type mqueue), not configured for
> labeling
> > SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses
> genfs_contexts
> > SELinux: initialized (dev devpts, type devpts), uses transition SIDs
> > SELinux: initialized (dev eventpollfs, type eventpollfs), uses
> genfs_contexts
> > SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
> > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
> > SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
> > SELinux: initialized (dev proc, type proc), uses genfs_contexts
> > SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
> > SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
> > SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
> > SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
> > libata version 2.00 loaded.
> > Emulex LightPulse Fibre Channel SCSI driver 8.0.16.27
> > Copyright(c) 2003-2006 Emulex.  All rights reserved.
> > ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
> > lpfc 0000:06:02.0: 0:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> > scsi0 : Emulex LP9002L-F2 2Gb PCI Fibre Channel Adapter on PCI bus 06
> device 10 irq 225
> > ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
> > lpfc 0000:07:04.0: 1:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> > scsi1 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07
> device 20 irq 233
> >   Vendor: HP        Model: OPEN-E            Rev: 2114
> >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sda: drive cache: write back
> > SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sda: drive cache: write back
> >  sda: sda1
> > Attached scsi disk sda at scsi1, channel 0, id 0, lun 0
> >   Vendor: HP        Model: OPEN-E            Rev: 2114
> >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdb: drive cache: write back
> > SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdb: drive cache: write back
> >  sdb: unknown partition table
> > Attached scsi disk sdb at scsi1, channel 0, id 0, lun 1
> >   Vendor: HP        Model: OPEN-E            Rev: 2114
> >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdc: drive cache: write back
> > SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdc: drive cache: write back
> >  sdc: unknown partition table
> > Attached scsi disk sdc at scsi1, channel 0, id 0, lun 2
> >   Vendor: HP        Model: OPEN-E            Rev: 2114
> >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdd: drive cache: write back
> > SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdd: drive cache: write back
> >  sdd: unknown partition table
> > Attached scsi disk sdd at scsi1, channel 0, id 0, lun 3
> > ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
> > Losing some ticks... checking if CPU frequency changed.
> > lpfc 0000:07:05.0: 2:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> > scsi2 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07
> device 28 irq 50
> >   Vendor: HP        Model: OPEN-E            Rev: 2114
> >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sde: drive cache: write back
> > SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sde: drive cache: write back
> >  sde: sde1
> > Attached scsi disk sde at scsi2, channel 0, id 0, lun 0
> >   Vendor: HP        Model: OPEN-E            Rev: 2114
> >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdf: drive cache: write back
> > SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdf: drive cache: write back
> >  sdf: unknown partition table
> > Attached scsi disk sdf at scsi2, channel 0, id 0, lun 1
> >   Vendor: HP        Model: OPEN-E            Rev: 2114
> >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdg: drive cache: write back
> > SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdg: drive cache: write back
> >  sdg: unknown partition table
> > Attached scsi disk sdg at scsi2, channel 0, id 0, lun 2
> >   Vendor: HP        Model: OPEN-E            Rev: 2114
> >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdh: drive cache: write back
> > SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> > SCSI device sdh: drive cache: write back
> >  sdh: unknown partition table
> > Attached scsi disk sdh at scsi2, channel 0, id 0, lun 3
> > inserting floppy driver for 2.6.9-55.ELsmp
> > Floppy drive(s): fd0 is 1.44M
> > FDC 0 is a National Semiconductor PC87306
> > Intel(R) PRO/1000 Network Driver - version 7.2.7-k2-NAPI
> > Copyright (c) 1999-2006 Intel Corporation.
> > ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
> > e1000: 0000:0a:01.0: e1000_probe: (PCI-X:133MHz:64-bit)
> 00:11:0a:64:7e:da
> > divert: allocating divert_blk for eth0
> > e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
> > ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
> > e1000: 0000:0a:01.1: e1000_probe: (PCI-X:133MHz:64-bit)
> 00:11:0a:64:7e:db
> > divert: allocating divert_blk for eth1
> > e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
> > tg3.c:v3.64-rh (July 31, 2006)
> > ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
> > divert: allocating divert_blk for eth2
> > eth2: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit)
> 10/100/1000BaseT Ethernet 00:14:38:bf:5a:51
> > eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] Split[0] WireSpeed[1]
> TSOcap[0]
> > eth2: dma_rwctrl[769f4000] dma_mask[64-bit]
> > ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
> > divert: allocating divert_blk for eth3
> > eth3: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit)
> 10/100/1000BaseT Ethernet 00:14:38:bf:5a:50
> > eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1]
> TSOcap[1]
> > eth3: dma_rwctrl[769f4000] dma_mask[64-bit]
> > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > hw_random hardware driver 1.0.0 loaded
> > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
> > ehci_hcd 0000:00:1d.7: EHCI Host Controller
> > PCI: Setting latency timer of device 0000:00:1d.7 to 64
> > ehci_hcd 0000:00:1d.7: irq 193, pci mem ffffff0010086000
> > SELinux: initialized (dev usbdevfs, type usbdevfs), uses
> genfs_contexts
> > ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
> > PCI: cache line size of 128 is not supported by device 0000:00:1d.7
> > ehci_hcd 0000:00:1d.7: USB 2.0 enabled, EHCI 1.00, driver 2004-May-10
> > hub 1-0:1.0: USB hub found
> > hub 1-0:1.0: 8 ports detected
> > USB Universal Host Controller Interface driver v2.2
> > ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
> > uhci_hcd 0000:00:1d.0: UHCI Host Controller
> > PCI: Setting latency timer of device 0000:00:1d.0 to 64
> > uhci_hcd 0000:00:1d.0: irq 169, io base 0000000000002000
> > uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
> > hub 2-0:1.0: USB hub found
> > hub 2-0:1.0: 2 ports detected
> > ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
> > uhci_hcd 0000:00:1d.1: UHCI Host Controller
> > PCI: Setting latency timer of device 0000:00:1d.1 to 64
> > uhci_hcd 0000:00:1d.1: irq 177, io base 0000000000002020
> > uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
> > hub 3-0:1.0: USB hub found
> > hub 3-0:1.0: 2 ports detected
> > ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
> > uhci_hcd 0000:00:1d.2: UHCI Host Controller
> > PCI: Setting latency timer of device 0000:00:1d.2 to 64
> > uhci_hcd 0000:00:1d.2: irq 185, io base 0000000000002040
> > uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
> > hub 4-0:1.0: USB hub found
> > hub 4-0:1.0: 2 ports detected
> > ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
> > uhci_hcd 0000:00:1d.3: UHCI Host Controller
> > PCI: Setting latency timer of device 0000:00:1d.3 to 64
> > uhci_hcd 0000:00:1d.3: irq 169, io base 0000000000002060
> > uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
> > hub 5-0:1.0: USB hub found
> > hub 5-0:1.0: 2 ports detected
> > md: Autodetecting RAID arrays.
> > md: autorun ...
> > md: ... autorun DONE.
> > ACPI: Power Button (FF) [PWRF]
> > EXT3 FS on dm-0, internal journal
> > device-mapper: dm-multipath version 1.0.5 loaded
> > device-mapper: dm-round-robin version 1.0.0 loaded
> > kjournald starting.  Commit interval 5 seconds
> > EXT3 FS on cciss/c0d0p1, internal journal
> > EXT3-fs: mounted filesystem with ordered data mode.
> > SELinux: initialized (dev cciss/c0d0p1, type ext3), uses xattr
> > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > kjournald starting.  Commit interval 5 seconds
> > EXT3 FS on dm-1, internal journal
> > EXT3-fs: mounted filesystem with ordered data mode.
> > SELinux: initialized (dev dm-1, type ext3), uses xattr
> > kjournald starting.  Commit interval 5 seconds
> > EXT3 FS on dm-2, internal journal
> > EXT3-fs: mounted filesystem with ordered data mode.
> > SELinux: initialized (dev dm-2, type ext3), uses xattr
> > kjournald starting.  Commit interval 5 seconds
> > EXT3 FS on dm-3, internal journal
> > EXT3-fs: mounted filesystem with ordered data mode.
> > SELinux: initialized (dev dm-3, type ext3), uses xattr
> > kjournald starting.  Commit interval 5 seconds
> > EXT3 FS on dm-4, internal journal
> > EXT3-fs: mounted filesystem with ordered data mode.
> > SELinux: initialized (dev dm-4, type ext3), uses xattr
> > kjournald starting.  Commit interval 5 seconds
> > EXT3 FS on dm-5, internal journal
> > EXT3-fs: mounted filesystem with ordered data mode.
> > SELinux: initialized (dev dm-5, type ext3), uses xattr
> > kjournald starting.  Commit interval 5 seconds
> > EXT3 FS on dm-6, internal journal
> > EXT3-fs: mounted filesystem with ordered data mode.
> > SELinux: initialized (dev dm-6, type ext3), uses xattr
> > Adding 2097144k swap on /dev/vg00/swap1.  Priority:-1 extents:1
> > SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses
> genfs_contexts
> > IA-32 Microcode Update Driver: v1.14 <tigran@veritas.com>
> > microcode: CPU0 already at revision 0x12 (current=0x12)
> > microcode: CPU1 already at revision 0x12 (current=0x12)
> > microcode: CPU2 already at revision 0x12 (current=0x12)
> > microcode: CPU3 already at revision 0x12 (current=0x12)
> > microcode: No new microdata for cpu 1
> > microcode: No new microdata for cpu 2
> > microcode: No new microdata for cpu 0
> > microcode: No new microdata for cpu 3
> > IA-32 Microcode Update Driver v1.14 unregistered
> > ip_tables: (C) 2000-2002 Netfilter core team
> > ip_conntrack version 2.1 (8192 buckets, 65536 max) - 456 bytes per
> conntrack
> > e1000: eth1: e1000_watchdog_task: NIC Link is Up 100 Mbps Half Duplex
> > i2c /dev entries driver
> > NET: Registered protocol family 10
> > Disabled Privacy Extensions on device ffffffff80408540(lo)
> > IPv6 over IPv4 tunneling driver
> > divert: not allocating divert_blk for non-ethernet device sit0
> > eth1: no IPv6 routers present
> > 
> > 
> > # cat /var/log/boot.log
> > Jan 31 15:02:31 corux38 syslog: syslogd startup succeeded
> > Jan 31 15:02:31 corux38 syslog: klogd startup succeeded
> > Jan 31 15:02:31 corux38 irqbalance: irqbalance startup succeeded
> > Jan 31 15:02:31 corux38 multipathd: multipathd startup succeeded
> > Jan 31 15:02:31 corux38 portmap: portmap startup succeeded
> > Jan 31 15:02:32 corux38 rc: Starting lm_sensors:  succeeded
> > Jan 31 15:02:32 corux38 xinetd: xinetd startup succeeded
> > Jan 31 15:02:32 corux38 ntpd: ntpd startup succeeded
> > Jan 31 15:02:32 corux38 vsftpd: vsftpd vsftpd succeeded
> > Jan 31 15:02:33 corux38 ssh-server-g3: Starting ssh-server-g3
> > Jan 31 10:01:59 corux38 rc.sysinit: -e
> > Jan 31 10:02:01 corux38 start_udev: Starting udev:  succeeded
> > Jan 31 10:02:25 corux38 rc.sysinit: -e
> > Jan 31 10:02:25 corux38 sysctl: net.ipv4.ip_forward = 0
> > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> > Jan 31 10:02:25 corux38 sysctl:
> net.ipv4.conf.default.accept_source_route = 0
> > Jan 31 10:02:25 corux38 sysctl: kernel.sysrq = 0
> > Jan 31 10:02:25 corux38 sysctl: kernel.core_uses_pid = 1
> > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_source_route
> = 0
> > Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_redirects
> = 0
> > Jan 31 10:02:25 corux38 sysctl: fs.file-max = 524288
> > Jan 31 10:02:25 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > Jan 31 10:02:25 corux38 rc.sysinit: Configuring kernel parameters:
> succeeded
> > Jan 31 15:02:26 corux38 date: Thu Jan 31 15:02:26 EST 2008
> > Jan 31 15:02:26 corux38 rc.sysinit: Setting clock  (localtime): Thu
> Jan 31 15:02:26 EST 2008 succeeded
> > Jan 31 15:02:26 corux38 rc.sysinit: Loading default keymap succeeded
> > Jan 31 15:02:26 corux38 rc.sysinit: Setting hostname corux38:
> succeeded
> > Jan 31 15:02:26 corux38 fsck: /dev/vg00/root: clean, 4335/131072
> files, 48559/262144 blocks
> > Jan 31 15:02:26 corux38 rc.sysinit: Checking root filesystem succeeded
> > Jan 31 15:02:26 corux38 rc.sysinit: Remounting root filesystem in
> read-write mode:  succeeded
> > Jan 31 15:02:26 corux38 lvm.static:   8 logical volume(s) in volume
> group vg00 now active
> > Jan 31 15:02:26 corux38 rc.sysinit: Setting up Logical Volume
> Management: succeeded
> > Jan 31 15:02:26 corux38 fsck: /boot: clean, 38/26104 files,
> 17822/104388 blocks
> > Jan 31 15:02:26 corux38 fsck: /dev/vg00/home: clean, 132/262144 files,
> 20580/524288 blocks
> > Jan 31 15:02:27 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files,
> 36957/1048576 blocks
> > Jan 31 15:02:27 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files,
> 13541/262144 blocks
> > Jan 31 15:02:27 corux38 fsck: /dev/vg00/usr: clean, 30250/524288
> files, 169645/1048576 blocks
> > Jan 31 15:02:27 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368
> files, 17525/540672 blocks
> > Jan 31 15:02:27 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files,
> 49124/2097152 blocks
> > Jan 31 15:02:27 corux38 rc.sysinit: Checking filesystems succeeded
> > Jan 31 15:02:27 corux38 rc.sysinit: Mounting local filesystems:
> succeeded
> > Jan 31 15:02:27 corux38 rc.sysinit: Enabling swap space:  succeeded
> > Jan 31 15:02:28 corux38 microcode_ctl: microcode_ctl startup succeeded
> > Jan 31 15:02:36 corux38 ssh-server-g3: done.
> > Jan 31 15:02:28 corux38 vgchange:   8 logical volume(s) in volume
> group "vg00" monitored
> > Jan 31 15:02:36 corux38 rc: Starting ssh-server-g3:  succeeded
> > Jan 31 15:02:28 corux38 lvm2-monitor: Starting monitoring for VG vg00:
> succeeded
> > Jan 31 15:02:36 corux38 crond: crond startup succeeded
> > Jan 31 15:02:28 corux38 cpuspeed: cpuspeed startup succeeded
> > Jan 31 15:02:28 corux38 iptables:  succeeded
> > Jan 31 15:02:36 corux38 atd: atd startup succeeded
> > Jan 31 15:02:29 corux38 sysctl: net.ipv4.ip_forward = 0
> > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> > Jan 31 15:02:36 corux38 messagebus: messagebus startup succeeded
> > Jan 31 15:02:29 corux38 sysctl:
> net.ipv4.conf.default.accept_source_route = 0
> > Jan 31 15:02:29 corux38 sysctl: kernel.sysrq = 0
> > Jan 31 15:02:29 corux38 sysctl: kernel.core_uses_pid = 1
> > Jan 31 15:02:36 corux38 haldaemon: haldaemon startup succeeded
> > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route
> = 0
> > Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects
> = 0
> > Jan 31 15:02:29 corux38 sysctl: fs.file-max = 524288
> > Jan 31 15:02:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > Jan 31 15:02:29 corux38 network: Setting network parameters:
> succeeded
> > Jan 31 15:02:29 corux38 network: Bringing up loopback interface:
> succeeded
> > Jan 31 15:02:31 corux38 network: Bringing up interface eth1:
> succeeded
> > Jan 31 15:03:08 corux38 haldaemon: haldaemon -TERM succeeded
> > Jan 31 15:03:08 corux38 messagebus: messagebus -TERM succeeded
> > Jan 31 15:03:08 corux38 atd: atd shutdown succeeded
> > Jan 31 15:03:09 corux38 vsftpd: vsftpd shutdown succeeded
> > Jan 31 15:03:09 corux38 xinetd: xinetd shutdown succeeded
> > Jan 31 15:03:09 corux38 crond: crond shutdown succeeded
> > Jan 31 15:03:09 corux38 ntpd: ntpd shutdown succeeded
> > Jan 31 15:03:09 corux38 irqbalance: irqbalance shutdown succeeded
> > Jan 31 15:03:09 corux38 multipathd: multipathd shutdown succeeded
> > Jan 31 15:03:09 corux38 portmap: portmap shutdown succeeded
> > Jan 31 15:05:36 corux38 syslog: syslogd startup succeeded
> > Jan 31 15:05:36 corux38 syslog: klogd startup succeeded
> > Jan 31 15:05:37 corux38 irqbalance: irqbalance startup succeeded
> > Jan 31 15:05:37 corux38 multipathd: multipathd startup succeeded
> > Jan 31 15:05:37 corux38 portmap: portmap startup succeeded
> > Jan 31 15:05:37 corux38 rc: Starting lm_sensors:  succeeded
> > Jan 31 15:05:37 corux38 xinetd: xinetd startup succeeded
> > Jan 31 15:05:37 corux38 ntpd: ntpd startup succeeded
> > Jan 31 15:05:38 corux38 vsftpd: vsftpd vsftpd succeeded
> > Jan 31 15:05:38 corux38 ssh-server-g3: Starting ssh-server-g3
> > Jan 31 10:05:03 corux38 rc.sysinit: -e
> > Jan 31 10:05:05 corux38 start_udev: Starting udev:  succeeded
> > Jan 31 10:05:29 corux38 rc.sysinit: -e
> > Jan 31 10:05:29 corux38 sysctl: net.ipv4.ip_forward = 0
> > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> > Jan 31 10:05:29 corux38 sysctl:
> net.ipv4.conf.default.accept_source_route = 0
> > Jan 31 10:05:29 corux38 sysctl: kernel.sysrq = 0
> > Jan 31 10:05:29 corux38 sysctl: kernel.core_uses_pid = 1
> > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route
> = 0
> > Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects
> = 0
> > Jan 31 10:05:29 corux38 sysctl: fs.file-max = 524288
> > Jan 31 10:05:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > Jan 31 10:05:29 corux38 rc.sysinit: Configuring kernel parameters:
> succeeded
> > Jan 31 15:05:30 corux38 date: Thu Jan 31 15:05:30 EST 2008
> > Jan 31 15:05:30 corux38 rc.sysinit: Setting clock  (localtime): Thu
> Jan 31 15:05:30 EST 2008 succeeded
> > Jan 31 15:05:30 corux38 rc.sysinit: Loading default keymap succeeded
> > Jan 31 15:05:30 corux38 rc.sysinit: Setting hostname corux38:
> succeeded
> > Jan 31 15:05:30 corux38 fsck: /dev/vg00/root: clean, 4335/131072
> files, 48559/262144 blocks
> > Jan 31 15:05:30 corux38 rc.sysinit: Checking root filesystem succeeded
> > Jan 31 15:05:30 corux38 rc.sysinit: Remounting root filesystem in
> read-write mode:  succeeded
> > Jan 31 15:05:30 corux38 lvm.static:   8 logical volume(s) in volume
> group vg00 now active
> > Jan 31 15:05:30 corux38 rc.sysinit: Setting up Logical Volume
> Management: succeeded
> > Jan 31 15:05:30 corux38 fsck: /boot: clean, 38/26104 files,
> 17822/104388 blocks
> > Jan 31 15:05:30 corux38 fsck: /dev/vg00/home: clean, 132/262144 files,
> 20580/524288 blocks
> > Jan 31 15:05:30 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files,
> 36957/1048576 blocks
> > Jan 31 15:05:30 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files,
> 13541/262144 blocks
> > Jan 31 15:05:30 corux38 fsck: /dev/vg00/usr: clean, 30250/524288
> files, 169645/1048576 blocks
> > Jan 31 15:05:30 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368
> files, 17525/540672 blocks
> > Jan 31 15:05:31 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files,
> 49141/2097152 blocks
> > Jan 31 15:05:31 corux38 rc.sysinit: Checking filesystems succeeded
> > Jan 31 15:05:31 corux38 rc.sysinit: Mounting local filesystems:
> succeeded
> > Jan 31 15:05:31 corux38 rc.sysinit: Enabling swap space:  succeeded
> > Jan 31 15:05:32 corux38 microcode_ctl: microcode_ctl startup succeeded
> > Jan 31 15:05:32 corux38 vgchange:   8 logical volume(s) in volume
> group "vg00" monitored
> > Jan 31 15:05:32 corux38 lvm2-monitor: Starting monitoring for VG vg00:
> succeeded
> > Jan 31 15:05:41 corux38 ssh-server-g3: done.
> > Jan 31 15:05:32 corux38 cpuspeed: cpuspeed startup succeeded
> > Jan 31 15:05:41 corux38 rc: Starting ssh-server-g3:  succeeded
> > Jan 31 15:05:32 corux38 iptables:  succeeded
> > Jan 31 15:05:32 corux38 sysctl: net.ipv4.ip_forward = 0
> > Jan 31 15:05:41 corux38 crond: crond startup succeeded
> > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> > Jan 31 15:05:41 corux38 atd: atd startup succeeded
> > Jan 31 15:05:32 corux38 sysctl:
> net.ipv4.conf.default.accept_source_route = 0
> > Jan 31 15:05:32 corux38 sysctl: kernel.sysrq = 0
> > Jan 31 15:05:32 corux38 sysctl: kernel.core_uses_pid = 1
> > Jan 31 15:05:42 corux38 messagebus: messagebus startup succeeded
> > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_source_route
> = 0
> > Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> > Jan 31 15:05:42 corux38 haldaemon: haldaemon startup succeeded
> > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_redirects
> = 0
> > Jan 31 15:05:32 corux38 sysctl: fs.file-max = 524288
> > Jan 31 15:05:32 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > Jan 31 15:05:32 corux38 network: Setting network parameters:
> succeeded
> > Jan 31 15:05:32 corux38 network: Bringing up loopback interface:
> succeeded
> > Jan 31 15:05:36 corux38 network: Bringing up interface eth1:
> succeeded
> > 
> > 
> > # multipath -ll
> > mpath1 (00040026_05:84)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 [enabled]
> >  \_ 2:0:0:1 sdf 8:80  [active][ready]
> >  \_ 1:0:0:1 sdb 8:16  [active][ready]
> > 
> > mpath0 (00040026_05:83)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 [enabled]
> >  \_ 2:0:0:0 sde 8:64  [active][ready]
> >  \_ 1:0:0:0 sda 8:0   [active][ready]
> Content-Description: manual_run.txt
> 
> > --
> > dm-devel mailing list
> > dm-devel@redhat.com
> > https://www.redhat.com/mailman/listinfo/dm-devel
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

Content-Description: multipath_boot_log.txt
> %%
> %% running multipath from rc.sysinit
> %%
> load path identifiers cache
> ux_socket_connect error
> #
> # all paths in cache :
> #
> cciss!c0d0 blacklisted
> cciss!c0d1 blacklisted
> dm-0 blacklisted
> dm-1 blacklisted
> dm-2 blacklisted
> dm-3 blacklisted
> dm-4 blacklisted
> dm-5 blacklisted
> dm-6 blacklisted
> dm-7 blacklisted
> fd0 blacklisted
> hda blacklisted
> md0 blacklisted
> ram0 blacklisted
> ram10 blacklisted
> ram11 blacklisted
> ram12 blacklisted
> ram13 blacklisted
> ram14 blacklisted
> ram15 blacklisted
> ram1 blacklisted
> ram2 blacklisted
> ram3 blacklisted
> ram4 blacklisted
> ram5 blacklisted
> ram6 blacklisted
> ram7 blacklisted
> ram8 blacklisted
> ram9 blacklisted
> path sda not found in pathvec
> 
> ===== path info sda (mask 0x1f) =====
> bus = 1
> dev_t = 8:0
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 1:0:0:0
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026 
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> getuid = /etc/xpdisk %n (controler setting)
> uid = 00040026_05:83 (callout)
> path sdb not found in pathvec
> 
> ===== path info sdb (mask 0x1f) =====
> bus = 1
> dev_t = 8:16
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 1:0:0:1
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026 
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> getuid = /etc/xpdisk %n (controler setting)
> uid = 00040026_05:84 (callout)
> path sdc not found in pathvec
> 
> ===== path info sdc (mask 0x1f) =====
> bus = 1
> dev_t = 8:32
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 1:0:0:2
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026 
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> getuid = /etc/xpdisk %n (controler setting)
> uid = 00040026_05:85 (callout)
> path sdd not found in pathvec
> 
> ===== path info sdd (mask 0x1f) =====
> bus = 1
> dev_t = 8:48
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 1:0:0:3
> tgt_node_name = 0x50060e80039c5a04
> serial = 40026 
> path checker = tur (controler setting)
> state = 2
> getprio = /bin/true (internal default)
> prio = 0
> getuid = /etc/xpdisk %n (controler setting)
> uid = 00040026_05:86 (callout)
> path sde not found in pathvec
> 
> ===== path info sde (mask 0x1f) =====
> bus = 1
> dev_t = 8:64
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 2:0:0:0
> tgt_node_name = 0x50060e80039c5a14
> path sdf not found in pathvec
> 
> ===== path info sdf (mask 0x1f) =====
> bus = 1
> dev_t = 8:80
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 2:0:0:1
> tgt_node_name = 0x50060e80039c5a14
> path sdg not found in pathvec
> 
> ===== path info sdg (mask 0x1f) =====
> bus = 1
> dev_t = 8:96
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 2:0:0:2
> tgt_node_name = 0x50060e80039c5a14
> path sdh not found in pathvec
> 
> ===== path info sdh (mask 0x1f) =====
> bus = 1
> dev_t = 8:112
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 2:0:0:3
> tgt_node_name = 0x50060e80039c5a14
> #
> # all paths :
> #
> 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E          /2114
> 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E          /2114
> 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E          /2114
> 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E          /2114
>   2:0:0:0 sde 8:64  [faulty] HP      /OPEN-E          /2114
>   2:0:0:1 sdf 8:80  [faulty] HP      /OPEN-E          /2114
>   2:0:0:2 sdg 8:96  [faulty] HP      /OPEN-E          /2114
>   2:0:0:3 sdh 8:112  [faulty] HP      /OPEN-E          /2114
> Found matching wwid [00040026_05:83] in bindings file.
> Setting alias to mpath1
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:0 100
> set ACT_CREATE: map does not exists
> message mpath1 0 switch_group 1
> 
> create: mpath1 (00040026_05:83)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 
>  \_ 1:0:0:0 sda 8:0   [ready]
> 
> reloading features
> Found matching wwid [00040026_05:84] in bindings file.
> Setting alias to mpath2
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:16 100
> set ACT_CREATE: map does not exists
> message mpath2 0 switch_group 1
> 
> create: mpath2 (00040026_05:84)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 
>  \_ 1:0:0:1 sdb 8:16  [ready]
> 
> reloading features
> Found matching wwid [00040026_05:85] in bindings file.
> Setting alias to mpath3
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:32 100
> set ACT_CREATE: map does not exists
> message mpath3 0 switch_group 1
> 
> create: mpath3 (00040026_05:85)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 
>  \_ 1:0:0:2 sdc 8:32  [ready]
> 
> reloading features
> Found matching wwid [00040026_05:86] in bindings file.
> Setting alias to mpath4
> pgpolicy = multibus (controler setting)
> selector = round-robin 0 (internal default)
> features = 0 (internal default)
> hwhandler = 0 (internal default)
> rr_weight = 2 (config file default)
> rr_min_io = 100 (config file default)
> no_path_retry = -1 (config file default)
> pg_timeout = NONE (internal default)
> 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:48 100
> set ACT_CREATE: map does not exists
> message mpath4 0 switch_group 1
> 
> create: mpath4 (00040026_05:86)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 
>  \_ 1:0:0:3 sdd 8:48  [ready]
> 
> reloading features
> %%
> %% running multipath.dev
> %%
> add /block/sdh
> %%
> %% running multipath.dev
> %%
> add /block/md0
> %%
> %% running multipath.dev
> %%
> add /block/sdg
> %%
> %% running multipath.dev
> %%
> add /block/sde
> %%
> %% running multipath.dev
> %%
> add /block/dm-8
> %%
> %% running multipath.dev
> %%
> add /block/dm-9
> %%
> %% running multipath.dev
> %%
> add /block/dm-10
> %%
> %% running multipath.dev
> %%
> add /block/sdf
> %%
> %% running multipath.dev
> %%
> add /block/fd0
> %%
> %% running multipath.dev
> %%
> add /block/dm-11
> %%
> %% running multipath from rc.local
> %%
> create: mpath2 (00040026_05:85)
> [size=13 GB][features="0"][hwhandler="0"]
> \_ round-robin 0 
>  \_ 1:0:0:2 sdc 8:32  [ready]
>  \_ 2:0:0:2 sdg 8:96  [ready]
> 
> %%
> %% running multipath.dev
> %%
> add /block/dm-10

> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

[-- Attachment #2: always_wait.patch --]
[-- Type: text/plain, Size: 722 bytes --]

diff -urpN multipath-tools/libmultipath/discovery.c multipath-tools-patched/libmultipath/discovery.c
--- multipath-tools/libmultipath/discovery.c	2008-02-12 14:00:38.000000000 -0600
+++ multipath-tools-patched/libmultipath/discovery.c	2008-02-15 09:28:32.000000000 -0600
@@ -170,11 +170,6 @@ path_discovery (vector pathvec, struct c
 	return r;
 }
 
-/*
- * the daemon can race udev upon path add,
- * not multipath(8), ran by udev
- */
-#if DAEMON
 #define WAIT_MAX_SECONDS 5
 #define WAIT_LOOP_PER_SECOND 5
 
@@ -197,13 +192,6 @@ wait_for_file (char * filename)
 	}
 	return 1;
 }
-#else
-static int
-wait_for_file (char * filename)
-{
-	return 0;
-}
-#endif
 
 #define declare_sysfs_get_str(fname, fmt) \
 extern int \

[-- Attachment #3: Type: text/plain, Size: 0 bytes --]

Re: Multipath not rebuilding correctly on reboot

[malahal]

Will udevsettle help here? Calling "udevsettle --timeout=60" prior to
calling multipath.static in rc.sysinit may help.

--Malahal.

Benjamin Marzinski [bmarzins@redhat.com] wrote:
> On Thu, Feb 14, 2008 at 01:40:53PM -0500, Greene, Rick wrote:
> > I tried Benjamin's suggestions, and with a little poking around I
> > basically got nowhere.
> > 
> > I did have to make one other adjustment to the system, I modified
> > /etc/lvm/lvm.conf to only try activating the vg00 volume group (local
> > disk) and not the vgftp volume group (built on the disk running through
> > multipath).
> > 
> > I'm still left with the same state, it takes that extra "multipath -v 2"
> > to get everything fully activated.  I do have that in rc.local at the
> > moment, but I'm hoping someone can figure out what is going on so I
> > don't have to have that extra step.
> > 
> > Attached is the log file generated during the boot process, including
> > the results of the extra step.  If you look for lines starting with %%,
> > you'll see comments showing what has generated each section of the long.
> > 
> > Any further advice greatly appreciated,
> 
> It seems that all your paths appear early enough to be managed by
> rc.sysint.  However, looking at the path info output for sde, sdf, sdg,
> and sdh, it looks like multipath can't open their device nodes.  I'm
> assuming that it's because udev hasn't created them yet.  In upstream
> and RHEL5 there is code to wait up to five seconds for the device node
> to be created.  In RHEL4, that code is only run by multipathd. I can't
> be sure that this is the cause of your problems, but it seems very likely.
> 
> Besides putting sleeps into rc.sysinit, there's not much that can be
> done without patching the code.  If you are willing to patch the source
> yourself, I've attached a patch.  Otherwise, I can build a test rpm,
> although maybe not till early next week, send out a link to it.
> 
> Hope this helps
> -Ben
> 
> ===== path info sdh (mask 0x1f) =====
> bus = 1
> dev_t = 8:112
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 2:0:0:3
> tgt_node_name = 0x50060e80039c5a14
> #
> # all paths :
> #
> 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E          /2114
> 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E          /2114
> 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E          /2114
> 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E          /2114
>   2:0:0:0 sde 8:64  [faulty] HP      /OPEN-E          /2114
>   2:0:0:1 sdf 8:80  [faulty] HP      /OPEN-E          /2114
>   2:0:0:2 sdg 8:96  [faulty] HP      /OPEN-E          /2114
>   2:0:0:3 sdh 8:112  [faulty] HP      /OPEN-E          /2114
> 
> > Rick
> > 
> > -----Original Message-----
> > From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> > On Behalf Of Benjamin Marzinski
> > Sent: Tuesday, February 12, 2008 5:22 PM
> > To: device-mapper development
> > Subject: Re: [dm-devel] Multipath not rebuilding correctly on reboot
> > 
> > On Thu, Jan 31, 2008 at 03:20:04PM -0500, Greene, Rick wrote:
> > > Now that I seem to have multipath and my XP 1024 working together,
> > I've
> > > found a new issue.  Someone recently had a similar thread going, but I
> > > saw no ultimate resolution.
> > > 
> > > My problem is that when I reboot my server, the multipath
> > configuration
> > > is not coming back the way it was before.  I moved the two external
> > > tools I use to find the UID into /etc (they had bin in /usr/bin and
> > > /sbin), updated the multipath.conf file (and one of the scripts) to
> > > reflect this, but odd things are still happening.
> > > 
> > > Attached is initial_view.txt, which shows what multipath is coming up
> > > with when I do the commands shown (the bulk of the file is multipath
> > -v3
> > > output, but at the bottom of the file is a multipath -ll output as
> > > well).  It (seems to) correctly shows that I have 4 disks, each
> > visible
> > > via two separate paths.
> > > 
> > > After I reboot, however, I get different results.  Once it showed 4
> > > paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
> > > correctly showed mpath0, mpath1, and mpath3, but didn't show mpath2 at
> > > all.  On the next attempt I got everything correct, and the very next
> > > one only showed mpath0 and mpath1.
> > > 
> > > The post_reboot.txt file shows the contents of the /var/log/boot.log
> > > file and the output of the dmesg command, along with the "multipath
> > -ll"
> > > view from the most recent reboot.
> > > 
> > > I then manually did a "multipath -v2" and the missing two paths then
> > > came back.  The file manual_run.txt shows those results plus the
> > updated
> > > "multipath -ll".
> > > 
> > > Do I need to just make my own /etc/init.d script to do a "multipath
> > -v2"
> > > at the end of booting to make sure it all gets covered, along with the
> > > requisite LVM & mount commands to get the VG that is on these disks
> > > working right?
> > 
> > Hopefully, you can just add the line
> > 
> > multipath -v 0 
> > 
> > to /etc/rc.local and fix this.  However, if you want to dig into
> > what's going wrong:
> > 
> > There are two places were multipath gets called to create devices during
> > bootup.  One is in /etc/rc.sysinit and one in
> > /etc/dev.d/block/multipath.dev.  /etc/rc.sysinit will always be run as
> > one of the first things during the boot process, and it just calls
> > multipath.static -v 0, which should correctly set up multipath devices
> > on all of the available paths.  /etc/dev.d/block/multipath.dev gets
> > called by udev, and is a lot more suspect.
> > 
> > If you feel confortable editting boot scripts, you can do some debugging
> > to figure out what's going on.
> > 
> > in /etc/rc.sysinit (assuming you aren't using md or raid), you can
> > change
> > the first line with:
> > /sbin/multipath.static -v 0
> > to:
> > /sbin/multipath.static -v 3 >> /tmp/multipath_boot_log 2>&1
> > 
> > the other lines that call multipath.static are only run if you have
> > the files /etc/raidtab or /etc/mdadm.conf, which you probably don't.
> > 
> > in /etc/dev.d/block/multipath.dev just add the following line right
> > after the #!/bin/sh line:
> > 
> > echo "${ACTION} ${DEVPATH}" >> /tmp/multipath_boot_log
> > 
> > Then reboot and look at /tmp/multipath_boot_log
> > 
> > You should see something that looks like the output of running
> > # multipath -v 3
> > along with a bunch of lines like:
> > 
> > add /block/md0
> > add /block/loop1
> > add /block/loop0
> > add /block/dm-7
> > 
> > The multipath run is from rc.sysinit, and the "add" lines are devices
> > that udev is trying to create a multipath device on.  On systems where
> > everthing comes up fine during boot up, all of the devices that aren't
> > dealt with by the multipath call in rc.sysinit should be added by udev.
> > 
> > I'm assuming that this won't be the case on your box. If udev isn't
> > running /etc/dev.d/block/multipath.dev, there's not much you can do
> > to fix it, besides filing a bug against udev.  However you may be able
> > to
> > make it more likely that your scsi devices will all be up by the time
> > rc.sysinit is run.  If your device drivers aren't getting loaded by the
> > initrd, you can add them to /etc/modprobe.conf, run mkinitrd.  If you do
> > this, it's always wise to back up your existing initrd, and make sure
> > that grub can boot with it.
> > 
> > Otherwise, just try adding the line to rc.local
> > 
> > Hope this helps
> > 
> > -Ben
> >  
> > > Thanks in advance,
> > > Rick
> > > 
> > > 
> > > 
> > 
> > Content-Description: initial_view.txt
> > > # service multipathd stop
> > > # multipath -F
> > > # service multipathd start
> > > # multipath -v3
> > > load path identifiers cache
> > > #
> > > # all paths in cache :
> > > #
> > > 00040026_05:83  1:0:0:0 sda 8:0   HP      /OPEN-E          /2114
> > > 00040026_05:84  1:0:0:1 sdb 8:16   HP      /OPEN-E          /2114
> > > 00040026_05:85  1:0:0:2 sdc 8:32   HP      /OPEN-E          /2114
> > > 00040026_05:86  1:0:0:3 sdd 8:48   HP      /OPEN-E          /2114
> > > 00040026_05:83  2:0:0:0 sde 8:64   HP      /OPEN-E          /2114
> > > 00040026_05:84  2:0:0:1 sdf 8:80   HP      /OPEN-E          /2114
> > > 00040026_05:85  2:0:0:2 sdg 8:96   HP      /OPEN-E          /2114
> > > 00040026_05:86  2:0:0:3 sdh 8:112   HP      /OPEN-E          /2114
> > > cciss!c0d0 blacklisted
> > > cciss!c0d1 blacklisted
> > > dm-0 blacklisted
> > > dm-1 blacklisted
> > > dm-2 blacklisted
> > > dm-3 blacklisted
> > > dm-4 blacklisted
> > > dm-5 blacklisted
> > > dm-6 blacklisted
> > > dm-7 blacklisted
> > > fd0 blacklisted
> > > hda blacklisted
> > > md0 blacklisted
> > > ram0 blacklisted
> > > ram10 blacklisted
> > > ram11 blacklisted
> > > ram12 blacklisted
> > > ram13 blacklisted
> > > ram14 blacklisted
> > > ram15 blacklisted
> > > ram1 blacklisted
> > > ram2 blacklisted
> > > ram3 blacklisted
> > > ram4 blacklisted
> > > ram5 blacklisted
> > > ram6 blacklisted
> > > ram7 blacklisted
> > > ram8 blacklisted
> > > ram9 blacklisted
> > > ===== path info sda (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:0
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 1:0:0:0
> > > tgt_node_name = 0x50060e80039c5a04
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:83 (cache)
> > > ===== path info sdb (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:16
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 1:0:0:1
> > > tgt_node_name = 0x50060e80039c5a04
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:84 (cache)
> > > ===== path info sdc (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:32
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 1:0:0:2
> > > tgt_node_name = 0x50060e80039c5a04
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:85 (cache)
> > > ===== path info sdd (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:48
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 1:0:0:3
> > > tgt_node_name = 0x50060e80039c5a04
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:86 (cache)
> > > ===== path info sde (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:64
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 2:0:0:0
> > > tgt_node_name = 0x50060e80039c5a14
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:83 (cache)
> > > ===== path info sdf (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:80
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 2:0:0:1
> > > tgt_node_name = 0x50060e80039c5a14
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:84 (cache)
> > > ===== path info sdg (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:96
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 2:0:0:2
> > > tgt_node_name = 0x50060e80039c5a14
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:85 (cache)
> > > ===== path info sdh (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:112
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 2:0:0:3
> > > tgt_node_name = 0x50060e80039c5a14
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:86 (cache)
> > > #
> > > # all paths :
> > > #
> > > 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:83  2:0:0:0 sde 8:64  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:84  2:0:0:1 sdf 8:80  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:85  2:0:0:2 sdg 8:96  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:86  2:0:0:3 sdh 8:112  [ready] HP      /OPEN-E
> > /2114
> > > Initialized new bindings file [/var/lib/multipath/bindings]
> > > No matching wwid [00040026_05:83] in bindings file.
> > > Created new binding [mpath0] for WWID [00040026_05:83]
> > > pgpolicy = multibus (controler setting)
> > > selector = round-robin 0 (internal default)
> > > features = 0 (internal default)
> > > hwhandler = 0 (internal default)
> > > rr_weight = 2 (config file default)
> > > rr_min_io = 100 (config file default)
> > > no_path_retry = -1 (config file default)
> > > pg_timeout = NONE (internal default)
> > > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:0 100 8:64 100
> > > set ACT_CREATE: map does not exists
> > > message mpath0 0 switch_group 1
> > > 
> > > create: mpath0 (00040026_05:83)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0
> > >  \_ 1:0:0:0 sda 8:0   [ready]
> > >  \_ 2:0:0:0 sde 8:64  [ready]
> > > 
> > > reloading features
> > > No matching wwid [00040026_05:84] in bindings file.
> > > Created new binding [mpath1] for WWID [00040026_05:84]
> > > pgpolicy = multibus (controler setting)
> > > selector = round-robin 0 (internal default)
> > > features = 0 (internal default)
> > > hwhandler = 0 (internal default)
> > > rr_weight = 2 (config file default)
> > > rr_min_io = 100 (config file default)
> > > no_path_retry = -1 (config file default)
> > > pg_timeout = NONE (internal default)
> > > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:16 100 8:80 100
> > > set ACT_CREATE: map does not exists
> > > message mpath1 0 switch_group 1
> > > 
> > > create: mpath1 (00040026_05:84)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0
> > >  \_ 1:0:0:1 sdb 8:16  [ready]
> > >  \_ 2:0:0:1 sdf 8:80  [ready]
> > > 
> > > reloading features
> > > No matching wwid [00040026_05:85] in bindings file.
> > > Created new binding [mpath2] for WWID [00040026_05:85]
> > > pgpolicy = multibus (controler setting)
> > > selector = round-robin 0 (internal default)
> > > features = 0 (internal default)
> > > hwhandler = 0 (internal default)
> > > rr_weight = 2 (config file default)
> > > rr_min_io = 100 (config file default)
> > > no_path_retry = -1 (config file default)
> > > pg_timeout = NONE (internal default)
> > > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:32 100 8:96 100
> > > set ACT_CREATE: map does not exists
> > > message mpath2 0 switch_group 1
> > > 
> > > create: mpath2 (00040026_05:85)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0
> > >  \_ 1:0:0:2 sdc 8:32  [ready]
> > >  \_ 2:0:0:2 sdg 8:96  [ready]
> > > 
> > > reloading features
> > > No matching wwid [00040026_05:86] in bindings file.
> > > Created new binding [mpath3] for WWID [00040026_05:86]
> > > pgpolicy = multibus (controler setting)
> > > selector = round-robin 0 (internal default)
> > > features = 0 (internal default)
> > > hwhandler = 0 (internal default)
> > > rr_weight = 2 (config file default)
> > > rr_min_io = 100 (config file default)
> > > no_path_retry = -1 (config file default)
> > > pg_timeout = NONE (internal default)
> > > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:48 100 8:112 100
> > > set ACT_CREATE: map does not exists
> > > message mpath3 0 switch_group 1
> > > 
> > > create: mpath3 (00040026_05:86)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0
> > >  \_ 1:0:0:3 sdd 8:48  [ready]
> > >  \_ 2:0:0:3 sdh 8:112 [ready]
> > > 
> > > reloading features
> > > 
> > > # multipath -ll
> > > mpath2 (00040026_05:85)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [active]
> > >  \_ 1:0:0:2 sdc 8:32  [active][ready]
> > >  \_ 2:0:0:2 sdg 8:96  [active][ready]
> > > 
> > > mpath1 (00040026_05:84)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [active]
> > >  \_ 1:0:0:1 sdb 8:16  [active][ready]
> > >  \_ 2:0:0:1 sdf 8:80  [active][ready]
> > > 
> > > mpath0 (00040026_05:83)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [active]
> > >  \_ 1:0:0:0 sda 8:0   [active][ready]
> > >  \_ 2:0:0:0 sde 8:64  [active][ready]
> > > 
> > > mpath3 (00040026_05:86)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [active]
> > >  \_ 1:0:0:3 sdd 8:48  [active][ready]
> > >  \_ 2:0:0:3 sdh 8:112 [active][ready]
> > 
> > Content-Description: post_reboot.txt
> > > # dmesg
> > > Bootdata ok (command line is ro root=/dev/vg00/root rhgb quiet)
> > > Linux version 2.6.9-55.ELsmp (brewbuilder@hs20-bc2-4.build.redhat.com)
> > (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Fri Apr 20
> > 16:36:54 EDT 2007
> > > BIOS-provided physical RAM map:
> > >  BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
> > >  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
> > >  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
> > >  BIOS-e820: 0000000000100000 - 00000000bfff3000 (usable)
> > >  BIOS-e820: 00000000bfff3000 - 00000000bfffb000 (ACPI data)
> > >  BIOS-e820: 00000000bfffb000 - 00000000c0000000 (reserved)
> > >  BIOS-e820: 00000000fec00000 - 00000000fed00000 (reserved)
> > >  BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
> > >  BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
> > > ACPI: RSDP (v002 HP                                    ) @
> > 0x00000000000f4f00
> > > ACPI: XSDT (v001 HP     P51      0x00000002 ? 0x0000162e) @
> > 0x00000000bfff3300
> > > ACPI: FADT (v003 HP     P51      0x00000002 ? 0x0000162e) @
> > 0x00000000bfff3380
> > > ACPI: SPCR (v001 HP     SPCRRBSU 0x00000001 ? 0x0000162e) @
> > 0x00000000bfff3140
> > > ACPI: MCFG (v001 HP     ProLiant 0x00000001  0x00000000) @
> > 0x00000000bfff31c0
> > > ACPI: MADT (v001 HP     00000083 0x00000002  0x00000000) @
> > 0x00000000bfff3200
> > > ACPI: SSDT (v001 HP        SSDTP 0x00000001 INTL 0x20030228) @
> > 0x00000000bfff8000
> > > ACPI: DSDT (v001 HP         DSDT 0x00000001 INTL 0x20030228) @
> > 0x0000000000000000
> > > No NUMA configuration found
> > > Faking a node at 0000000000000000-00000000bfff3000
> > > Bootmem setup node 0 0000000000000000-00000000bfff3000
> > > On node 0 totalpages: 786419
> > >   DMA zone: 4096 pages, LIFO batch:1
> > >   Normal zone: 782323 pages, LIFO batch:16
> > >   HighMem zone: 0 pages, LIFO batch:1
> > > DMI 2.3 present.
> > > ACPI: PM-Timer IO Port: 0x908
> > > ACPI: Local APIC address 0xfee00000
> > > ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> > > Processor #0 15:4 APIC version 16
> > > ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
> > > ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
> > > ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
> > > Processor #6 15:4 APIC version 16
> > > ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> > > Processor #1 15:4 APIC version 16
> > > ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
> > > ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
> > > ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
> > > Processor #7 15:4 APIC version 16
> > > ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
> > > Setting APIC routing to flat
> > > ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
> > > IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
> > > ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
> > > IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
> > > ACPI: IOAPIC (id[0x0a] address[0xfec80400] gsi_base[48])
> > > IOAPIC[2]: apic_id 10, version 32, address 0xfec80400, GSI 48-71
> > > ACPI: IOAPIC (id[0x0b] address[0xfec84000] gsi_base[72])
> > > IOAPIC[3]: apic_id 11, version 32, address 0xfec84000, GSI 72-95
> > > ACPI: IOAPIC (id[0x0c] address[0xfec84400] gsi_base[96])
> > > IOAPIC[4]: apic_id 12, version 32, address 0xfec84400, GSI 96-119
> > > ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> > > ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> > > ACPI: IRQ0 used by override.
> > > ACPI: IRQ2 used by override.
> > > ACPI: IRQ9 used by override.
> > > Using ACPI (MADT) for SMP configuration information
> > > Allocating PCI resources starting at c4000000 (gap: c0000000:3ec00000)
> > > Checking aperture...
> > > Built 1 zonelists
> > > Kernel command line: ro root=/dev/vg00/root rhgb quiet console=tty0
> > > Initializing CPU#0
> > > PID hash table entries: 4096 (order: 12, 131072 bytes)
> > > time.c: Using 3.579545 MHz PM timer.
> > > time.c: Detected 3400.312 MHz processor.
> > > Console: colour VGA+ 80x25
> > > Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> > > Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> > > Memory: 3089236k/3145676k available (2112k kernel code, 0k reserved,
> > 1305k data, 208k init)
> > > Calibrating delay using timer specific routine.. 6807.48 BogoMIPS
> > (lpj=3403744)
> > > Security Scaffold v1.0.0 initialized
> > > SELinux:  Initializing.
> > > SELinux:  Starting in permissive mode
> > > There is already a security framework initialized, register_security
> > failed.
> > > selinux_register_security:  Registering secondary module capability
> > > Capability LSM initialized as secondary
> > > Mount-cache hash table entries: 256 (order: 0, 4096 bytes)
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > using mwait in idle threads.
> > > CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> > > Using IO APIC NMI watchdog
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> > > CPU0:                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > > per-CPU timeslice cutoff: 1023.90 usecs.
> > > task migration cache decay timeout: 1 msecs.
> > > Booting processor 1/6 rip 6000 rsp 10037e05f58
> > > Initializing CPU#1
> > > Calibrating delay using timer specific routine.. 6799.32 BogoMIPS
> > (lpj=3399660)
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU1: Initial APIC ID: 6, Physical Processor ID: 3
> > >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > > Booting processor 2/1 rip 6000 rsp 10037e3df58
> > > Initializing CPU#2
> > > Calibrating delay using timer specific routine.. 6799.31 BogoMIPS
> > (lpj=3399655)
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU2: Initial APIC ID: 1, Physical Processor ID: 0
> > >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > > Booting processor 3/7 rip 6000 rsp 100016f3f58
> > > Initializing CPU#3
> > > Calibrating delay using timer specific routine.. 6799.18 BogoMIPS
> > (lpj=3399591)
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU3: Initial APIC ID: 7, Physical Processor ID: 3
> > >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > > Total of 4 processors activated (27205.30 BogoMIPS).
> > > activating NMI Watchdog ... done.
> > > testing NMI watchdog ... OK.
> > > Using local APIC timer interrupts.
> > > Detected 12.501 MHz APIC timer.
> > > checking TSC synchronization across 4 CPUs: passed.
> > > Brought up 4 CPUs
> > > time.c: Using PIT/TSC based timekeeping.
> > > checking if image is initramfs... it is
> > > NET: Registered protocol family 16
> > > PCI: Using configuration type 1
> > > PCI: Using MMCONFIG at e0000000
> > > mtrr: v2.0 (20020519)
> > > mtrr: your CPUs had inconsistent fixed MTRR settings
> > > mtrr: probably your BIOS does not setup all CPUs.
> > > mtrr: corrected configuration.
> > > ACPI: Subsystem revision 20040816
> > > ACPI: Interpreter enabled
> > > ACPI: Using IOAPIC for interrupt routing
> > > ACPI: PCI Root Bridge [PCI0] (00:00)
> > > PCI: Probing PCI hardware (bus 00)
> > > PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
> > > PCI: PXH quirk detected, disabling MSI for SHPC device
> > > PCI: PXH quirk detected, disabling MSI for SHPC device
> > > PCI: PXH quirk detected, disabling MSI for SHPC device
> > > PCI: PXH quirk detected, disabling MSI for SHPC device
> > > PCI: Transparent bridge - 0000:00:1e.0
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.IP2P._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXA._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXB._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXC._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXD._PRT]
> > > ACPI: PCI Interrupt Link [LNKA] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKB] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKC] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKD] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKE] (IRQs 5 7 10 11) *0, disabled.
> > > ACPI: PCI Interrupt Link [LNKF] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKG] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKH] (IRQs *5 7 10 11)
> > > usbcore: registered new driver usbfs
> > > usbcore: registered new driver hub
> > > PCI: Using ACPI for IRQ routing
> > > GSI 16 sharing vector 0xA9 and IRQ 16
> > > ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 169
> > > ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 169
> > > ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
> > > GSI 17 sharing vector 0xB1 and IRQ 17
> > > ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
> > > GSI 18 sharing vector 0xB9 and IRQ 18
> > > ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
> > > ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
> > > GSI 19 sharing vector 0xC1 and IRQ 19
> > > ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
> > > ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> > > GSI 20 sharing vector 0xC9 and IRQ 20
> > > ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
> > > GSI 21 sharing vector 0xD1 and IRQ 21
> > > ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
> > > GSI 22 sharing vector 0xD9 and IRQ 22
> > > ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
> > > GSI 23 sharing vector 0xE1 and IRQ 23
> > > ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
> > > GSI 24 sharing vector 0xE9 and IRQ 24
> > > ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
> > > GSI 25 sharing vector 0x32 and IRQ 25
> > > ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
> > > GSI 26 sharing vector 0x3A and IRQ 26
> > > ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
> > > GSI 27 sharing vector 0x42 and IRQ 27
> > > ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
> > > GSI 28 sharing vector 0x4A and IRQ 28
> > > ACPI: PCI Interrupt 0000:01:04.0[A] -> GSI 21 (level, low) -> IRQ 74
> > > GSI 29 sharing vector 0x52 and IRQ 29
> > > ACPI: PCI Interrupt 0000:01:04.2[B] -> GSI 22 (level, low) -> IRQ 82
> > > PCI-DMA: Disabling IOMMU.
> > > IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
> > > audit: initializing netlink socket (disabled)
> > > audit(1201791896.599:1): initialized
> > > Total HugeTLB memory allocated, 0
> > > VFS: Disk quotas dquot_6.5.1
> > > Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
> > > SELinux:  Registering netfilter hooks
> > > Initializing Cryptographic API
> > > ksign: Installing public key data
> > > Loading keyring
> > > - Added public key B7CA3C9BE2FAFC39
> > > - User ID: Red Hat, Inc. (Kernel Module GPG key)
> > > pci_hotplug: PCI Hot Plug PCI Core version: 0.5
> > > ACPI: Processor [CPU0] (supports C1)
> > > ACPI: Processor [CPU1] (supports C1)
> > > ACPI: Processor [CPU2] (supports C1)
> > > ACPI: Processor [CPU3] (supports C1)
> > > ACPI: Thermal Zone [THM0] (8 C)
> > > Real Time Clock Driver v1.12
> > > Linux agpgart interface v0.100 (c) Dave Jones
> > > serio: i8042 AUX port at 0x60,0x64 irq 12
> > > serio: i8042 KBD port at 0x60,0x64 irq 1
> > > Serial: 8250/16550 driver $Revision: 1.90 $ 68 ports, IRQ sharing
> > enabled
> > > ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> > > ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> > > RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
> > > divert: not allocating divert_blk for non-ethernet device lo
> > > Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
> > > ide: Assuming 33MHz system bus speed for PIO modes; override with
> > idebus=xx
> > > ICH5: IDE controller at PCI slot 0000:00:1f.1
> > > PCI: Enabling device 0000:00:1f.1 (0005 -> 0007)
> > > ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> > > ICH5: chipset revision 2
> > > ICH5: not 100% native mode: will probe irqs later
> > >     ide0: BM-DMA at 0x0500-0x0507, BIOS settings: hda:DMA, hdb:pio
> > >     ide1: BM-DMA at 0x0508-0x050f, BIOS settings: hdc:pio, hdd:pio
> > > Probing IDE interface ide0...
> > > hda: DV-28E-N, ATAPI CD/DVD-ROM drive
> > > Using cfq io scheduler
> > > ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
> > > Probing IDE interface ide1...
> > > Probing IDE interface ide1...
> > > Probing IDE interface ide2...
> > > Probing IDE interface ide3...
> > > Probing IDE interface ide4...
> > > Probing IDE interface ide5...
> > > hda: ATAPI 24X DVD-ROM drive, 256kB Cache, UDMA(33)
> > > Uniform CD-ROM driver Revision: 3.20
> > > ide-floppy driver 0.99.newide
> > > usbcore: registered new driver hiddev
> > > usbcore: registered new driver usbhid
> > > drivers/usb/input/hid-core.c: v2.0:USB HID core driver
> > > mice: PS/2 mouse device common for all mice
> > > input: AT Translated Set 2 keyboard on isa0060/serio0
> > > input: PS/2 Generic Mouse on isa0060/serio1
> > > md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
> > > NET: Registered protocol family 2
> > > IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
> > > TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
> > > TCP bind hash table entries: 262144 (order: 10, 4194304 bytes)
> > > TCP: Hash tables configured (established 262144 bind 262144)
> > > Initializing IPsec netlink socket
> > > NET: Registered protocol family 1
> > > NET: Registered protocol family 17
> > > cpufreq: CPU0 - ACPI performance management activated.
> > > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > > cpufreq: CPU1 - ACPI performance management activated.
> > > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > > cpufreq: CPU2 - ACPI performance management activated.
> > > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > > cpufreq: CPU3 - ACPI performance management activated.
> > > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > > ACPI wakeup devices:
> > > 
> > > ACPI: (supports S0 S4 S5)
> > > Freeing unused kernel memory: 208k freed
> > > SCSI subsystem initialized
> > > HP CISS Driver (v 2.6.14.RH2)
> > > cciss: Device 0x46 has been found at bus 4 dev 3 func 0
> > > ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ 217
> > > cciss: using DAC cycles
> > >       blocks= 71122559 block_size= 512
> > >       heads= 255, sectors= 32, cylinders= 8716
> > > 
> > >       blocks= 71122559 block_size= 512
> > >       heads= 255, sectors= 32, cylinders= 8716
> > > 
> > >       blocks= 71122559 block_size= 512
> > >       heads= 255, sectors= 32, cylinders= 8716
> > > 
> > >  cciss/c0d0: p1 p2
> > >       blocks= 71122559 block_size= 512
> > >       heads= 255, sectors= 32, cylinders= 8716
> > > 
> > >  cciss/c0d1: unknown partition table
> > > device-mapper: 4.5.5-ioctl (2006-12-01) initialised:
> > dm-devel@redhat.com
> > > hda: packet command error: status=0x51 { DriveReady SeekComplete Error
> > }
> > > hda: packet command error: error=0x50
> > > ide: failed opcode was 100
> > > cdrom: open failed.
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > security:  3 users, 4 roles, 355 types, 26 bools
> > > security:  55 classes, 22610 rules
> > > SELinux:  Completing initialization.
> > > SELinux:  Setting up existing superblocks.
> > > SELinux: initialized (dev dm-0, type ext3), uses xattr
> > > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > > SELinux: initialized (dev selinuxfs, type selinuxfs), uses
> > genfs_contexts
> > > SELinux: initialized (dev mqueue, type mqueue), not configured for
> > labeling
> > > SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses
> > genfs_contexts
> > > SELinux: initialized (dev devpts, type devpts), uses transition SIDs
> > > SELinux: initialized (dev eventpollfs, type eventpollfs), uses
> > genfs_contexts
> > > SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
> > > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > > SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
> > > SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
> > > SELinux: initialized (dev proc, type proc), uses genfs_contexts
> > > SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
> > > SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
> > > SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
> > > SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
> > > libata version 2.00 loaded.
> > > Emulex LightPulse Fibre Channel SCSI driver 8.0.16.27
> > > Copyright(c) 2003-2006 Emulex.  All rights reserved.
> > > ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ 225
> > > lpfc 0000:06:02.0: 0:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> > > scsi0 : Emulex LP9002L-F2 2Gb PCI Fibre Channel Adapter on PCI bus 06
> > device 10 irq 225
> > > ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ 233
> > > lpfc 0000:07:04.0: 1:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> > > scsi1 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07
> > device 20 irq 233
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > > SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sda: drive cache: write back
> > > SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sda: drive cache: write back
> > >  sda: sda1
> > > Attached scsi disk sda at scsi1, channel 0, id 0, lun 0
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > > SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdb: drive cache: write back
> > > SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdb: drive cache: write back
> > >  sdb: unknown partition table
> > > Attached scsi disk sdb at scsi1, channel 0, id 0, lun 1
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > > SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdc: drive cache: write back
> > > SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdc: drive cache: write back
> > >  sdc: unknown partition table
> > > Attached scsi disk sdc at scsi1, channel 0, id 0, lun 2
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > > SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdd: drive cache: write back
> > > SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdd: drive cache: write back
> > >  sdd: unknown partition table
> > > Attached scsi disk sdd at scsi1, channel 0, id 0, lun 3
> > > ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ 50
> > > Losing some ticks... checking if CPU frequency changed.
> > > lpfc 0000:07:05.0: 2:1303 Link Up Event x1 received Data: x1 xf7 x8 x0
> > > scsi2 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07
> > device 28 irq 50
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > > SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sde: drive cache: write back
> > > SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sde: drive cache: write back
> > >  sde: sde1
> > > Attached scsi disk sde at scsi2, channel 0, id 0, lun 0
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > > SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdf: drive cache: write back
> > > SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdf: drive cache: write back
> > >  sdf: unknown partition table
> > > Attached scsi disk sdf at scsi2, channel 0, id 0, lun 1
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > > SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdg: drive cache: write back
> > > SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdg: drive cache: write back
> > >  sdg: unknown partition table
> > > Attached scsi disk sdg at scsi2, channel 0, id 0, lun 2
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision: 02
> > > SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdh: drive cache: write back
> > > SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdh: drive cache: write back
> > >  sdh: unknown partition table
> > > Attached scsi disk sdh at scsi2, channel 0, id 0, lun 3
> > > inserting floppy driver for 2.6.9-55.ELsmp
> > > Floppy drive(s): fd0 is 1.44M
> > > FDC 0 is a National Semiconductor PC87306
> > > Intel(R) PRO/1000 Network Driver - version 7.2.7-k2-NAPI
> > > Copyright (c) 1999-2006 Intel Corporation.
> > > ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ 58
> > > e1000: 0000:0a:01.0: e1000_probe: (PCI-X:133MHz:64-bit)
> > 00:11:0a:64:7e:da
> > > divert: allocating divert_blk for eth0
> > > e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
> > > ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ 66
> > > e1000: 0000:0a:01.1: e1000_probe: (PCI-X:133MHz:64-bit)
> > 00:11:0a:64:7e:db
> > > divert: allocating divert_blk for eth1
> > > e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
> > > tg3.c:v3.64-rh (July 31, 2006)
> > > ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ 201
> > > divert: allocating divert_blk for eth2
> > > eth2: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit)
> > 10/100/1000BaseT Ethernet 00:14:38:bf:5a:51
> > > eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] Split[0] WireSpeed[1]
> > TSOcap[0]
> > > eth2: dma_rwctrl[769f4000] dma_mask[64-bit]
> > > ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ 209
> > > divert: allocating divert_blk for eth3
> > > eth3: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit)
> > 10/100/1000BaseT Ethernet 00:14:38:bf:5a:50
> > > eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1]
> > TSOcap[1]
> > > eth3: dma_rwctrl[769f4000] dma_mask[64-bit]
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > hw_random hardware driver 1.0.0 loaded
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 193
> > > ehci_hcd 0000:00:1d.7: EHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.7 to 64
> > > ehci_hcd 0000:00:1d.7: irq 193, pci mem ffffff0010086000
> > > SELinux: initialized (dev usbdevfs, type usbdevfs), uses
> > genfs_contexts
> > > ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
> > > PCI: cache line size of 128 is not supported by device 0000:00:1d.7
> > > ehci_hcd 0000:00:1d.7: USB 2.0 enabled, EHCI 1.00, driver 2004-May-10
> > > hub 1-0:1.0: USB hub found
> > > hub 1-0:1.0: 8 ports detected
> > > USB Universal Host Controller Interface driver v2.2
> > > ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
> > > uhci_hcd 0000:00:1d.0: UHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.0 to 64
> > > uhci_hcd 0000:00:1d.0: irq 169, io base 0000000000002000
> > > uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
> > > hub 2-0:1.0: USB hub found
> > > hub 2-0:1.0: 2 ports detected
> > > ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 177
> > > uhci_hcd 0000:00:1d.1: UHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.1 to 64
> > > uhci_hcd 0000:00:1d.1: irq 177, io base 0000000000002020
> > > uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
> > > hub 3-0:1.0: USB hub found
> > > hub 3-0:1.0: 2 ports detected
> > > ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 185
> > > uhci_hcd 0000:00:1d.2: UHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.2 to 64
> > > uhci_hcd 0000:00:1d.2: irq 185, io base 0000000000002040
> > > uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
> > > hub 4-0:1.0: USB hub found
> > > hub 4-0:1.0: 2 ports detected
> > > ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ 169
> > > uhci_hcd 0000:00:1d.3: UHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.3 to 64
> > > uhci_hcd 0000:00:1d.3: irq 169, io base 0000000000002060
> > > uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
> > > hub 5-0:1.0: USB hub found
> > > hub 5-0:1.0: 2 ports detected
> > > md: Autodetecting RAID arrays.
> > > md: autorun ...
> > > md: ... autorun DONE.
> > > ACPI: Power Button (FF) [PWRF]
> > > EXT3 FS on dm-0, internal journal
> > > device-mapper: dm-multipath version 1.0.5 loaded
> > > device-mapper: dm-round-robin version 1.0.0 loaded
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on cciss/c0d0p1, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev cciss/c0d0p1, type ext3), uses xattr
> > > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-1, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-1, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-2, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-2, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-3, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-3, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-4, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-4, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-5, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-5, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-6, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-6, type ext3), uses xattr
> > > Adding 2097144k swap on /dev/vg00/swap1.  Priority:-1 extents:1
> > > SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses
> > genfs_contexts
> > > IA-32 Microcode Update Driver: v1.14 <tigran@veritas.com>
> > > microcode: CPU0 already at revision 0x12 (current=0x12)
> > > microcode: CPU1 already at revision 0x12 (current=0x12)
> > > microcode: CPU2 already at revision 0x12 (current=0x12)
> > > microcode: CPU3 already at revision 0x12 (current=0x12)
> > > microcode: No new microdata for cpu 1
> > > microcode: No new microdata for cpu 2
> > > microcode: No new microdata for cpu 0
> > > microcode: No new microdata for cpu 3
> > > IA-32 Microcode Update Driver v1.14 unregistered
> > > ip_tables: (C) 2000-2002 Netfilter core team
> > > ip_conntrack version 2.1 (8192 buckets, 65536 max) - 456 bytes per
> > conntrack
> > > e1000: eth1: e1000_watchdog_task: NIC Link is Up 100 Mbps Half Duplex
> > > i2c /dev entries driver
> > > NET: Registered protocol family 10
> > > Disabled Privacy Extensions on device ffffffff80408540(lo)
> > > IPv6 over IPv4 tunneling driver
> > > divert: not allocating divert_blk for non-ethernet device sit0
> > > eth1: no IPv6 routers present
> > > 
> > > 
> > > # cat /var/log/boot.log
> > > Jan 31 15:02:31 corux38 syslog: syslogd startup succeeded
> > > Jan 31 15:02:31 corux38 syslog: klogd startup succeeded
> > > Jan 31 15:02:31 corux38 irqbalance: irqbalance startup succeeded
> > > Jan 31 15:02:31 corux38 multipathd: multipathd startup succeeded
> > > Jan 31 15:02:31 corux38 portmap: portmap startup succeeded
> > > Jan 31 15:02:32 corux38 rc: Starting lm_sensors:  succeeded
> > > Jan 31 15:02:32 corux38 xinetd: xinetd startup succeeded
> > > Jan 31 15:02:32 corux38 ntpd: ntpd startup succeeded
> > > Jan 31 15:02:32 corux38 vsftpd: vsftpd vsftpd succeeded
> > > Jan 31 15:02:33 corux38 ssh-server-g3: Starting ssh-server-g3
> > > Jan 31 10:01:59 corux38 rc.sysinit: -e
> > > Jan 31 10:02:01 corux38 start_udev: Starting udev:  succeeded
> > > Jan 31 10:02:25 corux38 rc.sysinit: -e
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.ip_forward = 0
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> > > Jan 31 10:02:25 corux38 sysctl:
> > net.ipv4.conf.default.accept_source_route = 0
> > > Jan 31 10:02:25 corux38 sysctl: kernel.sysrq = 0
> > > Jan 31 10:02:25 corux38 sysctl: kernel.core_uses_pid = 1
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_source_route
> > = 0
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.accept_redirects
> > = 0
> > > Jan 31 10:02:25 corux38 sysctl: fs.file-max = 524288
> > > Jan 31 10:02:25 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > > Jan 31 10:02:25 corux38 rc.sysinit: Configuring kernel parameters:
> > succeeded
> > > Jan 31 15:02:26 corux38 date: Thu Jan 31 15:02:26 EST 2008
> > > Jan 31 15:02:26 corux38 rc.sysinit: Setting clock  (localtime): Thu
> > Jan 31 15:02:26 EST 2008 succeeded
> > > Jan 31 15:02:26 corux38 rc.sysinit: Loading default keymap succeeded
> > > Jan 31 15:02:26 corux38 rc.sysinit: Setting hostname corux38:
> > succeeded
> > > Jan 31 15:02:26 corux38 fsck: /dev/vg00/root: clean, 4335/131072
> > files, 48559/262144 blocks
> > > Jan 31 15:02:26 corux38 rc.sysinit: Checking root filesystem succeeded
> > > Jan 31 15:02:26 corux38 rc.sysinit: Remounting root filesystem in
> > read-write mode:  succeeded
> > > Jan 31 15:02:26 corux38 lvm.static:   8 logical volume(s) in volume
> > group vg00 now active
> > > Jan 31 15:02:26 corux38 rc.sysinit: Setting up Logical Volume
> > Management: succeeded
> > > Jan 31 15:02:26 corux38 fsck: /boot: clean, 38/26104 files,
> > 17822/104388 blocks
> > > Jan 31 15:02:26 corux38 fsck: /dev/vg00/home: clean, 132/262144 files,
> > 20580/524288 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files,
> > 36957/1048576 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files,
> > 13541/262144 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/usr: clean, 30250/524288
> > files, 169645/1048576 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368
> > files, 17525/540672 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files,
> > 49124/2097152 blocks
> > > Jan 31 15:02:27 corux38 rc.sysinit: Checking filesystems succeeded
> > > Jan 31 15:02:27 corux38 rc.sysinit: Mounting local filesystems:
> > succeeded
> > > Jan 31 15:02:27 corux38 rc.sysinit: Enabling swap space:  succeeded
> > > Jan 31 15:02:28 corux38 microcode_ctl: microcode_ctl startup succeeded
> > > Jan 31 15:02:36 corux38 ssh-server-g3: done.
> > > Jan 31 15:02:28 corux38 vgchange:   8 logical volume(s) in volume
> > group "vg00" monitored
> > > Jan 31 15:02:36 corux38 rc: Starting ssh-server-g3:  succeeded
> > > Jan 31 15:02:28 corux38 lvm2-monitor: Starting monitoring for VG vg00:
> > succeeded
> > > Jan 31 15:02:36 corux38 crond: crond startup succeeded
> > > Jan 31 15:02:28 corux38 cpuspeed: cpuspeed startup succeeded
> > > Jan 31 15:02:28 corux38 iptables:  succeeded
> > > Jan 31 15:02:36 corux38 atd: atd startup succeeded
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.ip_forward = 0
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> > > Jan 31 15:02:36 corux38 messagebus: messagebus startup succeeded
> > > Jan 31 15:02:29 corux38 sysctl:
> > net.ipv4.conf.default.accept_source_route = 0
> > > Jan 31 15:02:29 corux38 sysctl: kernel.sysrq = 0
> > > Jan 31 15:02:29 corux38 sysctl: kernel.core_uses_pid = 1
> > > Jan 31 15:02:36 corux38 haldaemon: haldaemon startup succeeded
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route
> > = 0
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects
> > = 0
> > > Jan 31 15:02:29 corux38 sysctl: fs.file-max = 524288
> > > Jan 31 15:02:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > > Jan 31 15:02:29 corux38 network: Setting network parameters:
> > succeeded
> > > Jan 31 15:02:29 corux38 network: Bringing up loopback interface:
> > succeeded
> > > Jan 31 15:02:31 corux38 network: Bringing up interface eth1:
> > succeeded
> > > Jan 31 15:03:08 corux38 haldaemon: haldaemon -TERM succeeded
> > > Jan 31 15:03:08 corux38 messagebus: messagebus -TERM succeeded
> > > Jan 31 15:03:08 corux38 atd: atd shutdown succeeded
> > > Jan 31 15:03:09 corux38 vsftpd: vsftpd shutdown succeeded
> > > Jan 31 15:03:09 corux38 xinetd: xinetd shutdown succeeded
> > > Jan 31 15:03:09 corux38 crond: crond shutdown succeeded
> > > Jan 31 15:03:09 corux38 ntpd: ntpd shutdown succeeded
> > > Jan 31 15:03:09 corux38 irqbalance: irqbalance shutdown succeeded
> > > Jan 31 15:03:09 corux38 multipathd: multipathd shutdown succeeded
> > > Jan 31 15:03:09 corux38 portmap: portmap shutdown succeeded
> > > Jan 31 15:05:36 corux38 syslog: syslogd startup succeeded
> > > Jan 31 15:05:36 corux38 syslog: klogd startup succeeded
> > > Jan 31 15:05:37 corux38 irqbalance: irqbalance startup succeeded
> > > Jan 31 15:05:37 corux38 multipathd: multipathd startup succeeded
> > > Jan 31 15:05:37 corux38 portmap: portmap startup succeeded
> > > Jan 31 15:05:37 corux38 rc: Starting lm_sensors:  succeeded
> > > Jan 31 15:05:37 corux38 xinetd: xinetd startup succeeded
> > > Jan 31 15:05:37 corux38 ntpd: ntpd startup succeeded
> > > Jan 31 15:05:38 corux38 vsftpd: vsftpd vsftpd succeeded
> > > Jan 31 15:05:38 corux38 ssh-server-g3: Starting ssh-server-g3
> > > Jan 31 10:05:03 corux38 rc.sysinit: -e
> > > Jan 31 10:05:05 corux38 start_udev: Starting udev:  succeeded
> > > Jan 31 10:05:29 corux38 rc.sysinit: -e
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.ip_forward = 0
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> > > Jan 31 10:05:29 corux38 sysctl:
> > net.ipv4.conf.default.accept_source_route = 0
> > > Jan 31 10:05:29 corux38 sysctl: kernel.sysrq = 0
> > > Jan 31 10:05:29 corux38 sysctl: kernel.core_uses_pid = 1
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_source_route
> > = 0
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.accept_redirects
> > = 0
> > > Jan 31 10:05:29 corux38 sysctl: fs.file-max = 524288
> > > Jan 31 10:05:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > > Jan 31 10:05:29 corux38 rc.sysinit: Configuring kernel parameters:
> > succeeded
> > > Jan 31 15:05:30 corux38 date: Thu Jan 31 15:05:30 EST 2008
> > > Jan 31 15:05:30 corux38 rc.sysinit: Setting clock  (localtime): Thu
> > Jan 31 15:05:30 EST 2008 succeeded
> > > Jan 31 15:05:30 corux38 rc.sysinit: Loading default keymap succeeded
> > > Jan 31 15:05:30 corux38 rc.sysinit: Setting hostname corux38:
> > succeeded
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/root: clean, 4335/131072
> > files, 48559/262144 blocks
> > > Jan 31 15:05:30 corux38 rc.sysinit: Checking root filesystem succeeded
> > > Jan 31 15:05:30 corux38 rc.sysinit: Remounting root filesystem in
> > read-write mode:  succeeded
> > > Jan 31 15:05:30 corux38 lvm.static:   8 logical volume(s) in volume
> > group vg00 now active
> > > Jan 31 15:05:30 corux38 rc.sysinit: Setting up Logical Volume
> > Management: succeeded
> > > Jan 31 15:05:30 corux38 fsck: /boot: clean, 38/26104 files,
> > 17822/104388 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/home: clean, 132/262144 files,
> > 20580/524288 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/opt: clean, 83/524288 files,
> > 36957/1048576 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/tmp: clean, 34/131072 files,
> > 13541/262144 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/usr: clean, 30250/524288
> > files, 169645/1048576 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368
> > files, 17525/540672 blocks
> > > Jan 31 15:05:31 corux38 fsck: /dev/vg00/var: clean, 395/1048576 files,
> > 49141/2097152 blocks
> > > Jan 31 15:05:31 corux38 rc.sysinit: Checking filesystems succeeded
> > > Jan 31 15:05:31 corux38 rc.sysinit: Mounting local filesystems:
> > succeeded
> > > Jan 31 15:05:31 corux38 rc.sysinit: Enabling swap space:  succeeded
> > > Jan 31 15:05:32 corux38 microcode_ctl: microcode_ctl startup succeeded
> > > Jan 31 15:05:32 corux38 vgchange:   8 logical volume(s) in volume
> > group "vg00" monitored
> > > Jan 31 15:05:32 corux38 lvm2-monitor: Starting monitoring for VG vg00:
> > succeeded
> > > Jan 31 15:05:41 corux38 ssh-server-g3: done.
> > > Jan 31 15:05:32 corux38 cpuspeed: cpuspeed startup succeeded
> > > Jan 31 15:05:41 corux38 rc: Starting ssh-server-g3:  succeeded
> > > Jan 31 15:05:32 corux38 iptables:  succeeded
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.ip_forward = 0
> > > Jan 31 15:05:41 corux38 crond: crond startup succeeded
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.rp_filter = 1
> > > Jan 31 15:05:41 corux38 atd: atd startup succeeded
> > > Jan 31 15:05:32 corux38 sysctl:
> > net.ipv4.conf.default.accept_source_route = 0
> > > Jan 31 15:05:32 corux38 sysctl: kernel.sysrq = 0
> > > Jan 31 15:05:32 corux38 sysctl: kernel.core_uses_pid = 1
> > > Jan 31 15:05:42 corux38 messagebus: messagebus startup succeeded
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_source_route
> > = 0
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_max_syn_backlog = 4096
> > > Jan 31 15:05:42 corux38 haldaemon: haldaemon startup succeeded
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_redirects = 0
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.accept_redirects
> > = 0
> > > Jan 31 15:05:32 corux38 sysctl: fs.file-max = 524288
> > > Jan 31 15:05:32 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > > Jan 31 15:05:32 corux38 network: Setting network parameters:
> > succeeded
> > > Jan 31 15:05:32 corux38 network: Bringing up loopback interface:
> > succeeded
> > > Jan 31 15:05:36 corux38 network: Bringing up interface eth1:
> > succeeded
> > > 
> > > 
> > > # multipath -ll
> > > mpath1 (00040026_05:84)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [enabled]
> > >  \_ 2:0:0:1 sdf 8:80  [active][ready]
> > >  \_ 1:0:0:1 sdb 8:16  [active][ready]
> > > 
> > > mpath0 (00040026_05:83)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [enabled]
> > >  \_ 2:0:0:0 sde 8:64  [active][ready]
> > >  \_ 1:0:0:0 sda 8:0   [active][ready]
> > Content-Description: manual_run.txt
> > 
> > > --
> > > dm-devel mailing list
> > > dm-devel@redhat.com
> > > https://www.redhat.com/mailman/listinfo/dm-devel
> > 
> > --
> > dm-devel mailing list
> > dm-devel@redhat.com
> > https://www.redhat.com/mailman/listinfo/dm-devel
> 
> Content-Description: multipath_boot_log.txt
> > %%
> > %% running multipath from rc.sysinit
> > %%
> > load path identifiers cache
> > ux_socket_connect error
> > #
> > # all paths in cache :
> > #
> > cciss!c0d0 blacklisted
> > cciss!c0d1 blacklisted
> > dm-0 blacklisted
> > dm-1 blacklisted
> > dm-2 blacklisted
> > dm-3 blacklisted
> > dm-4 blacklisted
> > dm-5 blacklisted
> > dm-6 blacklisted
> > dm-7 blacklisted
> > fd0 blacklisted
> > hda blacklisted
> > md0 blacklisted
> > ram0 blacklisted
> > ram10 blacklisted
> > ram11 blacklisted
> > ram12 blacklisted
> > ram13 blacklisted
> > ram14 blacklisted
> > ram15 blacklisted
> > ram1 blacklisted
> > ram2 blacklisted
> > ram3 blacklisted
> > ram4 blacklisted
> > ram5 blacklisted
> > ram6 blacklisted
> > ram7 blacklisted
> > ram8 blacklisted
> > ram9 blacklisted
> > path sda not found in pathvec
> > 
> > ===== path info sda (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:0
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 1:0:0:0
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026 
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > getuid = /etc/xpdisk %n (controler setting)
> > uid = 00040026_05:83 (callout)
> > path sdb not found in pathvec
> > 
> > ===== path info sdb (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:16
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 1:0:0:1
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026 
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > getuid = /etc/xpdisk %n (controler setting)
> > uid = 00040026_05:84 (callout)
> > path sdc not found in pathvec
> > 
> > ===== path info sdc (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:32
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 1:0:0:2
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026 
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > getuid = /etc/xpdisk %n (controler setting)
> > uid = 00040026_05:85 (callout)
> > path sdd not found in pathvec
> > 
> > ===== path info sdd (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:48
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 1:0:0:3
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026 
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > getuid = /etc/xpdisk %n (controler setting)
> > uid = 00040026_05:86 (callout)
> > path sde not found in pathvec
> > 
> > ===== path info sde (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:64
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 2:0:0:0
> > tgt_node_name = 0x50060e80039c5a14
> > path sdf not found in pathvec
> > 
> > ===== path info sdf (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:80
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 2:0:0:1
> > tgt_node_name = 0x50060e80039c5a14
> > path sdg not found in pathvec
> > 
> > ===== path info sdg (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:96
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 2:0:0:2
> > tgt_node_name = 0x50060e80039c5a14
> > path sdh not found in pathvec
> > 
> > ===== path info sdh (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:112
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 2:0:0:3
> > tgt_node_name = 0x50060e80039c5a14
> > #
> > # all paths :
> > #
> > 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E          /2114
> > 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E          /2114
> > 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E          /2114
> > 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E          /2114
> >   2:0:0:0 sde 8:64  [faulty] HP      /OPEN-E          /2114
> >   2:0:0:1 sdf 8:80  [faulty] HP      /OPEN-E          /2114
> >   2:0:0:2 sdg 8:96  [faulty] HP      /OPEN-E          /2114
> >   2:0:0:3 sdh 8:112  [faulty] HP      /OPEN-E          /2114
> > Found matching wwid [00040026_05:83] in bindings file.
> > Setting alias to mpath1
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:0 100
> > set ACT_CREATE: map does not exists
> > message mpath1 0 switch_group 1
> > 
> > create: mpath1 (00040026_05:83)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:0 sda 8:0   [ready]
> > 
> > reloading features
> > Found matching wwid [00040026_05:84] in bindings file.
> > Setting alias to mpath2
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:16 100
> > set ACT_CREATE: map does not exists
> > message mpath2 0 switch_group 1
> > 
> > create: mpath2 (00040026_05:84)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:1 sdb 8:16  [ready]
> > 
> > reloading features
> > Found matching wwid [00040026_05:85] in bindings file.
> > Setting alias to mpath3
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:32 100
> > set ACT_CREATE: map does not exists
> > message mpath3 0 switch_group 1
> > 
> > create: mpath3 (00040026_05:85)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:2 sdc 8:32  [ready]
> > 
> > reloading features
> > Found matching wwid [00040026_05:86] in bindings file.
> > Setting alias to mpath4
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:48 100
> > set ACT_CREATE: map does not exists
> > message mpath4 0 switch_group 1
> > 
> > create: mpath4 (00040026_05:86)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:3 sdd 8:48  [ready]
> > 
> > reloading features
> > %%
> > %% running multipath.dev
> > %%
> > add /block/sdh
> > %%
> > %% running multipath.dev
> > %%
> > add /block/md0
> > %%
> > %% running multipath.dev
> > %%
> > add /block/sdg
> > %%
> > %% running multipath.dev
> > %%
> > add /block/sde
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-8
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-9
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-10
> > %%
> > %% running multipath.dev
> > %%
> > add /block/sdf
> > %%
> > %% running multipath.dev
> > %%
> > add /block/fd0
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-11
> > %%
> > %% running multipath from rc.local
> > %%
> > create: mpath2 (00040026_05:85)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:2 sdc 8:32  [ready]
> >  \_ 2:0:0:2 sdg 8:96  [ready]
> > 
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-10
> 
> > --
> > dm-devel mailing list
> > dm-devel@redhat.com
> > https://www.redhat.com/mailman/listinfo/dm-devel

> diff -urpN multipath-tools/libmultipath/discovery.c multipath-tools-patched/libmultipath/discovery.c
> --- multipath-tools/libmultipath/discovery.c	2008-02-12 14:00:38.000000000 -0600
> +++ multipath-tools-patched/libmultipath/discovery.c	2008-02-15 09:28:32.000000000 -0600
> @@ -170,11 +170,6 @@ path_discovery (vector pathvec, struct c
>  	return r;
>  }
> 
> -/*
> - * the daemon can race udev upon path add,
> - * not multipath(8), ran by udev
> - */
> -#if DAEMON
>  #define WAIT_MAX_SECONDS 5
>  #define WAIT_LOOP_PER_SECOND 5
> 
> @@ -197,13 +192,6 @@ wait_for_file (char * filename)
>  	}
>  	return 1;
>  }
> -#else
> -static int
> -wait_for_file (char * filename)
> -{
> -	return 0;
> -}
> -#endif
> 
>  #define declare_sysfs_get_str(fname, fmt) \
>  extern int \

> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

RE: Multipath not rebuilding correctly on reboot

[Greene, Rick]

Quick question...what RPM would I find udevsettle in? Doesn't appear to
be installed on my system (RedHat Enterprise Linux 4), nor can I find
reference to it on RedHat's site.

Thanks,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of malahal@us.ibm.com
Sent: Sunday, February 17, 2008 2:47 AM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath not rebuilding correctly on reboot

Will udevsettle help here? Calling "udevsettle --timeout=60" prior to
calling multipath.static in rc.sysinit may help.

--Malahal.

Benjamin Marzinski [bmarzins@redhat.com] wrote:
> On Thu, Feb 14, 2008 at 01:40:53PM -0500, Greene, Rick wrote:
> > I tried Benjamin's suggestions, and with a little poking around I
> > basically got nowhere.
> > 
> > I did have to make one other adjustment to the system, I modified
> > /etc/lvm/lvm.conf to only try activating the vg00 volume group
(local
> > disk) and not the vgftp volume group (built on the disk running
through
> > multipath).
> > 
> > I'm still left with the same state, it takes that extra "multipath
-v 2"
> > to get everything fully activated.  I do have that in rc.local at
the
> > moment, but I'm hoping someone can figure out what is going on so I
> > don't have to have that extra step.
> > 
> > Attached is the log file generated during the boot process,
including
> > the results of the extra step.  If you look for lines starting with
%%,
> > you'll see comments showing what has generated each section of the
long.
> > 
> > Any further advice greatly appreciated,
> 
> It seems that all your paths appear early enough to be managed by
> rc.sysint.  However, looking at the path info output for sde, sdf,
sdg,
> and sdh, it looks like multipath can't open their device nodes.  I'm
> assuming that it's because udev hasn't created them yet.  In upstream
> and RHEL5 there is code to wait up to five seconds for the device node
> to be created.  In RHEL4, that code is only run by multipathd. I can't
> be sure that this is the cause of your problems, but it seems very
likely.
> 
> Besides putting sleeps into rc.sysinit, there's not much that can be
> done without patching the code.  If you are willing to patch the
source
> yourself, I've attached a patch.  Otherwise, I can build a test rpm,
> although maybe not till early next week, send out a link to it.
> 
> Hope this helps
> -Ben
> 
> ===== path info sdh (mask 0x1f) =====
> bus = 1
> dev_t = 8:112
> size = 28452960
> vendor = HP      
> product = OPEN-E          
> rev = 2114
> h:b:t:l = 2:0:0:3
> tgt_node_name = 0x50060e80039c5a14
> #
> # all paths :
> #
> 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E
/2114
> 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E
/2114
> 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E
/2114
> 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E
/2114
>   2:0:0:0 sde 8:64  [faulty] HP      /OPEN-E          /2114
>   2:0:0:1 sdf 8:80  [faulty] HP      /OPEN-E          /2114
>   2:0:0:2 sdg 8:96  [faulty] HP      /OPEN-E          /2114
>   2:0:0:3 sdh 8:112  [faulty] HP      /OPEN-E          /2114
> 
> > Rick
> > 
> > -----Original Message-----
> > From: dm-devel-bounces@redhat.com
[mailto:dm-devel-bounces@redhat.com]
> > On Behalf Of Benjamin Marzinski
> > Sent: Tuesday, February 12, 2008 5:22 PM
> > To: device-mapper development
> > Subject: Re: [dm-devel] Multipath not rebuilding correctly on reboot
> > 
> > On Thu, Jan 31, 2008 at 03:20:04PM -0500, Greene, Rick wrote:
> > > Now that I seem to have multipath and my XP 1024 working together,
> > I've
> > > found a new issue.  Someone recently had a similar thread going,
but I
> > > saw no ultimate resolution.
> > > 
> > > My problem is that when I reboot my server, the multipath
> > configuration
> > > is not coming back the way it was before.  I moved the two
external
> > > tools I use to find the UID into /etc (they had bin in /usr/bin
and
> > > /sbin), updated the multipath.conf file (and one of the scripts)
to
> > > reflect this, but odd things are still happening.
> > > 
> > > Attached is initial_view.txt, which shows what multipath is coming
up
> > > with when I do the commands shown (the bulk of the file is
multipath
> > -v3
> > > output, but at the bottom of the file is a multipath -ll output as
> > > well).  It (seems to) correctly shows that I have 4 disks, each
> > visible
> > > via two separate paths.
> > > 
> > > After I reboot, however, I get different results.  Once it showed
4
> > > paths for mpath0, and 2 paths for mpath1, 2, and 3.  Next time it
> > > correctly showed mpath0, mpath1, and mpath3, but didn't show
mpath2 at
> > > all.  On the next attempt I got everything correct, and the very
next
> > > one only showed mpath0 and mpath1.
> > > 
> > > The post_reboot.txt file shows the contents of the
/var/log/boot.log
> > > file and the output of the dmesg command, along with the
"multipath
> > -ll"
> > > view from the most recent reboot.
> > > 
> > > I then manually did a "multipath -v2" and the missing two paths
then
> > > came back.  The file manual_run.txt shows those results plus the
> > updated
> > > "multipath -ll".
> > > 
> > > Do I need to just make my own /etc/init.d script to do a
"multipath
> > -v2"
> > > at the end of booting to make sure it all gets covered, along with
the
> > > requisite LVM & mount commands to get the VG that is on these
disks
> > > working right?
> > 
> > Hopefully, you can just add the line
> > 
> > multipath -v 0 
> > 
> > to /etc/rc.local and fix this.  However, if you want to dig into
> > what's going wrong:
> > 
> > There are two places were multipath gets called to create devices
during
> > bootup.  One is in /etc/rc.sysinit and one in
> > /etc/dev.d/block/multipath.dev.  /etc/rc.sysinit will always be run
as
> > one of the first things during the boot process, and it just calls
> > multipath.static -v 0, which should correctly set up multipath
devices
> > on all of the available paths.  /etc/dev.d/block/multipath.dev gets
> > called by udev, and is a lot more suspect.
> > 
> > If you feel confortable editting boot scripts, you can do some
debugging
> > to figure out what's going on.
> > 
> > in /etc/rc.sysinit (assuming you aren't using md or raid), you can
> > change
> > the first line with:
> > /sbin/multipath.static -v 0
> > to:
> > /sbin/multipath.static -v 3 >> /tmp/multipath_boot_log 2>&1
> > 
> > the other lines that call multipath.static are only run if you have
> > the files /etc/raidtab or /etc/mdadm.conf, which you probably don't.
> > 
> > in /etc/dev.d/block/multipath.dev just add the following line right
> > after the #!/bin/sh line:
> > 
> > echo "${ACTION} ${DEVPATH}" >> /tmp/multipath_boot_log
> > 
> > Then reboot and look at /tmp/multipath_boot_log
> > 
> > You should see something that looks like the output of running
> > # multipath -v 3
> > along with a bunch of lines like:
> > 
> > add /block/md0
> > add /block/loop1
> > add /block/loop0
> > add /block/dm-7
> > 
> > The multipath run is from rc.sysinit, and the "add" lines are
devices
> > that udev is trying to create a multipath device on.  On systems
where
> > everthing comes up fine during boot up, all of the devices that
aren't
> > dealt with by the multipath call in rc.sysinit should be added by
udev.
> > 
> > I'm assuming that this won't be the case on your box. If udev isn't
> > running /etc/dev.d/block/multipath.dev, there's not much you can do
> > to fix it, besides filing a bug against udev.  However you may be
able
> > to
> > make it more likely that your scsi devices will all be up by the
time
> > rc.sysinit is run.  If your device drivers aren't getting loaded by
the
> > initrd, you can add them to /etc/modprobe.conf, run mkinitrd.  If
you do
> > this, it's always wise to back up your existing initrd, and make
sure
> > that grub can boot with it.
> > 
> > Otherwise, just try adding the line to rc.local
> > 
> > Hope this helps
> > 
> > -Ben
> >  
> > > Thanks in advance,
> > > Rick
> > > 
> > > 
> > > 
> > 
> > Content-Description: initial_view.txt
> > > # service multipathd stop
> > > # multipath -F
> > > # service multipathd start
> > > # multipath -v3
> > > load path identifiers cache
> > > #
> > > # all paths in cache :
> > > #
> > > 00040026_05:83  1:0:0:0 sda 8:0   HP      /OPEN-E          /2114
> > > 00040026_05:84  1:0:0:1 sdb 8:16   HP      /OPEN-E          /2114
> > > 00040026_05:85  1:0:0:2 sdc 8:32   HP      /OPEN-E          /2114
> > > 00040026_05:86  1:0:0:3 sdd 8:48   HP      /OPEN-E          /2114
> > > 00040026_05:83  2:0:0:0 sde 8:64   HP      /OPEN-E          /2114
> > > 00040026_05:84  2:0:0:1 sdf 8:80   HP      /OPEN-E          /2114
> > > 00040026_05:85  2:0:0:2 sdg 8:96   HP      /OPEN-E          /2114
> > > 00040026_05:86  2:0:0:3 sdh 8:112   HP      /OPEN-E          /2114
> > > cciss!c0d0 blacklisted
> > > cciss!c0d1 blacklisted
> > > dm-0 blacklisted
> > > dm-1 blacklisted
> > > dm-2 blacklisted
> > > dm-3 blacklisted
> > > dm-4 blacklisted
> > > dm-5 blacklisted
> > > dm-6 blacklisted
> > > dm-7 blacklisted
> > > fd0 blacklisted
> > > hda blacklisted
> > > md0 blacklisted
> > > ram0 blacklisted
> > > ram10 blacklisted
> > > ram11 blacklisted
> > > ram12 blacklisted
> > > ram13 blacklisted
> > > ram14 blacklisted
> > > ram15 blacklisted
> > > ram1 blacklisted
> > > ram2 blacklisted
> > > ram3 blacklisted
> > > ram4 blacklisted
> > > ram5 blacklisted
> > > ram6 blacklisted
> > > ram7 blacklisted
> > > ram8 blacklisted
> > > ram9 blacklisted
> > > ===== path info sda (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:0
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 1:0:0:0
> > > tgt_node_name = 0x50060e80039c5a04
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:83 (cache)
> > > ===== path info sdb (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:16
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 1:0:0:1
> > > tgt_node_name = 0x50060e80039c5a04
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:84 (cache)
> > > ===== path info sdc (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:32
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 1:0:0:2
> > > tgt_node_name = 0x50060e80039c5a04
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:85 (cache)
> > > ===== path info sdd (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:48
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 1:0:0:3
> > > tgt_node_name = 0x50060e80039c5a04
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:86 (cache)
> > > ===== path info sde (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:64
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 2:0:0:0
> > > tgt_node_name = 0x50060e80039c5a14
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:83 (cache)
> > > ===== path info sdf (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:80
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 2:0:0:1
> > > tgt_node_name = 0x50060e80039c5a14
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:84 (cache)
> > > ===== path info sdg (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:96
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 2:0:0:2
> > > tgt_node_name = 0x50060e80039c5a14
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:85 (cache)
> > > ===== path info sdh (mask 0x1f) =====
> > > bus = 1
> > > dev_t = 8:112
> > > size = 28452960
> > > vendor = HP
> > > product = OPEN-E
> > > rev = 2114
> > > h:b:t:l = 2:0:0:3
> > > tgt_node_name = 0x50060e80039c5a14
> > > serial = 40026
> > > path checker = tur (controler setting)
> > > state = 2
> > > getprio = /bin/true (internal default)
> > > prio = 0
> > > uid = 00040026_05:86 (cache)
> > > #
> > > # all paths :
> > > #
> > > 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:83  2:0:0:0 sde 8:64  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:84  2:0:0:1 sdf 8:80  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:85  2:0:0:2 sdg 8:96  [ready] HP      /OPEN-E
> > /2114
> > > 00040026_05:86  2:0:0:3 sdh 8:112  [ready] HP      /OPEN-E
> > /2114
> > > Initialized new bindings file [/var/lib/multipath/bindings]
> > > No matching wwid [00040026_05:83] in bindings file.
> > > Created new binding [mpath0] for WWID [00040026_05:83]
> > > pgpolicy = multibus (controler setting)
> > > selector = round-robin 0 (internal default)
> > > features = 0 (internal default)
> > > hwhandler = 0 (internal default)
> > > rr_weight = 2 (config file default)
> > > rr_min_io = 100 (config file default)
> > > no_path_retry = -1 (config file default)
> > > pg_timeout = NONE (internal default)
> > > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:0 100 8:64 100
> > > set ACT_CREATE: map does not exists
> > > message mpath0 0 switch_group 1
> > > 
> > > create: mpath0 (00040026_05:83)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0
> > >  \_ 1:0:0:0 sda 8:0   [ready]
> > >  \_ 2:0:0:0 sde 8:64  [ready]
> > > 
> > > reloading features
> > > No matching wwid [00040026_05:84] in bindings file.
> > > Created new binding [mpath1] for WWID [00040026_05:84]
> > > pgpolicy = multibus (controler setting)
> > > selector = round-robin 0 (internal default)
> > > features = 0 (internal default)
> > > hwhandler = 0 (internal default)
> > > rr_weight = 2 (config file default)
> > > rr_min_io = 100 (config file default)
> > > no_path_retry = -1 (config file default)
> > > pg_timeout = NONE (internal default)
> > > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:16 100 8:80 100
> > > set ACT_CREATE: map does not exists
> > > message mpath1 0 switch_group 1
> > > 
> > > create: mpath1 (00040026_05:84)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0
> > >  \_ 1:0:0:1 sdb 8:16  [ready]
> > >  \_ 2:0:0:1 sdf 8:80  [ready]
> > > 
> > > reloading features
> > > No matching wwid [00040026_05:85] in bindings file.
> > > Created new binding [mpath2] for WWID [00040026_05:85]
> > > pgpolicy = multibus (controler setting)
> > > selector = round-robin 0 (internal default)
> > > features = 0 (internal default)
> > > hwhandler = 0 (internal default)
> > > rr_weight = 2 (config file default)
> > > rr_min_io = 100 (config file default)
> > > no_path_retry = -1 (config file default)
> > > pg_timeout = NONE (internal default)
> > > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:32 100 8:96 100
> > > set ACT_CREATE: map does not exists
> > > message mpath2 0 switch_group 1
> > > 
> > > create: mpath2 (00040026_05:85)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0
> > >  \_ 1:0:0:2 sdc 8:32  [ready]
> > >  \_ 2:0:0:2 sdg 8:96  [ready]
> > > 
> > > reloading features
> > > No matching wwid [00040026_05:86] in bindings file.
> > > Created new binding [mpath3] for WWID [00040026_05:86]
> > > pgpolicy = multibus (controler setting)
> > > selector = round-robin 0 (internal default)
> > > features = 0 (internal default)
> > > hwhandler = 0 (internal default)
> > > rr_weight = 2 (config file default)
> > > rr_min_io = 100 (config file default)
> > > no_path_retry = -1 (config file default)
> > > pg_timeout = NONE (internal default)
> > > 0 28452960 multipath 0 0 1 1 round-robin 0 2 1 8:48 100 8:112 100
> > > set ACT_CREATE: map does not exists
> > > message mpath3 0 switch_group 1
> > > 
> > > create: mpath3 (00040026_05:86)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0
> > >  \_ 1:0:0:3 sdd 8:48  [ready]
> > >  \_ 2:0:0:3 sdh 8:112 [ready]
> > > 
> > > reloading features
> > > 
> > > # multipath -ll
> > > mpath2 (00040026_05:85)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [active]
> > >  \_ 1:0:0:2 sdc 8:32  [active][ready]
> > >  \_ 2:0:0:2 sdg 8:96  [active][ready]
> > > 
> > > mpath1 (00040026_05:84)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [active]
> > >  \_ 1:0:0:1 sdb 8:16  [active][ready]
> > >  \_ 2:0:0:1 sdf 8:80  [active][ready]
> > > 
> > > mpath0 (00040026_05:83)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [active]
> > >  \_ 1:0:0:0 sda 8:0   [active][ready]
> > >  \_ 2:0:0:0 sde 8:64  [active][ready]
> > > 
> > > mpath3 (00040026_05:86)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [active]
> > >  \_ 1:0:0:3 sdd 8:48  [active][ready]
> > >  \_ 2:0:0:3 sdh 8:112 [active][ready]
> > 
> > Content-Description: post_reboot.txt
> > > # dmesg
> > > Bootdata ok (command line is ro root=/dev/vg00/root rhgb quiet)
> > > Linux version 2.6.9-55.ELsmp
(brewbuilder@hs20-bc2-4.build.redhat.com)
> > (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Fri Apr 20
> > 16:36:54 EDT 2007
> > > BIOS-provided physical RAM map:
> > >  BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
> > >  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
> > >  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
> > >  BIOS-e820: 0000000000100000 - 00000000bfff3000 (usable)
> > >  BIOS-e820: 00000000bfff3000 - 00000000bfffb000 (ACPI data)
> > >  BIOS-e820: 00000000bfffb000 - 00000000c0000000 (reserved)
> > >  BIOS-e820: 00000000fec00000 - 00000000fed00000 (reserved)
> > >  BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
> > >  BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
> > > ACPI: RSDP (v002 HP                                    ) @
> > 0x00000000000f4f00
> > > ACPI: XSDT (v001 HP     P51      0x00000002 ? 0x0000162e) @
> > 0x00000000bfff3300
> > > ACPI: FADT (v003 HP     P51      0x00000002 ? 0x0000162e) @
> > 0x00000000bfff3380
> > > ACPI: SPCR (v001 HP     SPCRRBSU 0x00000001 ? 0x0000162e) @
> > 0x00000000bfff3140
> > > ACPI: MCFG (v001 HP     ProLiant 0x00000001  0x00000000) @
> > 0x00000000bfff31c0
> > > ACPI: MADT (v001 HP     00000083 0x00000002  0x00000000) @
> > 0x00000000bfff3200
> > > ACPI: SSDT (v001 HP        SSDTP 0x00000001 INTL 0x20030228) @
> > 0x00000000bfff8000
> > > ACPI: DSDT (v001 HP         DSDT 0x00000001 INTL 0x20030228) @
> > 0x0000000000000000
> > > No NUMA configuration found
> > > Faking a node at 0000000000000000-00000000bfff3000
> > > Bootmem setup node 0 0000000000000000-00000000bfff3000
> > > On node 0 totalpages: 786419
> > >   DMA zone: 4096 pages, LIFO batch:1
> > >   Normal zone: 782323 pages, LIFO batch:16
> > >   HighMem zone: 0 pages, LIFO batch:1
> > > DMI 2.3 present.
> > > ACPI: PM-Timer IO Port: 0x908
> > > ACPI: Local APIC address 0xfee00000
> > > ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> > > Processor #0 15:4 APIC version 16
> > > ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
> > > ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled)
> > > ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
> > > Processor #6 15:4 APIC version 16
> > > ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> > > Processor #1 15:4 APIC version 16
> > > ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
> > > ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled)
> > > ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
> > > Processor #7 15:4 APIC version 16
> > > ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
> > > Setting APIC routing to flat
> > > ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
> > > IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
> > > ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
> > > IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
> > > ACPI: IOAPIC (id[0x0a] address[0xfec80400] gsi_base[48])
> > > IOAPIC[2]: apic_id 10, version 32, address 0xfec80400, GSI 48-71
> > > ACPI: IOAPIC (id[0x0b] address[0xfec84000] gsi_base[72])
> > > IOAPIC[3]: apic_id 11, version 32, address 0xfec84000, GSI 72-95
> > > ACPI: IOAPIC (id[0x0c] address[0xfec84400] gsi_base[96])
> > > IOAPIC[4]: apic_id 12, version 32, address 0xfec84400, GSI 96-119
> > > ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> > > ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> > > ACPI: IRQ0 used by override.
> > > ACPI: IRQ2 used by override.
> > > ACPI: IRQ9 used by override.
> > > Using ACPI (MADT) for SMP configuration information
> > > Allocating PCI resources starting at c4000000 (gap:
c0000000:3ec00000)
> > > Checking aperture...
> > > Built 1 zonelists
> > > Kernel command line: ro root=/dev/vg00/root rhgb quiet
console=tty0
> > > Initializing CPU#0
> > > PID hash table entries: 4096 (order: 12, 131072 bytes)
> > > time.c: Using 3.579545 MHz PM timer.
> > > time.c: Detected 3400.312 MHz processor.
> > > Console: colour VGA+ 80x25
> > > Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> > > Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> > > Memory: 3089236k/3145676k available (2112k kernel code, 0k
reserved,
> > 1305k data, 208k init)
> > > Calibrating delay using timer specific routine.. 6807.48 BogoMIPS
> > (lpj=3403744)
> > > Security Scaffold v1.0.0 initialized
> > > SELinux:  Initializing.
> > > SELinux:  Starting in permissive mode
> > > There is already a security framework initialized,
register_security
> > failed.
> > > selinux_register_security:  Registering secondary module
capability
> > > Capability LSM initialized as secondary
> > > Mount-cache hash table entries: 256 (order: 0, 4096 bytes)
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > using mwait in idle threads.
> > > CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> > > Using IO APIC NMI watchdog
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU0: Initial APIC ID: 0, Physical Processor ID: 0
> > > CPU0:                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > > per-CPU timeslice cutoff: 1023.90 usecs.
> > > task migration cache decay timeout: 1 msecs.
> > > Booting processor 1/6 rip 6000 rsp 10037e05f58
> > > Initializing CPU#1
> > > Calibrating delay using timer specific routine.. 6799.32 BogoMIPS
> > (lpj=3399660)
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU1: Initial APIC ID: 6, Physical Processor ID: 3
> > >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > > Booting processor 2/1 rip 6000 rsp 10037e3df58
> > > Initializing CPU#2
> > > Calibrating delay using timer specific routine.. 6799.31 BogoMIPS
> > (lpj=3399655)
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU2: Initial APIC ID: 1, Physical Processor ID: 0
> > >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > > Booting processor 3/7 rip 6000 rsp 100016f3f58
> > > Initializing CPU#3
> > > Calibrating delay using timer specific routine.. 6799.18 BogoMIPS
> > (lpj=3399591)
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU3: Initial APIC ID: 7, Physical Processor ID: 3
> > >                   Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
> > > Total of 4 processors activated (27205.30 BogoMIPS).
> > > activating NMI Watchdog ... done.
> > > testing NMI watchdog ... OK.
> > > Using local APIC timer interrupts.
> > > Detected 12.501 MHz APIC timer.
> > > checking TSC synchronization across 4 CPUs: passed.
> > > Brought up 4 CPUs
> > > time.c: Using PIT/TSC based timekeeping.
> > > checking if image is initramfs... it is
> > > NET: Registered protocol family 16
> > > PCI: Using configuration type 1
> > > PCI: Using MMCONFIG at e0000000
> > > mtrr: v2.0 (20020519)
> > > mtrr: your CPUs had inconsistent fixed MTRR settings
> > > mtrr: probably your BIOS does not setup all CPUs.
> > > mtrr: corrected configuration.
> > > ACPI: Subsystem revision 20040816
> > > ACPI: Interpreter enabled
> > > ACPI: Using IOAPIC for interrupt routing
> > > ACPI: PCI Root Bridge [PCI0] (00:00)
> > > PCI: Probing PCI hardware (bus 00)
> > > PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
> > > PCI: PXH quirk detected, disabling MSI for SHPC device
> > > PCI: PXH quirk detected, disabling MSI for SHPC device
> > > PCI: PXH quirk detected, disabling MSI for SHPC device
> > > PCI: PXH quirk detected, disabling MSI for SHPC device
> > > PCI: Transparent bridge - 0000:00:1e.0
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.IP2P._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXA._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTA0.PCXB._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXC._PRT]
> > > ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PTC0.PCXD._PRT]
> > > ACPI: PCI Interrupt Link [LNKA] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKB] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKC] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKD] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKE] (IRQs 5 7 10 11) *0, disabled.
> > > ACPI: PCI Interrupt Link [LNKF] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKG] (IRQs *5 7 10 11)
> > > ACPI: PCI Interrupt Link [LNKH] (IRQs *5 7 10 11)
> > > usbcore: registered new driver usbfs
> > > usbcore: registered new driver hub
> > > PCI: Using ACPI for IRQ routing
> > > GSI 16 sharing vector 0xA9 and IRQ 16
> > > ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ
169
> > > ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ
169
> > > ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ
169
> > > GSI 17 sharing vector 0xB1 and IRQ 17
> > > ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ
177
> > > GSI 18 sharing vector 0xB9 and IRQ 18
> > > ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ
185
> > > ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ
169
> > > GSI 19 sharing vector 0xC1 and IRQ 19
> > > ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ
193
> > > ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> > > GSI 20 sharing vector 0xC9 and IRQ 20
> > > ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ
201
> > > GSI 21 sharing vector 0xD1 and IRQ 21
> > > ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ
209
> > > GSI 22 sharing vector 0xD9 and IRQ 22
> > > ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ
217
> > > GSI 23 sharing vector 0xE1 and IRQ 23
> > > ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ
225
> > > GSI 24 sharing vector 0xE9 and IRQ 24
> > > ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ
233
> > > GSI 25 sharing vector 0x32 and IRQ 25
> > > ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ
50
> > > GSI 26 sharing vector 0x3A and IRQ 26
> > > ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ
58
> > > GSI 27 sharing vector 0x42 and IRQ 27
> > > ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ
66
> > > GSI 28 sharing vector 0x4A and IRQ 28
> > > ACPI: PCI Interrupt 0000:01:04.0[A] -> GSI 21 (level, low) -> IRQ
74
> > > GSI 29 sharing vector 0x52 and IRQ 29
> > > ACPI: PCI Interrupt 0000:01:04.2[B] -> GSI 22 (level, low) -> IRQ
82
> > > PCI-DMA: Disabling IOMMU.
> > > IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
> > > audit: initializing netlink socket (disabled)
> > > audit(1201791896.599:1): initialized
> > > Total HugeTLB memory allocated, 0
> > > VFS: Disk quotas dquot_6.5.1
> > > Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
> > > SELinux:  Registering netfilter hooks
> > > Initializing Cryptographic API
> > > ksign: Installing public key data
> > > Loading keyring
> > > - Added public key B7CA3C9BE2FAFC39
> > > - User ID: Red Hat, Inc. (Kernel Module GPG key)
> > > pci_hotplug: PCI Hot Plug PCI Core version: 0.5
> > > ACPI: Processor [CPU0] (supports C1)
> > > ACPI: Processor [CPU1] (supports C1)
> > > ACPI: Processor [CPU2] (supports C1)
> > > ACPI: Processor [CPU3] (supports C1)
> > > ACPI: Thermal Zone [THM0] (8 C)
> > > Real Time Clock Driver v1.12
> > > Linux agpgart interface v0.100 (c) Dave Jones
> > > serio: i8042 AUX port at 0x60,0x64 irq 12
> > > serio: i8042 KBD port at 0x60,0x64 irq 1
> > > Serial: 8250/16550 driver $Revision: 1.90 $ 68 ports, IRQ sharing
> > enabled
> > > ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> > > ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> > > RAMDISK driver initialized: 16 RAM disks of 16384K size 1024
blocksize
> > > divert: not allocating divert_blk for non-ethernet device lo
> > > Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
> > > ide: Assuming 33MHz system bus speed for PIO modes; override with
> > idebus=xx
> > > ICH5: IDE controller at PCI slot 0000:00:1f.1
> > > PCI: Enabling device 0000:00:1f.1 (0005 -> 0007)
> > > ACPI: PCI interrupt 0000:00:1f.1[A]: no GSI
> > > ICH5: chipset revision 2
> > > ICH5: not 100% native mode: will probe irqs later
> > >     ide0: BM-DMA at 0x0500-0x0507, BIOS settings: hda:DMA, hdb:pio
> > >     ide1: BM-DMA at 0x0508-0x050f, BIOS settings: hdc:pio, hdd:pio
> > > Probing IDE interface ide0...
> > > hda: DV-28E-N, ATAPI CD/DVD-ROM drive
> > > Using cfq io scheduler
> > > ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
> > > Probing IDE interface ide1...
> > > Probing IDE interface ide1...
> > > Probing IDE interface ide2...
> > > Probing IDE interface ide3...
> > > Probing IDE interface ide4...
> > > Probing IDE interface ide5...
> > > hda: ATAPI 24X DVD-ROM drive, 256kB Cache, UDMA(33)
> > > Uniform CD-ROM driver Revision: 3.20
> > > ide-floppy driver 0.99.newide
> > > usbcore: registered new driver hiddev
> > > usbcore: registered new driver usbhid
> > > drivers/usb/input/hid-core.c: v2.0:USB HID core driver
> > > mice: PS/2 mouse device common for all mice
> > > input: AT Translated Set 2 keyboard on isa0060/serio0
> > > input: PS/2 Generic Mouse on isa0060/serio1
> > > md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
> > > NET: Registered protocol family 2
> > > IP route cache hash table entries: 131072 (order: 8, 1048576
bytes)
> > > TCP established hash table entries: 262144 (order: 10, 4194304
bytes)
> > > TCP bind hash table entries: 262144 (order: 10, 4194304 bytes)
> > > TCP: Hash tables configured (established 262144 bind 262144)
> > > Initializing IPsec netlink socket
> > > NET: Registered protocol family 1
> > > NET: Registered protocol family 17
> > > cpufreq: CPU0 - ACPI performance management activated.
> > > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > > cpufreq: CPU1 - ACPI performance management activated.
> > > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > > cpufreq: CPU2 - ACPI performance management activated.
> > > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > > cpufreq: CPU3 - ACPI performance management activated.
> > > cpufreq: *P0: 3400 MHz, 103000 mW, 100 uS
> > > cpufreq:  P1: 2800 MHz, 77469 mW, 100 uS
> > > ACPI wakeup devices:
> > > 
> > > ACPI: (supports S0 S4 S5)
> > > Freeing unused kernel memory: 208k freed
> > > SCSI subsystem initialized
> > > HP CISS Driver (v 2.6.14.RH2)
> > > cciss: Device 0x46 has been found at bus 4 dev 3 func 0
> > > ACPI: PCI Interrupt 0000:04:03.0[A] -> GSI 51 (level, low) -> IRQ
217
> > > cciss: using DAC cycles
> > >       blocks= 71122559 block_size= 512
> > >       heads= 255, sectors= 32, cylinders= 8716
> > > 
> > >       blocks= 71122559 block_size= 512
> > >       heads= 255, sectors= 32, cylinders= 8716
> > > 
> > >       blocks= 71122559 block_size= 512
> > >       heads= 255, sectors= 32, cylinders= 8716
> > > 
> > >  cciss/c0d0: p1 p2
> > >       blocks= 71122559 block_size= 512
> > >       heads= 255, sectors= 32, cylinders= 8716
> > > 
> > >  cciss/c0d1: unknown partition table
> > > device-mapper: 4.5.5-ioctl (2006-12-01) initialised:
> > dm-devel@redhat.com
> > > hda: packet command error: status=0x51 { DriveReady SeekComplete
Error
> > }
> > > hda: packet command error: error=0x50
> > > ide: failed opcode was 100
> > > cdrom: open failed.
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > security:  3 users, 4 roles, 355 types, 26 bools
> > > security:  55 classes, 22610 rules
> > > SELinux:  Completing initialization.
> > > SELinux:  Setting up existing superblocks.
> > > SELinux: initialized (dev dm-0, type ext3), uses xattr
> > > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > > SELinux: initialized (dev selinuxfs, type selinuxfs), uses
> > genfs_contexts
> > > SELinux: initialized (dev mqueue, type mqueue), not configured for
> > labeling
> > > SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses
> > genfs_contexts
> > > SELinux: initialized (dev devpts, type devpts), uses transition
SIDs
> > > SELinux: initialized (dev eventpollfs, type eventpollfs), uses
> > genfs_contexts
> > > SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
> > > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > > SELinux: initialized (dev futexfs, type futexfs), uses
genfs_contexts
> > > SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
> > > SELinux: initialized (dev proc, type proc), uses genfs_contexts
> > > SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
> > > SELinux: initialized (dev rootfs, type rootfs), uses
genfs_contexts
> > > SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
> > > SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
> > > libata version 2.00 loaded.
> > > Emulex LightPulse Fibre Channel SCSI driver 8.0.16.27
> > > Copyright(c) 2003-2006 Emulex.  All rights reserved.
> > > ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 78 (level, low) -> IRQ
225
> > > lpfc 0000:06:02.0: 0:1303 Link Up Event x1 received Data: x1 xf7
x8 x0
> > > scsi0 : Emulex LP9002L-F2 2Gb PCI Fibre Channel Adapter on PCI bus
06
> > device 10 irq 225
> > > ACPI: PCI Interrupt 0000:07:04.0[A] -> GSI 74 (level, low) -> IRQ
233
> > > lpfc 0000:07:04.0: 1:1303 Link Up Event x1 received Data: x1 xf7
x8 x0
> > > scsi1 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07
> > device 20 irq 233
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision:
02
> > > SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sda: drive cache: write back
> > > SCSI device sda: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sda: drive cache: write back
> > >  sda: sda1
> > > Attached scsi disk sda at scsi1, channel 0, id 0, lun 0
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision:
02
> > > SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdb: drive cache: write back
> > > SCSI device sdb: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdb: drive cache: write back
> > >  sdb: unknown partition table
> > > Attached scsi disk sdb at scsi1, channel 0, id 0, lun 1
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision:
02
> > > SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdc: drive cache: write back
> > > SCSI device sdc: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdc: drive cache: write back
> > >  sdc: unknown partition table
> > > Attached scsi disk sdc at scsi1, channel 0, id 0, lun 2
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision:
02
> > > SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdd: drive cache: write back
> > > SCSI device sdd: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdd: drive cache: write back
> > >  sdd: unknown partition table
> > > Attached scsi disk sdd at scsi1, channel 0, id 0, lun 3
> > > ACPI: PCI Interrupt 0000:07:05.0[A] -> GSI 73 (level, low) -> IRQ
50
> > > Losing some ticks... checking if CPU frequency changed.
> > > lpfc 0000:07:05.0: 2:1303 Link Up Event x1 received Data: x1 xf7
x8 x0
> > > scsi2 : Emulex LP9002 2Gb PCI Fibre Channel Adapter on PCI bus 07
> > device 28 irq 50
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision:
02
> > > SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sde: drive cache: write back
> > > SCSI device sde: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sde: drive cache: write back
> > >  sde: sde1
> > > Attached scsi disk sde at scsi2, channel 0, id 0, lun 0
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision:
02
> > > SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdf: drive cache: write back
> > > SCSI device sdf: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdf: drive cache: write back
> > >  sdf: unknown partition table
> > > Attached scsi disk sdf at scsi2, channel 0, id 0, lun 1
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision:
02
> > > SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdg: drive cache: write back
> > > SCSI device sdg: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdg: drive cache: write back
> > >  sdg: unknown partition table
> > > Attached scsi disk sdg at scsi2, channel 0, id 0, lun 2
> > >   Vendor: HP        Model: OPEN-E            Rev: 2114
> > >   Type:   Direct-Access                      ANSI SCSI revision:
02
> > > SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdh: drive cache: write back
> > > SCSI device sdh: 28452960 512-byte hdwr sectors (14568 MB)
> > > SCSI device sdh: drive cache: write back
> > >  sdh: unknown partition table
> > > Attached scsi disk sdh at scsi2, channel 0, id 0, lun 3
> > > inserting floppy driver for 2.6.9-55.ELsmp
> > > Floppy drive(s): fd0 is 1.44M
> > > FDC 0 is a National Semiconductor PC87306
> > > Intel(R) PRO/1000 Network Driver - version 7.2.7-k2-NAPI
> > > Copyright (c) 1999-2006 Intel Corporation.
> > > ACPI: PCI Interrupt 0000:0a:01.0[A] -> GSI 97 (level, low) -> IRQ
58
> > > e1000: 0000:0a:01.0: e1000_probe: (PCI-X:133MHz:64-bit)
> > 00:11:0a:64:7e:da
> > > divert: allocating divert_blk for eth0
> > > e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
> > > ACPI: PCI Interrupt 0000:0a:01.1[B] -> GSI 98 (level, low) -> IRQ
66
> > > e1000: 0000:0a:01.1: e1000_probe: (PCI-X:133MHz:64-bit)
> > 00:11:0a:64:7e:db
> > > divert: allocating divert_blk for eth1
> > > e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
> > > tg3.c:v3.64-rh (July 31, 2006)
> > > ACPI: PCI Interrupt 0000:03:01.0[A] -> GSI 25 (level, low) -> IRQ
201
> > > divert: allocating divert_blk for eth2
> > > eth2: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit)
> > 10/100/1000BaseT Ethernet 00:14:38:bf:5a:51
> > > eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] Split[0]
WireSpeed[1]
> > TSOcap[0]
> > > eth2: dma_rwctrl[769f4000] dma_mask[64-bit]
> > > ACPI: PCI Interrupt 0000:03:01.1[B] -> GSI 26 (level, low) -> IRQ
209
> > > divert: allocating divert_blk for eth3
> > > eth3: Tigon3 [partno(N/A) rev 2100 PHY(5704)] (PCIX:133MHz:64-bit)
> > 10/100/1000BaseT Ethernet 00:14:38:bf:5a:50
> > > eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0]
WireSpeed[1]
> > TSOcap[1]
> > > eth3: dma_rwctrl[769f4000] dma_mask[64-bit]
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > hw_random hardware driver 1.0.0 loaded
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > shpchp: acpi_shpchprm:\_SB_.PCI0 evaluate _BBN fail=0x5
> > > shpchp: acpi_shpchprm:get_device PCI ROOT HID fail=0x5
> > > ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ
193
> > > ehci_hcd 0000:00:1d.7: EHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.7 to 64
> > > ehci_hcd 0000:00:1d.7: irq 193, pci mem ffffff0010086000
> > > SELinux: initialized (dev usbdevfs, type usbdevfs), uses
> > genfs_contexts
> > > ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number
1
> > > PCI: cache line size of 128 is not supported by device
0000:00:1d.7
> > > ehci_hcd 0000:00:1d.7: USB 2.0 enabled, EHCI 1.00, driver
2004-May-10
> > > hub 1-0:1.0: USB hub found
> > > hub 1-0:1.0: 8 ports detected
> > > USB Universal Host Controller Interface driver v2.2
> > > ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ
169
> > > uhci_hcd 0000:00:1d.0: UHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.0 to 64
> > > uhci_hcd 0000:00:1d.0: irq 169, io base 0000000000002000
> > > uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number
2
> > > hub 2-0:1.0: USB hub found
> > > hub 2-0:1.0: 2 ports detected
> > > ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ
177
> > > uhci_hcd 0000:00:1d.1: UHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.1 to 64
> > > uhci_hcd 0000:00:1d.1: irq 177, io base 0000000000002020
> > > uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number
3
> > > hub 3-0:1.0: USB hub found
> > > hub 3-0:1.0: 2 ports detected
> > > ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ
185
> > > uhci_hcd 0000:00:1d.2: UHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.2 to 64
> > > uhci_hcd 0000:00:1d.2: irq 185, io base 0000000000002040
> > > uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number
4
> > > hub 4-0:1.0: USB hub found
> > > hub 4-0:1.0: 2 ports detected
> > > ACPI: PCI Interrupt 0000:00:1d.3[A] -> GSI 16 (level, low) -> IRQ
169
> > > uhci_hcd 0000:00:1d.3: UHCI Host Controller
> > > PCI: Setting latency timer of device 0000:00:1d.3 to 64
> > > uhci_hcd 0000:00:1d.3: irq 169, io base 0000000000002060
> > > uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number
5
> > > hub 5-0:1.0: USB hub found
> > > hub 5-0:1.0: 2 ports detected
> > > md: Autodetecting RAID arrays.
> > > md: autorun ...
> > > md: ... autorun DONE.
> > > ACPI: Power Button (FF) [PWRF]
> > > EXT3 FS on dm-0, internal journal
> > > device-mapper: dm-multipath version 1.0.5 loaded
> > > device-mapper: dm-round-robin version 1.0.0 loaded
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on cciss/c0d0p1, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev cciss/c0d0p1, type ext3), uses xattr
> > > SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-1, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-1, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-2, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-2, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-3, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-3, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-4, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-4, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-5, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-5, type ext3), uses xattr
> > > kjournald starting.  Commit interval 5 seconds
> > > EXT3 FS on dm-6, internal journal
> > > EXT3-fs: mounted filesystem with ordered data mode.
> > > SELinux: initialized (dev dm-6, type ext3), uses xattr
> > > Adding 2097144k swap on /dev/vg00/swap1.  Priority:-1 extents:1
> > > SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses
> > genfs_contexts
> > > IA-32 Microcode Update Driver: v1.14 <tigran@veritas.com>
> > > microcode: CPU0 already at revision 0x12 (current=0x12)
> > > microcode: CPU1 already at revision 0x12 (current=0x12)
> > > microcode: CPU2 already at revision 0x12 (current=0x12)
> > > microcode: CPU3 already at revision 0x12 (current=0x12)
> > > microcode: No new microdata for cpu 1
> > > microcode: No new microdata for cpu 2
> > > microcode: No new microdata for cpu 0
> > > microcode: No new microdata for cpu 3
> > > IA-32 Microcode Update Driver v1.14 unregistered
> > > ip_tables: (C) 2000-2002 Netfilter core team
> > > ip_conntrack version 2.1 (8192 buckets, 65536 max) - 456 bytes per
> > conntrack
> > > e1000: eth1: e1000_watchdog_task: NIC Link is Up 100 Mbps Half
Duplex
> > > i2c /dev entries driver
> > > NET: Registered protocol family 10
> > > Disabled Privacy Extensions on device ffffffff80408540(lo)
> > > IPv6 over IPv4 tunneling driver
> > > divert: not allocating divert_blk for non-ethernet device sit0
> > > eth1: no IPv6 routers present
> > > 
> > > 
> > > # cat /var/log/boot.log
> > > Jan 31 15:02:31 corux38 syslog: syslogd startup succeeded
> > > Jan 31 15:02:31 corux38 syslog: klogd startup succeeded
> > > Jan 31 15:02:31 corux38 irqbalance: irqbalance startup succeeded
> > > Jan 31 15:02:31 corux38 multipathd: multipathd startup succeeded
> > > Jan 31 15:02:31 corux38 portmap: portmap startup succeeded
> > > Jan 31 15:02:32 corux38 rc: Starting lm_sensors:  succeeded
> > > Jan 31 15:02:32 corux38 xinetd: xinetd startup succeeded
> > > Jan 31 15:02:32 corux38 ntpd: ntpd startup succeeded
> > > Jan 31 15:02:32 corux38 vsftpd: vsftpd vsftpd succeeded
> > > Jan 31 15:02:33 corux38 ssh-server-g3: Starting ssh-server-g3
> > > Jan 31 10:01:59 corux38 rc.sysinit: -e
> > > Jan 31 10:02:01 corux38 start_udev: Starting udev:  succeeded
> > > Jan 31 10:02:25 corux38 rc.sysinit: -e
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.ip_forward = 0
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.default.rp_filter =
1
> > > Jan 31 10:02:25 corux38 sysctl:
> > net.ipv4.conf.default.accept_source_route = 0
> > > Jan 31 10:02:25 corux38 sysctl: kernel.sysrq = 0
> > > Jan 31 10:02:25 corux38 sysctl: kernel.core_uses_pid = 1
> > > Jan 31 10:02:25 corux38 sysctl:
net.ipv4.conf.all.accept_source_route
> > = 0
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_max_syn_backlog =
4096
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > > Jan 31 10:02:25 corux38 sysctl: net.ipv4.conf.all.accept_redirects
= 0
> > > Jan 31 10:02:25 corux38 sysctl:
net.ipv4.conf.default.accept_redirects
> > = 0
> > > Jan 31 10:02:25 corux38 sysctl: fs.file-max = 524288
> > > Jan 31 10:02:25 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > > Jan 31 10:02:25 corux38 rc.sysinit: Configuring kernel parameters:
> > succeeded
> > > Jan 31 15:02:26 corux38 date: Thu Jan 31 15:02:26 EST 2008
> > > Jan 31 15:02:26 corux38 rc.sysinit: Setting clock  (localtime):
Thu
> > Jan 31 15:02:26 EST 2008 succeeded
> > > Jan 31 15:02:26 corux38 rc.sysinit: Loading default keymap
succeeded
> > > Jan 31 15:02:26 corux38 rc.sysinit: Setting hostname corux38:
> > succeeded
> > > Jan 31 15:02:26 corux38 fsck: /dev/vg00/root: clean, 4335/131072
> > files, 48559/262144 blocks
> > > Jan 31 15:02:26 corux38 rc.sysinit: Checking root filesystem
succeeded
> > > Jan 31 15:02:26 corux38 rc.sysinit: Remounting root filesystem in
> > read-write mode:  succeeded
> > > Jan 31 15:02:26 corux38 lvm.static:   8 logical volume(s) in
volume
> > group vg00 now active
> > > Jan 31 15:02:26 corux38 rc.sysinit: Setting up Logical Volume
> > Management: succeeded
> > > Jan 31 15:02:26 corux38 fsck: /boot: clean, 38/26104 files,
> > 17822/104388 blocks
> > > Jan 31 15:02:26 corux38 fsck: /dev/vg00/home: clean, 132/262144
files,
> > 20580/524288 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/opt: clean, 83/524288
files,
> > 36957/1048576 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/tmp: clean, 34/131072
files,
> > 13541/262144 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/usr: clean, 30250/524288
> > files, 169645/1048576 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368
> > files, 17525/540672 blocks
> > > Jan 31 15:02:27 corux38 fsck: /dev/vg00/var: clean, 395/1048576
files,
> > 49124/2097152 blocks
> > > Jan 31 15:02:27 corux38 rc.sysinit: Checking filesystems succeeded
> > > Jan 31 15:02:27 corux38 rc.sysinit: Mounting local filesystems:
> > succeeded
> > > Jan 31 15:02:27 corux38 rc.sysinit: Enabling swap space:
succeeded
> > > Jan 31 15:02:28 corux38 microcode_ctl: microcode_ctl startup
succeeded
> > > Jan 31 15:02:36 corux38 ssh-server-g3: done.
> > > Jan 31 15:02:28 corux38 vgchange:   8 logical volume(s) in volume
> > group "vg00" monitored
> > > Jan 31 15:02:36 corux38 rc: Starting ssh-server-g3:  succeeded
> > > Jan 31 15:02:28 corux38 lvm2-monitor: Starting monitoring for VG
vg00:
> > succeeded
> > > Jan 31 15:02:36 corux38 crond: crond startup succeeded
> > > Jan 31 15:02:28 corux38 cpuspeed: cpuspeed startup succeeded
> > > Jan 31 15:02:28 corux38 iptables:  succeeded
> > > Jan 31 15:02:36 corux38 atd: atd startup succeeded
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.ip_forward = 0
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.default.rp_filter =
1
> > > Jan 31 15:02:36 corux38 messagebus: messagebus startup succeeded
> > > Jan 31 15:02:29 corux38 sysctl:
> > net.ipv4.conf.default.accept_source_route = 0
> > > Jan 31 15:02:29 corux38 sysctl: kernel.sysrq = 0
> > > Jan 31 15:02:29 corux38 sysctl: kernel.core_uses_pid = 1
> > > Jan 31 15:02:36 corux38 haldaemon: haldaemon startup succeeded
> > > Jan 31 15:02:29 corux38 sysctl:
net.ipv4.conf.all.accept_source_route
> > = 0
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog =
4096
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > > Jan 31 15:02:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects
= 0
> > > Jan 31 15:02:29 corux38 sysctl:
net.ipv4.conf.default.accept_redirects
> > = 0
> > > Jan 31 15:02:29 corux38 sysctl: fs.file-max = 524288
> > > Jan 31 15:02:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > > Jan 31 15:02:29 corux38 network: Setting network parameters:
> > succeeded
> > > Jan 31 15:02:29 corux38 network: Bringing up loopback interface:
> > succeeded
> > > Jan 31 15:02:31 corux38 network: Bringing up interface eth1:
> > succeeded
> > > Jan 31 15:03:08 corux38 haldaemon: haldaemon -TERM succeeded
> > > Jan 31 15:03:08 corux38 messagebus: messagebus -TERM succeeded
> > > Jan 31 15:03:08 corux38 atd: atd shutdown succeeded
> > > Jan 31 15:03:09 corux38 vsftpd: vsftpd shutdown succeeded
> > > Jan 31 15:03:09 corux38 xinetd: xinetd shutdown succeeded
> > > Jan 31 15:03:09 corux38 crond: crond shutdown succeeded
> > > Jan 31 15:03:09 corux38 ntpd: ntpd shutdown succeeded
> > > Jan 31 15:03:09 corux38 irqbalance: irqbalance shutdown succeeded
> > > Jan 31 15:03:09 corux38 multipathd: multipathd shutdown succeeded
> > > Jan 31 15:03:09 corux38 portmap: portmap shutdown succeeded
> > > Jan 31 15:05:36 corux38 syslog: syslogd startup succeeded
> > > Jan 31 15:05:36 corux38 syslog: klogd startup succeeded
> > > Jan 31 15:05:37 corux38 irqbalance: irqbalance startup succeeded
> > > Jan 31 15:05:37 corux38 multipathd: multipathd startup succeeded
> > > Jan 31 15:05:37 corux38 portmap: portmap startup succeeded
> > > Jan 31 15:05:37 corux38 rc: Starting lm_sensors:  succeeded
> > > Jan 31 15:05:37 corux38 xinetd: xinetd startup succeeded
> > > Jan 31 15:05:37 corux38 ntpd: ntpd startup succeeded
> > > Jan 31 15:05:38 corux38 vsftpd: vsftpd vsftpd succeeded
> > > Jan 31 15:05:38 corux38 ssh-server-g3: Starting ssh-server-g3
> > > Jan 31 10:05:03 corux38 rc.sysinit: -e
> > > Jan 31 10:05:05 corux38 start_udev: Starting udev:  succeeded
> > > Jan 31 10:05:29 corux38 rc.sysinit: -e
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.ip_forward = 0
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.default.rp_filter =
1
> > > Jan 31 10:05:29 corux38 sysctl:
> > net.ipv4.conf.default.accept_source_route = 0
> > > Jan 31 10:05:29 corux38 sysctl: kernel.sysrq = 0
> > > Jan 31 10:05:29 corux38 sysctl: kernel.core_uses_pid = 1
> > > Jan 31 10:05:29 corux38 sysctl:
net.ipv4.conf.all.accept_source_route
> > = 0
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_max_syn_backlog =
4096
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > > Jan 31 10:05:29 corux38 sysctl: net.ipv4.conf.all.accept_redirects
= 0
> > > Jan 31 10:05:29 corux38 sysctl:
net.ipv4.conf.default.accept_redirects
> > = 0
> > > Jan 31 10:05:29 corux38 sysctl: fs.file-max = 524288
> > > Jan 31 10:05:29 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > > Jan 31 10:05:29 corux38 rc.sysinit: Configuring kernel parameters:
> > succeeded
> > > Jan 31 15:05:30 corux38 date: Thu Jan 31 15:05:30 EST 2008
> > > Jan 31 15:05:30 corux38 rc.sysinit: Setting clock  (localtime):
Thu
> > Jan 31 15:05:30 EST 2008 succeeded
> > > Jan 31 15:05:30 corux38 rc.sysinit: Loading default keymap
succeeded
> > > Jan 31 15:05:30 corux38 rc.sysinit: Setting hostname corux38:
> > succeeded
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/root: clean, 4335/131072
> > files, 48559/262144 blocks
> > > Jan 31 15:05:30 corux38 rc.sysinit: Checking root filesystem
succeeded
> > > Jan 31 15:05:30 corux38 rc.sysinit: Remounting root filesystem in
> > read-write mode:  succeeded
> > > Jan 31 15:05:30 corux38 lvm.static:   8 logical volume(s) in
volume
> > group vg00 now active
> > > Jan 31 15:05:30 corux38 rc.sysinit: Setting up Logical Volume
> > Management: succeeded
> > > Jan 31 15:05:30 corux38 fsck: /boot: clean, 38/26104 files,
> > 17822/104388 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/home: clean, 132/262144
files,
> > 20580/524288 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/opt: clean, 83/524288
files,
> > 36957/1048576 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/tmp: clean, 34/131072
files,
> > 13541/262144 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/usr: clean, 30250/524288
> > files, 169645/1048576 blocks
> > > Jan 31 15:05:30 corux38 fsck: /dev/vg00/usrlocal: clean, 46/270368
> > files, 17525/540672 blocks
> > > Jan 31 15:05:31 corux38 fsck: /dev/vg00/var: clean, 395/1048576
files,
> > 49141/2097152 blocks
> > > Jan 31 15:05:31 corux38 rc.sysinit: Checking filesystems succeeded
> > > Jan 31 15:05:31 corux38 rc.sysinit: Mounting local filesystems:
> > succeeded
> > > Jan 31 15:05:31 corux38 rc.sysinit: Enabling swap space:
succeeded
> > > Jan 31 15:05:32 corux38 microcode_ctl: microcode_ctl startup
succeeded
> > > Jan 31 15:05:32 corux38 vgchange:   8 logical volume(s) in volume
> > group "vg00" monitored
> > > Jan 31 15:05:32 corux38 lvm2-monitor: Starting monitoring for VG
vg00:
> > succeeded
> > > Jan 31 15:05:41 corux38 ssh-server-g3: done.
> > > Jan 31 15:05:32 corux38 cpuspeed: cpuspeed startup succeeded
> > > Jan 31 15:05:41 corux38 rc: Starting ssh-server-g3:  succeeded
> > > Jan 31 15:05:32 corux38 iptables:  succeeded
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.ip_forward = 0
> > > Jan 31 15:05:41 corux38 crond: crond startup succeeded
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.default.rp_filter =
1
> > > Jan 31 15:05:41 corux38 atd: atd startup succeeded
> > > Jan 31 15:05:32 corux38 sysctl:
> > net.ipv4.conf.default.accept_source_route = 0
> > > Jan 31 15:05:32 corux38 sysctl: kernel.sysrq = 0
> > > Jan 31 15:05:32 corux38 sysctl: kernel.core_uses_pid = 1
> > > Jan 31 15:05:42 corux38 messagebus: messagebus startup succeeded
> > > Jan 31 15:05:32 corux38 sysctl:
net.ipv4.conf.all.accept_source_route
> > = 0
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_max_syn_backlog =
4096
> > > Jan 31 15:05:42 corux38 haldaemon: haldaemon startup succeeded
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.rp_filter = 1
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.tcp_syncookies = 1
> > > Jan 31 15:05:32 corux38 sysctl: net.ipv4.conf.all.accept_redirects
= 0
> > > Jan 31 15:05:32 corux38 sysctl:
net.ipv4.conf.default.accept_redirects
> > = 0
> > > Jan 31 15:05:32 corux38 sysctl: fs.file-max = 524288
> > > Jan 31 15:05:32 corux38 sysctl: kernel.sem = 1024 32000 32 4096
> > > Jan 31 15:05:32 corux38 network: Setting network parameters:
> > succeeded
> > > Jan 31 15:05:32 corux38 network: Bringing up loopback interface:
> > succeeded
> > > Jan 31 15:05:36 corux38 network: Bringing up interface eth1:
> > succeeded
> > > 
> > > 
> > > # multipath -ll
> > > mpath1 (00040026_05:84)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [enabled]
> > >  \_ 2:0:0:1 sdf 8:80  [active][ready]
> > >  \_ 1:0:0:1 sdb 8:16  [active][ready]
> > > 
> > > mpath0 (00040026_05:83)
> > > [size=13 GB][features="0"][hwhandler="0"]
> > > \_ round-robin 0 [enabled]
> > >  \_ 2:0:0:0 sde 8:64  [active][ready]
> > >  \_ 1:0:0:0 sda 8:0   [active][ready]
> > Content-Description: manual_run.txt
> > 
> > > --
> > > dm-devel mailing list
> > > dm-devel@redhat.com
> > > https://www.redhat.com/mailman/listinfo/dm-devel
> > 
> > --
> > dm-devel mailing list
> > dm-devel@redhat.com
> > https://www.redhat.com/mailman/listinfo/dm-devel
> 
> Content-Description: multipath_boot_log.txt
> > %%
> > %% running multipath from rc.sysinit
> > %%
> > load path identifiers cache
> > ux_socket_connect error
> > #
> > # all paths in cache :
> > #
> > cciss!c0d0 blacklisted
> > cciss!c0d1 blacklisted
> > dm-0 blacklisted
> > dm-1 blacklisted
> > dm-2 blacklisted
> > dm-3 blacklisted
> > dm-4 blacklisted
> > dm-5 blacklisted
> > dm-6 blacklisted
> > dm-7 blacklisted
> > fd0 blacklisted
> > hda blacklisted
> > md0 blacklisted
> > ram0 blacklisted
> > ram10 blacklisted
> > ram11 blacklisted
> > ram12 blacklisted
> > ram13 blacklisted
> > ram14 blacklisted
> > ram15 blacklisted
> > ram1 blacklisted
> > ram2 blacklisted
> > ram3 blacklisted
> > ram4 blacklisted
> > ram5 blacklisted
> > ram6 blacklisted
> > ram7 blacklisted
> > ram8 blacklisted
> > ram9 blacklisted
> > path sda not found in pathvec
> > 
> > ===== path info sda (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:0
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 1:0:0:0
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026 
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > getuid = /etc/xpdisk %n (controler setting)
> > uid = 00040026_05:83 (callout)
> > path sdb not found in pathvec
> > 
> > ===== path info sdb (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:16
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 1:0:0:1
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026 
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > getuid = /etc/xpdisk %n (controler setting)
> > uid = 00040026_05:84 (callout)
> > path sdc not found in pathvec
> > 
> > ===== path info sdc (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:32
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 1:0:0:2
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026 
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > getuid = /etc/xpdisk %n (controler setting)
> > uid = 00040026_05:85 (callout)
> > path sdd not found in pathvec
> > 
> > ===== path info sdd (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:48
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 1:0:0:3
> > tgt_node_name = 0x50060e80039c5a04
> > serial = 40026 
> > path checker = tur (controler setting)
> > state = 2
> > getprio = /bin/true (internal default)
> > prio = 0
> > getuid = /etc/xpdisk %n (controler setting)
> > uid = 00040026_05:86 (callout)
> > path sde not found in pathvec
> > 
> > ===== path info sde (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:64
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 2:0:0:0
> > tgt_node_name = 0x50060e80039c5a14
> > path sdf not found in pathvec
> > 
> > ===== path info sdf (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:80
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 2:0:0:1
> > tgt_node_name = 0x50060e80039c5a14
> > path sdg not found in pathvec
> > 
> > ===== path info sdg (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:96
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 2:0:0:2
> > tgt_node_name = 0x50060e80039c5a14
> > path sdh not found in pathvec
> > 
> > ===== path info sdh (mask 0x1f) =====
> > bus = 1
> > dev_t = 8:112
> > size = 28452960
> > vendor = HP      
> > product = OPEN-E          
> > rev = 2114
> > h:b:t:l = 2:0:0:3
> > tgt_node_name = 0x50060e80039c5a14
> > #
> > # all paths :
> > #
> > 00040026_05:83  1:0:0:0 sda 8:0  [ready] HP      /OPEN-E
/2114
> > 00040026_05:84  1:0:0:1 sdb 8:16  [ready] HP      /OPEN-E
/2114
> > 00040026_05:85  1:0:0:2 sdc 8:32  [ready] HP      /OPEN-E
/2114
> > 00040026_05:86  1:0:0:3 sdd 8:48  [ready] HP      /OPEN-E
/2114
> >   2:0:0:0 sde 8:64  [faulty] HP      /OPEN-E          /2114
> >   2:0:0:1 sdf 8:80  [faulty] HP      /OPEN-E          /2114
> >   2:0:0:2 sdg 8:96  [faulty] HP      /OPEN-E          /2114
> >   2:0:0:3 sdh 8:112  [faulty] HP      /OPEN-E          /2114
> > Found matching wwid [00040026_05:83] in bindings file.
> > Setting alias to mpath1
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:0 100
> > set ACT_CREATE: map does not exists
> > message mpath1 0 switch_group 1
> > 
> > create: mpath1 (00040026_05:83)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:0 sda 8:0   [ready]
> > 
> > reloading features
> > Found matching wwid [00040026_05:84] in bindings file.
> > Setting alias to mpath2
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:16 100
> > set ACT_CREATE: map does not exists
> > message mpath2 0 switch_group 1
> > 
> > create: mpath2 (00040026_05:84)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:1 sdb 8:16  [ready]
> > 
> > reloading features
> > Found matching wwid [00040026_05:85] in bindings file.
> > Setting alias to mpath3
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:32 100
> > set ACT_CREATE: map does not exists
> > message mpath3 0 switch_group 1
> > 
> > create: mpath3 (00040026_05:85)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:2 sdc 8:32  [ready]
> > 
> > reloading features
> > Found matching wwid [00040026_05:86] in bindings file.
> > Setting alias to mpath4
> > pgpolicy = multibus (controler setting)
> > selector = round-robin 0 (internal default)
> > features = 0 (internal default)
> > hwhandler = 0 (internal default)
> > rr_weight = 2 (config file default)
> > rr_min_io = 100 (config file default)
> > no_path_retry = -1 (config file default)
> > pg_timeout = NONE (internal default)
> > 0 28452960 multipath 0 0 1 1 round-robin 0 1 1 8:48 100
> > set ACT_CREATE: map does not exists
> > message mpath4 0 switch_group 1
> > 
> > create: mpath4 (00040026_05:86)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:3 sdd 8:48  [ready]
> > 
> > reloading features
> > %%
> > %% running multipath.dev
> > %%
> > add /block/sdh
> > %%
> > %% running multipath.dev
> > %%
> > add /block/md0
> > %%
> > %% running multipath.dev
> > %%
> > add /block/sdg
> > %%
> > %% running multipath.dev
> > %%
> > add /block/sde
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-8
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-9
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-10
> > %%
> > %% running multipath.dev
> > %%
> > add /block/sdf
> > %%
> > %% running multipath.dev
> > %%
> > add /block/fd0
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-11
> > %%
> > %% running multipath from rc.local
> > %%
> > create: mpath2 (00040026_05:85)
> > [size=13 GB][features="0"][hwhandler="0"]
> > \_ round-robin 0 
> >  \_ 1:0:0:2 sdc 8:32  [ready]
> >  \_ 2:0:0:2 sdg 8:96  [ready]
> > 
> > %%
> > %% running multipath.dev
> > %%
> > add /block/dm-10
> 
> > --
> > dm-devel mailing list
> > dm-devel@redhat.com
> > https://www.redhat.com/mailman/listinfo/dm-devel

> diff -urpN multipath-tools/libmultipath/discovery.c
multipath-tools-patched/libmultipath/discovery.c
> --- multipath-tools/libmultipath/discovery.c	2008-02-12
14:00:38.000000000 -0600
> +++ multipath-tools-patched/libmultipath/discovery.c	2008-02-15
09:28:32.000000000 -0600
> @@ -170,11 +170,6 @@ path_discovery (vector pathvec, struct c
>  	return r;
>  }
> 
> -/*
> - * the daemon can race udev upon path add,
> - * not multipath(8), ran by udev
> - */
> -#if DAEMON
>  #define WAIT_MAX_SECONDS 5
>  #define WAIT_LOOP_PER_SECOND 5
> 
> @@ -197,13 +192,6 @@ wait_for_file (char * filename)
>  	}
>  	return 1;
>  }
> -#else
> -static int
> -wait_for_file (char * filename)
> -{
> -	return 0;
> -}
> -#endif
> 
>  #define declare_sysfs_get_str(fname, fmt) \
>  extern int \

> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

Re: Multipath not rebuilding correctly on reboot

[malahal]

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Quick question...what RPM would I find udevsettle in? Doesn't appear to
> be installed on my system (RedHat Enterprise Linux 4), nor can I find
> reference to it on RedHat's site.

Part of udev rpm (udev-085-30.37) on my system (SLES10 SP1). Maybe RHEL4
has an older version of udev that lacks udevsettle. That explains why
they used a "sleep"!

--Malahal.

RE: Multipath not rebuilding correctly on reboot

[Greene, Rick]

I just checked one of my RHEL5 servers, and it does have udevsettle, so
it looks like I'm stuck with my current rc.local workaround.

From what you said before, maybe sticking a sleep in rc.sysinit before
the multipath.static is called could also help?  If so, how long a sleep
would you suggest?

Thanks,
Rick

-----Original Message-----
From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
On Behalf Of malahal@us.ibm.com
Sent: Monday, February 18, 2008 5:20 PM
To: dm-devel@redhat.com
Subject: Re: [dm-devel] Multipath not rebuilding correctly on reboot

Greene, Rick [rick.greene@ncogroup.com] wrote:
> Quick question...what RPM would I find udevsettle in? Doesn't appear
to
> be installed on my system (RedHat Enterprise Linux 4), nor can I find
> reference to it on RedHat's site.

Part of udev rpm (udev-085-30.37) on my system (SLES10 SP1). Maybe RHEL4
has an older version of udev that lacks udevsettle. That explains why
they used a "sleep"!

--Malahal.

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel

Re: Multipath not rebuilding correctly on reboot

[Benjamin Marzinski]

On Tue, Feb 19, 2008 at 07:21:19AM -0500, Greene, Rick wrote:
> I just checked one of my RHEL5 servers, and it does have udevsettle, so
> it looks like I'm stuck with my current rc.local workaround.
> 
> >From what you said before, maybe sticking a sleep in rc.sysinit before
> the multipath.static is called could also help?  If so, how long a sleep
> would you suggest?

You'll probably need to experiment. Start with something like 5. If that
works, try cutting it down.

I'll try to get a test-rpm with the patch I sent earlier built
soonish, so you can try that.

I don't think udevsettle would help things anyway.  It looks like your
devices may have come online before udev was started. In that case, udev
won't handle them, which is why the multipath call exists in rc.sysinit.

-Ben
 
> Thanks,
> Rick
> 
> -----Original Message-----
> From: dm-devel-bounces@redhat.com [mailto:dm-devel-bounces@redhat.com]
> On Behalf Of malahal@us.ibm.com
> Sent: Monday, February 18, 2008 5:20 PM
> To: dm-devel@redhat.com
> Subject: Re: [dm-devel] Multipath not rebuilding correctly on reboot
> 
> Greene, Rick [rick.greene@ncogroup.com] wrote:
> > Quick question...what RPM would I find udevsettle in? Doesn't appear
> to
> > be installed on my system (RedHat Enterprise Linux 4), nor can I find
> > reference to it on RedHat's site.
> 
> Part of udev rpm (udev-085-30.37) on my system (SLES10 SP1). Maybe RHEL4
> has an older version of udev that lacks udevsettle. That explains why
> they used a "sleep"!
> 
> --Malahal.
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel