multipath problem

multipath problem

[Pavel Stano]

hello

i have strange problem with multipath
my configuration is: sunfire x4100 with 2 lsi sas 3442-e cards connected
to promise vtrak e310s (mptsas driver)

after i boot and multipath-tools is not installed, it look like this
redneck:~# lsscsi
[0:0:0:0]    cd/dvd  AMI      Virtual CDROM    1.00  /dev/scd0
[1:0:0:0]    disk    AMI      Virtual Floppy   1.00  /dev/sdb
[2:0:0:0]    disk    Promise  VTrak E310s      0322  /dev/sda
[3:0:0:0]    disk    Promise  VTrak E310s      0322  /dev/sdc
[4:0:0:0]    disk    SEAGATE  ST973402SSUN72G  0400  -
[4:0:1:0]    disk    SEAGATE  ST973402SSUN72G  0400  -
[4:1:0:0]    disk    LSILOGIC Logical Volume   3000  /dev/sdd

redneck:~# pvs
  Found duplicate PV tS0KIb4H0CVGAspUqdWIkZSUVSwMlwib: using /dev/sdc
not /dev/sda
  PV         VG   Fmt  Attr PSize PFree
  /dev/sdc   vg0  lvm2 a-   2.32T 3.00G

and i want create multipath failover device with sda and sdc (and on top
of that device i want use LVM)

when i install multipath-tools (debian 4.0)
apt-get install multipath-tools
it automatically start multipathd, but it is in D state, it freeze somewhere
multipathd -k dont work
sda/sdc is not accessible, every proces accessing sda/sdc go to D state
and after some minutes there are some mesasges from kernel:

Oct 18 21:00:15 redneck kernel: mptscsih: ioc1: attempting task abort!
(sc=ffff8102157fc080)
Oct 18 21:00:15 redneck kernel: sd 0:0:0:0: [sda] CDB: Read(10): 28 00
00 00 00 00 00 00 01 00
Oct 18 21:00:19 redneck kernel: mptbase: ioc0: LogInfo(0x31140000):
Originator={PL}, Code={IO Executed}, SubCode(0x0000)
Oct 18 21:00:19 redneck kernel: mptscsih: ioc0: task abort: SUCCESS
(sc=ffff8102157fc080)
Oct 18 21:00:29 redneck kernel: mptscsih: ioc0: attempting task abort!
(sc=ffff8102157fc080)
Oct 18 21:00:29 redneck kernel: sd 0:0:0:0: [sda] CDB: Test Unit Ready:
00 00 00 00 00 00
Oct 18 21:00:34 redneck kernel: mptbase: ioc0: LogInfo(0x31140000):
Originator={PL}, Code={IO Executed}, SubCode(0x0000)
Oct 18 21:00:34 redneck kernel: mptscsih: ioc0: task abort: SUCCESS
(sc=ffff8102157fc080)
Oct 18 21:00:34 redneck kernel: mptscsih: ioc0: attempting task abort!
(sc=ffff8104163c30c0)
Oct 18 21:00:34 redneck kernel: sd 0:0:0:0: [sda] CDB: Read(10): 28 00
00 00 00 00 00 00 01 00
Oct 18 21:00:39 redneck kernel: mptbase: ioc0: LogInfo(0x31140000):
Originator={PL}, Code={IO Executed}, SubCode(0x0000)
Oct 19 21:00:39 redneck kernel: mptscsih: ioc0: task abort: SUCCESS
(sc=ffff8104163c30c0)
Oct 18 21:00:49 redneck kernel: mptscsih: ioc0: attempting task abort!
(sc=ffff8104163c30c0)
Oct 18 21:00:49 redneck kernel: sd 0:0:0:0: [sda] CDB: Test Unit Ready:
00 00 00 00 00 00
Oct 18 21:00:50 redneck kernel: mptbase: ioc0: LogInfo(0x31140000):
Originator={PL}, Code={IO Executed}, SubCode(0x0000)
Oct 18 21:00:50 redneck kernel: mptscsih: ioc0: Response
Code(0x00000005): F/W: The requested task failed.
Oct 18 21:00:50 redneck kernel: mptscsih: ioc0: task abort: SUCCESS
(sc=ffff8104163c30c0)
Oct 18 21:00:50 redneck kernel: mptscsih: ioc0: attempting target reset!
(sc=ffff8102157fc080)
Oct 18 21:00:50 redneck kernel: sd 0:0:0:0: [sda] CDB: Read(10): 28 00
00 00 00 00 00 00 01 00
Oct 18 21:00:52 redneck kernel: mptscsih: ioc0: Issue of TaskMgmt failed!
Oct 18 21:00:52 redneck kernel: mptscsih: ioc0: target reset: FAILED
(sc=ffff8102157fc080)
Oct 18 21:00:52 redneck kernel: mptscsih: ioc0: attempting bus reset!
(sc=ffff8102157fc080)
Oct 18 21:00:52 redneck kernel: sd 0:0:0:0: [sda] CDB: Read(10): 28 00
00 00 00 00 00 00 01 00
Oct 18 21:01:07 redneck kernel: mptbase: Initiating ioc0 recovery
Oct 18 21:01:07 redneck kernel: mptscsih: ioc0: Issue of TaskMgmt failed!
Oct 18 21:01:07 redneck kernel: mptscsih: ioc0: bus reset: FAILED
(sc=ffff8102157fc080)
Oct 18 21:01:07 redneck kernel: mptscsih: ioc0: attempting host reset!
(sc=ffff8102157fc080)
Oct 18 21:01:07 redneck kernel: mptbase: Initiating ioc0 recovery
Oct 18 21:01:21 redneck kernel: mptscsih: ioc0: host reset: SUCCESS
(sc=ffff8102157fc080)
Oct 18 21:01:21 redneck kernel: sd 0:0:0:0: scsi: Device offlined - not
ready after error recovery
Oct 18 21:01:21 redneck kernel: sd 0:0:0:0: scsi: Device offlined - not
ready after error recovery
Oct 18 21:01:21 redneck kernel: sd 0:0:0:0: rejecting I/O to offline device

where can be the problem ? in mptsas/mptscsih/mptbase driver or
dm-multipath ?

thanks
-- 
Pavel Stano

Multipath problem

[Oliver Heinz]

Hi,

I'm trying to setup a HP packaged cluster (2xDL380G4 Servers +MA500G2 
Storage) both Servers  are connected via 2 SCSI-Links one for each of 
the storages's redundancy controllers.
The Storage shows as /dev/cciss/c0d1 and /dev/cciss/c1d0. When I create 
an multipath md device with version 1.6 of mdadm I can create it but 
restarting the array after I stopped it fails. With version 1.8.2 the 
size of the generated Array is 0 Blocks but I can restart it (which buys 
me nothing with that size ;-)

Mixing mdadm-1.6 and 1.8.1 for creating/managing the device doesn't 
work, it gives me an segfault.

Distro: Is debian woody, with a 2.4.25 debian standard kernel + patches 
for acl+ea and devmapper (linux-2.4.26-rc1-devmapper-ioctl.patch)

Any Ideas?

Thanks in advance,
Oliver


Version 1.60 (debian-package from adrian bunk):
server-b:~# mdadm --create /dev/md0 --level multipath -n 2  
/dev/cciss/c0d1 /dev/cciss/c1d0
VERS = 9000
mdadm: array /dev/md0 started.

server-b:/usr/src/packages# cat /proc/mdstat
Personalities : [multipath]
read_ahead 1024 sectors
md0 : active multipath cciss/c1d0[0] cciss/c0d1[1]
      573496704 blocks [1/1] [U]

unused devices: <none>

mdadm --examine --scan --config=/etc/mdadm/mdadm.conf >> 
/etc/mdadm/mdadm.conf
server-b:/usr/src/packages/mdadm-1.8.1# cat /etc/mdadm/mdadm.conf
DEVICE /dev/cciss/c[0-9]d[0-9]
ARRAY /dev/md0 level=multipath num-devices=1 
UUID=b4370fc9:9f734ab7:d6811ec0:062e8936
   spares=2   devices=/dev/cciss/c1d0,/dev/cciss/c0d1

server-b:/usr/src/packages# mdadm /dev/md0 --stop
server-b:/usr/src/packages# mdadm -A /dev/md0 -f /dev/cciss/c1d0 
/dev/cciss/c0d1
mdadm: failed to RUN_ARRAY /dev/md0: Invalid argument




Version 1.8.2 (source compiled):
server-b:/usr/src/packages# mdadm --create /dev/md0 --level multipath -n 
2  /dev/cciss/c0d1 /dev/cciss/c1d0
mdadm: array /dev/md0 started.

server-b:~# cat /proc/mdstat
Personalities : [multipath]
read_ahead 1024 sectors
md0 : active multipath cciss/c1d0[0] cciss/c0d1[1]
      0 blocks [1/1] [U]

unused devices: <none>

mdadm --examine --scan --config=/etc/mdadm/mdadm.conf >> 
/etc/mdadm/mdadm.conf
server-b:/usr/src/packages# cat /etc/mdadm/mdadm.conf
DEVICE /dev/cciss/c[0-9]d[0-9]
ARRAY /dev/md0 level=multipath num-devices=1 
UUID=afcb797f:f7cfa5f6:e0ed8819:59529278
   devices=/dev/cciss/c1d0,/dev/cciss/c0d1

server-b:/usr/src/packages# mdadm /dev/md0 --stop
server-b:/usr/src/packages/mdadm-1.8.1# mdadm -A /dev/md0 -f 
/dev/cciss/c1d0 /dev/cciss/c0d1
mdadm: /dev/md0 has been started with 1 drive and 1 spare.

Re: Multipath problem

[Luca Berra]

[-- Attachment #1: Type: text/plain, Size: 393 bytes --]

On Tue, Nov 23, 2004 at 01:19:51PM +0100, Oliver Heinz wrote:
>Mixing mdadm-1.6 and 1.8.1 for creating/managing the device doesn't 
>work, it gives me an segfault.

try patching mdadm-1.8.1 with this patch, it might help with the
segfault.


-- 
Luca Berra -- bluca@comedia.it
        Communication Media & Services S.r.l.
 /"\
 \ /     ASCII RIBBON CAMPAIGN
  X        AGAINST HTML MAIL
 / \

[-- Attachment #2: mdadm-1.8.1-memset.patch --]
[-- Type: text/plain, Size: 933 bytes --]

--- mdadm-1.8.1/mdadm.c.bluca	2004-11-14 19:44:26.000000000 +0100
+++ mdadm-1.8.1/mdadm.c	2004-11-14 19:44:31.747309097 +0100
@@ -80,11 +80,10 @@
 
 	int mdfd = -1;
 
-	ident.uuid_set=0;
+	memset(&ident,0,sizeof(struct mddev_ident_s));
 	ident.level = UnSet;
 	ident.raid_disks = UnSet;
 	ident.super_minor= UnSet;
-	ident.devices=0;
 
 	while ((option_index = -1) ,
 	       (opt=getopt_long(argc, argv,
--- mdadm-1.8.1/config.c.bluca	2004-11-02 06:11:06.000000000 +0100
+++ mdadm-1.8.1/config.c	2004-11-14 19:44:35.693660204 +0100
@@ -266,15 +266,11 @@
 	struct mddev_ident_s mis;
 	mddev_ident_t mi;
 
-	mis.uuid_set = 0;
+	memset(&mis,0,sizeof(struct mddev_ident_s));
 	mis.super_minor = UnSet;
 	mis.level = UnSet;
 	mis.raid_disks = UnSet;
 	mis.spare_disks = UnSet;
-	mis.devices = NULL;
-	mis.devname = NULL;
-	mis.spare_group = NULL;
-	mis.autof = 0;
 
 	for (w=dl_next(line); w!=line; w=dl_next(w)) {
 		if (w[0] == '/') {

Re: Multipath problem

[Neil Brown]

On Tuesday November 23, oheinz@fbihome.de wrote:
> Hi,
> 
> I'm trying to setup a HP packaged cluster (2xDL380G4 Servers +MA500G2 
> Storage) both Servers  are connected via 2 SCSI-Links one for each of 
> the storages's redundancy controllers.
> The Storage shows as /dev/cciss/c0d1 and /dev/cciss/c1d0. When I create 
> an multipath md device with version 1.6 of mdadm I can create it but 
> restarting the array after I stopped it fails. With version 1.8.2 the 
> size of the generated Array is 0 Blocks but I can restart it (which buys 
> me nothing with that size ;-)
> 
> Mixing mdadm-1.6 and 1.8.1 for creating/managing the device doesn't 
> work, it gives me an segfault.

mdadm 1.8.0 is the version I would recommend.  1.8.1 is a development
release.

> server-b:/usr/src/packages# mdadm -A /dev/md0 -f /dev/cciss/c1d0 
> /dev/cciss/c0d1
> mdadm: failed to RUN_ARRAY /dev/md0: Invalid argument
> 

If this still happens with 1.8.0, could you see if there are any
messages in the kernel log (e.g. output of 'dmesg'), and send them to
me.

Thanks,
NeilBrown