* MPTSAS: ("activate status led" | "find disc") in external enclosure
@ 2008-04-18 10:41 Lars Täuber
2008-04-18 14:29 ` James Bottomley
0 siblings, 1 reply; 10+ messages in thread
From: Lars Täuber @ 2008-04-18 10:41 UTC (permalink / raw)
To: linux-scsi
Hallo!
As some of you might already now I have to set up a (for us) bigger SAN with Linux.
I'm simulating disc failure right now. To find a defective disc in the enclosure is unresolved yet.
I already had a look at several web pages and searched for it but without luck.
The manual of the enclosure says (PROMISE VTRAK J610S):
-----------------------------------------------------------------------
LEDs State
| Dark | Steady Green | Flashing Green
Power/Activity* | No Drive | Drive Present | Activity
Status** | HBA/RAID controller determines the LED behavior
[...]
** Refer to the user documentation for your HBA or RAID controller for this
information.
-----------------------------------------------------------------------
Is there a standard way to lit the led in the enclosure with linux means or anything alike?
The enclosure does not tell the serial numbers of the included disc.
The HBA is an LSI SAS 3801X.
Thanks
Lars
--
Informationstechnologie
Berlin-Brandenburgische Akademie der Wissenschaften
Jägerstrasse 22-23 10117 Berlin
Tel.: +49 30 20370-352 http://www.bbaw.de
--
To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 10+ messages in thread* Re: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-18 10:41 MPTSAS: ("activate status led" | "find disc") in external enclosure Lars Täuber @ 2008-04-18 14:29 ` James Bottomley 2008-04-21 9:01 ` Lars Täuber 0 siblings, 1 reply; 10+ messages in thread From: James Bottomley @ 2008-04-18 14:29 UTC (permalink / raw) To: Lars Täuber; +Cc: linux-scsi On Fri, 2008-04-18 at 12:41 +0200, Lars Täuber wrote: > As some of you might already now I have to set up a (for us) bigger SAN with Linux. > I'm simulating disc failure right now. To find a defective disc in the enclosure is unresolved yet. > I already had a look at several web pages and searched for it but without luck. > > The manual of the enclosure says (PROMISE VTRAK J610S): > ----------------------------------------------------------------------- > LEDs State > | Dark | Steady Green | Flashing Green > Power/Activity* | No Drive | Drive Present | Activity > Status** | HBA/RAID controller determines the LED behavior > [...] > ** Refer to the user documentation for your HBA or RAID controller for this > information. > ----------------------------------------------------------------------- > > Is there a standard way to lit the led in the enclosure with linux means or anything alike? > The enclosure does not tell the serial numbers of the included disc. > The HBA is an LSI SAS 3801X. It depends on whether you have the HBA configured in RAID mode or not. If you have, then it takes absolute control of the enclosure management at the moment and I don't think you can get to it. If you run the HBA as a pure SAS one, then the promise website says this enclosure is ses2 compliant, so you should just be able to insert the ses module and have enclosure management (2.6.24+ kernels). This relies on the HBA exposing the enclosure device, but I think mptsas only eats it for RAID configurations. to see what's in the enclosure, just do ls /sys/class/enclosure/*/ each of the subdirectories has a slot label (name taken from SES) to locate the enclosure, just echo 1 to the locate file and it will flash the lights. If it has a disk, there should be a device link in the slot directory (might not be, this depends on ses working correctly and VPD inquiries identifying the right disk). James -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-18 14:29 ` James Bottomley @ 2008-04-21 9:01 ` Lars Täuber 2008-04-21 15:16 ` James Bottomley 0 siblings, 1 reply; 10+ messages in thread From: Lars Täuber @ 2008-04-21 9:01 UTC (permalink / raw) To: James Bottomley; +Cc: linux-scsi Hi James, James Bottomley <James.Bottomley@HansenPartnership.com> schrieb: > On Fri, 2008-04-18 at 12:41 +0200, Lars Täuber wrote: > > Is there a standard way to lit the led in the enclosure with linux means or anything alike? > > The enclosure does not tell the serial numbers of the included disc. > > The HBA is an LSI SAS 3801X. > > It depends on whether you have the HBA configured in RAID mode or not. > If you have, then it takes absolute control of the enclosure management > at the moment and I don't think you can get to it. our HBA has no RAID option. > If you run the HBA as a pure SAS one, then the promise website says this > enclosure is ses2 compliant, so you should just be able to insert the > ses module and have enclosure management (2.6.24+ kernels). This relies > on the HBA exposing the enclosure device, but I think mptsas only eats > it for RAID configurations. I tried 2.6.24.5 but the ses seems to be introduced in 2.6.25. > to see what's in the enclosure, just do > > ls /sys/class/enclosure/*/ # ls /sys/class/enclosure/*/ /sys/class/enclosure/6:0:16:0/: 0 10 12 14 2 4 6 8 components subsystem 1 11 13 15 3 5 7 9 device uevent /sys/class/enclosure/6:0:33:0/: 0 10 12 14 2 4 6 8 components subsystem 1 11 13 15 3 5 7 9 device uevent This is two times the same enclosure. > each of the subdirectories has a slot label (name taken from SES) to > locate the enclosure, just echo 1 to the locate file and it will flash > the lights. If it has a disk, there should be a device link in the slot > directory (might not be, this depends on ses working correctly and VPD > inquiries identifying the right disk). monosan:/sys/class/enclosure/6:0:16:0/0 # ls -l insgesamt 0 -rw-r--r-- 1 root root 4096 21. Apr 10:48 active -rw-r--r-- 1 root root 4096 21. Apr 10:48 fault -rw-r--r-- 1 root root 4096 21. Apr 10:48 locate -rw-r--r-- 1 root root 4096 21. Apr 10:48 status lrwxrwxrwx 1 root root 0 21. Apr 10:46 subsystem -> ../../../enclosure_component -r--r--r-- 1 root root 4096 21. Apr 10:48 type --w------- 1 root root 4096 21. Apr 10:48 uevent There seems to be no device link if I understood you correctly. Is the subdirctory numbering somehow in relation to the SCSI ID? Thanks Lars -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-21 9:01 ` Lars Täuber @ 2008-04-21 15:16 ` James Bottomley 2008-04-22 7:18 ` Lars Täuber 0 siblings, 1 reply; 10+ messages in thread From: James Bottomley @ 2008-04-21 15:16 UTC (permalink / raw) To: Lars Täuber; +Cc: linux-scsi On Mon, 2008-04-21 at 11:01 +0200, Lars Täuber wrote: > Hi James, > > James Bottomley <James.Bottomley@HansenPartnership.com> schrieb: > > On Fri, 2008-04-18 at 12:41 +0200, Lars Täuber wrote: > > > Is there a standard way to lit the led in the enclosure with linux means or anything alike? > > > The enclosure does not tell the serial numbers of the included disc. > > > The HBA is an LSI SAS 3801X. > > > > It depends on whether you have the HBA configured in RAID mode or not. > > If you have, then it takes absolute control of the enclosure management > > at the moment and I don't think you can get to it. > > our HBA has no RAID option. > > > If you run the HBA as a pure SAS one, then the promise website says this > > enclosure is ses2 compliant, so you should just be able to insert the > > ses module and have enclosure management (2.6.24+ kernels). This relies > > on the HBA exposing the enclosure device, but I think mptsas only eats > > it for RAID configurations. > I tried 2.6.24.5 but the ses seems to be introduced in 2.6.25. OK ... it's hard for me to keep track of what went when. It must have gone in after 2.6.24 in the merge window. > > to see what's in the enclosure, just do > > > > ls /sys/class/enclosure/*/ > > # ls /sys/class/enclosure/*/ > /sys/class/enclosure/6:0:16:0/: > 0 10 12 14 2 4 6 8 components subsystem > 1 11 13 15 3 5 7 9 device uevent > > /sys/class/enclosure/6:0:33:0/: > 0 10 12 14 2 4 6 8 components subsystem > 1 11 13 15 3 5 7 9 device uevent > > This is two times the same enclosure. That's unusual .. to have two devices managing the same enclosure, but if you only have 16 slots and not 32, I suppose it must be so. I'd also guess the enclosure information doesn't provide slot names, so ses automatically provided the numbering. I have a 12 slot vitesse enclosure with two enclosure devices but they each manage half the slots: /sys/class/enclosure/0:0:1:0/: components power/ SLOT 007/ SLOT 009/ SLOT 011/ uevent device@ SLOT 006/ SLOT 008/ SLOT 010/ subsystem@ /sys/class/enclosure/0:0:3:0/: components power/ SLOT 001/ SLOT 003/ SLOT 005/ uevent device@ SLOT 000/ SLOT 002/ SLOT 004/ subsystem@ > > each of the subdirectories has a slot label (name taken from SES) to > > locate the enclosure, just echo 1 to the locate file and it will flash > > the lights. If it has a disk, there should be a device link in the slot > > directory (might not be, this depends on ses working correctly and VPD > > inquiries identifying the right disk). > > monosan:/sys/class/enclosure/6:0:16:0/0 # ls -l > insgesamt 0 > -rw-r--r-- 1 root root 4096 21. Apr 10:48 active > -rw-r--r-- 1 root root 4096 21. Apr 10:48 fault > -rw-r--r-- 1 root root 4096 21. Apr 10:48 locate > -rw-r--r-- 1 root root 4096 21. Apr 10:48 status > lrwxrwxrwx 1 root root 0 21. Apr 10:46 subsystem -> ../../../enclosure_component > -r--r--r-- 1 root root 4096 21. Apr 10:48 type > --w------- 1 root root 4096 21. Apr 10:48 uevent > > There seems to be no device link if I understood you correctly. > Is the subdirctory numbering somehow in relation to the SCSI ID? No ... the subdirectory numbering is taken from the enclosure information (if available)... it should be the slot numbers of the enclosure. If the slot is populated a device link should appear (this is the tricky bit because the ses driver uses VPD inquiries to match up the reported disk, assuming the enclosure reports it, to the actual one. These work for SAS disks, but not for SATA ones). Empty slots have no device link (but you can still flash the lights using the files). If you look at my enclosure, I only have two devices: sparkweed:~# ls -l /sys/class/enclosure/*/*/device lrwxrwxrwx 1 root root 0 2008-04-21 10:16 /sys/class/enclosure/0:0:1:0/SLOT 006/device -> ../../../../../../../port-0:0:0/end_device-0:0:0/target0:0:0/0:0:0:0 lrwxrwxrwx 1 root root 0 2008-04-21 10:16 /sys/class/enclosure/0:0:3:0/SLOT 001/device -> ../../../../../../../port-0:1:11/end_device-0:1:11/target0:0:2/0:0:2:0 James James > Thanks > Lars > -- > To unsubscribe from this list: send the line "unsubscribe linux-scsi" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-21 15:16 ` James Bottomley @ 2008-04-22 7:18 ` Lars Täuber 2008-04-22 15:44 ` Moore, Eric 2008-04-22 16:12 ` James Bottomley 0 siblings, 2 replies; 10+ messages in thread From: Lars Täuber @ 2008-04-22 7:18 UTC (permalink / raw) To: James Bottomley; +Cc: linux-scsi James Bottomley <James.Bottomley@HansenPartnership.com> schrieb: > On Mon, 2008-04-21 at 11:01 +0200, Lars Täuber wrote: > > # ls /sys/class/enclosure/*/ > > /sys/class/enclosure/6:0:16:0/: > > 0 10 12 14 2 4 6 8 components subsystem > > 1 11 13 15 3 5 7 9 device uevent > > > > /sys/class/enclosure/6:0:33:0/: > > 0 10 12 14 2 4 6 8 components subsystem > > 1 11 13 15 3 5 7 9 device uevent > > > > This is two times the same enclosure. > > That's unusual .. to have two devices managing the same enclosure, but > if you only have 16 slots and not 32, I suppose it must be so. I use both external connections to both expanderboards of the enclosure just for redundancy. > > monosan:/sys/class/enclosure/6:0:16:0/0 # ls -l > > insgesamt 0 > > -rw-r--r-- 1 root root 4096 21. Apr 10:48 active > > -rw-r--r-- 1 root root 4096 21. Apr 10:48 fault > > -rw-r--r-- 1 root root 4096 21. Apr 10:48 locate > > -rw-r--r-- 1 root root 4096 21. Apr 10:48 status > > lrwxrwxrwx 1 root root 0 21. Apr 10:46 subsystem -> ../../../enclosure_component > > -r--r--r-- 1 root root 4096 21. Apr 10:48 type > > --w------- 1 root root 4096 21. Apr 10:48 uevent > > > > There seems to be no device link if I understood you correctly. > > Is the subdirctory numbering somehow in relation to the SCSI ID? > > If the slot is populated a device link should appear (this > is the tricky bit because the ses driver uses VPD inquiries to match up > the reported disk, assuming the enclosure reports it, to the actual one. > These work for SAS disks, but not for SATA ones). So this will never work for the SATA discs in our enclosure, right? Or is there a chance with asking LSI to do something in their firmware? Seems I have no chance to get to know which slot contains the failed drive without a shutdown. Bad luck. But thanks alot anyway. Best regards Lars -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* RE: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-22 7:18 ` Lars Täuber @ 2008-04-22 15:44 ` Moore, Eric 2008-04-23 8:11 ` Lars Täuber 2008-04-22 16:12 ` James Bottomley 1 sibling, 1 reply; 10+ messages in thread From: Moore, Eric @ 2008-04-22 15:44 UTC (permalink / raw) To: Lars Täuber, James Bottomley; +Cc: linux-scsi On Tuesday, April 22, 2008 1:19 AM, Lars Täuber wrote: > So this will never work for the SATA discs in our enclosure, > right? Or is there a chance with asking LSI to do something > in their firmware? > > Seems I have no chance to get to know which slot contains the > failed drive without a shutdown. Bad luck. > If you want to upgrade your controller fw, I need the contents of all the attributes in /sys/class/scsi_host/host#. Just yesterday we got Warner Wakko upgraded, and I believe it might of solved his problems. I'm not sure what problems your experiencing, as this thread has been hard to follow. I would like to point out there is a firmware request for sending SEP request, for instance setting LEDS. Here is a copy of the structure. We call this function to set LED when there is SMART errors (for non-raid devices). For RAID, the firmware handles it. Is this what your looking for? Function = MPI_FUNCTION_SCSI_ENCLOSURE_PROCESSOR: typedef struct _MSG_SEP_REQUEST { U8 TargetID; /* 00h */ U8 Bus; /* 01h */ U8 ChainOffset; /* 02h */ U8 Function; /* 03h */ U8 Action; /* 04h */ U8 Flags; /* 05h */ U8 Reserved1; /* 06h */ U8 MsgFlags; /* 07h */ U32 MsgContext; /* 08h */ U32 SlotStatus; /* 0Ch */ U32 Reserved2; /* 10h */ U32 Reserved3; /* 14h */ U32 Reserved4; /* 18h */ U16 Slot; /* 1Ch */ U16 EnclosureHandle; /* 1Eh */ } MSG_SEP_REQUEST, MPI_POINTER PTR_MSG_SEP_REQUEST, SEPRequest_t, MPI_POINTER pSEPRequest_t; /* Action defines */ #define MPI_SEP_REQ_ACTION_WRITE_STATUS (0x00) #define MPI_SEP_REQ_ACTION_READ_STATUS (0x01) /* Flags defines */ #define MPI_SEP_REQ_FLAGS_ENCLOSURE_SLOT_ADDRESS (0x01) #define MPI_SEP_REQ_FLAGS_BUS_TARGETID_ADDRESS (0x00) /* SlotStatus bits for MSG_SEP_REQUEST */ #define MPI_SEP_REQ_SLOTSTATUS_NO_ERROR (0x00000001) #define MPI_SEP_REQ_SLOTSTATUS_DEV_FAULTY (0x00000002) #define MPI_SEP_REQ_SLOTSTATUS_DEV_REBUILDING (0x00000004) #define MPI_SEP_REQ_SLOTSTATUS_IN_FAILED_ARRAY (0x00000008) #define MPI_SEP_REQ_SLOTSTATUS_IN_CRITICAL_ARRAY (0x00000010) #define MPI_SEP_REQ_SLOTSTATUS_PARITY_CHECK (0x00000020) #define MPI_SEP_REQ_SLOTSTATUS_PREDICTED_FAULT (0x00000040) #define MPI_SEP_REQ_SLOTSTATUS_UNCONFIGURED (0x00000080) #define MPI_SEP_REQ_SLOTSTATUS_HOT_SPARE (0x00000100) #define MPI_SEP_REQ_SLOTSTATUS_REBUILD_STOPPED (0x00000200) #define MPI_SEP_REQ_SLOTSTATUS_REQ_CONSISTENCY_CHECK (0x00001000) #define MPI_SEP_REQ_SLOTSTATUS_DISABLE (0x00002000) #define MPI_SEP_REQ_SLOTSTATUS_REQ_RESERVED_DEVICE (0x00004000) #define MPI_SEP_REQ_SLOTSTATUS_IDENTIFY_REQUEST (0x00020000) #define MPI_SEP_REQ_SLOTSTATUS_REQUEST_REMOVE (0x00040000) #define MPI_SEP_REQ_SLOTSTATUS_REQUEST_INSERT (0x00080000) #define MPI_SEP_REQ_SLOTSTATUS_DO_NOT_MOVE (0x00400000) #define MPI_SEP_REQ_SLOTSTATUS_ACTIVE (0x00800000) #define MPI_SEP_REQ_SLOTSTATUS_B_ENABLE_BYPASS (0x04000000) #define MPI_SEP_REQ_SLOTSTATUS_A_ENABLE_BYPASS (0x08000000) #define MPI_SEP_REQ_SLOTSTATUS_DEV_OFF (0x10000000) #define MPI_SEP_REQ_SLOTSTATUS_SWAP_RESET (0x80000000) -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-22 15:44 ` Moore, Eric @ 2008-04-23 8:11 ` Lars Täuber 2008-04-23 15:39 ` Moore, Eric 0 siblings, 1 reply; 10+ messages in thread From: Lars Täuber @ 2008-04-23 8:11 UTC (permalink / raw) To: Moore, Eric; +Cc: linux-scsi Hallo Eric, "Moore, Eric" <Eric.Moore@lsi.com> schrieb: > On Tuesday, April 22, 2008 1:19 AM, Lars Täuber wrote: > > > So this will never work for the SATA discs in our enclosure, > > right? Or is there a chance with asking LSI to do something > > in their firmware? > > > > Seems I have no chance to get to know which slot contains the > > failed drive without a shutdown. Bad luck. > > > > If you want to upgrade your controller fw, I need the contents of all the attributes in /sys/class/scsi_host/host#. Just yesterday we got Warner Wakko upgraded, and I believe it might of solved his problems. I'm not sure what problems your experiencing, as this thread has been hard to follow. I hoped I had the newet version of the firmware on the HBA. monosan:~ # cat /sys/class/scsi_host/host6/version_fw 01.24.01.00 monosan:~ # cat /sys/class/scsi_host/host6/version_mpi 105 monosan:~ # cat /sys/class/scsi_host/host6/version_nvdata_default 2d02h monosan:~ # cat /sys/class/scsi_host/host6/version_nvdata_persistent 2d02h monosan:~ # cat /sys/class/scsi_host/host6/version_product LSISAS1068 B1 monosan:~ # cat /sys/class/scsi_host/host6/board_name SAS3801X > I would like to point out there is a firmware request for sending SEP request, for instance setting LEDS. Here is a copy of the structure. We call this function to set LED when there is SMART errors (for non-raid devices). For RAID, the firmware handles it. Is this what your looking for? I'm not firm enough with scsi to understand all your words. But the problem I have is not that something doesn't work. It works with 2.6.25. I can get the LEDs to blink. I can choose which one should do. I simply don't know which one it should be. The problem is, I wanted to simultate a faulty drive without being one faulty. Therefore I choosed a (working) disk to be faulty by its mutlipath-name: dm-9 Then I found out which disk it is in sd? notation. Then I read the serial number of this disk with the smartmontools. Now I want this LED of the bay containing the disk with this serial number to blink. But I can't find out which LED matches which serial number of the containing disk. I know my english is not the best. Ask and I try to explain again. Regards Lars -- Informationstechnologie Berlin-Brandenburgische Akademie der Wissenschaften Jägerstrasse 22-23 10117 Berlin Tel.: +49 30 20370-352 http://www.bbaw.de -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* RE: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-23 8:11 ` Lars Täuber @ 2008-04-23 15:39 ` Moore, Eric 0 siblings, 0 replies; 10+ messages in thread From: Moore, Eric @ 2008-04-23 15:39 UTC (permalink / raw) To: Lars Täuber; +Cc: linux-scsi On Wednesday, April 23, 2008 2:12 AM, Lars Täuber wrote: > I hoped I had the newet version of the firmware on the HBA. > monosan:~ # cat /sys/class/scsi_host/host6/version_fw > 01.24.01.00 This is code was release back in December, so its fairly new. > > I would like to point out there is a firmware request for > sending SEP request, for instance setting LEDS. Here is a > copy of the structure. We call this function to set LED when > there is SMART errors (for non-raid devices). For RAID, the > firmware handles it. Is this what your looking for? > > I'm not firm enough with scsi to understand all your words. > But the problem I have is not that something doesn't work. It > works with 2.6.25. > I can get the LEDs to blink. I can choose which one should > do. I simply don't know which one it should be. > > The problem is, I wanted to simultate a faulty drive without > being one faulty. > Therefore I choosed a (working) disk to be faulty by its > mutlipath-name: dm-9 > Then I found out which disk it is in sd? notation. Then I > read the serial number of this disk with the smartmontools. > Now I want this LED of the bay containing the disk with this > serial number to blink. But I can't find out which LED > matches which serial number of the containing disk. > The current driver will set the faulty LED when there is sense ASC = 0x5D, meaning smart error. This will occurr from the device driver for devices not belonging to a RAID volume. If its in a RAID volume, the firmware will handle setting the LED. You can verify this by adding a printk inside the source code: From function mptscsih_copy_sense_data(), scroll down to "Log Smart Data", add it here after the check on 0x5D. Also mptscish_issue_sep_command() is called to send the SEP command to set the LED. This is found in /usr/src/linux/drivers/message/fusion/mptscsih.c. Also, you should be able to figure out which slot your device inside your enclosure. Each enclousre will have a unique enclosoure logical id, which is simailar to a sas address. Each device that is in inside the enclosure is assigned a slot id, which is the same as a bay indentifier. If you have a SAS device, it will have the sas_address on the sticker. Then with that sas_address, you can search inside /sys/class/sas_device, that will tell you which end device it is. Within that, you will see the bay identifier, which is the slot id. The slot id I guess is assigned from 0 to the largest number you have of slots in your enclosure, probally from left to right. If you look inside the expanders, you will see the enslosure logical id. If you have more than one expander in the enclosure, they all have the same enclosure logical id. Eric -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-22 7:18 ` Lars Täuber 2008-04-22 15:44 ` Moore, Eric @ 2008-04-22 16:12 ` James Bottomley 2008-04-23 7:55 ` Lars Täuber 1 sibling, 1 reply; 10+ messages in thread From: James Bottomley @ 2008-04-22 16:12 UTC (permalink / raw) To: Lars Täuber; +Cc: linux-scsi On Tue, 2008-04-22 at 09:18 +0200, Lars Täuber wrote: > James Bottomley <James.Bottomley@HansenPartnership.com> schrieb: > > On Mon, 2008-04-21 at 11:01 +0200, Lars Täuber wrote: > > > # ls /sys/class/enclosure/*/ > > > /sys/class/enclosure/6:0:16:0/: > > > 0 10 12 14 2 4 6 8 components subsystem > > > 1 11 13 15 3 5 7 9 device uevent > > > > > > /sys/class/enclosure/6:0:33:0/: > > > 0 10 12 14 2 4 6 8 components subsystem > > > 1 11 13 15 3 5 7 9 device uevent > > > > > > This is two times the same enclosure. > > > > That's unusual .. to have two devices managing the same enclosure, but > > if you only have 16 slots and not 32, I suppose it must be so. > > I use both external connections to both expanderboards of the enclosure just for redundancy. > > > > > monosan:/sys/class/enclosure/6:0:16:0/0 # ls -l > > > insgesamt 0 > > > -rw-r--r-- 1 root root 4096 21. Apr 10:48 active > > > -rw-r--r-- 1 root root 4096 21. Apr 10:48 fault > > > -rw-r--r-- 1 root root 4096 21. Apr 10:48 locate > > > -rw-r--r-- 1 root root 4096 21. Apr 10:48 status > > > lrwxrwxrwx 1 root root 0 21. Apr 10:46 subsystem -> ../../../enclosure_component > > > -r--r--r-- 1 root root 4096 21. Apr 10:48 type > > > --w------- 1 root root 4096 21. Apr 10:48 uevent > > > > > > There seems to be no device link if I understood you correctly. > > > Is the subdirctory numbering somehow in relation to the SCSI ID? > > > > If the slot is populated a device link should appear (this > > is the tricky bit because the ses driver uses VPD inquiries to match up > > the reported disk, assuming the enclosure reports it, to the actual one. > > These work for SAS disks, but not for SATA ones). > > So this will never work for the SATA discs in our enclosure, right? Or is there a chance with asking LSI to do something in their firmware? I don't think its an LSI issue. The enclosure itself collects WWNs from the inserted drives. SAS drives have an agreed format which they present in a VPD INQUIRY, so they're easy to match up. SATA drives have a defined way of manufacturing this information (defined in the SAT standard). I just need to plug one of these in and make sure my enclosure does this correctly. Once that's done, I have to persuade the ATA people to add the correct form of translation for the VPD inquiry to libata's SAT layer ... then it should all "just work". So it's basically just some development work. > Seems I have no chance to get to know which slot contains the failed drive without a shutdown. Bad luck. You could start by asking the sg_ses tools what you have. You need to find the sg device for your enclosure and then do sg_ses --page=10 /dev/sg<n> It will print out a list of what the enclosure thinks the addresses for the devices are. Then I just need to verify they're SAT format and away we can go. James -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: MPTSAS: ("activate status led" | "find disc") in external enclosure 2008-04-22 16:12 ` James Bottomley @ 2008-04-23 7:55 ` Lars Täuber 0 siblings, 0 replies; 10+ messages in thread From: Lars Täuber @ 2008-04-23 7:55 UTC (permalink / raw) To: James Bottomley; +Cc: linux-scsi [-- Attachment #1: Type: text/plain, Size: 845 bytes --] Hallo James, James Bottomley <James.Bottomley@HansenPartnership.com> schrieb: > On Tue, 2008-04-22 at 09:18 +0200, Lars Täuber wrote: > You could start by asking the sg_ses tools what you have. You need to > find the sg device for your enclosure and then do > > sg_ses --page=10 /dev/sg<n> I just did it and attached the output monosan:~ # sg_ses --page=10 /dev/sg19 > sg19.ses <<<additional: response too short>>> > It will print out a list of what the enclosure thinks the addresses for > the devices are. Then I just need to verify they're SAT format and away > we can go. Thanks. Lars -- Informationstechnologie Berlin-Brandenburgische Akademie der Wissenschaften Jägerstrasse 22-23 10117 Berlin Tel.: +49 30 20370-352 http://www.bbaw.de [-- Attachment #2: sg19.ses --] [-- Type: application/octet-stream, Size: 12430 bytes --] PROMISE 3U-SAS-16-D BP 0107 enclosure services device Additional (device) element status diagnostic page: generation code: 0x0 Element type: Array device, subenclosure id: 0 element index: 0 [0x0] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 1 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4200 phy identifier: 0x0 element index: 1 [0x1] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 2 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4201 phy identifier: 0x0 element index: 2 [0x2] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 3 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4202 phy identifier: 0x0 element index: 3 [0x3] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 4 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4203 phy identifier: 0x0 element index: 4 [0x4] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 5 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4204 phy identifier: 0x0 element index: 5 [0x5] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 6 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4205 phy identifier: 0x0 element index: 6 [0x6] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 7 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4206 phy identifier: 0x0 element index: 7 [0x7] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 8 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4207 phy identifier: 0x0 element index: 8 [0x8] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 9 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4208 phy identifier: 0x0 element index: 9 [0x9] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 10 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b4209 phy identifier: 0x0 element index: 10 [0xa] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 11 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b420a phy identifier: 0x0 element index: 11 [0xb] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 12 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b420b phy identifier: 0x0 element index: 12 [0xc] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 13 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b420c phy identifier: 0x0 element index: 13 [0xd] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 14 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b420d phy identifier: 0x0 element index: 14 [0xe] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 15 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b420e phy identifier: 0x0 element index: 15 [0xf] Transport protocol: SAS number of phys: 1, not all phys: 1, bay number: 16 phy index: 0 device type: no device attached initiator port for: target port for: SATA_device attached SAS address: 0x50001553561b423f SAS address: 0x50001553561b420f phy identifier: 0x0 Element type: Enclosure services controller electronics, subenclosure id: 0 element index: 38 [0x26] Transport protocol: SAS number of phys: 24 phy index: 0 phy identifier: 0x50 connector element index: 21, other element index: 83 SAS address: 0x561b423f28002a01 phy index: 1 phy identifier: 0x2c connector element index: 46, other element index: 3 SAS address: 0x3004320534063607 phy index: 2 phy identifier: 0x38 connector element index: 58, other element index: 9 SAS address: 0x3c0a3e0b400c420d phy index: 3 phy identifier: 0x44 connector element index: 70, other element index: 15 SAS address: 0x48ff49ff4aff4bff phy index: 4 phy identifier: 0x4c connector element index: 77 SAS address: 0x4eff4fff163e0027 phy index: 5 phy identifier: 0x18 connector element index: 0, other element index: 0 SAS address: 0x50001553561b433f phy index: 6 phy identifier: 0x29 connector element index: 43, other element index: 1 SAS address: 0x2d022f0331043305 phy index: 7 phy identifier: 0x35 connector element index: 55, other element index: 7 SAS address: 0x39083b093d0a3f0b phy index: 8 phy identifier: 0x41 connector element index: 67, other element index: 13 SAS address: 0x450e470f50ff51ff phy index: 9 phy identifier: 0x52 connector element index: 83 SAS address: 0x54ff55ff56ff57ff phy index: 10 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 11 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 12 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 13 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 14 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 15 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 16 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 17 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 18 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 19 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 20 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 21 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 22 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 23 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 element index: 39 [0x27] Transport protocol: SAS number of phys: 24 phy index: 0 phy identifier: 0x50 connector element index: 21, other element index: 83 SAS address: 0x561b433f29002b01 phy index: 1 phy identifier: 0x2d connector element index: 47, other element index: 3 SAS address: 0x3104330535063707 phy index: 2 phy identifier: 0x39 connector element index: 59, other element index: 9 SAS address: 0x3d0a3f0b410c430d phy index: 3 phy identifier: 0x45 connector element index: 71, other element index: 15 SAS address: 0x50ff51ff52ff53ff phy index: 4 phy identifier: 0x54 connector element index: 85 SAS address: 0x56ff57ff00000000 phy index: 5 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 6 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 7 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 8 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 9 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 10 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 11 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 12 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 13 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 14 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 15 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 16 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 17 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 18 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 19 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 20 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 21 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 22 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 phy index: 23 phy identifier: 0x0 connector element index: 0, other element index: 0 SAS address: 0x0000000000000000 ^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2008-04-23 15:39 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-04-18 10:41 MPTSAS: ("activate status led" | "find disc") in external enclosure Lars Täuber
2008-04-18 14:29 ` James Bottomley
2008-04-21 9:01 ` Lars Täuber
2008-04-21 15:16 ` James Bottomley
2008-04-22 7:18 ` Lars Täuber
2008-04-22 15:44 ` Moore, Eric
2008-04-23 8:11 ` Lars Täuber
2008-04-23 15:39 ` Moore, Eric
2008-04-22 16:12 ` James Bottomley
2008-04-23 7:55 ` Lars Täuber
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox