Re: Advice requested

[Phil Turmel <philip@turmel.org>]

On 11/03/2015 08:36 AM, o1bigtenor wrote:
> On Tue, Nov 3, 2015 at 7:09 AM, Phil Turmel <philip@turmel.org> wrote:

>> Just add the other drives back into the array in one step, then let them
>> recover.
>>
>> mdadm /dev/md0 --add /dev/sdc1 --add /dev/sde1
>>
>> {Use the current names if those aren't correct at this time.}

One caveat -- don't do this part until you've corrected your timeout mismatch
problem, or any latent UREs will break your array again.

>> Although I wouldn't set up a new system quite like this, there's nothing
>> wrong with this layout.  It'll be fine like this until the day you want
>> more space.  A new bigger array would be an appropriate time to redesign.
> 
> Would you have any suggestions as to how to setup a different array?

I've pasted my most recent media server build's 'lsdrv' report at the end
of this mail.[1]  Some notes:

1) Paired SSDs for boot and OS.  Boots from EFI SYS partitions containing
monolithic kernels (EFI stub + kernel + initramfs in one file).  My
maintenance scripts place identical kernels in both boot partitions without
running as mirrors.

2) Balance of SSDs is mirrored and operated as an LVM physical volume and
Volume Group.  This group contains root, home, and swap.  Some space is
left unallocated for emergencies, as LVM can be modified on the fly.

3) Bulk storage is on multiple unpartitioned drives in raid6, which then
forms an LVM physical volume and Volume Group.  Again, some space left
unallocated for emergencies.

> (My NAS box is old server hardware where I am using hardware raid.)
> 
> Thanking you very much for your generous assistance.
> (copied all of the commands so that anyone accessing the information for
> their own use might have some ideas of what to do - - - hopefully also
> achieving a successful result!

You're welcome.

Phil

[1] http://github.com/pturmel/lsdrv

-- 

brutus ~ # lsdrv
PCI [ahci] 00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family SATA AHCI Controller (rev 05)
├scsi 0:0:0:0 ATA      Crucial_CT250MX2 {15250FDF00E8}
│└sda 232.89g [8:0] Partitioned (gpt)
│ ├sda1 512.00m [8:1] vfat 'BootA' {FDF9-37CE}
│ │└Mounted as /dev/sda1 @ /bootA
│ └sda2 232.38g [8:2] MD raid10,near2 (1/2) (w/ sdb2) in_sync 'sysresccd:1' {20b4a43b-447d-dc22-0b96-3f49392b07ec}
│  └md1 232.35g [9:1] MD v1.2 raid10,near2 (2) clean, 512k Chunk {20b4a43b:447ddc22:0b963f49:392b07ec}
│   │                 PV LVM2_member 56.00g used, 176.35g free {WnG1i4-9LYh-6EHe-mMUh-P4hZ-2oNm-R5Vze7}
│   └VG Fast 232.35g 176.35g free {Yp0bW3-xAS5-QQkW-dFSf-sGok-6ym0-XR3DLw}
│    ├dm-4 20.00g [252:4] LV Home ext4 'Home' {08f885a7-216c-47cc-8fa1-a25e28ca28b0}
│    │└Mounted as /dev/mapper/Fast-Home @ /home
│    ├dm-2 20.00g [252:2] LV Root ext4 'Root' {d77eb871-6366-4501-b3b0-5118daa034c6}
│    │└Mounted as /dev/mapper/Fast-Root @ /
│    └dm-3 16.00g [252:3] LV Swap swap 'Swap' {0e6731d8-2816-4c54-a6c3-2f6f48ee5544}
├scsi 1:0:0:0 ATA      Crucial_CT250MX2 {15250FDEF73C}
│└sdb 232.89g [8:16] Partitioned (gpt)
│ ├sdb1 512.00m [8:17] vfat 'BootB' {FDF9-37CE}
│ │└Mounted as /dev/sdb1 @ /bootB
│ └sdb2 232.38g [8:18] MD raid10,near2 (0/2) (w/ sda2) in_sync 'sysresccd:1' {20b4a43b-447d-dc22-0b96-3f49392b07ec}
│  └md1 232.35g [9:1] MD v1.2 raid10,near2 (2) clean, 512k Chunk {20b4a43b:447ddc22:0b963f49:392b07ec}
│                     PV LVM2_member 56.00g used, 176.35g free {WnG1i4-9LYh-6EHe-mMUh-P4hZ-2oNm-R5Vze7}
├scsi 2:x:x:x [Empty]
├scsi 3:x:x:x [Empty]
├scsi 4:x:x:x [Empty]
└scsi 5:x:x:x [Empty]
PCI [mpt2sas] 02:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
├scsi 6:0:0:0 ATA      WDC WD40EFRX-68W {WD-WCC4E1648652}
│└sdc 3.64t [8:32] MD raid6 (0/6) (w/ sdd,sde,sdf,sdg,sdh) in_sync 'sysresccd:2' {2d3f6b75-3a9b-12bc-1582-64533545931b}
│ └md2 14.55t [9:2] MD v1.2 raid6 (6) clean, 16k Chunk {2d3f6b75:3a9b12bc:15826453:3545931b}
│  │                PV LVM2_member 12.00t used, 2.55t free {ezb7fd-6iTr-PhjG-d1EW-xMNC-ThYm-KvTxgg}
│  └VG Bulk 14.55t 2.55t free {kOlzy0-xBY6-cIVX-bBgE-0ef8-cAEv-c9Ts9l}
│   ├dm-1 8.00t [252:1] LV Media xfs 'Media' {bb83668f-c4a1-44eb-a511-0e55ed10181b}
│   │└Mounted as /dev/mapper/Bulk-Media @ /media/BulkMedia
│   └dm-0 4.00t [252:0] LV MythTV xfs 'MythTV' {644bcdf4-8c1d-4eaf-baac-f71ca8d75a6f}
│    └Mounted as /dev/mapper/Bulk-MythTV @ /media/MythTV
├scsi 6:0:1:0 ATA      WDC WD40EFRX-68W {WD-WCC4E1611663}
│└sdd 3.64t [8:48] MD raid6 (1/6) (w/ sdc,sde,sdf,sdg,sdh) in_sync 'sysresccd:2' {2d3f6b75-3a9b-12bc-1582-64533545931b}
│ └md2 14.55t [9:2] MD v1.2 raid6 (6) clean, 16k Chunk {2d3f6b75:3a9b12bc:15826453:3545931b}
│                   PV LVM2_member 12.00t used, 2.55t free {ezb7fd-6iTr-PhjG-d1EW-xMNC-ThYm-KvTxgg}
├scsi 6:0:2:0 ATA      WDC WD40EFRX-68W {WD-WCC4EJJTZ35U}
│└sde 3.64t [8:64] MD raid6 (2/6) (w/ sdc,sdd,sdf,sdg,sdh) in_sync 'sysresccd:2' {2d3f6b75-3a9b-12bc-1582-64533545931b}
│ └md2 14.55t [9:2] MD v1.2 raid6 (6) clean, 16k Chunk {2d3f6b75:3a9b12bc:15826453:3545931b}
│                   PV LVM2_member 12.00t used, 2.55t free {ezb7fd-6iTr-PhjG-d1EW-xMNC-ThYm-KvTxgg}
├scsi 6:0:3:0 ATA      WDC WD40EFRX-68W {WD-WCC4E1640373}
│└sdf 3.64t [8:80] MD raid6 (4/6) (w/ sdc,sdd,sde,sdg,sdh) in_sync 'sysresccd:2' {2d3f6b75-3a9b-12bc-1582-64533545931b}
│ └md2 14.55t [9:2] MD v1.2 raid6 (6) clean, 16k Chunk {2d3f6b75:3a9b12bc:15826453:3545931b}
│                   PV LVM2_member 12.00t used, 2.55t free {ezb7fd-6iTr-PhjG-d1EW-xMNC-ThYm-KvTxgg}
├scsi 6:0:4:0 ATA      WDC WD40EFRX-68W {WD-WCC4E1631668}
│└sdg 3.64t [8:96] MD raid6 (5/6) (w/ sdc,sdd,sde,sdf,sdh) in_sync 'sysresccd:2' {2d3f6b75-3a9b-12bc-1582-64533545931b}
│ └md2 14.55t [9:2] MD v1.2 raid6 (6) clean, 16k Chunk {2d3f6b75:3a9b12bc:15826453:3545931b}
│                   PV LVM2_member 12.00t used, 2.55t free {ezb7fd-6iTr-PhjG-d1EW-xMNC-ThYm-KvTxgg}
├scsi 6:0:5:0 ATA      WDC WD40EFRX-68W {WD-WCC4E7HT90DE}
│└sdh 3.64t [8:112] MD raid6 (3/6) (w/ sdc,sdd,sde,sdf,sdg) in_sync 'sysresccd:2' {2d3f6b75-3a9b-12bc-1582-64533545931b}
│ └md2 14.55t [9:2] MD v1.2 raid6 (6) clean, 16k Chunk {2d3f6b75:3a9b12bc:15826453:3545931b}
│                   PV LVM2_member 12.00t used, 2.55t free {ezb7fd-6iTr-PhjG-d1EW-xMNC-ThYm-KvTxgg}
└scsi 6:x:x:x [Empty]
Other Block Devices
├loop0 0.00k [7:0] Empty/Unknown
└loop1 0.00k [7:1] Empty/Unknown

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html