All of lore.kernel.org
 help / color / mirror / Atom feed
From: Ed W <lists@wildgooses.com>
To: Joe Landman <joe.landman@gmail.com>
Cc: linux-raid@vger.kernel.org
Subject: Re: HBA Adaptor advice
Date: Fri, 20 May 2011 14:21:12 +0100	[thread overview]
Message-ID: <4DD66AC8.60804@wildgooses.com> (raw)
In-Reply-To: <4DD65C18.5090804@gmail.com>

Hi

> If you absolutely insist on using a large expensive RAID card as a JBOD
> card, yeah, there are things you *can* do to keep access to the cache
> and BBU, though they are counter-intuitive.

The main issue with hardware cards is that really you need at least two
of them... At the most inopportune moment the only single one you own
will break and then your entire dataset becomes unavailable...

For sure, anyone with moderate or larger budgets, or a pool of similar
hardware, this becomes a case of simply buying an extra one and stashing
it.  Or at least keeping an eye on when it becomes end of line and
unavailable to buy a new one...


> First off, the LSI 920x series has a 16 port HBA.  You can look it up on
> their site.  SAS+SATA HBA I think.  LSI likes adorning some of their
> HBAs with some inherent RAID capability (their IR mode).  I personally
> prefer the IT mode, but its sometimes hard/impossible to make the switch
> (this is usually for motherboard mounted 'RAID' units). HBAs can be used
> as RAIDs, though the performance is abysmal (c.f. PERC*, lower end LSI
> ... which PERC are rebranded versions of, ...)

This sounds helpful, but I'm not understanding it?

Are you describing the reverse, ie taking a straight HBA card and asking
it to do "hardware raid" of multiple disks?

Or do you mean that performance is dismal even if you make X arrays of 1
disk each in order to access their BB cache?

Or to be really clear - can I take a cheapo PERC6 from ebay, and make it
run 8x disks completely under linux MD Raid, with smartctl access to the
individual disks and BB cache on the card - *with* high performance...
(phew...)



> When you do this, then use mdadm atop this.  We've found, generally, by
> doing this, we can build much faster RAIDs than the LSI 8888 units, and
> comparible to the 9260's in terms of performance across the same number
> of disks, at a lower price.  E.g. mdadm and the MD RAID stack are quite
> good.

What do you think stops the MD Stack being *better* than a 9260?  Also
in very round terms what kind of performance drop do you see from going
to linux MD raid versus a 9260?


> The additional cache doesn't buy you much for this arrangement. Might
> work against you if the card CPU is slow (as most of the hardware RAID
> chips are).

Hopefully not a silly question, but surely the CPU would have to be
extremely slow indeed not to keep up with a sorted bunch of writes that
are being issued to spinning rust drives with multi-ms seek latencies?
Are they really that slow..?

Thanks for your very helpful feedback - much appreciated

Ed W

  parent reply	other threads:[~2011-05-20 13:21 UTC|newest]

Thread overview: 60+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-05-19 12:26 HBA Adaptor advice Ed W
2011-05-19 12:36 ` Roman Mamedov
2011-05-19 12:43   ` Mathias Burén
2011-05-19 14:06 ` Michael Sallaway
2011-05-19 19:10 ` Thomas Harold
2011-05-19 21:12   ` Rudy Zijlstra
2011-05-19 21:07 ` Brad Campbell
2011-05-20 20:58   ` Tobias McNulty
2011-05-20 21:23     ` Brad Campbell
2011-05-20  2:08 ` Andy Smith
2011-05-20  5:30   ` Stan Hoeppner
2011-05-21  9:52     ` Ed W
2011-05-20  7:33   ` Ed W
2011-05-20 10:21     ` Stan Hoeppner
2011-05-21 11:17       ` Ed W
2011-05-21 11:29         ` Rudy Zijlstra
2011-05-21 11:54           ` Ed W
2011-05-21 17:37             ` Leslie Rhorer
2011-05-22  9:41             ` Stan Hoeppner
2011-05-22 10:03               ` Rudy Zijlstra
2011-05-23  9:32                 ` Ed W
2011-05-21 17:05           ` Leslie Rhorer
2011-05-22  9:04         ` Stan Hoeppner
2011-05-22 10:09           ` Brad Campbell
2011-05-22 19:25             ` Stan Hoeppner
2011-05-22 20:57               ` Tobias McNulty
2011-05-22 21:13                 ` Johannes Truschnigg
2011-05-23  9:48                   ` Ed W
2011-05-23 10:44                     ` John Robinson
2011-05-22 23:19               ` Brad Campbell
2011-05-23  4:09                 ` Roman Mamedov
2011-05-23  5:54                   ` Brad Campbell
2011-05-23  6:08                     ` Roman Mamedov
2011-05-23 10:42                     ` Stan Hoeppner
2011-05-23 11:35                       ` David Brown
2011-05-23  6:54                 ` Stan Hoeppner
2011-05-23  7:23                   ` Brad Campbell
2011-05-22 23:44               ` Brad Campbell
2011-05-23  0:07                 ` Brad Campbell
2011-05-23  5:30                   ` Stefan /*St0fF*/ Hübner
2011-05-23 10:18                     ` Ed W
2011-05-23  9:58                 ` Stan Hoeppner
2011-05-23 10:33                   ` Ed W
2011-05-23 11:21                     ` Stan Hoeppner
2011-05-20 12:18     ` Joe Landman
2011-05-20 12:34       ` Roman Mamedov
2011-05-20 12:36         ` Mathias Burén
2011-05-20 12:48         ` Joe Landman
2011-05-20 13:21       ` Ed W [this message]
2011-05-20 14:23         ` Joe Landman
2011-05-20 20:01       ` Andy Smith
2011-05-20 20:12         ` Stan Hoeppner
2011-05-20 20:24         ` Drew
2011-05-20 20:58           ` Stan Hoeppner
     [not found]             ` <4DD7A100.2010807@wildgooses.com>
2011-05-22  8:13               ` Stan Hoeppner
  -- strict thread matches above, loose matches on Subject: below --
2011-05-23  2:11 Jim Schatzman
2011-05-23  3:39 ` Tobias McNulty
2011-05-23 10:42   ` Ed W
2011-05-23 11:14 HBA Adaptor Advice Ed W
2011-05-23 11:55 ` Joe Landman

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4DD66AC8.60804@wildgooses.com \
    --to=lists@wildgooses.com \
    --cc=joe.landman@gmail.com \
    --cc=linux-raid@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.