From: "Austin S. Hemmelgarn" <ahferroin7@gmail.com>
To: Martin <rc6encrypted@gmail.com>
Cc: Erkki Seppala <flux-btrfs@inside.org>,
Btrfs BTRFS <linux-btrfs@vger.kernel.org>
Subject: Re: How to stress test raid6 on 122 disk array
Date: Mon, 15 Aug 2016 08:38:37 -0400 [thread overview]
Message-ID: <65cdf178-4992-2061-5b04-7072041ce924@gmail.com> (raw)
In-Reply-To: <CAGQ70Ycengg60hu3Wm5BxVHxUwhdfydmKFEy55RG8WnDZrgqqA@mail.gmail.com>
On 2016-08-15 08:19, Martin wrote:
>>> The smallest disk of the 122 is 500GB. Is it possible to have btrfs
>>> see each disk as only e.g. 10GB? That way I can corrupt and resilver
>>> more disks over a month.
>>
>> Well, at least you can easily partition the devices for that to happen.
>
> Can it be done with btrfs or should I do it with gdisk?
With gdisk. BTRFS includes some volume management features, but it
doesn't handle partitioning itself.
>
>> However, I would also suggest that would it be more useful use of the
>> resource to run many arrays in parallel? Ie. one 6-device raid6, one
>> 20-device raid6, and then perhaps use the rest of the devices for a very
>> large btrfs filesystem? Or if you have been using partitioning the large
>> btrfs volume can also be composed of all the 122 devices; in fact you
>> could even run multiple 122-device raid6s and use different kind of
>> testing on each. For performance testing you might only excert one of
>> the file systems at a time, though.
>
> Very interesting idea, which leads me to the following question:
>
> For the past weeks have I had all 122 disks in one raid6 filesystem,
> and since I didn't entered any vdev (zfs term) size, I suspect only 2
> of the 122 disks are parity.
>
> If, how can I make the filesystem, so for every 6 disks, 2 of them are parity?
>
> Reading the mkfs.btrfs man page gives me the impression that it can't
> be done, which I find hard to believe.
That really is the case, there's currently no way to do this with BTRFS.
You have to keep in mind that the raid5/6 code only went into the
mainline kernel a few versions ago, and it's still pretty immature as
far as kernel code goes. I don't know when (if ever) such a feature
might get put in, but it's definitely something to add to the list of
things that would be nice to have.
For the moment, the only option to achieve something like this is to set
up a bunch of separate 8 device filesystems, but I would be willing to
bet that the way you have it configured right now is closer to what most
people would be doing in a regular deployment, and therefore is probably
more valuable for testing.
next prev parent reply other threads:[~2016-08-15 12:39 UTC|newest]
Thread overview: 18+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-08-04 17:43 How to stress test raid6 on 122 disk array Martin
2016-08-04 19:05 ` Austin S. Hemmelgarn
2016-08-04 20:01 ` Chris Murphy
2016-08-04 20:51 ` Martin
2016-08-04 21:12 ` Chris Murphy
2016-08-04 22:19 ` Martin
2016-08-05 10:15 ` Erkki Seppala
2016-08-15 12:19 ` Martin
2016-08-15 12:38 ` Austin S. Hemmelgarn [this message]
2016-08-15 13:39 ` Martin
2016-08-15 13:47 ` Austin S. Hemmelgarn
2016-08-05 11:39 ` Austin S. Hemmelgarn
2016-08-15 12:19 ` Martin
2016-08-15 12:44 ` Austin S. Hemmelgarn
2016-08-15 13:38 ` Martin
2016-08-15 13:41 ` Austin S. Hemmelgarn
2016-08-15 13:43 ` Chris Murphy
2016-08-15 13:40 ` Chris Murphy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=65cdf178-4992-2061-5b04-7072041ce924@gmail.com \
--to=ahferroin7@gmail.com \
--cc=flux-btrfs@inside.org \
--cc=linux-btrfs@vger.kernel.org \
--cc=rc6encrypted@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).