* Know about chunk size
@ 2012-11-25 3:15 Kks Kbase
2012-11-26 7:35 ` Roy Sigurd Karlsbakk
0 siblings, 1 reply; 6+ messages in thread
From: Kks Kbase @ 2012-11-25 3:15 UTC (permalink / raw)
To: Linux Raid
Hi Folks,
I want to know what is best chunk size to create s/w raid devices? Also is it possible to change the chunk size for an existing array?
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Know about chunk size
2012-11-25 3:15 Know about chunk size Kks Kbase
@ 2012-11-26 7:35 ` Roy Sigurd Karlsbakk
2012-11-26 22:11 ` Stan Hoeppner
0 siblings, 1 reply; 6+ messages in thread
From: Roy Sigurd Karlsbakk @ 2012-11-26 7:35 UTC (permalink / raw)
To: Kks Kbase; +Cc: Linux Raid
> I want to know what is best chunk size to create s/w raid devices?
That depends on the workload, file sizes etc. The default will probably do fine
> Also is it possible to change the chunk size for an existing array?
AFAIK, no
Vennlige hilsener / Best regards
roy
--
Roy Sigurd Karlsbakk
(+47) 98013356
roy@karlsbakk.net
http://blogg.karlsbakk.net/
GPG Public key: http://karlsbakk.net/roysigurdkarlsbakk.pubkey.txt
--
I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med xenotyp etymologi. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Know about chunk size
2012-11-26 7:35 ` Roy Sigurd Karlsbakk
@ 2012-11-26 22:11 ` Stan Hoeppner
2012-11-27 7:39 ` Kks Kbase
0 siblings, 1 reply; 6+ messages in thread
From: Stan Hoeppner @ 2012-11-26 22:11 UTC (permalink / raw)
To: Roy Sigurd Karlsbakk; +Cc: Kks Kbase, Linux Raid
On 11/26/2012 1:35 AM, Roy Sigurd Karlsbakk wrote:
>> I want to know what is best chunk size to create s/w raid devices?
>
> That depends on the workload, file sizes etc.
Correct. And greatly depends on array type.
> The default will probably do fine
This is not true of metadata 1.2 and parity arrays in which case the
default chunk size is 512KB. That's way too large for anything but
large file streaming workloads. Most workloads involve metadata and
small files. This has been discussed previously in detail on this list
and on the XFS list. For most workloads other than large file
streaming, mirroring+striping is best, but if you must use parity RAID a
small chunk size of 32/64KB yields superior IO performance due to
decreased overhead during RMW.
>> Also is it possible to change the chunk size for an existing array?
No. You must destroy and recreate it with the new chunk size. If one
creates an array with an appropriate chunk size there is no need to ever
change it, UNLESS the primary workload hitting the array changes from
random IO to large streaming, or the reverse. In such a case one
typically builds a new server with a new array, or simply adds a new
array to the existing server for the new workload. If you are
redeploying the server/array, destroy and recreate with the new optimal
chunk size.
--
Stan
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Know about chunk size
2012-11-26 22:11 ` Stan Hoeppner
@ 2012-11-27 7:39 ` Kks Kbase
2012-11-27 8:19 ` Roy Sigurd Karlsbakk
2012-11-27 18:36 ` Piergiorgio Sartor
0 siblings, 2 replies; 6+ messages in thread
From: Kks Kbase @ 2012-11-27 7:39 UTC (permalink / raw)
To: stan@hardwarefreak.com, Roy Sigurd Karlsbakk; +Cc: Linux Raid
Okay thanks.
If we deleted the raid device and created new one with the disks that have data would it cause the data loss?
----- Original Message -----
From: Stan Hoeppner <stan@hardwarefreak.com>
To: Roy Sigurd Karlsbakk <roy@karlsbakk.net>
Cc: Kks Kbase <kks.kbase@yahoo.in>; Linux Raid <linux-raid@vger.kernel.org>
Sent: Tuesday, 27 November 2012 3:41 AM
Subject: Re: Know about chunk size
On 11/26/2012 1:35 AM, Roy Sigurd Karlsbakk wrote:
>> I want to know what is best chunk size to create s/w raid devices?
>
> That depends on the workload, file sizes etc.
Correct. And greatly depends on array type.
> The default will probably do fine
This is not true of metadata 1.2 and parity arrays in which case the
default chunk size is 512KB. That's way too large for anything but
large file streaming workloads. Most workloads involve metadata and
small files. This has been discussed previously in detail on this list
and on the XFS list. For most workloads other than large file
streaming, mirroring+striping is best, but if you must use parity RAID a
small chunk size of 32/64KB yields superior IO performance due to
decreased overhead during RMW.
>> Also is it possible to change the chunk size for an existing array?
No. You must destroy and recreate it with the new chunk size. If one
creates an array with an appropriate chunk size there is no need to ever
change it, UNLESS the primary workload hitting the array changes from
random IO to large streaming, or the reverse. In such a case one
typically builds a new server with a new array, or simply adds a new
array to the existing server for the new workload. If you are
redeploying the server/array, destroy and recreate with the new optimal
chunk size.
--
Stan
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Know about chunk size
2012-11-27 7:39 ` Kks Kbase
@ 2012-11-27 8:19 ` Roy Sigurd Karlsbakk
2012-11-27 18:36 ` Piergiorgio Sartor
1 sibling, 0 replies; 6+ messages in thread
From: Roy Sigurd Karlsbakk @ 2012-11-27 8:19 UTC (permalink / raw)
To: Kks Kbase; +Cc: Linux Raid, stan
----- Opprinnelig melding -----
> Okay thanks.
>
> If we deleted the raid device and created new one with the disks that
> have data would it cause the data loss?
It will cause 100% data loss on the old RAID. The new one will come up empty and shiny.
Vennlige hilsener / Best regards
roy
--
Roy Sigurd Karlsbakk
(+47) 98013356
roy@karlsbakk.net
http://blogg.karlsbakk.net/
GPG Public key: http://karlsbakk.net/roysigurdkarlsbakk.pubkey.txt
--
I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med xenotyp etymologi. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Know about chunk size
2012-11-27 7:39 ` Kks Kbase
2012-11-27 8:19 ` Roy Sigurd Karlsbakk
@ 2012-11-27 18:36 ` Piergiorgio Sartor
1 sibling, 0 replies; 6+ messages in thread
From: Piergiorgio Sartor @ 2012-11-27 18:36 UTC (permalink / raw)
To: Kks Kbase; +Cc: stan@hardwarefreak.com, Roy Sigurd Karlsbakk, Linux Raid
On Tue, Nov 27, 2012 at 03:39:17PM +0800, Kks Kbase wrote:
[...]
> >> Also is it possible to change the chunk size for an existing array?
>
> No. You must destroy and recreate it with the new chunk size. If one
It seems to me it is possible.
Should be one option of "Grow", as far as I can remember.
The issue is, it is not possible to increase the size,
unless it will fit the current number of chunks.
So, for example, if the size is doubled, there should
be an even number of chunks.
Furthermore, LVM will not be happy if the alignment is
lost due to this. It will complain, but it will work.
bye,
--
piergiorgio
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2012-11-27 18:36 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-11-25 3:15 Know about chunk size Kks Kbase
2012-11-26 7:35 ` Roy Sigurd Karlsbakk
2012-11-26 22:11 ` Stan Hoeppner
2012-11-27 7:39 ` Kks Kbase
2012-11-27 8:19 ` Roy Sigurd Karlsbakk
2012-11-27 18:36 ` Piergiorgio Sartor
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).