From: Adam Goryachev <adam@websitemanagers.com.au>
To: Another Sillyname <anothersname@googlemail.com>,
linux-raid@vger.kernel.org
Subject: Re: CPU requirements......
Date: Tue, 14 Jul 2015 09:10:24 +1000 [thread overview]
Message-ID: <55A44560.8050603@websitemanagers.com.au> (raw)
In-Reply-To: <CAOS+5GGAL-8R7ZNd563Z-5oXbRw1QAswOKv7DstT5cLFdyR+Sw@mail.gmail.com>
On 14/07/15 02:14, Another Sillyname wrote:
> I've been testing a test RAID6 setup with a 5970 CPU that has worked fine.
>
> As this box is almost exclusively going to be a file server I'm
> thinking of swapping to a G3258 processor, dual core, not overclocked
> and no hyperthreading or turbo features.
>
> The box may also be used to do transcodes of media files from HD mpeg
> to x264 which is pretty CPU intensive......
>
> Are there any likely issues with the RAID running on a substantially
> slower CPU? I can't seem to find an recent/decent docs suggesting
> minimum CPU requirements for MDADM raid configs.
>
I'm not sure about the specific CPU's you are referencing, however, as I
understand it, RAID5 (and RAID6) are still single threaded (only one CPU
is used for calculating the parity) which is done during all writes, and
when degraded during all reads as well.
In addition, transcoding media files will also be very CPU intensive.
Some questions to ask:
1) How many transcodes do you want to do concurrently? Just one at a
time means you maybe only need one core for that.
2) Does transcoding a single file/stream utilise more than one core?
Having more cores will mean a faster result.
3) What is the read throughput you need to keep the transcoding process
CPU busy (ie, you want to be able to read the file from disk faster than
the CPU can do the work to convert the file)
4) What is the write throughput you need to save the resulting file from
the transcoding process (ie, if the transcode can't write the result,
then it will waste CPU time).
5) Don't forget you now have concurrent read/write on the same set of
disks, consider tuning the read ahead (read and cache more of the input
file) and potentially write buffers (assuming you can always recode the
input file if the system crashes during the process).
What is the goal?
a) Make sure it works (should not be a problem, just performance will be
slower)
b) Make the transcode as fast as possible with the given disks (If the
disks are slower than the slow CPU, then no problem, otherwise use the
faster CPU)
c) Make the transcode as fast as possible with the given CPU (either
one) (take your pick...)
You would probably need to do a lot of test and measure of the above.
The advantage you have is a well defined work load, that can be easily
tested. Just remember to record the results clearly showing what you
changed in each scenario. Though it might be difficult to "swap" CPU for
the various tests...
Hope that helps....
Regards,
Adam
--
Adam Goryachev
Website Managers
P: +61 2 8304 0000 adam@websitemanagers.com.au
F: +61 2 8304 0001 www.websitemanagers.com.au
prev parent reply other threads:[~2015-07-13 23:10 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-07-13 16:14 CPU requirements Another Sillyname
2015-07-13 16:26 ` Jared Mauch
2015-07-13 23:10 ` Adam Goryachev [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=55A44560.8050603@websitemanagers.com.au \
--to=adam@websitemanagers.com.au \
--cc=anothersname@googlemail.com \
--cc=linux-raid@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox