linux-raid.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Phil Turmel <philip@turmel.org>
To: Simon Mcnair <simonmcnair@gmail.com>
Cc: NeilBrown <neilb@suse.de>, linux-raid@vger.kernel.org
Subject: Re: Linux software RAID assistance
Date: Fri, 18 Feb 2011 08:16:19 -0500	[thread overview]
Message-ID: <4D5E7123.5020103@turmel.org> (raw)
In-Reply-To: <AANLkTi=420ttuWWG0vCWy00YLmZvGiM9JTF2n-oi2ebu@mail.gmail.com>

On 02/18/2011 04:31 AM, Simon Mcnair wrote:
> time passes.  You are eaten by a Grue.  Sheesh this is taking a long time.
> 
> simon@proxmox:~$ top
> 
> top - 09:26:19 up 20:36, 11 users,  load average: 2.46, 2.49, 2.39
> Tasks: 334 total,   9 running, 325 sleeping,   0 stopped,   0 zombie
> Cpu(s): 52.8%us,  9.4%sy,  0.0%ni, 35.2%id,  2.5%wa,  0.0%hi,  0.2%si,  0.0%st
> Mem:  12299244k total, 12227584k used,    71660k free, 11042868k buffers
> Swap: 11534332k total,        0k used, 11534332k free,   208204k cached
> 
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> 18896 root      20   0 12288 1072  460 S   63  0.0 431:16.55 ntfs-3g
> 18909 root      20   0 12288 1064  460 R   62  0.0 419:17.11 ntfs-3g
> 18920 root      20   0 12288 1100  492 R   62  0.0 428:17.33 ntfs-3g
>  9210 root      20   0  4068  520  328 S   54  0.0 661:59.92 gzip
>  9138 root      20   0  4068  524  328 R   53  0.0 647:29.07 gzip
>  9247 root      20   0  4068  524  328 S   53  0.0 651:28.36 gzip
> 25678 root      20   0  4068  524  328 R   52  0.0 439:49.20 gzip
> 24957 root      20   0  4068  524  328 R   51  0.0 437:44.01 gzip
> 25792 root      20   0  4068  524  328 S   48  0.0 433:28.14 gzip
> 
> This is hardly touching the CPU on the box (in my opinion), any advice
> on using renice ?  I've never used it before, but now seems like a
> good time ?

Probably wouldn't help.

You have a total usage of 65%.  I suspect that each of the processors running gzip are nearly pegged, and everything else is loafing along.  Hit '1' in top to show the CPU usage per-cpu.  Single-threaded gzip is holding you back.

If you had enough space for saving the partitions uncompressed, it would be much faster.  The PCIe x4 interface on the SuperMicro has a theoretical performance of 1GByte/s, which would be ~ 125MB/s per drive.  From what I've read, that card actually delivers ~ 75MB/s per drive when they're all busy.

Phil

  reply	other threads:[~2011-02-18 13:16 UTC|newest]

Thread overview: 64+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-02-10 16:16 Linux software RAID assistance Simon McNair
2011-02-10 18:24 ` Phil Turmel
2011-02-15  4:53 ` NeilBrown
2011-02-15  8:48   ` Simon McNair
2011-02-15 14:51   ` Phil Turmel
2011-02-15 19:04     ` Simon McNair
2011-02-15 19:37       ` Phil Turmel
2011-02-15 19:45         ` Roman Mamedov
2011-02-15 21:09           ` Simon McNair
2011-02-17 15:10           ` Simon Mcnair
2011-02-17 15:42             ` Roman Mamedov
2011-02-18  9:13               ` Simon McNair
2011-02-18  9:38                 ` Robin Hill
2011-02-18 10:38                   ` Simon Mcnair
2011-02-19 11:46                     ` Jan Ceuleers
2011-02-19 12:40                       ` Simon McNair
2011-02-19 17:37                         ` Jan Ceuleers
2011-02-16 13:51     ` Simon McNair
2011-02-16 14:37       ` Phil Turmel
2011-02-16 17:49         ` Simon McNair
2011-02-16 18:14           ` Phil Turmel
2011-02-16 18:18             ` Simon McNair
2011-02-16 18:22               ` Phil Turmel
2011-02-16 18:25                 ` Phil Turmel
2011-02-16 18:52                   ` Simon McNair
2011-02-16 18:57                     ` Phil Turmel
2011-02-16 19:07                       ` Simon McNair
2011-02-16 19:10                         ` Phil Turmel
2011-02-16 19:15                           ` Simon McNair
2011-02-16 19:36                             ` Phil Turmel
2011-02-16 21:28                               ` Simon McNair
2011-02-16 21:30                                 ` Phil Turmel
2011-02-16 22:44                                   ` Simon Mcnair
2011-02-16 23:39                                     ` Phil Turmel
2011-02-17 13:26                                       ` Simon Mcnair
2011-02-17 13:48                                         ` Phil Turmel
2011-02-17 13:56                                           ` Simon Mcnair
2011-02-17 14:34                                             ` Simon Mcnair
2011-02-17 16:54                                               ` Phil Turmel
2011-02-19  8:43                                                 ` Simon Mcnair
2011-02-19 15:30                                                   ` Phil Turmel
     [not found]                                                     ` <AANLkTinOXJWRw_et2U43R_T9XPBzQLnN56Kf2bOAz=_c@mail.gmail.com>
2011-02-19 16:19                                                       ` Phil Turmel
2011-02-20  9:56                                                         ` Simon Mcnair
2011-02-20 19:50                                                           ` Phil Turmel
2011-02-20 23:17                                                             ` Simon Mcnair
2011-02-20 23:39                                                               ` Phil Turmel
2011-02-22 17:12                                                                 ` Simon Mcnair
2011-02-22 17:14                                                                   ` Simon Mcnair
2011-02-22 18:23                                                                     ` Phil Turmel
2011-02-22 18:36                                                                       ` Simon McNair
2011-02-22 19:06                                                                         ` Phil Turmel
2011-02-18  9:31                               ` Simon Mcnair
2011-02-18 13:16                                 ` Phil Turmel [this message]
2011-02-18 13:21                                   ` Roberto Spadim
2011-02-18 13:26                                     ` Phil Turmel
2011-02-18 13:29                                   ` Simon Mcnair
2011-02-18 13:34                                     ` Phil Turmel
2011-02-18 14:12                                       ` Simon McNair
2011-02-18 16:10                                         ` Phil Turmel
2011-02-18 16:38                                           ` Roberto Spadim
     [not found]                               ` <AANLkTi=RmR5nVnmFLuqK5anHc3WDPxjuYjitT6+5wAqS@mail.gmail.com>
2011-02-20 18:48                                 ` Phil Turmel
2011-02-20 19:25                                   ` Simon Mcnair
2011-02-19  8:49             ` Simon Mcnair
2011-02-16 13:56     ` Simon McNair

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4D5E7123.5020103@turmel.org \
    --to=philip@turmel.org \
    --cc=linux-raid@vger.kernel.org \
    --cc=neilb@suse.de \
    --cc=simonmcnair@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).