All of lore.kernel.org
 help / color / mirror / Atom feed
From: Phil Turmel <philip@turmel.org>
To: Simon Mcnair <simonmcnair@gmail.com>
Cc: NeilBrown <neilb@suse.de>, linux-raid@vger.kernel.org
Subject: Re: Linux software RAID assistance
Date: Fri, 18 Feb 2011 08:16:19 -0500	[thread overview]
Message-ID: <4D5E7123.5020103@turmel.org> (raw)
In-Reply-To: <AANLkTi=420ttuWWG0vCWy00YLmZvGiM9JTF2n-oi2ebu@mail.gmail.com>

On 02/18/2011 04:31 AM, Simon Mcnair wrote:
> time passes.  You are eaten by a Grue.  Sheesh this is taking a long time.
> 
> simon@proxmox:~$ top
> 
> top - 09:26:19 up 20:36, 11 users,  load average: 2.46, 2.49, 2.39
> Tasks: 334 total,   9 running, 325 sleeping,   0 stopped,   0 zombie
> Cpu(s): 52.8%us,  9.4%sy,  0.0%ni, 35.2%id,  2.5%wa,  0.0%hi,  0.2%si,  0.0%st
> Mem:  12299244k total, 12227584k used,    71660k free, 11042868k buffers
> Swap: 11534332k total,        0k used, 11534332k free,   208204k cached
> 
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> 18896 root      20   0 12288 1072  460 S   63  0.0 431:16.55 ntfs-3g
> 18909 root      20   0 12288 1064  460 R   62  0.0 419:17.11 ntfs-3g
> 18920 root      20   0 12288 1100  492 R   62  0.0 428:17.33 ntfs-3g
>  9210 root      20   0  4068  520  328 S   54  0.0 661:59.92 gzip
>  9138 root      20   0  4068  524  328 R   53  0.0 647:29.07 gzip
>  9247 root      20   0  4068  524  328 S   53  0.0 651:28.36 gzip
> 25678 root      20   0  4068  524  328 R   52  0.0 439:49.20 gzip
> 24957 root      20   0  4068  524  328 R   51  0.0 437:44.01 gzip
> 25792 root      20   0  4068  524  328 S   48  0.0 433:28.14 gzip
> 
> This is hardly touching the CPU on the box (in my opinion), any advice
> on using renice ?  I've never used it before, but now seems like a
> good time ?

Probably wouldn't help.

You have a total usage of 65%.  I suspect that each of the processors running gzip are nearly pegged, and everything else is loafing along.  Hit '1' in top to show the CPU usage per-cpu.  Single-threaded gzip is holding you back.

If you had enough space for saving the partitions uncompressed, it would be much faster.  The PCIe x4 interface on the SuperMicro has a theoretical performance of 1GByte/s, which would be ~ 125MB/s per drive.  From what I've read, that card actually delivers ~ 75MB/s per drive when they're all busy.

Phil

  reply	other threads:[~2011-02-18 13:16 UTC|newest]

Thread overview: 64+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-02-10 16:16 Linux software RAID assistance Simon McNair
2011-02-10 18:24 ` Phil Turmel
2011-02-15  4:53 ` NeilBrown
2011-02-15  8:48   ` Simon McNair
2011-02-15 14:51   ` Phil Turmel
2011-02-15 19:04     ` Simon McNair
2011-02-15 19:37       ` Phil Turmel
2011-02-15 19:45         ` Roman Mamedov
2011-02-15 21:09           ` Simon McNair
2011-02-17 15:10           ` Simon Mcnair
2011-02-17 15:42             ` Roman Mamedov
2011-02-18  9:13               ` Simon McNair
2011-02-18  9:38                 ` Robin Hill
2011-02-18 10:38                   ` Simon Mcnair
2011-02-19 11:46                     ` Jan Ceuleers
2011-02-19 12:40                       ` Simon McNair
2011-02-19 17:37                         ` Jan Ceuleers
2011-02-16 13:51     ` Simon McNair
2011-02-16 14:37       ` Phil Turmel
2011-02-16 17:49         ` Simon McNair
2011-02-16 18:14           ` Phil Turmel
2011-02-16 18:18             ` Simon McNair
2011-02-16 18:22               ` Phil Turmel
2011-02-16 18:25                 ` Phil Turmel
2011-02-16 18:52                   ` Simon McNair
2011-02-16 18:57                     ` Phil Turmel
2011-02-16 19:07                       ` Simon McNair
2011-02-16 19:10                         ` Phil Turmel
2011-02-16 19:15                           ` Simon McNair
2011-02-16 19:36                             ` Phil Turmel
2011-02-16 21:28                               ` Simon McNair
2011-02-16 21:30                                 ` Phil Turmel
2011-02-16 22:44                                   ` Simon Mcnair
2011-02-16 23:39                                     ` Phil Turmel
2011-02-17 13:26                                       ` Simon Mcnair
2011-02-17 13:48                                         ` Phil Turmel
2011-02-17 13:56                                           ` Simon Mcnair
2011-02-17 14:34                                             ` Simon Mcnair
2011-02-17 16:54                                               ` Phil Turmel
2011-02-19  8:43                                                 ` Simon Mcnair
2011-02-19 15:30                                                   ` Phil Turmel
     [not found]                                                     ` <AANLkTinOXJWRw_et2U43R_T9XPBzQLnN56Kf2bOAz=_c@mail.gmail.com>
2011-02-19 16:19                                                       ` Phil Turmel
2011-02-20  9:56                                                         ` Simon Mcnair
2011-02-20 19:50                                                           ` Phil Turmel
2011-02-20 23:17                                                             ` Simon Mcnair
2011-02-20 23:39                                                               ` Phil Turmel
2011-02-22 17:12                                                                 ` Simon Mcnair
2011-02-22 17:14                                                                   ` Simon Mcnair
2011-02-22 18:23                                                                     ` Phil Turmel
2011-02-22 18:36                                                                       ` Simon McNair
2011-02-22 19:06                                                                         ` Phil Turmel
2011-02-18  9:31                               ` Simon Mcnair
2011-02-18 13:16                                 ` Phil Turmel [this message]
2011-02-18 13:21                                   ` Roberto Spadim
2011-02-18 13:26                                     ` Phil Turmel
2011-02-18 13:29                                   ` Simon Mcnair
2011-02-18 13:34                                     ` Phil Turmel
2011-02-18 14:12                                       ` Simon McNair
2011-02-18 16:10                                         ` Phil Turmel
2011-02-18 16:38                                           ` Roberto Spadim
     [not found]                               ` <AANLkTi=RmR5nVnmFLuqK5anHc3WDPxjuYjitT6+5wAqS@mail.gmail.com>
2011-02-20 18:48                                 ` Phil Turmel
2011-02-20 19:25                                   ` Simon Mcnair
2011-02-19  8:49             ` Simon Mcnair
2011-02-16 13:56     ` Simon McNair

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4D5E7123.5020103@turmel.org \
    --to=philip@turmel.org \
    --cc=linux-raid@vger.kernel.org \
    --cc=neilb@suse.de \
    --cc=simonmcnair@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.