From: Christoph Klocker <cklocker@kth.se>
To: linux-kernel@vger.kernel.org
Subject: datatransfer slow down with 1TB files
Date: Tue, 30 Sep 2003 13:39:23 +0200 [thread overview]
Message-ID: <3F796B6B.8070505@kth.se> (raw)
Hi
I am developing a system to stream large uncompressed videofiles which
are about 1,5TB.
I need a bandwith of 195MB/s (HD-SDI)
my system is now:
RH8 - kernel: 2.4.18
xeon 2,4GHz
1GB RAM
3ware escalade controller 12 s-ata harddisks (seagate barracuda 7200.7 -
120GB - SCSI)
when I do different tests with bonnie++ I get very good results for a
2GB file, sequential input 236mb/s,
but when the files get larger the speed is going down significantly.
at 10GB - 216MB/s
at 100GB - 187MB/s
at 1TB - 161MB/s
the sequential output stays at 183MB/s any time, up to 1TB.
As my harddisks have a sustained rate of 32-50 MB/s each it should not
be the
case that they influence the results. I also tested the raid full up to
1,2TB and there was no difference in the results.
Best filesystem performance I tested was on XFS or EXT2
I applied min-readahead to 128 and max-readahead to 256
I tested also with lmdd with the O_DIRECT option, and get lower results.
lmdd if=internal of=fred bs=2m count=1000 fsync=1 direct=1
2097.1520 MB in 12.5588 secs, 166.9860 MB/sec
the driver for the videocard I use don't support 2.6
please reply personally
thanks
christoph
next reply other threads:[~2003-09-30 11:40 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2003-09-30 11:39 Christoph Klocker [this message]
2003-09-30 16:34 ` datatransfer slow down with 1TB files bert hubert
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=3F796B6B.8070505@kth.se \
--to=cklocker@kth.se \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.