From: Christoph Klocker <cklocker@kth.se>
To: linux-kernel@vger.kernel.org
Subject: datatransfer slow down with 1TB files
Date: Tue, 30 Sep 2003 13:39:23 +0200 [thread overview]
Message-ID: <3F796B6B.8070505@kth.se> (raw)
Hi
I am developing a system to stream large uncompressed videofiles which
are about 1,5TB.
I need a bandwith of 195MB/s (HD-SDI)
my system is now:
RH8 - kernel: 2.4.18
xeon 2,4GHz
1GB RAM
3ware escalade controller 12 s-ata harddisks (seagate barracuda 7200.7 -
120GB - SCSI)
when I do different tests with bonnie++ I get very good results for a
2GB file, sequential input 236mb/s,
but when the files get larger the speed is going down significantly.
at 10GB - 216MB/s
at 100GB - 187MB/s
at 1TB - 161MB/s
the sequential output stays at 183MB/s any time, up to 1TB.
As my harddisks have a sustained rate of 32-50 MB/s each it should not
be the
case that they influence the results. I also tested the raid full up to
1,2TB and there was no difference in the results.
Best filesystem performance I tested was on XFS or EXT2
I applied min-readahead to 128 and max-readahead to 256
I tested also with lmdd with the O_DIRECT option, and get lower results.
lmdd if=internal of=fred bs=2m count=1000 fsync=1 direct=1
2097.1520 MB in 12.5588 secs, 166.9860 MB/sec
the driver for the videocard I use don't support 2.6
please reply personally
thanks
christoph
next reply other threads:[~2003-09-30 11:40 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2003-09-30 11:39 Christoph Klocker [this message]
2003-09-30 16:34 ` datatransfer slow down with 1TB files bert hubert
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=3F796B6B.8070505@kth.se \
--to=cklocker@kth.se \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox