public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
* Low file-system performance for 2.6.11 compared to 2.4.26
@ 2005-03-31 16:34 linux-os
  2005-03-31 23:59 ` Lincoln Dale
  2005-04-01  0:13 ` Nick Piggin
  0 siblings, 2 replies; 4+ messages in thread
From: linux-os @ 2005-03-31 16:34 UTC (permalink / raw)
  To: Linux kernel

[-- Attachment #1: Type: TEXT/PLAIN, Size: 222 bytes --]


For those interested, some file-system tests and a test-tools
are attached.

Also, my .signature disappeared during the file-system tests.
There were no errors and e2fsck thinks everything is fine!

Cheers,

Dick Johnson

[-- Attachment #2: Type: TEXT/plain, Size: 26026 bytes --]

The attached program, executed on Linux-2.4.26, runs in about
a minute. The program forks and creates a bunch of files. It
emulates some data-base activity.


Script started on Thu 31 Mar 2005 10:15:10 AM EST
LINUX> time ./tester

real	1m10.101s
user	0m0.011s
sys	0m2.904s
LINUX> uname -r
2.4.26
LINUX> exit
exit
Script done on Thu 31 Mar 2005 10:17:21 AM EST


The same program, running on the same machine, but booted
with Linux-2.6.11, takes about 3 minutes to complete!

Script started on Thu 31 Mar 2005 10:55:17 AM EST
LINUX> time ./tester

real	2m57.211s
user	0m0.017s
sys	0m8.602s
LINUX> uname -r
2.6.11
LINUX> exit
exit

Script done on Thu 31 Mar 2005 10:58:44 AM EST

Further, most everything is in the 'D' state, including an attempt
to execute `ls`......

F   UID   PID  PPID PRI  NI   VSZ  RSS WCHAN  STAT TTY        TIME COMMAND
4     0     1     0  16   0  1544  452 -      S    ?          0:01 init [5]       
1     0     2     1 -100  0     0    0 migrat SW   ?          0:00 [migration/0]
1     0     3     1  34  19     0    0 ksofti SWN  ?          0:00 [ksoftirqd/0]
1     0     4     1  10  -5     0    0 worker SW<  ?          0:00 [events/0]
1     0     5     1  14  -5     0    0 worker SW<  ?          0:00 [khelper]
1     0    10     1  10  -5     0    0 worker SW<  ?          0:00 [kthread]
1     0    19    10  20  -5     0    0 worker SW<  ?          0:00 [kacpid]
1     0   118    10  10  -5     0    0 worker SW<  ?          0:00 [kblockd/0]
1     0   126     1  15   0     0    0 hub_th SW   ?          0:00 [khubd]
1     0   184    10  19  -5     0    0 worker SW<  ?          0:00 [aio/0]
1     0   183     1  15   0     0    0 kswapd SW   ?          0:03 [kswapd0]
1     0   785     1  15   0     0    0 serio_ SW   ?          0:00 [kseriod]
1     0   913     1  22   0     0    0 -      SW   ?          0:00 [scsi_eh_0]
1     0   914     1  15   0     0    0 -      SW   ?          0:00 [ahc_dv_0]
1     0   937    10  11  -5     0    0 worker SW<  ?          0:00 [ata/0]
1     0   941     1  21   0     0    0 -      SW   ?          0:00 [scsi_eh_1]
1     0   942     1  21   0     0    0 -      SW   ?          0:00 [scsi_eh_2]
1     0   949     1  15   0     0    0 get_re DW   ?          0:01 [kjournald]
0     0  1105     1  11  -5  1456  284 -      S<   ?          0:00 udevd
5     0  3413     1  16   0  1528  580 start_ D    ?          0:00 syslogd -m 0
5     0  3417     1  15   0  1480  428 syslog S    ?          0:00 klogd -x
5    32  3438     1  16   0  1608  564 -      S    ?          0:00 portmap
5    29  3458     1  21   0  1616  712 -      S    ?          0:00 rpc.statd
1     0  3491     1  16   0  1536  564 -      S    ?          0:00 rpc.idmapd
5     0  3535     1  18   0  1772  608 -      S    ?          0:00 hcid: processing events
1     0  3553     1  17   0  1520  432 -      S    ?          0:00 /usr/sbin/sdpd
1     0  3572     1  10 -10     0    0 rfcomm SW<  ?          0:00 [krfcommd]
5     0  3638     1  16   0  1708  736 -      S    ?          0:00 /usr/sbin/smartd
1     0  3648     1  19   0  1468  456 -      S    ?          0:00 /usr/sbin/acpid
5     0  3703     1  16   0  8780 3300 -      S    ?          0:00 cupsd
5     0  3944     1  16   0  2084  920 -      S    ?          0:00 xinetd -stayalive -pidfile /var/run/xinetd.pid
5     0  3963     1  16   0  7048 2812 -      S    ?          0:00 sendmail: rejecting connections on daemon MTA: load average: 117
1    51  3972     1  16   0  6124 2368 pause  S    ?          0:00 sendmail: Queue runner@01:00:00 for /var/spool/clientmqueue
1     0  3984     1  17   0 25300 21304 -     S    ?          0:00 /usr/bin/spamd -d -c -a -m5 -H
5    73  3994     1  18   0  1976 1016 -      S    ?          0:00 /usr/sbin/privoxy --user privoxy privoxy --pidfile /var/run/privoxy.pid /etc/privoxy/config
1     0  4021     1  15   0  1680  456 -      S    ?          0:00 gpm -m /dev/input/mice -t imps2
1   100  4051     1  18   0  1468  252 wait   S    ?          0:00 /usr/sbin/htt
0   100  4052  4051  15   0  4424 1664 -      S    ?          0:00 htt_server -nodaemon
1     1  4063     1  16   0  1920 1056 -      S    ?          0:00 /usr/sbin/cannaserver -syslog -u bin
1     0  4076     1  15   0  1588  644 -      S    ?          0:00 crond
1    49  4088     1  18   0  5232 4020 -      S    ?          0:00 /usr/bin/jserver
5    43  4124     1  16   0  6616 4876 -      S    ?          0:00 xfs -droppriv -daemon
1     2  4143     1  16   0  1580  604 -      S    ?          0:00 /usr/sbin/atd
5    81  4162     1  18   0  1940  820 -      S    ?          0:00 dbus-daemon-1 --system
0     0  4178     1  16   0  1528  300 -      S    ?          0:00 mdadm --monitor --scan
4     0  4275     1  16   0  1464  340 -      S    tty3       0:00 /sbin/mingetty tty3
4     0  4292     1  18   0  1464  340 -      S    tty4       0:00 /sbin/mingetty tty4
4     0  4348     1  18   0  1464  340 -      S    tty5       0:00 /sbin/mingetty tty5
4     0  4349     1  18   0  1464  340 -      S    tty6       0:00 /sbin/mingetty tty6
4     0  4391     1  15   0 10608 2124 -      S    ?          0:00 /usr/bin/gdm-binary -nodaemon
5     0  4619  4391  16   0 11100 2572 pipe_w S    ?          0:00 /usr/bin/gdm-binary -nodaemon
4     0  4654  4619  15   0  9912 8200 -      S    ?          0:01 /usr/X11R6/bin/X :0 -audit 0 -auth /var/gdm/:0.Xauth -nolisten tcp vt7
4    42  4735  4619  15   0 20000 8940 -      S    ?          0:02 /usr/bin/gdmgreeter
4     0  4890     1  17   0  2744 1108 wait   S    ?          0:00 login -- root     
4     0  5119     1  17   0  2744 1328 wait   S    ?          0:00 login -- linux-os     
4   666  8579  5119  15   0  4464 1336 wait   S    tty1       0:00 -bash
4     0  8747  4890  15   0  4468 1652 wait   S    tty2       0:00 -bash
1     0  5784    10  15   0     0    0 sync_b DW   ?          0:00 [pdflush]
1     0  5786    10  15   0     0    0 blk_co DW   ?          0:00 [pdflush]
1   666  5817     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5818     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5819     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5820     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5821     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5822     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5823     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5824     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5825     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5826     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5827     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5828     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5829     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5830     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5831     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5832     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5833     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5834     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5835     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5836     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5837     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5838     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5839     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5840     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5841     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5842     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5843     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5844     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5845     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5846     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5847     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5848     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5849     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5850     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5851     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5852     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5853     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5854     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5855     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5856     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5857     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5858     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5859     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5860     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5861     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5862     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5863     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5864     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5865     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5866     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5867     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5868     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5869     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5870     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5871     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5872     1  18   0  1320  320 start_ D    tty1       0:00 ./tester
1   666  5873     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5874     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5875     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5876     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5877     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5878     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5879     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5880     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5881     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5882     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5883     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5884     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5885     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5886     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5887     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5888     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5889     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5890     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5891     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5892     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5893     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5894     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5895     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5896     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5897     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5898     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5899     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5900     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5901     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5902     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5903     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5904     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5905     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5906     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5907     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5908     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5909     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5910     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5911     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5912     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5913     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5914     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5915     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5916     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5917     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5918     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5919     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5920     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5921     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5922     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5923     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5924     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5925     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5926     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5927     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5928     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5929     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5930     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5931     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5932     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5933     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5934     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5935     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5936     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5937     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5938     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5939     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5940     1  17   0  9516 3656 sync_p D    tty1       0:00 ./tester
1   666  5941     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5942     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5943     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5944     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5945     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5946     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5947     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5948     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5949     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5950     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5951     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5952     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5953     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5954     1  17   0  9516 8136 sync_p D    tty1       0:00 ./tester
1   666  5955     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5956     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5957     1  18   0  1320  320 sync_p D    tty1       0:00 ./tester
1   666  5958     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5959     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5960     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5961     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5962     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5963     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5964     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5965     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5966     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5967     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5968     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5969     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5970     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5971     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5972     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5973     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5974     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5975     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5976     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5977     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5978     1  18   0  9516  316 start_ D    tty1       0:00 ./tester
1   666  5979     1  17   0  9516 1608 sync_p D    tty1       0:00 ./tester
1   666  5980     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5981     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5982     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5983     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5984     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5985     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5986     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5987     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5988     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5989     1  18   0  9516  316 sync_p D    tty1       0:00 ./tester
1   666  5990     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5991     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5992     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5993     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5994     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  5995     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5996     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5997     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5998     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  5999     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6000     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6001     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6002     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6003     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  6004     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6005     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6006     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  6007     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6008     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  6009     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  6010     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  6011     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  6012     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  6013     1  17   0  9516 1224 sync_p D    tty1       0:00 ./tester
1   666  6014     1  17   0  1320  328 -      D    tty1       0:00 ./tester
1   666  6015     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6016     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6017     1  18   0  1320  320 log_wa D    tty1       0:00 ./tester
1   666  6018     1  18   0  1320  280 start_ D    tty1       0:00 ./tester
1   666  6019     1  18   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6020     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6021     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6022     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6023     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6024     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6025     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6026     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6027     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6028     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6029     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6030     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6031     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6032     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6033     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6034     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6035     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6036     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6037     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6038     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6039     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6040     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6041     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6042     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6043     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6044     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6045     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6046     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6047     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6048     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6049     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6050     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6051     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6052     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6053     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6054     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6055     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6056     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6057     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6058     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6059     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6060     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6061     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6062     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6063     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6064     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6065     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6066     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6067     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6068     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6069     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6070     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6071     1  25   0  1320  280 -      D    tty1       0:00 ./tester
1   666  6072     1  25   0  1320  280 -      D    tty1       0:00 ./tester
0     0  6073  8747  16   0  3836  580 -      D    tty2       0:00 ls --color=tty
0   666  6076  8579  17   0  2272  588 -      R    tty1       0:00 ps laxw


Is it expected to be fixed or is this the new performance available
from Linux?



[-- Attachment #3: Type: APPLICATION/x-gzip, Size: 7518 bytes --]

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Low file-system performance for 2.6.11 compared to 2.4.26
  2005-03-31 16:34 Low file-system performance for 2.6.11 compared to 2.4.26 linux-os
@ 2005-03-31 23:59 ` Lincoln Dale
  2005-04-01  0:13 ` Nick Piggin
  1 sibling, 0 replies; 4+ messages in thread
From: Lincoln Dale @ 2005-03-31 23:59 UTC (permalink / raw)
  To: linux-os; +Cc: Linux kernel

At 02:34 AM 1/04/2005, linux-os wrote:
>For those interested, some file-system tests and a test-tools
>are attached.

in high-performance-I/O-testing i perform regularly, i notice no slowdown 
in 2.6 compared to 2.4.

looking at your test-tools, i would hardly call your workload anywhere near 
'realistic' in terms of its I/O patterns.

a few suggestions / constructive comments:

  (1) 100 processes each performing i/o in the pattern of write 8MB, 
fsync(), wait, read 8MB, wait, delete probably isn't realistic
  (2) you don't mention whether you're performing testing on ext2 or ext3
  (3) you also don't mention what i/o scheduled is being used
  (4) your benchmark doesn't measure 'fairness' between processes
  (5) your benchmark sleeps for a random amount of time at various parts

it is well known that in 2.4 kernels, processes can 'hog' the i/o channel - 
which may result in higher overall throughput but at the detriment of being 
'fair' to the rest of the system.  you should address point (4) above.

can you modify your program to present the time-taken-per-process?
if i'm a betting man, i'd say that 2.6 will be a lot more 'fair' compared 
to 2.4.

default settings for 2.6 likely also means that there is a lot less data 
outstanding in the buffer-cache.
2.6's fsync() behavior is also quite different to that of 2.4.
also note that if you're using a journalled filesystem, fsync() likely does 
different things ...

you don't seed rand, so the random numbers out of rand() aren't actually 
random.
it probably doesn't matter so much since we're only talking microseconds 
here (up to 0.511 msec) - but given 2.4 kernels will have HZ of 100 and 2.6 
will have HZ of 1000, you're clearly going to get a different end result - 
perhaps with 2.6 resulting in a busy-wait from usleep().


cheers,

lincoln.

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Low file-system performance for 2.6.11 compared to 2.4.26
  2005-03-31 16:34 Low file-system performance for 2.6.11 compared to 2.4.26 linux-os
  2005-03-31 23:59 ` Lincoln Dale
@ 2005-04-01  0:13 ` Nick Piggin
  2005-04-01 18:13   ` Richard B. Johnson
  1 sibling, 1 reply; 4+ messages in thread
From: Nick Piggin @ 2005-04-01  0:13 UTC (permalink / raw)
  To: linux-os; +Cc: Linux kernel

linux-os wrote:
> 
> For those interested, some file-system tests and a test-tools
> are attached.
> 

I'll give it a run when I get a chance. Thanks.
In the meantime, can you try with different io schedulers?

> Also, my .signature disappeared during the file-system tests.
> There were no errors and e2fsck thinks everything is fine!
> 

You seem to be constantly plagued by gremlins. I don't
know whether to laugh or cry.


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Low file-system performance for 2.6.11 compared to 2.4.26
  2005-04-01  0:13 ` Nick Piggin
@ 2005-04-01 18:13   ` Richard B. Johnson
  0 siblings, 0 replies; 4+ messages in thread
From: Richard B. Johnson @ 2005-04-01 18:13 UTC (permalink / raw)
  To: Nick Piggin; +Cc: Linux kernel

On Thu, 31 Mar 2005, Nick Piggin wrote:

> linux-os wrote:
>>
>> For those interested, some file-system tests and a test-tools
>> are attached.
>>
>
> I'll give it a run when I get a chance. Thanks.
> In the meantime, can you try with different io schedulers?
>

I was trying to emulate some old servers that had new
kernels installed. These servers are used to send medical
images around. One used to get a 512x512x16-bit image to
a work-station in a few hundred milliseconds. It takes
seconds with the newer kernels. I found out that the
SCSI disk(s) were running continuously and sampled
their I/O patterns. The 'C' code comes very close
to emulating that.

The installation involved an "ugrade" to linux-2.6.5-1.358
that came with a RedHat Fedora distibution. The provided
code will even HALT that distibution. Everything goes
into the 'D' state and waits forever (at least overnight).

Later versions like linux-2.6.8 will run to completion
but with verrry slow through-put.

Never versions, like linux-2.6.11 will run, but with a strange
slowness, everything in 'D' and the file-system can end up with
missing files.

The SCSI controller is AIC7XXX, and the fs is ext3 with jbd, just
as it comes from Red Hat.

>> Also, my .signature disappeared during the file-system tests.
>> There were no errors and e2fsck thinks everything is fine!
>>
>
> You seem to be constantly plagued by gremlins. I don't
> know whether to laugh or cry.
>

I test many, many (too many) systems as part of my job. When
somebody writes a hardware device-driver and I get to check it,
sometimes it blows up or doesn't otherwise work. I then test the
bare kernel(s) and I often find some really strange things going
on.

For instance, there was a recent change that make the BKL be
held during an ioctl(). This has devistating performance
consequences with a lot of drivers. For instance, the stuff
that writes CD/ROMs. It does a lot of the work using ioctl(),
the firewire drivers also use ioctl() for I/O.

>

Cheers,
Dick Johnson
Penguin : Linux version 2.6.11 on an i686 machine (5537.79 BogoMips).
  Notice : All mail here is now cached for review by Dictator Bush.
                  98.36% of all statistics are fiction.

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2005-04-01 18:13 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2005-03-31 16:34 Low file-system performance for 2.6.11 compared to 2.4.26 linux-os
2005-03-31 23:59 ` Lincoln Dale
2005-04-01  0:13 ` Nick Piggin
2005-04-01 18:13   ` Richard B. Johnson

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox