* Re: [Bug 12309] Large I/O operations result in poor interactive performance and high iowait times [not found] ` <201201201611.q0KGBPf6029256@bugzilla.kernel.org> @ 2012-01-20 22:45 ` Andrew Morton 2012-01-28 14:44 ` Wu, Fengguang 0 siblings, 1 reply; 3+ messages in thread From: Andrew Morton @ 2012-01-20 22:45 UTC (permalink / raw) To: linux-mm; +Cc: Wu Fengguang On Fri, 20 Jan 2012 16:11:25 GMT bugzilla-daemon@bugzilla.kernel.org wrote: > https://bugzilla.kernel.org/show_bug.cgi?id=12309 We've had some recent updates to the world's largest bug report. Apparently our large-writer-paralyses-the-machine problems have worsened in recent kernels. -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/ Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a> ^ permalink raw reply [flat|nested] 3+ messages in thread
* RE: [Bug 12309] Large I/O operations result in poor interactive performance and high iowait times 2012-01-20 22:45 ` [Bug 12309] Large I/O operations result in poor interactive performance and high iowait times Andrew Morton @ 2012-01-28 14:44 ` Wu, Fengguang 2012-02-01 14:02 ` Wu Fengguang 0 siblings, 1 reply; 3+ messages in thread From: Wu, Fengguang @ 2012-01-28 14:44 UTC (permalink / raw) To: Andrew Morton, linux-mm@kvack.org; +Cc: fengguang.wu@gmail.com [replying from webmail and CC my gmail account] >> https://bugzilla.kernel.org/show_bug.cgi?id=12309 > We've had some recent updates to the world's largest bug report. > Apparently our large-writer-paralyses-the-machine problems have > worsened in recent kernels. Yeah I can reproduce the interactive problem on 3.3-rc1, and the main stalls seem to happen when loading the task and allocating memory. My test case is to start a small 1MB dd when there are 10 long running dd tasks each writing to one JBOD disk. [long running dd tasks] root 5232 28.6 0.0 8316 632 ? D 21:19 0:36 dd bs=4k if=/dev/zero of=/fs/sdc1/zero-1 root 5235 27.4 0.0 8316 632 ? D 21:19 0:34 dd bs=4k if=/dev/zero of=/fs/sdd1/zero-1 root 5238 30.5 0.0 8316 632 ? R 21:19 0:38 dd bs=4k if=/dev/zero of=/fs/sde1/zero-1 root 5241 29.7 0.0 8316 628 ? R 21:19 0:37 dd bs=4k if=/dev/zero of=/fs/sdf1/zero-1 root 5244 25.8 0.0 8316 628 ? D 21:19 0:32 dd bs=4k if=/dev/zero of=/fs/sdg1/zero-1 root 5247 23.4 0.0 8316 632 ? D 21:19 0:29 dd bs=4k if=/dev/zero of=/fs/sdh1/zero-1 root 5250 23.4 0.0 8316 632 ? R 21:19 0:29 dd bs=4k if=/dev/zero of=/fs/sdi1/zero-1 root 5253 23.7 0.0 8316 632 ? D 21:19 0:30 dd bs=4k if=/dev/zero of=/fs/sdj1/zero-1 root 5256 22.3 0.0 8316 632 ? D 21:19 0:28 dd bs=4k if=/dev/zero of=/fs/sdk1/zero-1 root 5259 23.7 0.0 8316 628 ? D 21:19 0:30 dd bs=4k if=/dev/zero of=/fs/sdl1/zero-1 [short 1MB dd command which is repeated for many times] wfg@lkp-nex04 /fs/sdj1% sudo dd if=/dev/zero of=zero2 bs=1M count=1 The long running dd is progressing at 60-70MB/s, however the small 1MB dd is rather slow in all but one invocations: 1048576 bytes (1.0 MB) copied, 0.2296 s, 4.6 MB/s 1048576 bytes (1.0 MB) copied, 0.366903 s, 2.9 MB/s 1048576 bytes (1.0 MB) copied, 0.47013 s, 2.2 MB/s 1048576 bytes (1.0 MB) copied, 0.257523 s, 4.1 MB/s 1048576 bytes (1.0 MB) copied, 0.36692 s, 2.9 MB/s 1048576 bytes (1.0 MB) copied, 0.473319 s, 2.2 MB/s 1048576 bytes (1.0 MB) copied, 0.50198 s, 2.1 MB/s 1048576 bytes (1.0 MB) copied, 0.018758 s, 55.9 MB/s 1048576 bytes (1.0 MB) copied, 0.341166 s, 3.1 MB/s 1048576 bytes (1.0 MB) copied, 0.348311 s, 3.0 MB/s 1048576 bytes (1.0 MB) copied, 0.418185 s, 2.5 MB/s 1048576 bytes (1.0 MB) copied, 0.444071 s, 2.4 MB/s And the 10MB dd can achieve much better throughput: wfg@lkp-nex04 /fs/sdj1% sudo dd if=/dev/zero of=zero2 bs=1M count=10 10485760 bytes (10 MB) copied, 0.417411 s, 25.1 MB/s 10485760 bytes (10 MB) copied, 0.468597 s, 22.4 MB/s Below is the balance_dirty_pages trace events for the small 1MB/10MB dd tasks (dd-5253 is the long running dd task on bdi 8:144). dd-5563 [025] .... 165.504338: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950856 bdi_setpoint=83005 bdi_dirty=81032 dirty_ratelimit=63408 task_ratelimit=63592 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5563 [025] .... 165.504703: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950942 bdi_setpoint=83005 bdi_dirty=81088 dirty_ratelimit=63408 task_ratelimit=63528 dirtied=32 dirtied_pause=32 paused=0 pause=-4294824915 period=2 think=4294824917 dd-5563 [025] .... 165.505039: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951051 bdi_setpoint=83005 bdi_dirty=81088 dirty_ratelimit=63408 task_ratelimit=63468 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5563 [025] .... 165.505469: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950754 bdi_setpoint=82981 bdi_dirty=81200 dirty_ratelimit=63408 task_ratelimit=63468 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-2 dd-5563 [025] .... 165.505971: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950845 bdi_setpoint=82973 bdi_dirty=81200 dirty_ratelimit=63408 task_ratelimit=63468 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5563 [025] .... 165.506398: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950999 bdi_setpoint=82973 bdi_dirty=81312 dirty_ratelimit=63408 task_ratelimit=63408 dirtied=32 dirtied_pause=32 paused=0 pause=7 period=2 think=-5 The traces show that balance_dirty_pages is trying to throttle the short lived dd tasks at around task_ratelimit=63592 KB/s, which is the right thing to do. Judging from the timestamps and the pause=X fields, we can tell that - the short lived dd tasks spend very little time in balance_dirty_pages() For dd-5563, pause=0,-4294824915,0,0,0,7 which adds up to 7ms. - 99% block time should occur in loading the dd process and allocating the memory Because the dd-5563 balance_dirty_pages events start at 165.504338 and ends at 165.506398 which only takes 2ms in between. Thanks, Fengguang --- wfg@bee /export/writeback/lkp-nex04/JBOD-10HDD-thresh=4G/ext4-1dd-1-3.3.0-rc1% bzgrep 8:144: trace.bz2 |g -v dd-5253|g dd dd-5563 [025] .... 165.504338: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950856 bdi_setpoint=83005 bdi_dirty=81032 dirty_ratelimit=63408 task_ratelimit=63592 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5563 [025] .... 165.504703: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950942 bdi_setpoint=83005 bdi_dirty=81088 dirty_ratelimit=63408 task_ratelimit=63528 dirtied=32 dirtied_pause=32 paused=0 pause=-4294824915 period=2 think=4294824917 dd-5563 [025] .... 165.505039: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951051 bdi_setpoint=83005 bdi_dirty=81088 dirty_ratelimit=63408 task_ratelimit=63468 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5563 [025] .... 165.505469: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950754 bdi_setpoint=82981 bdi_dirty=81200 dirty_ratelimit=63408 task_ratelimit=63468 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-2 dd-5563 [025] .... 165.505971: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950845 bdi_setpoint=82973 bdi_dirty=81200 dirty_ratelimit=63408 task_ratelimit=63468 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5563 [025] .... 165.506398: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950999 bdi_setpoint=82973 bdi_dirty=81312 dirty_ratelimit=63408 task_ratelimit=63408 dirtied=32 dirtied_pause=32 paused=0 pause=7 period=2 think=-5 dd-5572 [041] .... 167.463729: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950826 bdi_setpoint=82916 bdi_dirty=83720 dirty_ratelimit=63400 task_ratelimit=61788 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5572 [041] .... 167.464038: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950760 bdi_setpoint=82910 bdi_dirty=83720 dirty_ratelimit=63400 task_ratelimit=61788 dirtied=32 dirtied_pause=32 paused=0 pause=-4294826878 period=2 think=4294826880 dd-5572 [041] .... 167.464323: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950737 bdi_setpoint=82910 bdi_dirty=83720 dirty_ratelimit=63400 task_ratelimit=61788 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5572 [041] .... 167.464645: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950667 bdi_setpoint=82898 bdi_dirty=83776 dirty_ratelimit=63400 task_ratelimit=61728 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-2 dd-5572 [041] .... 167.464964: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950804 bdi_setpoint=82898 bdi_dirty=83832 dirty_ratelimit=63400 task_ratelimit=61728 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5572 [041] .... 167.465286: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950903 bdi_setpoint=82891 bdi_dirty=83832 dirty_ratelimit=63400 task_ratelimit=61728 dirtied=32 dirtied_pause=32 paused=0 pause=7 period=2 think=-5 dd-5581 [051] .... 169.594955: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955229 bdi_setpoint=83567 bdi_dirty=84000 dirty_ratelimit=63400 task_ratelimit=61540 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5581 [051] .... 169.595226: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955141 bdi_setpoint=83563 bdi_dirty=84000 dirty_ratelimit=63400 task_ratelimit=61540 dirtied=32 dirtied_pause=32 paused=0 pause=-4294829013 period=2 think=4294829015 dd-5581 [051] .... 169.595486: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955174 bdi_setpoint=83563 bdi_dirty=84056 dirty_ratelimit=63400 task_ratelimit=61480 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5581 [051] .... 169.595752: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955196 bdi_setpoint=83563 bdi_dirty=84112 dirty_ratelimit=63400 task_ratelimit=61480 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-2 dd-5581 [051] .... 169.596042: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955262 bdi_setpoint=83563 bdi_dirty=84112 dirty_ratelimit=63400 task_ratelimit=61480 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5581 [051] .... 169.596334: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955196 bdi_setpoint=83558 bdi_dirty=84168 dirty_ratelimit=63400 task_ratelimit=61416 dirtied=32 dirtied_pause=32 paused=0 pause=7 period=2 think=-5 dd-5592 [049] .... 171.845210: bdi_dirty_ratelimit: bdi 8:144: write_bw=64504 awrite_bw=63908 dirty_rate=22072 dirty_ratelimit=63400 task_ratelimit=63960 balanced_dirty_ratelimit=63908 dd-5592 [049] .... 171.845211: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953514 bdi_setpoint=84104 bdi_dirty=81032 dirty_ratelimit=63400 task_ratelimit=63956 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5592 [049] .... 171.845603: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953504 bdi_setpoint=84096 bdi_dirty=81088 dirty_ratelimit=63400 task_ratelimit=63892 dirtied=32 dirtied_pause=32 paused=0 pause=-4294831268 period=2 think=4294831270 dd-5592 [049] .... 171.846095: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953608 bdi_setpoint=84096 bdi_dirty=81144 dirty_ratelimit=63400 task_ratelimit=63832 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5592 [049] .... 171.846484: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953723 bdi_setpoint=84096 bdi_dirty=81256 dirty_ratelimit=63400 task_ratelimit=63768 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5592 [049] .... 171.846899: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953871 bdi_setpoint=84096 bdi_dirty=81312 dirty_ratelimit=63400 task_ratelimit=63768 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5592 [049] .... 171.847315: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953890 bdi_setpoint=84088 bdi_dirty=81368 dirty_ratelimit=63400 task_ratelimit=63708 dirtied=32 dirtied_pause=32 paused=0 pause=6 period=2 think=-4 dd-5601 [049] .... 173.794360: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955596 bdi_setpoint=84205 bdi_dirty=84504 dirty_ratelimit=63400 task_ratelimit=61604 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5601 [049] .... 173.794888: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955651 bdi_setpoint=84205 bdi_dirty=84560 dirty_ratelimit=63400 task_ratelimit=61540 dirtied=32 dirtied_pause=32 paused=0 pause=-4294833221 period=2 think=4294833223 dd-5601 [049] .... 173.795259: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955410 bdi_setpoint=84187 bdi_dirty=84560 dirty_ratelimit=63400 task_ratelimit=61604 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=1 dd-5601 [049] .... 173.795634: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955375 bdi_setpoint=84187 bdi_dirty=84616 dirty_ratelimit=63400 task_ratelimit=61540 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5601 [049] .... 173.796186: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955480 bdi_setpoint=84187 bdi_dirty=84616 dirty_ratelimit=63400 task_ratelimit=61540 dirtied=32 dirtied_pause=32 paused=1 pause=0 period=2 think=-2 dd-5601 [049] .... 173.796807: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955461 bdi_setpoint=84248 bdi_dirty=84560 dirty_ratelimit=63400 task_ratelimit=61604 dirtied=32 dirtied_pause=32 paused=0 pause=6 period=2 think=-4 dd-5610 [041] .... 176.710294: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=958022 bdi_setpoint=82789 bdi_dirty=85736 dirty_ratelimit=63400 task_ratelimit=59620 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5610 [041] .... 176.710729: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957956 bdi_setpoint=82781 bdi_dirty=85736 dirty_ratelimit=63400 task_ratelimit=59620 dirtied=32 dirtied_pause=32 paused=0 pause=-4294836143 period=2 think=4294836145 dd-5610 [041] .... 176.711224: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=958077 bdi_setpoint=82781 bdi_dirty=85848 dirty_ratelimit=63400 task_ratelimit=59560 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5610 [041] .... 176.711747: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=958187 bdi_setpoint=82772 bdi_dirty=85904 dirty_ratelimit=63400 task_ratelimit=59496 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5610 [041] .... 176.712235: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=958152 bdi_setpoint=82762 bdi_dirty=85960 dirty_ratelimit=63400 task_ratelimit=59436 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5610 [041] .... 176.712732: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=958343 bdi_setpoint=82762 bdi_dirty=86072 dirty_ratelimit=63400 task_ratelimit=59372 dirtied=32 dirtied_pause=32 paused=0 pause=6 period=2 think=-4 dd-5641 [049] .... 190.728161: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955683 bdi_setpoint=80839 bdi_dirty=86408 dirty_ratelimit=63168 task_ratelimit=57924 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5641 [049] .... 190.728460: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955767 bdi_setpoint=80839 bdi_dirty=86408 dirty_ratelimit=63168 task_ratelimit=57924 dirtied=32 dirtied_pause=32 paused=0 pause=-4294850188 period=2 think=4294850190 dd-5641 [049] .... 190.728773: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955894 bdi_setpoint=80839 bdi_dirty=86408 dirty_ratelimit=63168 task_ratelimit=57924 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5641 [049] .... 190.729086: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955889 bdi_setpoint=80833 bdi_dirty=86464 dirty_ratelimit=63168 task_ratelimit=57860 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5641 [049] .... 190.729380: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955997 bdi_setpoint=80833 bdi_dirty=86464 dirty_ratelimit=63168 task_ratelimit=57860 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5641 [049] .... 190.729687: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=956072 bdi_setpoint=80833 bdi_dirty=86520 dirty_ratelimit=63168 task_ratelimit=57860 dirtied=32 dirtied_pause=32 paused=0 pause=6 period=2 think=-4 dd-5668 [057] .... 206.594016: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957370 bdi_setpoint=84074 bdi_dirty=83944 dirty_ratelimit=63072 task_ratelimit=61344 dirtied=1 dirtied_pause=32 paused=0 pause=0 period=0 think=0 dd-5668 [057] .... 206.594029: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957379 bdi_setpoint=84074 bdi_dirty=83944 dirty_ratelimit=63072 task_ratelimit=61344 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5668 [057] .... 206.594041: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957379 bdi_setpoint=84074 bdi_dirty=83944 dirty_ratelimit=63072 task_ratelimit=61344 dirtied=32 dirtied_pause=32 paused=0 pause=-4294866085 period=2 think=4294866087 dd-5668 [057] .... 206.594051: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957379 bdi_setpoint=84074 bdi_dirty=83944 dirty_ratelimit=63072 task_ratelimit=61344 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5668 [057] .... 206.594315: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957456 bdi_setpoint=84074 bdi_dirty=83944 dirty_ratelimit=63072 task_ratelimit=61344 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5668 [057] .... 206.594651: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957475 bdi_setpoint=84166 bdi_dirty=83832 dirty_ratelimit=63072 task_ratelimit=61468 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5668 [057] .... 206.595011: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957579 bdi_setpoint=84166 bdi_dirty=83888 dirty_ratelimit=63072 task_ratelimit=61344 dirtied=32 dirtied_pause=32 paused=0 pause=7 period=2 think=-5 dd-5668 [057] .... 206.602945: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=957726 bdi_setpoint=84063 bdi_dirty=84112 dirty_ratelimit=63072 task_ratelimit=61160 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5677 [057] .... 212.243213: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=941736 bdi_setpoint=84089 bdi_dirty=85232 dirty_ratelimit=63072 task_ratelimit=61900 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5677 [057] .... 212.243532: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=941813 bdi_setpoint=84089 bdi_dirty=85288 dirty_ratelimit=63072 task_ratelimit=61840 dirtied=32 dirtied_pause=32 paused=0 pause=-4294871746 period=2 think=4294871748 dd-5677 [057] .... 212.243853: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=941615 bdi_setpoint=84069 bdi_dirty=85288 dirty_ratelimit=63072 task_ratelimit=61840 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5677 [057] .... 212.244175: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=941648 bdi_setpoint=84069 bdi_dirty=85344 dirty_ratelimit=63072 task_ratelimit=61776 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5677 [057] .... 212.244500: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=941755 bdi_setpoint=84069 bdi_dirty=85344 dirty_ratelimit=63072 task_ratelimit=61776 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5677 [057] .... 212.244824: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=941840 bdi_setpoint=84069 bdi_dirty=85400 dirty_ratelimit=63072 task_ratelimit=61776 dirtied=32 dirtied_pause=32 paused=0 pause=7 period=2 think=-5 dd-5686 [058] .... 218.734557: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952833 bdi_setpoint=83354 bdi_dirty=85792 dirty_ratelimit=63072 task_ratelimit=60236 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5686 [058] .... 218.734893: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952973 bdi_setpoint=83354 bdi_dirty=85792 dirty_ratelimit=63072 task_ratelimit=60176 dirtied=32 dirtied_pause=32 paused=0 pause=-4294878250 period=2 think=4294878252 dd-5686 [058] .... 218.735281: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953120 bdi_setpoint=83354 bdi_dirty=85848 dirty_ratelimit=63072 task_ratelimit=60176 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=1 dd-5686 [058] .... 218.735630: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953293 bdi_setpoint=83354 bdi_dirty=85848 dirty_ratelimit=63072 task_ratelimit=60176 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5686 [058] .... 218.735978: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953455 bdi_setpoint=83354 bdi_dirty=85904 dirty_ratelimit=63072 task_ratelimit=60112 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5686 [058] .... 218.736332: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953595 bdi_setpoint=83354 bdi_dirty=85904 dirty_ratelimit=63072 task_ratelimit=60052 dirtied=32 dirtied_pause=32 paused=0 pause=6 period=2 think=-4 dd-5695 [041] .... 227.307415: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955590 bdi_setpoint=83450 bdi_dirty=84336 dirty_ratelimit=62952 task_ratelimit=60800 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5695 [041] .... 227.307810: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955642 bdi_setpoint=83443 bdi_dirty=84336 dirty_ratelimit=62952 task_ratelimit=60800 dirtied=32 dirtied_pause=32 paused=0 pause=-4294886840 period=2 think=4294886842 dd-5695 [041] .... 227.308235: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955772 bdi_setpoint=83443 bdi_dirty=84448 dirty_ratelimit=62952 task_ratelimit=60676 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=1 dd-5695 [041] .... 227.308845: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955756 bdi_setpoint=83437 bdi_dirty=84504 dirty_ratelimit=62952 task_ratelimit=60676 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5695 [041] .... 227.309538: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955708 bdi_setpoint=83430 bdi_dirty=84560 dirty_ratelimit=62952 task_ratelimit=60612 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-2 dd-5695 [041] .... 227.310120: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955741 bdi_setpoint=83430 bdi_dirty=84616 dirty_ratelimit=62952 task_ratelimit=60552 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5695 [041] .... 227.310631: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955622 bdi_setpoint=83417 bdi_dirty=84616 dirty_ratelimit=62952 task_ratelimit=60612 dirtied=32 dirtied_pause=32 paused=0 pause=7 period=2 think=-5 dd-5717 [057] .... 277.024811: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=956666 bdi_setpoint=83572 bdi_dirty=83496 dirty_ratelimit=62744 task_ratelimit=61088 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5717 [057] .... 277.025137: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=956776 bdi_setpoint=83572 bdi_dirty=83496 dirty_ratelimit=62744 task_ratelimit=61028 dirtied=32 dirtied_pause=32 paused=0 pause=-4294936656 period=2 think=4294936658 dd-5717 [057] .... 277.025605: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=956609 bdi_setpoint=83622 bdi_dirty=83440 dirty_ratelimit=62744 task_ratelimit=61148 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=1 dd-5717 [057] .... 277.026232: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=956541 bdi_setpoint=83616 bdi_dirty=83440 dirty_ratelimit=62744 task_ratelimit=61148 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5717 [057] .... 277.026938: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=956522 bdi_setpoint=83611 bdi_dirty=83496 dirty_ratelimit=62744 task_ratelimit=61148 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-2 dd-5717 [057] .... 277.027526: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=956653 bdi_setpoint=83611 bdi_dirty=83496 dirty_ratelimit=62744 task_ratelimit=61148 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5717 [057] .... 277.028148: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=956770 bdi_setpoint=83605 bdi_dirty=83552 dirty_ratelimit=62744 task_ratelimit=61028 dirtied=32 dirtied_pause=32 paused=0 pause=7 period=2 think=-5 dd-5726 [041] .... 285.898859: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954043 bdi_setpoint=81632 bdi_dirty=86856 dirty_ratelimit=62704 task_ratelimit=57988 dirtied=1 dirtied_pause=32 paused=0 pause=0 period=0 think=0 dd-5726 [041] .... 285.899181: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954098 bdi_setpoint=81632 bdi_dirty=86856 dirty_ratelimit=62704 task_ratelimit=57988 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5726 [041] .... 285.899502: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954153 bdi_setpoint=81632 bdi_dirty=86856 dirty_ratelimit=62704 task_ratelimit=57924 dirtied=32 dirtied_pause=32 paused=0 pause=-4294945548 period=2 think=4294945550 dd-5726 [009] .... 285.899890: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954072 bdi_setpoint=81624 bdi_dirty=86912 dirty_ratelimit=62704 task_ratelimit=57924 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=1 dd-5726 [009] .... 285.900243: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954066 bdi_setpoint=81617 bdi_dirty=87024 dirty_ratelimit=62704 task_ratelimit=57864 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5726 [009] .... 285.900599: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953930 bdi_setpoint=81601 bdi_dirty=87024 dirty_ratelimit=62704 task_ratelimit=57864 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5726 [009] .... 285.901007: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=953867 bdi_setpoint=81593 bdi_dirty=87136 dirty_ratelimit=62704 task_ratelimit=57804 dirtied=32 dirtied_pause=32 paused=0 pause=6 period=2 think=-4 dd-5726 [018] .... 285.908755: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954143 bdi_setpoint=81603 bdi_dirty=87192 dirty_ratelimit=62704 task_ratelimit=57680 dirtied=153 dirtied_pause=153 paused=0 pause=8 period=10 think=2 dd-5726 [019] .... 285.918580: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954457 bdi_setpoint=81692 bdi_dirty=87192 dirty_ratelimit=62704 task_ratelimit=57744 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [019] .... 285.928517: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954717 bdi_setpoint=81678 bdi_dirty=87416 dirty_ratelimit=62704 task_ratelimit=57560 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [020] .... 285.939941: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=954777 bdi_setpoint=81641 bdi_dirty=87584 dirty_ratelimit=62704 task_ratelimit=57436 dirtied=153 dirtied_pause=153 paused=0 pause=7 period=10 think=3 dd-5726 [021] .... 285.948496: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955090 bdi_setpoint=81643 bdi_dirty=87808 dirty_ratelimit=62704 task_ratelimit=57252 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [021] .... 285.958924: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955120 bdi_setpoint=81614 bdi_dirty=87976 dirty_ratelimit=62704 task_ratelimit=57128 dirtied=153 dirtied_pause=153 paused=0 pause=8 period=10 think=2 dd-5726 [022] .... 285.968287: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955009 bdi_setpoint=81672 bdi_dirty=88088 dirty_ratelimit=62704 task_ratelimit=57128 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [022] .... 285.978468: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955194 bdi_setpoint=81658 bdi_dirty=88200 dirty_ratelimit=62704 task_ratelimit=56944 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [023] .... 285.988475: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955302 bdi_setpoint=81629 bdi_dirty=88424 dirty_ratelimit=62704 task_ratelimit=56824 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [023] .... 285.998281: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955190 bdi_setpoint=81608 bdi_dirty=88648 dirty_ratelimit=62704 task_ratelimit=56640 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [016] .... 286.008352: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955498 bdi_setpoint=81602 bdi_dirty=88760 dirty_ratelimit=62704 task_ratelimit=56580 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [016] .... 286.018027: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955419 bdi_setpoint=81660 bdi_dirty=88816 dirty_ratelimit=62704 task_ratelimit=56580 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [017] .... 286.028230: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955365 bdi_setpoint=81631 bdi_dirty=89040 dirty_ratelimit=62704 task_ratelimit=56396 dirtied=153 dirtied_pause=153 paused=0 pause=9 period=10 think=1 dd-5726 [049] .... 286.038490: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955468 bdi_setpoint=81610 bdi_dirty=89096 dirty_ratelimit=62704 task_ratelimit=56396 dirtied=153 dirtied_pause=153 paused=0 pause=8 period=10 think=2 dd-5726 [049] .... 286.048435: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=955739 bdi_setpoint=81682 bdi_dirty=89208 dirty_ratelimit=62704 task_ratelimit=56272 dirtied=153 dirtied_pause=153 paused=0 pause=8 period=10 think=2 dd-5735 [041] .... 294.267435: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950852 bdi_setpoint=82067 bdi_dirty=84616 dirty_ratelimit=62664 task_ratelimit=59968 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=0 dd-5735 [041] .... 294.267765: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950970 bdi_setpoint=82067 bdi_dirty=84616 dirty_ratelimit=62664 task_ratelimit=59968 dirtied=32 dirtied_pause=32 paused=0 pause=-4294953933 period=2 think=4294953935 dd-5735 [041] .... 294.268098: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951017 bdi_setpoint=82060 bdi_dirty=84672 dirty_ratelimit=62664 task_ratelimit=59908 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=1 dd-5735 [041] .... 294.268424: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951029 bdi_setpoint=82060 bdi_dirty=84672 dirty_ratelimit=62664 task_ratelimit=59908 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-1 dd-5735 [041] .... 294.268742: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951095 bdi_setpoint=82060 bdi_dirty=84728 dirty_ratelimit=62664 task_ratelimit=59848 dirtied=32 dirtied_pause=32 paused=0 pause=0 period=2 think=-3 dd-5735 [041] .... 294.269061: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950833 bdi_setpoint=82042 bdi_dirty=84728 dirty_ratelimit=62664 task_ratelimit=59848 dirtied=32 dirtied_pause=32 paused=1 pause=7 period=2 think=-4 dd-5735 [041] .... 294.277895: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951014 bdi_setpoint=82044 bdi_dirty=84896 dirty_ratelimit=62664 task_ratelimit=59784 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [010] .... 294.287018: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=950953 bdi_setpoint=82027 bdi_dirty=85120 dirty_ratelimit=62664 task_ratelimit=59604 dirtied=152 dirtied_pause=152 paused=0 pause=9 period=10 think=1 dd-5735 [010] .... 294.297275: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951081 bdi_setpoint=82070 bdi_dirty=85120 dirty_ratelimit=62664 task_ratelimit=59604 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [011] .... 294.307161: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951125 bdi_setpoint=81988 bdi_dirty=85456 dirty_ratelimit=62664 task_ratelimit=59296 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [012] .... 294.316854: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951369 bdi_setpoint=82043 bdi_dirty=85568 dirty_ratelimit=62664 task_ratelimit=59296 dirtied=152 dirtied_pause=152 paused=0 pause=9 period=10 think=1 dd-5735 [013] .... 294.327260: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951431 bdi_setpoint=82026 bdi_dirty=85736 dirty_ratelimit=62664 task_ratelimit=59172 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [014] .... 294.337097: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=951718 bdi_setpoint=82022 bdi_dirty=85904 dirty_ratelimit=62664 task_ratelimit=59052 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [015] .... 294.346927: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952048 bdi_setpoint=82017 bdi_dirty=86128 dirty_ratelimit=62664 task_ratelimit=58868 dirtied=152 dirtied_pause=152 paused=0 pause=9 period=10 think=1 dd-5735 [008] .... 294.357367: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952092 bdi_setpoint=82060 bdi_dirty=86184 dirty_ratelimit=62664 task_ratelimit=58868 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [009] .... 294.366817: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952000 bdi_setpoint=82044 bdi_dirty=86408 dirty_ratelimit=62664 task_ratelimit=58684 dirtied=152 dirtied_pause=152 paused=0 pause=9 period=10 think=1 dd-5735 [010] .... 294.376936: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952338 bdi_setpoint=82098 bdi_dirty=86464 dirty_ratelimit=62664 task_ratelimit=58624 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [011] .... 294.386956: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952088 bdi_setpoint=82070 bdi_dirty=86632 dirty_ratelimit=62664 task_ratelimit=58560 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [012] .... 294.396998: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952441 bdi_setpoint=82066 bdi_dirty=86744 dirty_ratelimit=62664 task_ratelimit=58440 dirtied=152 dirtied_pause=152 paused=0 pause=8 period=10 think=2 dd-5735 [013] .... 294.406820: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952484 bdi_setpoint=82115 bdi_dirty=86800 dirty_ratelimit=62664 task_ratelimit=58440 dirtied=152 dirtied_pause=152 paused=0 pause=9 period=10 think=1 dd-5735 [014] .... 294.416669: balance_dirty_pages: bdi 8:144: limit=1048576 setpoint=917504 dirty=952273 bdi_setpoint=82092 bdi_dirty=86912 dirty_ratelimit=62664 task_ratelimit=58380 dirtied=152 dirtied_pause=152 paused=0 pause=9 period=10 think=1 -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/ Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a> ^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [Bug 12309] Large I/O operations result in poor interactive performance and high iowait times 2012-01-28 14:44 ` Wu, Fengguang @ 2012-02-01 14:02 ` Wu Fengguang 0 siblings, 0 replies; 3+ messages in thread From: Wu Fengguang @ 2012-02-01 14:02 UTC (permalink / raw) To: Andrew Morton, linux-mm@kvack.org; +Cc: Mel Gorman On Sat, Jan 28, 2012 at 02:44:24PM +0000, Wu, Fengguang wrote: > [replying from webmail and CC my gmail account] > > >> https://bugzilla.kernel.org/show_bug.cgi?id=12309 > > > We've had some recent updates to the world's largest bug report. > > Apparently our large-writer-paralyses-the-machine problems have > > worsened in recent kernels. > > Yeah I can reproduce the interactive problem on 3.3-rc1, and the main stalls seem to happen when loading the task and allocating memory. However I find no allocstall/nr_vmscan_write in this test box: wfg@bee /export/writeback/lkp-nex04% g vmscan JBOD*/*/vmstat-end JBOD-10HDD-thresh=1000M/ext4-1dd-1-3.3.0-rc1/vmstat-end:nr_vmscan_write 0 JBOD-10HDD-thresh=1000M/ext4-1dd-1-3.3.0-rc1/vmstat-end:nr_vmscan_immediate_reclaim 39380 JBOD-10HDD-thresh=100M/ext4-1dd-1-3.3.0-rc1/vmstat-end:nr_vmscan_write 0 JBOD-10HDD-thresh=100M/ext4-1dd-1-3.3.0-rc1/vmstat-end:nr_vmscan_immediate_reclaim 12795 JBOD-10HDD-thresh=100M/xfs-1dd-1-3.3.0-rc1/vmstat-end:nr_vmscan_write 0 JBOD-10HDD-thresh=100M/xfs-1dd-1-3.3.0-rc1/vmstat-end:nr_vmscan_immediate_reclaim 2328 JBOD-10HDD-thresh=4G/ext4-1dd-1-3.3.0-rc1/vmstat-end:nr_vmscan_write 0 JBOD-10HDD-thresh=4G/ext4-1dd-1-3.3.0-rc1/vmstat-end:nr_vmscan_immediate_reclaim 42120 wfg@bee /export/writeback/lkp-nex04% g stall JBOD*/*/vmstat-end JBOD-10HDD-thresh=1000M/ext4-1dd-1-3.3.0-rc1/vmstat-end:allocstall 0 JBOD-10HDD-thresh=100M/ext4-1dd-1-3.3.0-rc1/vmstat-end:allocstall 0 JBOD-10HDD-thresh=100M/xfs-1dd-1-3.3.0-rc1/vmstat-end:allocstall 8 JBOD-10HDD-thresh=4G/ext4-1dd-1-3.3.0-rc1/vmstat-end:allocstall 0 On the other side, I'd like to share some facts that indicate improved responsiveness since Linux 3.2: - the vmstat "allocstall" and "nr_vmscan_write" fields mostly drop to 0 thanks to Mel's IO-less page reclaim patches (data listed below) - I personally feel a lot better responsiveness when ssh into the test boxes checking things out when they are doing heavy writeback tests, thanks to the IO-less balance_dirty_pages() patches. There is a user report on impressive improvements on desktop responsiveness (see below email). Thanks, Fengguang --- wfg@bee /export/writeback/snb% g allocstall JBOD*/*3.1.0+/vmstat-end JBOD-4HDD-thresh=100M/btrfs-100dd-1-3.1.0+/vmstat-end:allocstall 38 JBOD-4HDD-thresh=100M/btrfs-100dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/btrfs-10dd-1-3.1.0+/vmstat-end:allocstall 20 JBOD-4HDD-thresh=100M/btrfs-10dd-2-3.1.0+/vmstat-end:allocstall 36 JBOD-4HDD-thresh=100M/btrfs-1dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/btrfs-1dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext3-100dd-1-3.1.0+/vmstat-end:allocstall 39 JBOD-4HDD-thresh=100M/ext3-100dd-2-3.1.0+/vmstat-end:allocstall 59 JBOD-4HDD-thresh=100M/ext3-10dd-1-3.1.0+/vmstat-end:allocstall 16 JBOD-4HDD-thresh=100M/ext3-10dd-2-3.1.0+/vmstat-end:allocstall 14 JBOD-4HDD-thresh=100M/ext3-1dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext3-1dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext4-100dd-1-3.1.0+/vmstat-end:allocstall 1502 JBOD-4HDD-thresh=100M/ext4-100dd-2-3.1.0+/vmstat-end:allocstall 953 JBOD-4HDD-thresh=100M/ext4-10dd-1-3.1.0+/vmstat-end:allocstall 158 JBOD-4HDD-thresh=100M/ext4-10dd-2-3.1.0+/vmstat-end:allocstall 107 JBOD-4HDD-thresh=100M/ext4-1dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext4-1dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/xfs-100dd-1-3.1.0+/vmstat-end:allocstall 498 JBOD-4HDD-thresh=100M/xfs-100dd-2-3.1.0+/vmstat-end:allocstall 486 JBOD-4HDD-thresh=100M/xfs-10dd-1-3.1.0+/vmstat-end:allocstall 159 JBOD-4HDD-thresh=100M/xfs-10dd-2-3.1.0+/vmstat-end:allocstall 621 JBOD-4HDD-thresh=100M/xfs-1dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/xfs-1dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-100dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-100dd-2-3.1.0+/vmstat-end:allocstall 29 JBOD-4HDD-thresh=1G/btrfs-10dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-10dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-1dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-1dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext3-100dd-1-3.1.0+/vmstat-end:allocstall 307 JBOD-4HDD-thresh=1G/ext3-100dd-2-3.1.0+/vmstat-end:allocstall 128 JBOD-4HDD-thresh=1G/ext3-10dd-1-3.1.0+/vmstat-end:allocstall 59 JBOD-4HDD-thresh=1G/ext3-10dd-2-3.1.0+/vmstat-end:allocstall 40 JBOD-4HDD-thresh=1G/ext3-1dd-1-3.1.0+/vmstat-end:allocstall 45 JBOD-4HDD-thresh=1G/ext3-1dd-2-3.1.0+/vmstat-end:allocstall 31 JBOD-4HDD-thresh=1G/ext4-100dd-1-3.1.0+/vmstat-end:allocstall 2022 JBOD-4HDD-thresh=1G/ext4-100dd-2-3.1.0+/vmstat-end:allocstall 1923 JBOD-4HDD-thresh=1G/ext4-10dd-1-3.1.0+/vmstat-end:allocstall 39 JBOD-4HDD-thresh=1G/ext4-10dd-2-3.1.0+/vmstat-end:allocstall 26 JBOD-4HDD-thresh=1G/ext4-1dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext4-1dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/xfs-100dd-1-3.1.0+/vmstat-end:allocstall 1838 JBOD-4HDD-thresh=1G/xfs-100dd-2-3.1.0+/vmstat-end:allocstall 1650 JBOD-4HDD-thresh=1G/xfs-10dd-1-3.1.0+/vmstat-end:allocstall 2294 JBOD-4HDD-thresh=1G/xfs-10dd-2-3.1.0+/vmstat-end:allocstall 2144 JBOD-4HDD-thresh=1G/xfs-1dd-1-3.1.0+/vmstat-end:allocstall 61 JBOD-4HDD-thresh=1G/xfs-1dd-2-3.1.0+/vmstat-end:allocstall 103 JBOD-4HDD-thresh=8G/btrfs-100dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/btrfs-100dd-2-3.1.0+/vmstat-end:allocstall 49 JBOD-4HDD-thresh=8G/btrfs-10dd-1-3.1.0+/vmstat-end:allocstall 186 JBOD-4HDD-thresh=8G/btrfs-10dd-2-3.1.0+/vmstat-end:allocstall 139 JBOD-4HDD-thresh=8G/btrfs-1dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/btrfs-1dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext3-100dd-1-3.1.0+/vmstat-end:allocstall 670 JBOD-4HDD-thresh=8G/ext3-100dd-2-3.1.0+/vmstat-end:allocstall 875 JBOD-4HDD-thresh=8G/ext3-10dd-1-3.1.0+/vmstat-end:allocstall 5 JBOD-4HDD-thresh=8G/ext3-10dd-2-3.1.0+/vmstat-end:allocstall 49 JBOD-4HDD-thresh=8G/ext3-1dd-1-3.1.0+/vmstat-end:allocstall 13 JBOD-4HDD-thresh=8G/ext3-1dd-2-3.1.0+/vmstat-end:allocstall 19 JBOD-4HDD-thresh=8G/ext4-100dd-1-3.1.0+/vmstat-end:allocstall 2784 JBOD-4HDD-thresh=8G/ext4-100dd-2-3.1.0+/vmstat-end:allocstall 1997 JBOD-4HDD-thresh=8G/ext4-10dd-1-3.1.0+/vmstat-end:allocstall 13 JBOD-4HDD-thresh=8G/ext4-10dd-2-3.1.0+/vmstat-end:allocstall 4 JBOD-4HDD-thresh=8G/ext4-1dd-1-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext4-1dd-2-3.1.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/xfs-100dd-1-3.1.0+/vmstat-end:allocstall 11282 JBOD-4HDD-thresh=8G/xfs-100dd-2-3.1.0+/vmstat-end:allocstall 11677 JBOD-4HDD-thresh=8G/xfs-10dd-1-3.1.0+/vmstat-end:allocstall 3848 JBOD-4HDD-thresh=8G/xfs-10dd-2-3.1.0+/vmstat-end:allocstall 3183 JBOD-4HDD-thresh=8G/xfs-1dd-1-3.1.0+/vmstat-end:allocstall 206 JBOD-4HDD-thresh=8G/xfs-1dd-2-3.1.0+/vmstat-end:allocstall 189 wfg@bee /export/writeback/snb% g allocstall JBOD*/*3.2.0+/vmstat-end JBOD-4HDD-thresh=100M/btrfs-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/btrfs-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/btrfs-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/btrfs-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/btrfs-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/btrfs-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext3-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext3-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext3-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext3-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext3-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext3-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext4-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext4-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext4-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext4-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext4-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/ext4-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/xfs-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/xfs-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/xfs-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/xfs-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/xfs-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=100M/xfs-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/btrfs-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext3-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext3-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext3-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext3-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext3-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext3-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext4-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext4-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext4-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext4-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext4-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/ext4-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/xfs-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/xfs-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/xfs-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/xfs-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/xfs-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=1G/xfs-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/btrfs-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/btrfs-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/btrfs-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/btrfs-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/btrfs-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/btrfs-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext3-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext3-100dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext3-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext3-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext3-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext3-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext4-100dd-1-3.2.0+/vmstat-end:allocstall 45 JBOD-4HDD-thresh=8G/ext4-100dd-2-3.2.0+/vmstat-end:allocstall 33 JBOD-4HDD-thresh=8G/ext4-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext4-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext4-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/ext4-1dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/xfs-100dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/xfs-100dd-2-3.2.0+/vmstat-end:allocstall 12 JBOD-4HDD-thresh=8G/xfs-10dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/xfs-10dd-2-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/xfs-1dd-1-3.2.0+/vmstat-end:allocstall 0 JBOD-4HDD-thresh=8G/xfs-1dd-2-3.2.0+/vmstat-end:allocstall 0 wfg@bee /export/writeback/snb% g nr_vmscan_write JBOD*/*3.1.0+/vmstat-end JBOD-4HDD-thresh=100M/btrfs-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 61 JBOD-4HDD-thresh=100M/btrfs-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 97 JBOD-4HDD-thresh=100M/btrfs-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 38 JBOD-4HDD-thresh=100M/btrfs-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 33 JBOD-4HDD-thresh=100M/btrfs-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 13 JBOD-4HDD-thresh=100M/btrfs-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 3 JBOD-4HDD-thresh=100M/ext3-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 11 JBOD-4HDD-thresh=100M/ext3-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 7 JBOD-4HDD-thresh=100M/ext3-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 12 JBOD-4HDD-thresh=100M/ext3-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 26 JBOD-4HDD-thresh=100M/ext3-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 4 JBOD-4HDD-thresh=100M/ext3-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 16 JBOD-4HDD-thresh=100M/ext4-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 19 JBOD-4HDD-thresh=100M/ext4-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 13 JBOD-4HDD-thresh=100M/ext4-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 25 JBOD-4HDD-thresh=100M/ext4-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 36 JBOD-4HDD-thresh=100M/ext4-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 23 JBOD-4HDD-thresh=100M/ext4-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 11 JBOD-4HDD-thresh=100M/xfs-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 1 JBOD-4HDD-thresh=100M/xfs-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/xfs-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 3 JBOD-4HDD-thresh=100M/xfs-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 7 JBOD-4HDD-thresh=100M/xfs-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 1 JBOD-4HDD-thresh=100M/xfs-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/btrfs-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 234 JBOD-4HDD-thresh=1G/btrfs-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 166 JBOD-4HDD-thresh=1G/btrfs-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 65 JBOD-4HDD-thresh=1G/btrfs-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 63 JBOD-4HDD-thresh=1G/btrfs-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 8 JBOD-4HDD-thresh=1G/btrfs-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 15 JBOD-4HDD-thresh=1G/ext3-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 46 JBOD-4HDD-thresh=1G/ext3-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 55 JBOD-4HDD-thresh=1G/ext3-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 102 JBOD-4HDD-thresh=1G/ext3-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 49 JBOD-4HDD-thresh=1G/ext3-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 91 JBOD-4HDD-thresh=1G/ext3-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 77 JBOD-4HDD-thresh=1G/ext4-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 1 JBOD-4HDD-thresh=1G/ext4-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 3 JBOD-4HDD-thresh=1G/ext4-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 14 JBOD-4HDD-thresh=1G/ext4-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 3 JBOD-4HDD-thresh=1G/ext4-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 6 JBOD-4HDD-thresh=1G/ext4-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 10 JBOD-4HDD-thresh=1G/xfs-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 5 JBOD-4HDD-thresh=1G/xfs-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 5 JBOD-4HDD-thresh=1G/xfs-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 8 JBOD-4HDD-thresh=1G/xfs-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 2 JBOD-4HDD-thresh=1G/xfs-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 159 JBOD-4HDD-thresh=1G/xfs-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 178 JBOD-4HDD-thresh=8G/btrfs-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 282 JBOD-4HDD-thresh=8G/btrfs-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 203 JBOD-4HDD-thresh=8G/btrfs-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 107 JBOD-4HDD-thresh=8G/btrfs-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 82 JBOD-4HDD-thresh=8G/btrfs-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 19 JBOD-4HDD-thresh=8G/btrfs-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 46 JBOD-4HDD-thresh=8G/ext3-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 288 JBOD-4HDD-thresh=8G/ext3-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 330 JBOD-4HDD-thresh=8G/ext3-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 229 JBOD-4HDD-thresh=8G/ext3-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 227 JBOD-4HDD-thresh=8G/ext3-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 171 JBOD-4HDD-thresh=8G/ext3-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 129 JBOD-4HDD-thresh=8G/ext4-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext4-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 13 JBOD-4HDD-thresh=8G/ext4-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 453 JBOD-4HDD-thresh=8G/ext4-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 224 JBOD-4HDD-thresh=8G/ext4-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 14 JBOD-4HDD-thresh=8G/ext4-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 11 JBOD-4HDD-thresh=8G/xfs-100dd-1-3.1.0+/vmstat-end:nr_vmscan_write 7 JBOD-4HDD-thresh=8G/xfs-100dd-2-3.1.0+/vmstat-end:nr_vmscan_write 5 JBOD-4HDD-thresh=8G/xfs-10dd-1-3.1.0+/vmstat-end:nr_vmscan_write 1126 JBOD-4HDD-thresh=8G/xfs-10dd-2-3.1.0+/vmstat-end:nr_vmscan_write 98 JBOD-4HDD-thresh=8G/xfs-1dd-1-3.1.0+/vmstat-end:nr_vmscan_write 252 JBOD-4HDD-thresh=8G/xfs-1dd-2-3.1.0+/vmstat-end:nr_vmscan_write 278 wfg@bee /export/writeback/snb% g nr_vmscan_write JBOD*/*3.2.0+/vmstat-end JBOD-4HDD-thresh=100M/btrfs-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/btrfs-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/btrfs-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/btrfs-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/btrfs-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/btrfs-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext3-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext3-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext3-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext3-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext3-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext3-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext4-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext4-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext4-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext4-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext4-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/ext4-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/xfs-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/xfs-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/xfs-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/xfs-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/xfs-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=100M/xfs-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/btrfs-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/btrfs-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/btrfs-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/btrfs-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/btrfs-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/btrfs-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext3-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext3-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext3-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext3-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext3-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext3-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext4-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext4-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext4-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext4-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext4-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/ext4-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/xfs-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/xfs-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/xfs-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/xfs-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/xfs-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=1G/xfs-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/btrfs-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/btrfs-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/btrfs-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/btrfs-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/btrfs-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/btrfs-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext3-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext3-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext3-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext3-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext3-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext3-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext4-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext4-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext4-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext4-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext4-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/ext4-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/xfs-100dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/xfs-100dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/xfs-10dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/xfs-10dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/xfs-1dd-1-3.2.0+/vmstat-end:nr_vmscan_write 0 JBOD-4HDD-thresh=8G/xfs-1dd-2-3.2.0+/vmstat-end:nr_vmscan_write 0 From: Manuel Krause <manuels-adresse@t-online.de> To: "Wu, Fengguang" <fengguang.wu@intel.com> Cc: Bcc: Subject: Re: Encouraged by Con Kolivas: Your IO-less-dirty-throttling patches v12 Reply-To: In-Reply-To: <20111217022028.GA19178@localhost> user-agent: Mozilla/5.0 (X11; Linux i686; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 Hi Fengguang, On 2011-12-17 03:20, Wu Fengguang wrote: > Hi Manuel, > >> Hi, >> >> I'm running an openSUSE 11.4 with a 3.1.4 (non-vanilla) kernel >> source that is somehow patched by SUSE at first. Upon that I am >> used to patch the most recent CK and BFQ patches since years. >> >> I'm following Con Kolivas' Blog, currently >> http://ck-hack.blogspot.com/2011/11/310-ck2-bfs-0415.html?showComment=1324079830206#c3565024166985189501 >> (There you'll find many things I'd write in the following. So to >> speak that's a kind of history.) >> >> Some kernels ago my usual workflow broke, as there were too many >> stalls and hickups when watching a video via vlc at the same time. >> >> My "testcase" (as Con named it) is the following: >> Old system >> PIII-1400 (Tualatin) >> SDRAM 2GB (Kingston, highest timings) >> ASUS-TUV4X, VIA Chipset, 133/33MHz, AGP 4x >> normally 2 IDE disks @UDMA-100 (now, recently, one failed) >> reiserfs 3.6 as standard FS >> swap as partiton on second disk with 4GB (originally, now on >> first disk). >> shmfs mounted with 3GB >> >> So I have 2GB RAM, 4GB swap and 3GB shmfs. Where shmfs and swap >> and RAM may interfere. > > Yeah, the shmfs looks large. The original idea behind this setup was: The normal file sizes to be decoded are about 400 to 800MB and would fit into the RAM part of the overlapping shmfs resulting in a fast processing, what is true. Files bigger than that would simply swap out to disk. I originally thought that to be as simple as if I decoded directly from disk to disk (and so giving the swap partition an extra use than to only be a suspend-to-disk area). But that obviously isn't the case (any more), read below. From some kernel version on (that I don't remember) it became worse with stuttering, stalling or even hours to wait for the system to recover. > >> >> I then decode an encrypted file to /dev/shm (Simple cp makes the >> same issues without extra CPU utilization). Open it in Avidemux >> and cut it and copy it back to the original partition (with >> previously deleting the original file on the later=same target >> partition). > > And it's a bit complex operations. Did you do that _while_ running > vlc? No wonder vlc is impacted.. Yes, of course! I've found that to be a good test of system responsiveness / low latency / advantage of the CK patchset over vanilla. Also it's a usual workflow for me. Scrolling a website in firefox does show the same stutterings like vlc video playback, btw. Watching a video while decoding is just more convenient ;-) >> Whenever the file's size exceeded about 900MB/1GB, whether to be >> decoded to shm, later to be opened by Avidemux or to be processed >> in Avidemux at the end, my system began to stall often and for >> long times. Sometimes for minutes, sometimes for hours. Because >> of weird swapping behavior. Setting back some vm things like >> swappiness or dirty_ratio to kernel defaults (against ck2) did >> not help out. >> > > Yeah, that stress use of your memory can easily lead to a slow > responding system. Last night I retested the decoding, now, from and to the same partition and there was no loss of desktop responsiveness or stuttering in vlc video playback at all (same 1.2GB file as in the shmfs test before). > >> Yesterday I applied your 11 patches from v12 and they >> applied+compiled fine. And they seem to work like a charm. I'd >> consider that as a great effort! > > Thanks for trying it out! It's actually a big surprising for me. What makes you be surprised? > > FYI, most of the patches are now in 3.2-rcX and the others are pending > for 3.3. So you won't need to carry the patches for long time :-) Nice to hear that, but patching is no problem. Can you tell what patches remain pending for 3.3? > >> Most of the hickups in vlc video playing (at the same time) are >> gone now, they are much shorter, when decoding like explained >> above. Also the recovery times and the overall processing time at >> all ist much shorter due to much fewer stalls. >> >> I know this is no "benchmark" as usual, but it definitely shows >> that your patches WILL have benefit for normal users. > > Thanks for the feedback, I appreciate it a lot! :-) Feel free to use it as argument in discussions about the usefulness of your patches. If you have any ideas on how to improve my vm experience in my setup or experimental patches or hints for tunable variables, I would be glad to read from you, best regards, and cheers, too, Manuel Krause -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/ Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a> ^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2012-02-01 14:02 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <bug-12309-27@https.bugzilla.kernel.org/>
[not found] ` <201201201611.q0KGBPf6029256@bugzilla.kernel.org>
2012-01-20 22:45 ` [Bug 12309] Large I/O operations result in poor interactive performance and high iowait times Andrew Morton
2012-01-28 14:44 ` Wu, Fengguang
2012-02-01 14:02 ` Wu Fengguang
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).