From: Wu Fengguang <fengguang.wu@intel.com>
To: Trond Myklebust <Trond.Myklebust@netapp.com>
Cc: linux-nfs@vger.kernel.org, linux-fsdevel@vger.kernel.org,
LKML <linux-kernel@vger.kernel.org>,
Feng Tang <feng.tang@intel.com>
Subject: Re: [PATCH] nfs: writeback pages wait queue
Date: Mon, 21 Nov 2011 15:15:25 +0800 [thread overview]
Message-ID: <20111121071525.GA24937@localhost> (raw)
In-Reply-To: <20111119125253.GA5483@localhost>
[-- Attachment #1: Type: text/plain, Size: 34789 bytes --]
> Tests show that it can effectively reduce stalls in the disk-network
> pipeline, improve performance and reduce delays.
For the record, the full stats are listed below.
The attached two figures about NFS server disk/network traffics are
taken from cases
snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1-ioless-full+
The former shows more interleaved disk/network activities (one is
mostly stalled when the other is busy). While the latter shows more
evenly distributed disk/net bandwidth, both disk/net throughput are
dropping to 0 less often.
Thanks,
Fengguang
---
wfg@bee /export/writeback% ./compare-nfs.sh -g nfs snb/*/{*-3.2.0-rc1,*-3.2.0-rc1-ioless-full+}
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
20.66 +136.7% 48.90 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
20.82 +147.5% 51.52 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
20.57 +129.8% 47.26 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
35.96 +96.5% 70.67 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
37.47 +89.1% 70.85 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
34.55 +106.1% 71.21 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
58.24 +28.2% 74.63 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
59.83 +18.6% 70.93 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
58.30 +31.4% 76.61 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
23.69 -10.0% 21.33 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
23.59 -1.7% 23.19 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
23.94 -1.0% 23.70 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
27.06 -0.0% 27.06 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
25.43 +4.8% 26.66 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
27.21 -0.8% 26.99 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
53.82 +4.4% 56.17 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
55.80 +4.2% 58.12 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
55.75 +2.9% 57.37 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
15.47 +1.3% 15.68 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
16.09 -3.5% 15.53 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
15.09 -0.9% 14.96 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
26.65 +13.0% 30.10 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
25.09 +7.7% 27.02 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
27.16 +3.3% 28.06 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
27.51 +78.6% 49.11 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
22.46 +131.6% 52.01 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
12.95 +289.8% 50.50 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
42.28 +81.0% 76.52 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
40.33 +78.8% 72.10 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
42.52 +67.6% 71.27 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
62.27 +34.6% 83.84 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
60.10 +35.6% 81.48 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
66.29 +17.5% 77.88 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
1164.97 +41.6% 1649.19 TOTAL write_bw
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
2404.00 +67.7% 4031.00 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
3236.00 +22.6% 3968.00 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
2435.00 +100.7% 4886.00 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
415.00 +113.7% 887.00 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
429.00 +119.6% 942.00 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
400.00 +127.2% 909.00 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
72.00 +40.3% 101.00 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
73.00 +28.8% 94.00 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
71.00 +47.9% 105.00 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
455.00 +233.4% 1517.00 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
401.00 -21.7% 314.00 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
390.00 -1.0% 386.00 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
2875.00 -0.6% 2858.00 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
2664.00 +5.9% 2820.00 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
2882.00 -1.8% 2829.00 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
718.00 +5.4% 757.00 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
756.00 +4.8% 792.00 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
756.00 +2.6% 776.00 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
6570.00 +0.1% 6574.00 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
6551.00 -3.8% 6305.00 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
6362.00 -0.0% 6360.00 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
2895.00 +21.2% 3509.00 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
2542.00 +17.2% 2978.00 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
2987.00 +0.3% 2996.00 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
2140.00 +77.6% 3801.00 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
1808.00 +41.2% 2552.00 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
679.00 +293.8% 2674.00 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
241.00 +141.1% 581.00 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
237.00 +97.5% 468.00 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
240.00 +135.4% 565.00 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
41.00 +34.1% 55.00 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
35.00 +65.7% 58.00 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
39.00 +33.3% 52.00 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
54799.00 +25.0% 68500.00 TOTAL nfs_nr_commits
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
40601.00 -14.0% 34925.00 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
41859.00 -12.2% 36761.00 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
39947.00 -15.1% 33897.00 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
153398.00 -72.0% 42898.00 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
149928.00 -65.0% 52422.00 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
118064.00 -59.6% 47707.00 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
102626.00 +78.2% 182853.00 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
111743.00 +81.4% 202708.00 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
91838.00 +107.1% 190184.00 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
35016.00 +16.7% 40874.00 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
34778.00 -2.3% 33981.00 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
35749.00 -1.7% 35131.00 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
104527.00 -7.4% 96761.00 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
91568.00 +6.5% 97506.00 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
99681.00 -5.1% 94596.00 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
208450.00 -1.0% 206384.00 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
205944.00 +12.2% 231073.00 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
190945.00 +21.8% 232662.00 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
71042.00 -0.1% 70937.00 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
71398.00 -3.2% 69148.00 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
70247.00 -1.1% 69504.00 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
142168.00 +35.0% 191905.00 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
116012.00 +18.7% 137664.00 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
145534.00 +5.6% 153619.00 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
67785.00 -39.1% 41269.00 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
53151.00 -20.1% 42471.00 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
73200.00 -39.9% 43988.00 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
188725.00 -57.4% 80357.00 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
176809.00 -75.0% 44204.00 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
173292.00 -44.2% 96636.00 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
96940.00 +76.7% 171281.00 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
111572.00 +36.3% 152049.00 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
128726.00 +29.8% 167063.00 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
3543263.00 -3.3% 3425418.00 TOTAL nfs_nr_writes
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
5.56 +44.9% 8.06 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
4.14 +109.1% 8.67 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
5.46 +16.3% 6.35 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
52.04 -8.4% 47.70 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
52.33 -13.8% 45.09 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
51.72 -9.2% 46.98 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
484.63 -8.6% 443.16 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
492.42 -8.2% 452.26 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
493.13 -11.4% 437.15 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
32.52 -72.9% 8.80 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
36.15 +26.1% 45.58 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
38.33 +0.4% 38.49 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
5.67 +0.5% 5.69 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
5.74 -1.1% 5.68 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
5.69 +0.9% 5.74 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
44.91 -1.0% 44.45 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
44.22 -0.6% 43.96 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
44.18 +0.2% 44.28 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
1.42 +1.1% 1.43 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
1.48 +0.3% 1.48 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
1.43 -1.0% 1.42 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
5.51 -6.8% 5.14 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
5.91 -8.1% 5.43 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
5.44 +3.0% 5.61 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
8.80 +6.6% 9.38 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
8.51 +65.2% 14.06 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
15.28 -13.2% 13.27 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
105.12 -24.9% 78.99 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
101.90 -9.1% 92.60 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
106.24 -29.7% 74.65 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
909.85 +0.4% 913.68 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
1030.45 -18.3% 841.68 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
1016.56 -11.6% 898.36 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
5222.74 -10.1% 4695.25 TOTAL nfs_commit_size
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
0.33 +182.4% 0.93 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
0.32 +192.0% 0.94 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
0.33 +175.1% 0.91 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
0.14 +600.4% 0.99 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
0.15 +441.1% 0.81 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
0.18 +410.8% 0.90 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
0.34 -28.0% 0.24 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
0.32 -34.8% 0.21 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
0.38 -36.7% 0.24 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
0.42 -22.7% 0.33 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
0.42 +1.0% 0.42 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
0.42 +1.1% 0.42 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
0.16 +7.9% 0.17 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
0.17 -1.6% 0.16 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
0.16 +4.4% 0.17 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
0.15 +5.4% 0.16 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
0.16 -7.2% 0.15 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
0.17 -15.6% 0.15 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
0.13 +1.3% 0.13 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
0.14 -0.3% 0.14 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
0.13 +0.0% 0.13 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
0.11 -16.4% 0.09 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
0.13 -9.3% 0.12 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
0.11 -2.2% 0.11 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
0.28 +210.9% 0.86 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
0.29 +191.9% 0.85 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
0.14 +469.1% 0.81 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
0.13 +325.5% 0.57 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
0.14 +617.7% 0.98 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
0.15 +196.6% 0.44 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
0.38 -23.8% 0.29 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
0.32 -0.7% 0.32 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
0.31 -9.2% 0.28 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
7.62 +89.2% 14.42 TOTAL nfs_write_size
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
90226.82 -99.9% 92.07 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
88904.27 -99.9% 80.21 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
97436.73 -99.9% 87.32 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
62167.19 -99.3% 444.25 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
64150.34 -99.2% 539.38 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
78675.54 -99.3% 540.27 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
5372.84 +57.8% 8477.45 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
10245.66 -51.2% 4995.71 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
4744.06 +109.1% 9919.55 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
1727.29 -9.6% 1562.16 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
2183.49 +4.4% 2280.21 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
2201.49 +3.7% 2281.92 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
6213.73 +19.9% 7448.13 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
8127.01 +3.2% 8387.06 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
7255.35 +4.4% 7571.11 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
1144.67 +20.4% 1378.01 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
1010.02 +19.0% 1202.22 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
906.33 +15.8% 1049.76 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
642.82 +17.3% 753.80 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
766.82 -21.7% 600.18 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
575.95 +16.5% 670.85 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
21.91 +71.0% 37.47 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
16.70 +105.3% 34.29 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
19.05 -71.3% 5.47 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
123877.11 -99.0% 1187.27 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
122353.65 -98.8% 1505.84 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
101140.82 -98.4% 1641.03 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
78248.51 -98.9% 892.00 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
84589.42 -98.6% 1212.17 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
89684.95 -99.4% 495.28 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
10405.39 -6.9% 9684.57 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
16151.86 -48.5% 8316.69 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
16119.17 -49.0% 8214.84 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
1177306.98 -92.1% 93588.50 TOTAL nfs_write_queue_time
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
316.90 -56.7% 137.37 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
279.71 -55.0% 125.88 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
328.22 -63.4% 120.29 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
152.06 -45.7% 82.53 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
159.06 -52.7% 75.25 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
192.96 -59.0% 79.16 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
35.55 -21.2% 28.02 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
33.14 -32.9% 22.24 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
31.55 -11.1% 28.06 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
446.92 +3.2% 461.33 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
403.82 +12.8% 455.34 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
410.66 +5.3% 432.30 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
347.30 +3.8% 360.34 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
372.89 -7.4% 345.26 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
352.98 +2.0% 360.11 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
25.22 +18.9% 29.99 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
21.90 +7.6% 23.57 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
23.49 -7.2% 21.79 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
286.86 +0.4% 288.09 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
288.38 +5.5% 304.22 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
299.92 +1.0% 302.95 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
74.81 -37.8% 46.53 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
106.27 -23.8% 81.03 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
76.47 -6.5% 71.48 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
175.97 -9.8% 158.73 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
190.32 -11.5% 168.43 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
81.29 +99.2% 161.97 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
104.98 -58.2% 43.89 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
119.66 -42.3% 68.99 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
126.88 -65.9% 43.32 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
62.43 -53.5% 29.04 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
28.99 +8.7% 31.50 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
19.47 +55.9% 30.37 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
5977.02 -16.0% 5019.34 TOTAL nfs_write_rtt_time
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
90545.77 -99.7% 229.94 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
89185.97 -99.8% 206.68 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
97766.88 -99.8% 208.12 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
62320.35 -99.2% 528.28 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
64310.52 -99.0% 615.99 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
78869.77 -99.2% 620.86 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
5416.77 +57.1% 8508.91 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
10286.87 -51.2% 5021.39 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
4784.53 +108.0% 9950.05 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
2174.34 -6.9% 2023.56 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
2587.44 +5.7% 2735.64 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
2612.29 +3.9% 2714.30 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
6561.24 +19.0% 7808.62 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
8500.09 +2.7% 8732.45 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
7608.54 +4.2% 7931.36 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
1171.48 +20.3% 1408.94 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
1033.75 +18.7% 1226.79 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
931.62 +15.1% 1072.45 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
929.77 +12.1% 1041.98 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
1055.30 -14.3% 904.49 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
875.95 +11.2% 973.88 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
96.80 -13.1% 84.09 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
123.09 -6.2% 115.40 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
95.61 -19.4% 77.06 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
124054.85 -98.9% 1346.78 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
122545.76 -98.6% 1674.99 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
101222.98 -98.2% 1803.76 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
78354.75 -98.8% 937.22 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
84710.46 -98.5% 1283.06 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
89813.36 -99.4% 540.01 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
10476.93 -7.3% 9717.35 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
16189.55 -48.4% 8351.81 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
16146.79 -48.9% 8249.52 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
1183360.15 -91.7% 98645.74 TOTAL nfs_write_execute_time
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
2262.68 -97.0% 68.18 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
1794.04 -99.5% 8.96 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
2128.07 -95.2% 101.40 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
1614.18 -96.3% 60.53 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
1764.72 -94.3% 100.35 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
1602.32 -97.7% 37.01 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
2000.24 -72.6% 548.77 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
2028.37 -69.5% 619.40 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
2114.61 -80.3% 417.26 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
195.97 -35.4% 126.53 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
158.77 +9.6% 173.97 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
140.91 +40.0% 197.30 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
36.36 -6.1% 34.14 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
39.42 -9.9% 35.51 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
38.72 -16.9% 32.19 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
97.43 -17.2% 80.69 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
96.45 -20.6% 76.63 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
102.16 -25.3% 76.35 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
2.99 -2.0% 2.94 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
1.61 -0.9% 1.60 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
1.40 -13.4% 1.21 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
1.56 -3.3% 1.51 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
1.65 -0.6% 1.64 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
1.69 +9.3% 1.85 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
4122.75 -57.5% 1750.85 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
3385.95 +25.5% 4249.51 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
4023.74 +14.6% 4611.05 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
3242.20 -62.2% 1226.57 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
2961.05 -74.8% 745.85 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
3666.47 -71.1% 1059.87 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
3438.00 -78.1% 753.51 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
4524.00 -79.2% 940.24 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
3596.13 -71.4% 1027.63 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
51186.59 -62.5% 19170.98 TOTAL nfs_commit_queue_time
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
1860.87 -31.5% 1274.40 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
1758.72 -26.6% 1291.19 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
1906.15 -45.9% 1030.96 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
3905.95 +11.3% 4349.24 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
3863.32 +2.7% 3968.57 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
3698.44 +11.0% 4103.96 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
4080.74 +7.1% 4372.00 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
3861.75 +21.1% 4674.71 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
3844.38 +13.9% 4377.59 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
389.74 +16.8% 455.39 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
348.41 +15.1% 400.95 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
360.80 +6.6% 384.70 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
846.22 -0.9% 838.24 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
878.63 -2.7% 854.63 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
836.37 +0.5% 840.59 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
530.48 +0.5% 533.08 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
521.77 +2.8% 536.20 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
518.10 +2.9% 532.87 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
238.28 +3.4% 246.32 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
238.98 +8.7% 259.86 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
254.25 -1.2% 251.15 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
135.25 +1.5% 137.26 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
139.34 -4.3% 133.34 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
136.72 +0.6% 137.48 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
1712.95 -8.8% 1562.92 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
1521.25 +36.5% 2076.59 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
1437.56 +34.1% 1927.87 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
8110.66 -32.3% 5493.17 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
8286.49 -13.1% 7202.22 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
6623.11 -16.5% 5532.38 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
5219.90 +65.6% 8644.65 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
6789.74 +14.3% 7758.48 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
6945.82 +23.1% 8552.21 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
81801.14 +3.6% 84735.19 TOTAL nfs_commit_rtt_time
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
4123.94 -67.4% 1342.77 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
3553.22 -63.4% 1300.47 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
4034.69 -71.9% 1132.59 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
5521.41 -20.1% 4411.29 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
5629.16 -27.7% 4070.70 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
5302.14 -21.9% 4142.63 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
6082.58 -19.1% 4921.35 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
5890.41 -10.1% 5294.47 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
5960.49 -19.5% 4795.47 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
585.80 -0.6% 582.04 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
507.32 +13.3% 575.00 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
501.85 +16.0% 582.10 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
882.89 -1.2% 872.69 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
918.37 -3.0% 890.44 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
875.43 -0.3% 873.07 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
628.33 -2.3% 613.90 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
618.86 -1.0% 612.97 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
620.76 -1.8% 609.36 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
241.39 +3.3% 249.35 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
240.69 +8.7% 261.56 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
255.75 -1.3% 252.45 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
136.85 +1.4% 138.79 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
141.03 -4.3% 135.01 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
138.44 +0.7% 139.36 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
5836.33 -43.2% 3314.23 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
4907.99 +28.9% 6326.79 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
5462.84 +19.7% 6539.49 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
11355.59 -40.8% 6723.06 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
11250.64 -29.3% 7950.03 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
10293.16 -35.9% 6594.40 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
8658.85 +8.5% 9398.44 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
11314.40 -23.1% 8699.43 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
10543.72 -9.1% 9580.37 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
133015.32 -21.9% 103926.05 TOTAL nfs_commit_execute_time
[-- Attachment #2: dstat-nfss-bw.png --]
[-- Type: image/png, Size: 58730 bytes --]
[-- Attachment #3: dstat-nfss-bw.png --]
[-- Type: image/png, Size: 65720 bytes --]
prev parent reply other threads:[~2011-11-21 7:15 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-11-19 12:52 [PATCH] nfs: writeback pages wait queue Wu Fengguang
[not found] ` <20111119134412.GA5853@umich.edu>
2011-11-20 1:57 ` Wu Fengguang
2011-11-20 1:57 ` Wu Fengguang
2011-11-21 7:15 ` Wu Fengguang [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20111121071525.GA24937@localhost \
--to=fengguang.wu@intel.com \
--cc=Trond.Myklebust@netapp.com \
--cc=feng.tang@intel.com \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-nfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.