Re: [PATCH] nfs: writeback pages wait queue

From: Wu Fengguang
Date: Mon Nov 21 2011 - 02:15:37 EST

> Tests show that it can effectively reduce stalls in the disk-network
> pipeline, improve performance and reduce delays.

For the record, the full stats are listed below.

The attached two figures about NFS server disk/network traffics are
taken from cases

snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1-ioless-full+

The former shows more interleaved disk/network activities (one is
mostly stalled when the other is busy). While the latter shows more
evenly distributed disk/net bandwidth, both disk/net throughput are
dropping to 0 less often.

Thanks,
Fengguang
---

wfg@bee /export/writeback% ./compare-nfs.sh -g nfs snb/*/{*-3.2.0-rc1,*-3.2.0-rc1-ioless-full+}
3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
20.66 +136.7% 48.90 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
20.82 +147.5% 51.52 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
20.57 +129.8% 47.26 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
35.96 +96.5% 70.67 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
37.47 +89.1% 70.85 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
34.55 +106.1% 71.21 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
58.24 +28.2% 74.63 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
59.83 +18.6% 70.93 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
58.30 +31.4% 76.61 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
23.69 -10.0% 21.33 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
23.59 -1.7% 23.19 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
23.94 -1.0% 23.70 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
27.06 -0.0% 27.06 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
25.43 +4.8% 26.66 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
27.21 -0.8% 26.99 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
53.82 +4.4% 56.17 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
55.80 +4.2% 58.12 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
55.75 +2.9% 57.37 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
15.47 +1.3% 15.68 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
16.09 -3.5% 15.53 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
15.09 -0.9% 14.96 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
26.65 +13.0% 30.10 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
25.09 +7.7% 27.02 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
27.16 +3.3% 28.06 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
27.51 +78.6% 49.11 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
22.46 +131.6% 52.01 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
12.95 +289.8% 50.50 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
42.28 +81.0% 76.52 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
40.33 +78.8% 72.10 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
42.52 +67.6% 71.27 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
62.27 +34.6% 83.84 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
60.10 +35.6% 81.48 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
66.29 +17.5% 77.88 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
1164.97 +41.6% 1649.19 TOTAL write_bw

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
2404.00 +67.7% 4031.00 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
3236.00 +22.6% 3968.00 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
2435.00 +100.7% 4886.00 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
415.00 +113.7% 887.00 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
429.00 +119.6% 942.00 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
400.00 +127.2% 909.00 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
72.00 +40.3% 101.00 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
73.00 +28.8% 94.00 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
71.00 +47.9% 105.00 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
455.00 +233.4% 1517.00 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
401.00 -21.7% 314.00 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
390.00 -1.0% 386.00 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
2875.00 -0.6% 2858.00 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
2664.00 +5.9% 2820.00 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
2882.00 -1.8% 2829.00 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
718.00 +5.4% 757.00 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
756.00 +4.8% 792.00 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
756.00 +2.6% 776.00 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
6570.00 +0.1% 6574.00 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
6551.00 -3.8% 6305.00 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
6362.00 -0.0% 6360.00 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
2895.00 +21.2% 3509.00 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
2542.00 +17.2% 2978.00 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
2987.00 +0.3% 2996.00 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
2140.00 +77.6% 3801.00 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
1808.00 +41.2% 2552.00 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
679.00 +293.8% 2674.00 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
241.00 +141.1% 581.00 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
237.00 +97.5% 468.00 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
240.00 +135.4% 565.00 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
41.00 +34.1% 55.00 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
35.00 +65.7% 58.00 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
39.00 +33.3% 52.00 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
54799.00 +25.0% 68500.00 TOTAL nfs_nr_commits

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
40601.00 -14.0% 34925.00 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
41859.00 -12.2% 36761.00 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
39947.00 -15.1% 33897.00 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
153398.00 -72.0% 42898.00 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
149928.00 -65.0% 52422.00 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
118064.00 -59.6% 47707.00 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
102626.00 +78.2% 182853.00 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
111743.00 +81.4% 202708.00 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
91838.00 +107.1% 190184.00 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
35016.00 +16.7% 40874.00 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
34778.00 -2.3% 33981.00 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
35749.00 -1.7% 35131.00 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
104527.00 -7.4% 96761.00 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
91568.00 +6.5% 97506.00 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
99681.00 -5.1% 94596.00 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
208450.00 -1.0% 206384.00 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
205944.00 +12.2% 231073.00 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
190945.00 +21.8% 232662.00 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
71042.00 -0.1% 70937.00 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
71398.00 -3.2% 69148.00 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
70247.00 -1.1% 69504.00 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
142168.00 +35.0% 191905.00 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
116012.00 +18.7% 137664.00 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
145534.00 +5.6% 153619.00 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
67785.00 -39.1% 41269.00 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
53151.00 -20.1% 42471.00 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
73200.00 -39.9% 43988.00 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
188725.00 -57.4% 80357.00 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
176809.00 -75.0% 44204.00 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
173292.00 -44.2% 96636.00 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
96940.00 +76.7% 171281.00 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
111572.00 +36.3% 152049.00 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
128726.00 +29.8% 167063.00 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
3543263.00 -3.3% 3425418.00 TOTAL nfs_nr_writes

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
5.56 +44.9% 8.06 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
4.14 +109.1% 8.67 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
5.46 +16.3% 6.35 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
52.04 -8.4% 47.70 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
52.33 -13.8% 45.09 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
51.72 -9.2% 46.98 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
484.63 -8.6% 443.16 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
492.42 -8.2% 452.26 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
493.13 -11.4% 437.15 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
32.52 -72.9% 8.80 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
36.15 +26.1% 45.58 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
38.33 +0.4% 38.49 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
5.67 +0.5% 5.69 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
5.74 -1.1% 5.68 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
5.69 +0.9% 5.74 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
44.91 -1.0% 44.45 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
44.22 -0.6% 43.96 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
44.18 +0.2% 44.28 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
1.42 +1.1% 1.43 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
1.48 +0.3% 1.48 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
1.43 -1.0% 1.42 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
5.51 -6.8% 5.14 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
5.91 -8.1% 5.43 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
5.44 +3.0% 5.61 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
8.80 +6.6% 9.38 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
8.51 +65.2% 14.06 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
15.28 -13.2% 13.27 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
105.12 -24.9% 78.99 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
101.90 -9.1% 92.60 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
106.24 -29.7% 74.65 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
909.85 +0.4% 913.68 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
1030.45 -18.3% 841.68 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
1016.56 -11.6% 898.36 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
5222.74 -10.1% 4695.25 TOTAL nfs_commit_size

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
0.33 +182.4% 0.93 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
0.32 +192.0% 0.94 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
0.33 +175.1% 0.91 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
0.14 +600.4% 0.99 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
0.15 +441.1% 0.81 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
0.18 +410.8% 0.90 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
0.34 -28.0% 0.24 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
0.32 -34.8% 0.21 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
0.38 -36.7% 0.24 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
0.42 -22.7% 0.33 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
0.42 +1.0% 0.42 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
0.42 +1.1% 0.42 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
0.16 +7.9% 0.17 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
0.17 -1.6% 0.16 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
0.16 +4.4% 0.17 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
0.15 +5.4% 0.16 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
0.16 -7.2% 0.15 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
0.17 -15.6% 0.15 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
0.13 +1.3% 0.13 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
0.14 -0.3% 0.14 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
0.13 +0.0% 0.13 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
0.11 -16.4% 0.09 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
0.13 -9.3% 0.12 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
0.11 -2.2% 0.11 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
0.28 +210.9% 0.86 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
0.29 +191.9% 0.85 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
0.14 +469.1% 0.81 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
0.13 +325.5% 0.57 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
0.14 +617.7% 0.98 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
0.15 +196.6% 0.44 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
0.38 -23.8% 0.29 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
0.32 -0.7% 0.32 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
0.31 -9.2% 0.28 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
7.62 +89.2% 14.42 TOTAL nfs_write_size

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
90226.82 -99.9% 92.07 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
88904.27 -99.9% 80.21 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
97436.73 -99.9% 87.32 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
62167.19 -99.3% 444.25 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
64150.34 -99.2% 539.38 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
78675.54 -99.3% 540.27 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
5372.84 +57.8% 8477.45 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
10245.66 -51.2% 4995.71 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
4744.06 +109.1% 9919.55 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
1727.29 -9.6% 1562.16 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
2183.49 +4.4% 2280.21 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
2201.49 +3.7% 2281.92 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
6213.73 +19.9% 7448.13 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
8127.01 +3.2% 8387.06 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
7255.35 +4.4% 7571.11 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
1144.67 +20.4% 1378.01 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
1010.02 +19.0% 1202.22 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
906.33 +15.8% 1049.76 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
642.82 +17.3% 753.80 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
766.82 -21.7% 600.18 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
575.95 +16.5% 670.85 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
21.91 +71.0% 37.47 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
16.70 +105.3% 34.29 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
19.05 -71.3% 5.47 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
123877.11 -99.0% 1187.27 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
122353.65 -98.8% 1505.84 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
101140.82 -98.4% 1641.03 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
78248.51 -98.9% 892.00 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
84589.42 -98.6% 1212.17 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
89684.95 -99.4% 495.28 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
10405.39 -6.9% 9684.57 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
16151.86 -48.5% 8316.69 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
16119.17 -49.0% 8214.84 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
1177306.98 -92.1% 93588.50 TOTAL nfs_write_queue_time

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
316.90 -56.7% 137.37 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
279.71 -55.0% 125.88 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
328.22 -63.4% 120.29 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
152.06 -45.7% 82.53 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
159.06 -52.7% 75.25 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
192.96 -59.0% 79.16 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
35.55 -21.2% 28.02 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
33.14 -32.9% 22.24 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
31.55 -11.1% 28.06 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
446.92 +3.2% 461.33 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
403.82 +12.8% 455.34 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
410.66 +5.3% 432.30 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
347.30 +3.8% 360.34 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
372.89 -7.4% 345.26 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
352.98 +2.0% 360.11 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
25.22 +18.9% 29.99 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
21.90 +7.6% 23.57 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
23.49 -7.2% 21.79 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
286.86 +0.4% 288.09 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
288.38 +5.5% 304.22 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
299.92 +1.0% 302.95 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
74.81 -37.8% 46.53 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
106.27 -23.8% 81.03 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
76.47 -6.5% 71.48 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
175.97 -9.8% 158.73 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
190.32 -11.5% 168.43 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
81.29 +99.2% 161.97 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
104.98 -58.2% 43.89 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
119.66 -42.3% 68.99 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
126.88 -65.9% 43.32 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
62.43 -53.5% 29.04 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
28.99 +8.7% 31.50 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
19.47 +55.9% 30.37 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
5977.02 -16.0% 5019.34 TOTAL nfs_write_rtt_time

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
90545.77 -99.7% 229.94 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
89185.97 -99.8% 206.68 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
97766.88 -99.8% 208.12 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
62320.35 -99.2% 528.28 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
64310.52 -99.0% 615.99 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
78869.77 -99.2% 620.86 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
5416.77 +57.1% 8508.91 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
10286.87 -51.2% 5021.39 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
4784.53 +108.0% 9950.05 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
2174.34 -6.9% 2023.56 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
2587.44 +5.7% 2735.64 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
2612.29 +3.9% 2714.30 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
6561.24 +19.0% 7808.62 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
8500.09 +2.7% 8732.45 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
7608.54 +4.2% 7931.36 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
1171.48 +20.3% 1408.94 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
1033.75 +18.7% 1226.79 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
931.62 +15.1% 1072.45 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
929.77 +12.1% 1041.98 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
1055.30 -14.3% 904.49 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
875.95 +11.2% 973.88 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
96.80 -13.1% 84.09 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
123.09 -6.2% 115.40 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
95.61 -19.4% 77.06 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
124054.85 -98.9% 1346.78 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
122545.76 -98.6% 1674.99 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
101222.98 -98.2% 1803.76 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
78354.75 -98.8% 937.22 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
84710.46 -98.5% 1283.06 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
89813.36 -99.4% 540.01 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
10476.93 -7.3% 9717.35 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
16189.55 -48.4% 8351.81 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
16146.79 -48.9% 8249.52 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
1183360.15 -91.7% 98645.74 TOTAL nfs_write_execute_time

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
2262.68 -97.0% 68.18 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
1794.04 -99.5% 8.96 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
2128.07 -95.2% 101.40 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
1614.18 -96.3% 60.53 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
1764.72 -94.3% 100.35 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
1602.32 -97.7% 37.01 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
2000.24 -72.6% 548.77 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
2028.37 -69.5% 619.40 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
2114.61 -80.3% 417.26 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
195.97 -35.4% 126.53 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
158.77 +9.6% 173.97 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
140.91 +40.0% 197.30 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
36.36 -6.1% 34.14 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
39.42 -9.9% 35.51 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
38.72 -16.9% 32.19 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
97.43 -17.2% 80.69 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
96.45 -20.6% 76.63 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
102.16 -25.3% 76.35 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
2.99 -2.0% 2.94 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
1.61 -0.9% 1.60 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
1.40 -13.4% 1.21 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
1.56 -3.3% 1.51 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
1.65 -0.6% 1.64 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
1.69 +9.3% 1.85 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
4122.75 -57.5% 1750.85 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
3385.95 +25.5% 4249.51 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
4023.74 +14.6% 4611.05 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
3242.20 -62.2% 1226.57 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
2961.05 -74.8% 745.85 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
3666.47 -71.1% 1059.87 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
3438.00 -78.1% 753.51 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
4524.00 -79.2% 940.24 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
3596.13 -71.4% 1027.63 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
51186.59 -62.5% 19170.98 TOTAL nfs_commit_queue_time

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
1860.87 -31.5% 1274.40 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
1758.72 -26.6% 1291.19 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
1906.15 -45.9% 1030.96 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
3905.95 +11.3% 4349.24 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
3863.32 +2.7% 3968.57 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
3698.44 +11.0% 4103.96 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
4080.74 +7.1% 4372.00 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
3861.75 +21.1% 4674.71 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
3844.38 +13.9% 4377.59 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
389.74 +16.8% 455.39 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
348.41 +15.1% 400.95 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
360.80 +6.6% 384.70 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
846.22 -0.9% 838.24 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
878.63 -2.7% 854.63 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
836.37 +0.5% 840.59 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
530.48 +0.5% 533.08 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
521.77 +2.8% 536.20 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
518.10 +2.9% 532.87 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
238.28 +3.4% 246.32 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
238.98 +8.7% 259.86 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
254.25 -1.2% 251.15 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
135.25 +1.5% 137.26 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
139.34 -4.3% 133.34 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
136.72 +0.6% 137.48 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
1712.95 -8.8% 1562.92 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
1521.25 +36.5% 2076.59 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
1437.56 +34.1% 1927.87 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
8110.66 -32.3% 5493.17 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
8286.49 -13.1% 7202.22 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
6623.11 -16.5% 5532.38 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
5219.90 +65.6% 8644.65 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
6789.74 +14.3% 7758.48 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
6945.82 +23.1% 8552.21 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
81801.14 +3.6% 84735.19 TOTAL nfs_commit_rtt_time

3.2.0-rc1 3.2.0-rc1-ioless-full+
------------------------ ------------------------
4123.94 -67.4% 1342.77 snb/thresh=1000M/nfs-100dd-1-3.2.0-rc1
3553.22 -63.4% 1300.47 snb/thresh=1000M/nfs-100dd-2-3.2.0-rc1
4034.69 -71.9% 1132.59 snb/thresh=1000M/nfs-100dd-3-3.2.0-rc1
5521.41 -20.1% 4411.29 snb/thresh=1000M/nfs-10dd-1-3.2.0-rc1
5629.16 -27.7% 4070.70 snb/thresh=1000M/nfs-10dd-2-3.2.0-rc1
5302.14 -21.9% 4142.63 snb/thresh=1000M/nfs-10dd-3-3.2.0-rc1
6082.58 -19.1% 4921.35 snb/thresh=1000M/nfs-1dd-1-3.2.0-rc1
5890.41 -10.1% 5294.47 snb/thresh=1000M/nfs-1dd-2-3.2.0-rc1
5960.49 -19.5% 4795.47 snb/thresh=1000M/nfs-1dd-3-3.2.0-rc1
585.80 -0.6% 582.04 snb/thresh=100M/nfs-100dd-1-3.2.0-rc1
507.32 +13.3% 575.00 snb/thresh=100M/nfs-100dd-2-3.2.0-rc1
501.85 +16.0% 582.10 snb/thresh=100M/nfs-100dd-3-3.2.0-rc1
882.89 -1.2% 872.69 snb/thresh=100M/nfs-10dd-1-3.2.0-rc1
918.37 -3.0% 890.44 snb/thresh=100M/nfs-10dd-2-3.2.0-rc1
875.43 -0.3% 873.07 snb/thresh=100M/nfs-10dd-3-3.2.0-rc1
628.33 -2.3% 613.90 snb/thresh=100M/nfs-1dd-1-3.2.0-rc1
618.86 -1.0% 612.97 snb/thresh=100M/nfs-1dd-2-3.2.0-rc1
620.76 -1.8% 609.36 snb/thresh=100M/nfs-1dd-3-3.2.0-rc1
241.39 +3.3% 249.35 snb/thresh=10M/nfs-10dd-1-3.2.0-rc1
240.69 +8.7% 261.56 snb/thresh=10M/nfs-10dd-2-3.2.0-rc1
255.75 -1.3% 252.45 snb/thresh=10M/nfs-10dd-3-3.2.0-rc1
136.85 +1.4% 138.79 snb/thresh=10M/nfs-1dd-1-3.2.0-rc1
141.03 -4.3% 135.01 snb/thresh=10M/nfs-1dd-2-3.2.0-rc1
138.44 +0.7% 139.36 snb/thresh=10M/nfs-1dd-3-3.2.0-rc1
5836.33 -43.2% 3314.23 snb/thresh=2G/nfs-100dd-1-3.2.0-rc1
4907.99 +28.9% 6326.79 snb/thresh=2G/nfs-100dd-2-3.2.0-rc1
5462.84 +19.7% 6539.49 snb/thresh=2G/nfs-100dd-3-3.2.0-rc1
11355.59 -40.8% 6723.06 snb/thresh=2G/nfs-10dd-1-3.2.0-rc1
11250.64 -29.3% 7950.03 snb/thresh=2G/nfs-10dd-2-3.2.0-rc1
10293.16 -35.9% 6594.40 snb/thresh=2G/nfs-10dd-3-3.2.0-rc1
8658.85 +8.5% 9398.44 snb/thresh=2G/nfs-1dd-1-3.2.0-rc1
11314.40 -23.1% 8699.43 snb/thresh=2G/nfs-1dd-2-3.2.0-rc1
10543.72 -9.1% 9580.37 snb/thresh=2G/nfs-1dd-3-3.2.0-rc1
133015.32 -21.9% 103926.05 TOTAL nfs_commit_execute_time

Attachment: dstat-nfss-bw.png
Description: PNG image

Attachment: dstat-nfss-bw.png
Description: PNG image