From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754510Ab1LFVPn (ORCPT ); Tue, 6 Dec 2011 16:15:43 -0500 Received: from e4.ny.us.ibm.com ([32.97.182.144]:54112 "EHLO e4.ny.us.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753394Ab1LFVPl (ORCPT ); Tue, 6 Dec 2011 16:15:41 -0500 Message-ID: <4EDE85F4.4020503@linux.vnet.ibm.com> Date: Tue, 06 Dec 2011 14:15:32 -0700 From: Allison Henderson User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.17) Gecko/20110414 Thunderbird/3.1.10 MIME-Version: 1.0 To: Hugh Dickins CC: "Ted Ts'o" , Curt Wohlgemuth , Yongqiang Yang , Surbhi Palande , Rafael Wysocki , linux-ext4@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: Bug with "fix partial page writes" [3.2-rc regression] References: <20111121165626.GD14568@thunk.org> <4EDD729E.2060402@linux.vnet.ibm.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit x-cbid: 11120621-3534-0000-0000-00000357BD3D Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 12/06/2011 01:55 AM, Hugh Dickins wrote: > On Mon, 5 Dec 2011, Allison Henderson wrote: >> On 12/05/2011 04:38 PM, Hugh Dickins wrote: >>> >>> This has been outstanding for a month now, and we've heard no progress: >>> please revert commit 02fac1297eb3 "ext4: fix partial page writes" for rc5. >>> >>> The problems appear on a 1k-blocksize filesystem under memory pressure: >>> the hunk in ext4_da_write_end() causes oops, because it's playing with >>> a page after generic_write_end() dropped our last reference to it; and >>> backing out the hunk in ext4_da_write_begin() is then found to stop >>> rare data corruption seen when kbuilding. >>> >>> Although I earlier reported that backing out the patch caused an fsx >>> test to fail earlier, I've since found great variation in how soon it >>> fails, and seen it fail just as quickly with 02fac1297eb3 still in. >>> I also reported that I had to go back to 2.6.38 for fsx not to fail >>> under memory pressure: you won't be surprised that that turned out to >>> be because 2.6.38 defaults nomblk_io_submit but 2.6.39 mblk_io_submit. >> >> Have you tried Yongqiang's patch "[PATCH 1/2] ext4: let mpage_submit_io >> works well when blocksize< pagesize" ? I have tried it and it does seem to >> help, but I am still running into some failures that I am trying to debug, >> but let please let us know if it helps the issues that you are seeing. Thx! > > That 1/2, or the 2/2 "ext4: let ext4_discard_partial_buffers handle > pages without buffers correctly"? The latter is mostly a reversion > of your 02fac1297eb3, so that's the one I need to fix the oops and > rare data corruption. Perhaps you're suggesting 1/2 for fsx failures > under memory pressure? > > I've now tried the fsx test on three machines, with both 1/2 and 2/2 > applied to 3.2-rc4. On one machine, with ext2 on loop on tmpfs, the > fsx test failed in a couple of minutes with those patches; on another > machine, with ext2 on loop on tmpfs, it failed after about 40 minutes > with the patches; on this laptop, with ext2 on SSD, it's just now > failed after 35 minutes with the patches. > > That's not to say that Yongqiang's patches aren't good; but I cannot > detect whether they make any improvement or not, since lasting for 2 or > 40 minutes is typical for fsx under memory pressure with recent kernels. Well, initially I meant to just try the whole set, but now that I try just one of them, I find that I get further with only the first one. I think Yongqiang and I have a similar set up because I get the hang if I dont have the first patch, and I get the fsx write failure (in about 20 or so minutes) if I have the second one. But I think Yongqiang's right, we need to figure out why the page is uptodate when it shouldn't be. > > Hugh > -- > To unsubscribe from this list: send the line "unsubscribe linux-ext4" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html >