All of lore.kernel.org
 help / color / mirror / Atom feed
From: Nick Piggin <npiggin@suse.de>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-fsdevel@vger.kernel.org,
	Mark Fasheh <mark.fasheh@oracle.com>,
	Linux Memory Management <linux-mm@kvack.org>
Subject: Re: [patch 12/41] fs: introduce write_begin, write_end, and perform_write aops
Date: Thu, 31 May 2007 06:43:27 +0200	[thread overview]
Message-ID: <20070531044327.GD20107@wotan.suse.de> (raw)
In-Reply-To: <20070530213035.d7b6e3e0.akpm@linux-foundation.org>

On Wed, May 30, 2007 at 09:30:35PM -0700, Andrew Morton wrote:
> On Fri, 25 May 2007 22:21:56 +1000 npiggin@suse.de wrote:
> 
> > These are intended to replace prepare_write and commit_write with more
> > flexible alternatives that are also able to avoid the buffered write
> > deadlock problems efficiently (which prepare_write is unable to do).
> 
> It doesn't like LTP's vmsplice01:
> 
> ------------[ cut here ]------------
> kernel BUG at fs/buffer.c:1829!
> invalid opcode: 0000 [#1]
> SMP 
> Modules linked in:
> CPU:    0
> EIP:    0060:[<c01a2938>]    Not tainted VLI
> EFLAGS: 00010206   (2.6.22-rc3-mm1 #1)
> EIP is at __block_prepare_write+0x348/0x360
> eax: 4000081d   ebx: c176f10c   ecx: 000001f0   edx: c176f10c
> esi: df877670   edi: deeae3f0   ebp: de89fdc0   esp: de89fd60
> ds: 007b   es: 007b   fs: 00d8  gs: 0033  ss: 0068
> Process vmsplice01 (pid: 15759, ti=de89e000 task=c3ac1100 task.ti=de89e000)
> Stack: c0140083 de89fd7c 00000046 00000000 c2fffe20 000001f0 c176f10c deeae3f0 
>        c017c982 c01ee9b7 df877668 c01ee9b7 df877670 c345f300 df877684 de89fdcc 
>        c01ee9eb c176f10c de89fdc4 c015c7ee deeae504 c176f10c df877670 deeae3f0 
> Call Trace:
>  [<c0103e1a>] show_trace_log_lvl+0x1a/0x30
>  [<c0103ed8>] show_stack_log_lvl+0xa8/0xe0
>  [<c01040f9>] show_registers+0x1e9/0x2f0
>  [<c010430f>] die+0x10f/0x240
>  [<c01044d1>] do_trap+0x91/0xc0
>  [<c0104889>] do_invalid_op+0x89/0xa0
>  [<c03f44ca>] error_code+0x72/0x78
>  [<c01a29d9>] block_write_begin+0x49/0xd0
>  [<c01c9a27>] ext3_write_begin+0xb7/0x190
>  [<c015e77f>] pagecache_write_begin+0x4f/0x150
>  [<c019f02b>] pipe_to_file+0x8b/0x140
>  [<c019ea00>] __splice_from_pipe+0x70/0x250
>  [<c019ec28>] splice_from_pipe+0x48/0x70
>  [<c019eef4>] generic_file_splice_write+0x54/0x100
>  [<c019e91f>] do_splice_from+0x5f/0x80
>  [<c019fd84>] sys_splice+0x164/0x200
>  [<c0102d8e>] sysenter_past_esp+0x5f/0x99
>  =======================
> INFO: lockdep is turned off.
> Code: 49 c0 89 44 24 0c 89 7c 24 08 89 5c 24 04 c7 04 24 ac 2a 49 c0 e8 e9 ff f7 ff e8 b4 21 f6 ff 8b 4d f0 e9 a6 fe ff ff 0f 0b eb fe <0f> 0b eb fe 8d 74 26 00 0f 0b eb fe 0f 0b eb fe 90 8d b4 26 00 
> EIP: [<c01a2938>] __block_prepare_write+0x348/0x360 SS:ESP 0068:de89fd60
> 
> 
> That's
> 
> 	BUG_ON(to > PAGE_CACHE_SIZE);


Thanks. Hmm, sorry I didn't test splice much. Does this fix it?

---
Index: linux-2.6/fs/splice.c
===================================================================
--- linux-2.6.orig/fs/splice.c
+++ linux-2.6/fs/splice.c
@@ -570,7 +570,7 @@ static int pipe_to_file(struct pipe_inod
 	if (this_len + offset > PAGE_CACHE_SIZE)
 		this_len = PAGE_CACHE_SIZE - offset;
 
-	ret = pagecache_write_begin(file, mapping, sd->pos, sd->len,
+	ret = pagecache_write_begin(file, mapping, sd->pos, this_len,
 				AOP_FLAG_UNINTERRUPTIBLE, &page, &fsdata);
 	if (unlikely(ret))
 		goto out;
@@ -587,7 +587,7 @@ static int pipe_to_file(struct pipe_inod
 		buf->ops->unmap(pipe, buf, src);
 	}
 
-	ret = pagecache_write_end(file, mapping, sd->pos, sd->len, sd->len, page, fsdata);
+	ret = pagecache_write_end(file, mapping, sd->pos, this_len, this_len, page, fsdata);
 
 out:
 


WARNING: multiple messages have this Message-ID (diff)
From: Nick Piggin <npiggin@suse.de>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-fsdevel@vger.kernel.org,
	Mark Fasheh <mark.fasheh@oracle.com>,
	Linux Memory Management <linux-mm@kvack.org>
Subject: Re: [patch 12/41] fs: introduce write_begin, write_end, and perform_write aops
Date: Thu, 31 May 2007 06:43:27 +0200	[thread overview]
Message-ID: <20070531044327.GD20107@wotan.suse.de> (raw)
In-Reply-To: <20070530213035.d7b6e3e0.akpm@linux-foundation.org>

On Wed, May 30, 2007 at 09:30:35PM -0700, Andrew Morton wrote:
> On Fri, 25 May 2007 22:21:56 +1000 npiggin@suse.de wrote:
> 
> > These are intended to replace prepare_write and commit_write with more
> > flexible alternatives that are also able to avoid the buffered write
> > deadlock problems efficiently (which prepare_write is unable to do).
> 
> It doesn't like LTP's vmsplice01:
> 
> ------------[ cut here ]------------
> kernel BUG at fs/buffer.c:1829!
> invalid opcode: 0000 [#1]
> SMP 
> Modules linked in:
> CPU:    0
> EIP:    0060:[<c01a2938>]    Not tainted VLI
> EFLAGS: 00010206   (2.6.22-rc3-mm1 #1)
> EIP is at __block_prepare_write+0x348/0x360
> eax: 4000081d   ebx: c176f10c   ecx: 000001f0   edx: c176f10c
> esi: df877670   edi: deeae3f0   ebp: de89fdc0   esp: de89fd60
> ds: 007b   es: 007b   fs: 00d8  gs: 0033  ss: 0068
> Process vmsplice01 (pid: 15759, ti=de89e000 task=c3ac1100 task.ti=de89e000)
> Stack: c0140083 de89fd7c 00000046 00000000 c2fffe20 000001f0 c176f10c deeae3f0 
>        c017c982 c01ee9b7 df877668 c01ee9b7 df877670 c345f300 df877684 de89fdcc 
>        c01ee9eb c176f10c de89fdc4 c015c7ee deeae504 c176f10c df877670 deeae3f0 
> Call Trace:
>  [<c0103e1a>] show_trace_log_lvl+0x1a/0x30
>  [<c0103ed8>] show_stack_log_lvl+0xa8/0xe0
>  [<c01040f9>] show_registers+0x1e9/0x2f0
>  [<c010430f>] die+0x10f/0x240
>  [<c01044d1>] do_trap+0x91/0xc0
>  [<c0104889>] do_invalid_op+0x89/0xa0
>  [<c03f44ca>] error_code+0x72/0x78
>  [<c01a29d9>] block_write_begin+0x49/0xd0
>  [<c01c9a27>] ext3_write_begin+0xb7/0x190
>  [<c015e77f>] pagecache_write_begin+0x4f/0x150
>  [<c019f02b>] pipe_to_file+0x8b/0x140
>  [<c019ea00>] __splice_from_pipe+0x70/0x250
>  [<c019ec28>] splice_from_pipe+0x48/0x70
>  [<c019eef4>] generic_file_splice_write+0x54/0x100
>  [<c019e91f>] do_splice_from+0x5f/0x80
>  [<c019fd84>] sys_splice+0x164/0x200
>  [<c0102d8e>] sysenter_past_esp+0x5f/0x99
>  =======================
> INFO: lockdep is turned off.
> Code: 49 c0 89 44 24 0c 89 7c 24 08 89 5c 24 04 c7 04 24 ac 2a 49 c0 e8 e9 ff f7 ff e8 b4 21 f6 ff 8b 4d f0 e9 a6 fe ff ff 0f 0b eb fe <0f> 0b eb fe 8d 74 26 00 0f 0b eb fe 0f 0b eb fe 90 8d b4 26 00 
> EIP: [<c01a2938>] __block_prepare_write+0x348/0x360 SS:ESP 0068:de89fd60
> 
> 
> That's
> 
> 	BUG_ON(to > PAGE_CACHE_SIZE);


Thanks. Hmm, sorry I didn't test splice much. Does this fix it?

---
Index: linux-2.6/fs/splice.c
===================================================================
--- linux-2.6.orig/fs/splice.c
+++ linux-2.6/fs/splice.c
@@ -570,7 +570,7 @@ static int pipe_to_file(struct pipe_inod
 	if (this_len + offset > PAGE_CACHE_SIZE)
 		this_len = PAGE_CACHE_SIZE - offset;
 
-	ret = pagecache_write_begin(file, mapping, sd->pos, sd->len,
+	ret = pagecache_write_begin(file, mapping, sd->pos, this_len,
 				AOP_FLAG_UNINTERRUPTIBLE, &page, &fsdata);
 	if (unlikely(ret))
 		goto out;
@@ -587,7 +587,7 @@ static int pipe_to_file(struct pipe_inod
 		buf->ops->unmap(pipe, buf, src);
 	}
 
-	ret = pagecache_write_end(file, mapping, sd->pos, sd->len, sd->len, page, fsdata);
+	ret = pagecache_write_end(file, mapping, sd->pos, this_len, this_len, page, fsdata);
 
 out:
 

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2007-05-31  4:43 UTC|newest]

Thread overview: 78+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-05-25 12:21 [patch 00/41] Buffered write deadlock fix and new aops for 2.6.22-rc2-mm1 npiggin
2007-05-25 12:21 ` [patch 01/41] mm: revert KERNEL_DS buffered write optimisation npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 02/41] Revert 81b0c8713385ce1b1b9058e916edcf9561ad76d6 npiggin
2007-05-25 12:21   ` npiggin, Andrew Morton
2007-05-25 12:21 ` [patch 03/41] Revert 6527c2bdf1f833cc18e8f42bd97973d583e4aa83 npiggin
2007-05-25 12:21   ` npiggin, Andrew Morton
2007-05-25 12:21 ` [patch 04/41] mm: clean up buffered write code npiggin
2007-05-25 12:21   ` npiggin, Andrew Morton
2007-05-25 12:21 ` [patch 05/41] mm: debug write deadlocks npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 06/41] mm: trim more holes npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 07/41] mm: buffered write cleanup npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 08/41] mm: write iovec cleanup npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 09/41] mm: fix pagecache write deadlocks npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 10/41] mm: buffered write iterator npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 11/41] fs: fix data-loss on error npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 12/41] fs: introduce write_begin, write_end, and perform_write aops npiggin
2007-05-25 12:21   ` npiggin
2007-05-31  4:30   ` Andrew Morton
2007-05-31  4:30     ` Andrew Morton
2007-05-31  4:43     ` Nick Piggin [this message]
2007-05-31  4:43       ` Nick Piggin
2007-05-31  4:52       ` Andrew Morton
2007-05-31  4:52         ` Andrew Morton
2007-05-31  4:57         ` Nick Piggin
2007-05-31  4:57           ` Nick Piggin
2007-05-31  5:11           ` Andrew Morton
2007-05-31  5:11             ` Andrew Morton
2007-05-31  5:15             ` Nick Piggin
2007-05-31  5:15               ` Nick Piggin
2007-05-31  7:05               ` Andrew Morton
2007-05-31  7:05                 ` Andrew Morton
2007-06-01  1:18                 ` Nick Piggin
2007-06-01  1:18                   ` Nick Piggin
2007-05-25 12:21 ` [patch 13/41] mm: restore KERNEL_DS optimisations npiggin
2007-05-25 12:21   ` npiggin
2007-05-25 12:21 ` [patch 14/41] implement simple fs aops npiggin
2007-05-25 12:21 ` [patch 15/41] block_dev convert to new aops npiggin
2007-05-25 12:22 ` [patch 16/41] ext2 " npiggin
2007-05-25 12:22 ` [patch 17/41] ext3 " npiggin
2007-05-25 12:22 ` [patch 18/41] ext4 " npiggin
2007-05-25 12:22 ` [patch 19/41] xfs " npiggin
2007-05-25 12:22 ` [patch 20/41] fs: new cont helpers npiggin
2007-05-25 12:22 ` [patch 21/41] fat convert to new aops npiggin
2007-05-25 12:22 ` [patch 22/41] adfs " npiggin
2007-05-26  9:14   ` Russell King
2007-05-27  1:35     ` Nick Piggin
2007-05-25 12:22 ` [patch 23/41] hfs " npiggin
2007-05-25 12:22 ` [patch 24/41] hfsplus " npiggin
2007-05-25 12:22 ` [patch 25/41] hpfs " npiggin
2007-05-25 12:22 ` [patch 26/41] bfs " npiggin
2007-05-25 12:22 ` [patch 27/41] qnx4 " npiggin
2007-05-25 14:35   ` Anders Larsen
2007-05-26  7:23     ` Nick Piggin
2007-05-25 12:22 ` [patch 28/41] reiserfs use generic write npiggin
2007-05-25 12:22 ` [patch 29/41] reiserfs convert to new aops npiggin
2007-05-25 12:22 ` [patch 30/41] reiserfs use generic_cont_expand_simple npiggin
2007-05-25 12:22 ` [patch 31/41] With reiserfs no longer using the weird generic_cont_expand, remove it completely npiggin
2007-05-25 12:22 ` [patch 32/41] nfs convert to new aops npiggin
2007-05-25 12:22 ` [patch 33/41] smb " npiggin
2007-05-25 12:22 ` [patch 34/41] fuse " npiggin
2007-05-25 12:22 ` [patch 35/41] hostfs " npiggin
2007-05-25 12:22 ` [patch 36/41] jffs2 " npiggin
2007-05-25 12:22 ` [patch 37/41] ufs " npiggin
2007-05-25 12:22 ` [patch 38/41] udf " npiggin
2007-05-25 12:22 ` [patch 39/41] sysv " npiggin
2007-05-25 12:22 ` [patch 40/41] minix " npiggin
2007-05-25 12:22 ` [patch 41/41] jfs " npiggin
2007-05-25 22:55 ` [patch 00/41] Buffered write deadlock fix and new aops for 2.6.22-rc2-mm1 Mark Fasheh
  -- strict thread matches above, loose matches on Subject: below --
2007-05-14  6:06 [patch 00/41] Buffered write deadlock fix and new aops for 2.6.21-mm2 npiggin
2007-05-14  6:06 ` [patch 12/41] fs: introduce write_begin, write_end, and perform_write aops npiggin
2007-05-14  6:06   ` npiggin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20070531044327.GD20107@wotan.suse.de \
    --to=npiggin@suse.de \
    --cc=akpm@linux-foundation.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mark.fasheh@oracle.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.