From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail.jrs-s.net ([173.230.137.22]:55356 "EHLO mail.jrs-s.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751612AbaAMM6v (ORCPT ); Mon, 13 Jan 2014 07:58:51 -0500 Received: from [192.168.100.50] (cpe-024-088-095-145.sc.res.rr.com [24.88.95.145]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: jim@jrs-s.net) by mail.jrs-s.net (Postfix) with ESMTPSA id 32EE8D2A8 for ; Mon, 13 Jan 2014 07:58:49 -0500 (EST) Message-ID: <52D3E308.7060309@jrs-s.net> Date: Mon, 13 Jan 2014 07:58:48 -0500 From: Jim Salter MIME-Version: 1.0 To: linux-btrfs Subject: btrfs send: page allocation failure Content-Type: text/plain; charset=ISO-8859-1; format=flowed Sender: linux-btrfs-owner@vger.kernel.org List-ID: Hi list - Getting sporadic page allocation failures in btrfs send. This happened once several weeks ago but was fine after a reboot; yesterday I did not reboot, but had the failure back-to-back trying to send two different snapshots. These are full sends, not incremental, of a bit over 600G of data. Test machine has 32G of RAM, with 21G of it free (not including cache): root@gwa-virt1:/data/images/.snapshots# free -m total used free shared buffers cached Mem: 32159 31789 369 0 0 21276 -/+ buffers/cache: 10513 21646 Swap: 0 0 0 In both cases (all three, really) the btrfs send failed a bit more than half of the way through the send (somewhere around the 380GB mark). Kern log snippets follow: Jan 12 14:05:36 gwa-virt1 kernel: [535523.627611] btrfs: page allocation failure: order:6, mode:0x104050 Jan 12 14:05:36 gwa-virt1 kernel: [535523.627622] CPU: 6 PID: 9642 Comm: btrfs Not tainted 3.13.0-031300rc7-generic #201401041835 Jan 12 14:05:36 gwa-virt1 kernel: [535523.627773] [] ? btrfs_get_token_64+0x64/0xf0 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.627818] [] ? ulist_add_merge+0xcd/0x270 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.627860] [] ulist_add_merge+0xcd/0x270 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.627894] [] find_parent_nodes+0x50c/0x6f0 [btrf ] Jan 12 14:05:36 gwa-virt1 kernel: [535523.627930] [] ? compare_refs.isra.23+0x130/0x130 btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.627965] [] iterate_extent_inodes+0xf9/0x270 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628003] [] ? free_extent_buffer+0x35/0x40 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628037] [] find_extent_clone.isra.26+0x26d/0x340 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628072] [] process_extent+0xd7/0x180 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628107] [] changed_cb+0xdf/0x170 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628141] [] full_send_tree+0x142/0x280 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628174] [] ? send_subvol_begin+0xbc/0x2b0 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628209] [] send_subvol+0xe0/0xf0 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628244] [] btrfs_ioctl_send+0x341/0x520 [btrfs] Jan 12 14:05:36 gwa-virt1 kernel: [535523.628279] [] btrfs_ioctl+0x953/0xac0 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016512] btrfs: page allocation failure: order:5, mode:0x104050 Jan 12 21:34:00 gwa-virt1 kernel: [562448.016518] CPU: 4 PID: 18689 Comm: btrfs Not tainted 3.13.0-031300rc7-generic #201401041835 Jan 12 21:34:00 gwa-virt1 kernel: [562448.016597] [] ? btrfs_get_token_64+0x64/0xf0 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016617] [] ? ulist_add_merge+0xcd/0x270 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016637] [] ulist_add_merge+0xcd/0x270 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016653] [] find_parent_nodes+0x50c/0x6f0 [btrf ] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016669] [] ? compare_refs.isra.23+0x130/0x130 btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016684] [] iterate_extent_inodes+0xf9/0x270 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016700] [] ? free_extent_buffer+0x35/0x40 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016716] [] find_extent_clone.isra.26+0x26d/0x340 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016732] [] process_extent+0xd7/0x180 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016747] [] changed_cb+0xdf/0x170 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016763] [] full_send_tree+0x142/0x280 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016778] [] ? send_subvol_begin+0xbc/0x2b0 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016794] [] send_subvol+0xe0/0xf0 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016810] [] btrfs_ioctl_send+0x341/0x520 [btrfs] Jan 12 21:34:00 gwa-virt1 kernel: [562448.016826] [] btrfs_ioctl+0x953/0xac0 [btrfs]