From: Martin Steigerwald <Martin@lichtvoll.de>
To: Valdis Voronin <v@piratweb.com>
Cc: linux-btrfs@vger.kernel.org
Subject: Re: btrfs 3.14-2-amd64 btrfs_file_aio_write problem?
Date: Fri, 15 Aug 2014 14:47:16 +0200 [thread overview]
Message-ID: <2020271.3kqdDHC0N6@merkaba> (raw)
In-Reply-To: <4083225.3U5LomcQm0@workstation>
Am Freitag, 15. August 2014, 15:52:15 schrieb Valdis Voronin:
> Hi Martin,
>
> В письме от 15 августа 2014 12:25:36 пользователь Martin Steigerwald
написал:
> > Please include outputs of
> >
> > btrfs fi sh /
>
> # btrfs fi sh /
> Label: none uuid: e1fc1a29-32df-409c-81f6-1b7832643cf6
> Total devices 1 FS bytes used 187.81GiB
> devid 1 size 221.85GiB used 207.85GiB path /dev/md2
>
> Btrfs v3.14.1
>
> > btrfs fi df /
>
> # btrfs fi df /
> Data, single: total=197.82GiB, used=184.34GiB
> System, DUP: total=8.00MiB, used=32.00KiB
> System, single: total=4.00MiB, used=0.00
> Metadata, DUP: total=5.00GiB, used=3.47GiB
> Metadata, single: total=8.00MiB, used=0.00
Okay, so in both data and metadata case there still appears to be free space
within the tree. That and that this happens with 3.14 and the different
backtrace seems to point at a different problem than the hang issues since
switching BTRFS to workqueues with 3.15 and 3.16.
Well, maybe a developer can help here.
> > Also I do recommend against using SoftRAID on SSDs until SoftRAID actually
> > uses ATA TRIM to sync empty areas of both devices to one another. I am not
> > sure whether it does so in 3.14.
> >
> > Otherwise lets see what BTRFS developers have to say about this backtrace.
> > Since it happens with 3.14 it does not seem to be related with the hangs
> > after switching BTRFS to workqueues which happen in 3.15 and 3.16. There
> > are two patches related to fixing this issue, but the fix may still be
> > incomplete.
> >
> > Thanks,
> > Martin
> >
> > > > > Regards
> > > > > Vladislav
> > > > >
> > > > > cat > messages
> > > > >
> > > > > Aug 12 06:25:45 srv1 rsyslogd: [origin software="rsyslogd"
> > > > > swVersion="7.6.3" x-pid="1676" x-info="http://www.rsyslog.com"]
> > > > > rsyslogd
> > > > > was HUPed
> > > > > Aug 12 06:28:36 srv1 rsyslogd-2359: action 'action 17' resumed
> > > > > (module
> > > > > 'builtin:ompipe') [try http://www.rsyslog.com/e/2359 ]
> > > > > Aug 12 07:02:04 srv1 rsyslogd-2007: action 'action 17' suspended,
> > > > > next
> > > > > retry is Tue Aug 12 07:02:34 2014 [try http://www.rsyslog.com/e/2007
> > > > > ]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598939] mysqld D
> > > > > ffff88040b2a2e38 0 11941 4011 0x00000000
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598941] ffff88040b2a2a20
> > > > > 0000000000000086 0000000000014380 ffff880428eeffd8
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598943] 0000000000014380
> > > > > ffff88040b2a2a20 ffff88081ea54c10 ffff88081edc7608
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598944] 0000000000000002
> > > > > ffffffff81121000 ffff880428eef6d0 ffff880428eef7b0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598946] Call Trace:
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598950] [<ffffffff81121000>] ?
> > > > > wait_on_page_read+0x60/0x60
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598954] [<ffffffff814c7e34>] ?
> > > > > io_schedule+0x94/0x130
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598955] [<ffffffff81121005>] ?
> > > > > sleep_on_page+0x5/0x10
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598956] [<ffffffff814c81a4>] ?
> > > > > __wait_on_bit+0x54/0x80
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598960] [<ffffffff8109f510>] ?
> > > > > autoremove_wake_function+0x30/0x30
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598965] [<ffffffff811345b7>] ?
> > > > > shrink_inactive_list+0x187/0x4d0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598968] [<ffffffff811352de>] ?
> > > > > shrink_zone+0x5e/0x180
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598971] [<ffffffff81135e45>] ?
> > > > > try_to_free_mem_cgroup_pages+0xc5/0x150
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598975] [<ffffffff8117f82f>] ?
> > > > > __mem_cgroup_try_charge+0x55f/0x6a0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598990] [<ffffffff8117ffdd>] ?
> > > > > mem_cgroup_charge_common+0x3d/0x90
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.598995] [<ffffffff81121d41>] ?
> > > > > add_to_page_cache_lru+0x11/0x40
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599002] [<ffffffffa023f80e>] ?
> > > > > prepare_pages.isra.19+0xae/0x170 [btrfs]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599012] [<ffffffffa0240925>] ?
> > > > > btrfs_file_aio_write+0x215/0x550 [btrfs]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599015] [<ffffffff811876a7>] ?
> > > > > do_sync_write+0x57/0x90
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599018] [<ffffffff8118876d>] ?
> > > > > SyS_write+0x3d/0xa0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599054] ffff8807f6a1b1f0
> > > > > 0000000000000086 0000000000014380 ffff88053c2c3fd8
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599057] 0000000000000002
> > > > > ffffffff81121000 ffff88053c2c3650 ffff88053c2c3730
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599059] [<ffffffff81121000>] ?
> > > > > wait_on_page_read+0x60/0x60
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599062] [<ffffffff81121005>] ?
> > > > > sleep_on_page+0x5/0x10
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599064] [<ffffffff81120e0f>] ?
> > > > > wait_on_page_bit+0x7f/0x90
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599067] [<ffffffff81133bb7>] ?
> > > > > shrink_page_list+0x667/0xa50
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599069] [<ffffffff81134f69>] ?
> > > > > shrink_lruvec+0x2e9/0x600
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599072] [<ffffffff811357a0>] ?
> > > > > do_try_to_free_pages+0xe0/0x550
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599076] [<ffffffff81135e45>] ?
> > > > > try_to_free_mem_cgroup_pages+0xc5/0x150
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599079] [<ffffffff8117f82f>] ?
> > > > > __mem_cgroup_try_charge+0x55f/0x6a0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599082] [<ffffffff8117ffdd>] ?
> > > > > mem_cgroup_charge_common+0x3d/0x90
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599084] [<ffffffff81121c0f>] ?
> > > > > add_to_page_cache_locked+0x2f/0x150
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599091] [<ffffffffa024e127>] ?
> > > > > extent_readpages+0xb7/0x190 [btrfs]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599098] [<ffffffff8112d503>] ?
> > > > > __do_page_cache_readahead+0x193/0x240
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599101] [<ffffffff811238d9>] ?
> > > > > generic_file_aio_read+0x459/0x6d0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599103] [<ffffffff81187c41>] ?
> > > > > vfs_read+0x91/0x160
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599106] [<ffffffff814d2cf9>] ?
> > > > > system_call_fastpath+0x16/0x1b
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599168] kworker/u16:2 D
> > > > > ffff880730ea0868 0 27951 2 0x00000000
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599172] ffff880730ea0450
> > > > > 0000000000000046 0000000000014380 ffff88000721ffd8
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599174] ffff88000721f880
> > > > > 0000000000000002 ffffffff81121000 ffff8805827e3d98
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599176] [<ffffffff81121000>] ?
> > > > > wait_on_page_read+0x60/0x60
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599179] [<ffffffff81121005>] ?
> > > > > sleep_on_page+0x5/0x10
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599181] [<ffffffff811210f5>] ?
> > > > > __lock_page+0x65/0x70
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599189] [<ffffffffa0248fcd>] ?
> > > > > lock_delalloc_pages+0x10d/0x190 [btrfs]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599199] [<ffffffffa024b95f>] ?
> > > > > submit_extent_page.isra.36+0x1af/0x230 [btrfs]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599209] [<ffffffffa024b640>] ?
> > > > > end_extent_writepage+0x90/0x90 [btrfs]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599215] [<ffffffffa024ce97>] ?
> > > > > extent_write_cache_pages.isra.29.constprop.49+0x207/0x340 [btrfs]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599225] [<ffffffffa0233960>] ?
> > > > > btrfs_submit_direct+0x6b0/0x6b0 [btrfs]
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599229] [<ffffffff811ad63c>] ?
> > > > > writeback_sb_inodes+0x19c/0x3d0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599232] [<ffffffff811adb73>] ?
> > > > > wb_writeback+0x243/0x2d0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599236] [<ffffffff8101255b>] ?
> > > > > __switch_to+0x11b/0x4b0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599240] [<ffffffff8107a7e6>] ?
> > > > > worker_thread+0x116/0x3b0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599243] [<ffffffff81080a68>] ?
> > > > > kthread+0xb8/0xd0
> > > > > Aug 12 09:03:41 srv1 kernel: [163223.599245] [<ffffffff814d2c4c>] ?
> > > > > ret_from_fork+0x7c/0xb0
> > > > > Aug 12 09:05:41 srv1 kernel: [163343.527812] Call Trace:
> > > > >
> > > > > Grus
> > > > > Valdis
> > > >
> > > > --
> > > > To unsubscribe from this list: send the line "unsubscribe linux-btrfs"
> > > > in
> > > > the body of a message to majordomo@vger.kernel.org
> > > > More majordomo info at http://vger.kernel.org/majordomo-info.html
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
--
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA B82F 991B EAAC A599 84C7
prev parent reply other threads:[~2014-08-15 12:47 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-08-13 16:39 Welcome to linux-btrfs Valdis Voronin
2014-08-13 16:40 ` btrfs 3.14-2-amd64 btrfs_file_aio_write problem? Valdis Voronin
2014-08-15 10:06 ` Владислав Воробьев
2014-08-15 10:10 ` Valdis Voronin
2014-08-15 10:25 ` Martin Steigerwald
2014-08-15 11:52 ` Valdis Voronin
2014-08-15 12:47 ` Martin Steigerwald [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=2020271.3kqdDHC0N6@merkaba \
--to=martin@lichtvoll.de \
--cc=linux-btrfs@vger.kernel.org \
--cc=v@piratweb.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.