* XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118 on 4.8-rc1 kernel
@ 2016-08-12 14:04 Eryu Guan
2016-08-12 14:47 ` Eryu Guan
0 siblings, 1 reply; 4+ messages in thread
From: Eryu Guan @ 2016-08-12 14:04 UTC (permalink / raw)
To: xfs
Hi,
I hit oops while building kernel on XFS, 4.8-rc1 kernel, hit twice in
six kernel builds. I'm not sure if it's a regression since 4.7 kernel
yet, will do more testings.
The host is a x86_64 kvm guest running RHEL7.2 with upstream 4.8-rc1
kernel. Detailed console log and XFS info and memory & cpu info please
see the end of this mail.
Actually I was bisecting an issue caused by generic/224, I saw the
following message flooding dmesg.
...
[ 92.394306] XFS (sda6): page discard on page ffffea000204c9c0, inode 0x2e4, offset 84959232.
[ 92.401061] XFS (sda6): page discard on page ffffea000204ca00, inode 0x2e4, offset 84963328.
[ 92.406592] XFS (sda6): page discard on page ffffea000204ca40, inode 0x2e4, offset 84967424.
[ 92.409813] XFS (sda6): page discard on page ffffea000204ca80, inode 0x2e4, offset 84971520.
...
I'll send another email once I get bisect result.
Thanks,
Eryu
Host information:
[root@dhcp-66-86-11 ~]# xfs_info /dev/sdb1
meta-data=/dev/sdb1 isize=256 agcount=4, agsize=6553536 blks
= sectsz=512 attr=2, projid32bit=1
= crc=0 finobt=0 spinodes=0
data = bsize=4096 blocks=26214144, imaxpct=25
= sunit=0 swidth=0 blks
naming =version 2 bsize=4096 ascii-ci=0 ftype=0
log =internal bsize=4096 blocks=12799, version=2
= sectsz=512 sunit=0 blks, lazy-count=1
realtime =none extsz=4096 blocks=0, rtextents=0
[root@dhcp-66-86-11 ~]# df -h /dev/sdb1
Filesystem Size Used Avail Use% Mounted on
/dev/sdb1 100G 47G 54G 47% /root/workspace
[root@dhcp-66-86-11 ~]# free -m
total used free shared buff/cache available
Mem: 7982 111 7660 8 211 7594
Swap: 8063 0 8063
[root@dhcp-66-86-11 ~]# lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 4
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 13
Model name: QEMU Virtual CPU version (cpu64-rhel6)
Stepping: 3
CPU MHz: 2892.421
BogoMIPS: 5785.49
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 4096K
NUMA node0 CPU(s): 0-3
Console log:
[ 505.226162] XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118
[ 505.226796] ------------[ cut here ]------------
[ 505.227010] kernel BUG at fs/xfs/xfs_message.c:113!
[ 505.227010] invalid opcode: 0000 [#1] SMP
[ 505.227010] Modules linked in: btrfs xor raid6_pq ppdev i2c_piix4 parport_pc sg parport i2c_core virtio_balloon pcspkr acpi_cpufreq nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod ata_generic pata_acpi virtio_scsi ata_piix libata serio_raw virtio_pci 8139too virtio_ring 8139cp virtio mii floppy
[ 505.227010] CPU: 3 PID: 57 Comm: kswapd0 Not tainted 4.8.0-rc1 #17
[ 505.227010] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
[ 505.234430] task: ffff880215cde680 task.stack: ffff880210ad0000
[ 505.234430] RIP: 0010:[<ffffffffa013c9a2>] [<ffffffffa013c9a2>] assfail+0x22/0x30 [xfs]
[ 505.234430] RSP: 0018:ffff880210ad3a00 EFLAGS: 00010246
[ 505.234430] RAX: 0000000000000000 RBX: ffff88011ec02ad8 RCX: 0000000000000000
[ 505.234430] RDX: ffff880210ad3908 RSI: 000000000000000a RDI: ffffffffa016eb95
[ 505.234430] RBP: ffff880210ad3a00 R08: 0000000000000000 R09: 0000000000000000
[ 505.234430] R10: 000000000000000a R11: f000000000000000 R12: ffff88011ec02a80
[ 505.234430] R13: ffff8802107c1998 R14: ffff8802107c1900 R15: 0000000000000000
[ 505.234430] FS: 0000000000000000(0000) GS:ffff88021fd80000(0000) knlGS:0000000000000000
[ 505.234430] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 505.234430] CR2: 0000000001137000 CR3: 00000000447a7000 CR4: 00000000000006e0
[ 505.234430] Stack:
[ 505.234430] ffff880210ad3a38 ffffffffa0123332 ffff880201026c00 ffff880201026d24
[ 505.234430] ffff88011ec02a80 ffff8802107c1900 0000000000000000 ffff880210ad3a88
[ 505.234430] ffffffffa012e05d 0000000008405eae ffff88011ec02a80 00000000ec38fc98
[ 505.234430] Call Trace:
[ 505.234430] [<ffffffffa0123332>] xfs_buf_rele+0x2f2/0x380 [xfs]
[ 505.234430] [<ffffffffa012e05d>] xfs_reclaim_inode+0x38d/0x3a0 [xfs]
[ 505.234430] [<ffffffffa012e293>] xfs_reclaim_inodes_ag+0x223/0x360 [xfs]
[ 505.234430] [<ffffffff810b5638>] ? try_to_wake_up+0x58/0x390
[ 505.234430] [<ffffffff810b5985>] ? wake_up_process+0x15/0x20
[ 505.234430] [<ffffffffa012e4b3>] xfs_reclaim_inodes_nr+0x33/0x40 [xfs]
[ 505.234430] [<ffffffffa013f709>] xfs_fs_free_cached_objects+0x19/0x20 [xfs]
[ 505.234430] [<ffffffff81225f81>] super_cache_scan+0x181/0x190
[ 505.234430] [<ffffffff811a8837>] shrink_slab+0x237/0x400
[ 505.234430] [<ffffffff811ad4c3>] shrink_node+0x303/0x310
[ 505.234430] [<ffffffff811ae2d2>] kswapd+0x302/0x6f0
[ 505.234430] [<ffffffff811adfd0>] ? mem_cgroup_shrink_node+0x180/0x180
[ 505.234430] [<ffffffff810aa198>] kthread+0xd8/0xf0
[ 505.234430] [<ffffffff816d797f>] ret_from_fork+0x1f/0x40
[ 505.234430] [<ffffffff810aa0c0>] ? kthread_park+0x60/0x60
[ 505.234430] Code: 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 f1 41 89 d0 48 c7 c6 30 a9 17 a0 48 89 fa 31 c0 48 89 e5 31 ff e8 ae f8 ff ff <0f> 0b 66 90 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48
[ 505.234430] RIP [<ffffffffa013c9a2>] assfail+0x22/0x30 [xfs]
[ 505.234430] RSP <ffff880210ad3a00>
[ 505.251864] ---[ end trace d6c2d984ee03a700 ]---
[ 505.252246] Kernel panic - not syncing: Fatal exception
[ 505.252662] Kernel Offset: disabled
[ 505.252929] ---[ end Kernel panic - not syncing: Fatal exception
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118 on 4.8-rc1 kernel
2016-08-12 14:04 XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118 on 4.8-rc1 kernel Eryu Guan
@ 2016-08-12 14:47 ` Eryu Guan
2016-08-12 17:07 ` Brian Foster
0 siblings, 1 reply; 4+ messages in thread
From: Eryu Guan @ 2016-08-12 14:47 UTC (permalink / raw)
To: xfs
On Fri, Aug 12, 2016 at 10:04:14PM +0800, Eryu Guan wrote:
> Hi,
>
> I hit oops while building kernel on XFS, 4.8-rc1 kernel, hit twice in
> six kernel builds. I'm not sure if it's a regression since 4.7 kernel
> yet, will do more testings.
Just hit again on 4.8-rc1 kernel, I was doing
# clean partial builds from previous run and build again
make clean
make -j 8
Seems I have to do kernel build on 4.7 kernel to finish the bisect.
Thanks,
Eryu
[ 2515.752039] XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118
[ 2515.752649] ------------[ cut here ]------------
[ 2515.752949] kernel BUG at fs/xfs/xfs_message.c:113!
[ 2515.753010] invalid opcode: 0000 [#1] SMP
[ 2515.753010] Modules linked in: btrfs xor raid6_pq ppdev i2c_piix4 parport_pc sg pcspkr i2c_core parport virtio_balloon acpi_cpufreq nfsd auth_rpcgss nfs_acl lockd grace sunrp
c ip_tables xfs libcrc32c sd_mod ata_generic pata_acpi virtio_scsi serio_raw ata_piix virtio_pci 8139too floppy libata virtio_ring virtio 8139cp mii
[ 2515.753010] CPU: 1 PID: 57 Comm: kswapd0 Not tainted 4.8.0-rc1 #17
[ 2515.753010] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
[ 2515.753010] task: ffff880215cde680 task.stack: ffff880210a98000
[ 2515.753010] RIP: 0010:[<ffffffffa01489a2>] [<ffffffffa01489a2>] assfail+0x22/0x30 [xfs]
[ 2515.753010] RSP: 0000:ffff880210a9ba00 EFLAGS: 00010246
[ 2515.753010] RAX: 0000000000000000 RBX: ffff8801289fb9d8 RCX: 0000000000000000
[ 2515.753010] RDX: ffff880210a9b908 RSI: 000000000000000a RDI: ffffffffa017ab95
[ 2515.753010] RBP: ffff880210a9ba00 R08: 0000000000000000 R09: 0000000000000000
[ 2515.753010] R10: 000000000000000a R11: f000000000000000 R12: ffff8801289fb980
[ 2515.753010] R13: ffff88020f701c98 R14: ffff88020f701c00 R15: 0000000000000000
[ 2515.753010] FS: 0000000000000000(0000) GS:ffff88021fc80000(0000) knlGS:0000000000000000
[ 2515.753010] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2515.753010] CR2: 00002ab2aa17d000 CR3: 0000000208cd6000 CR4: 00000000000006e0
[ 2515.753010] Stack:
[ 2515.753010] ffff880210a9ba38 ffffffffa012f332 ffff880103b4b000 ffff880103b4b124
[ 2515.753010] ffff8801289fb980 ffff88020f701c00 0000000000000000 ffff880210a9ba88
[ 2515.753010] ffffffffa013a05d 0000000008405ead ffff8801289fb980 000000009df3522a
[ 2515.753010] Call Trace:
[ 2515.753010] [<ffffffffa012f332>] xfs_buf_rele+0x2f2/0x380 [xfs]
[ 2515.753010] [<ffffffffa013a05d>] xfs_reclaim_inode+0x38d/0x3a0 [xfs]
[ 2515.753010] [<ffffffffa013a293>] xfs_reclaim_inodes_ag+0x223/0x360 [xfs]
[ 2515.753010] [<ffffffff810b5638>] ? try_to_wake_up+0x58/0x390
[ 2515.753010] [<ffffffff810b5985>] ? wake_up_process+0x15/0x20
[ 2515.753010] [<ffffffffa013a4b3>] xfs_reclaim_inodes_nr+0x33/0x40 [xfs]
[ 2515.753010] [<ffffffffa014b709>] xfs_fs_free_cached_objects+0x19/0x20 [xfs]
[ 2515.753010] [<ffffffff81225f81>] super_cache_scan+0x181/0x190
[ 2515.753010] [<ffffffff811a8837>] shrink_slab+0x237/0x400
[ 2515.753010] [<ffffffff811ad4c3>] shrink_node+0x303/0x310
[ 2515.753010] [<ffffffff811ae2d2>] kswapd+0x302/0x6f0
[ 2515.753010] [<ffffffff811adfd0>] ? mem_cgroup_shrink_node+0x180/0x180
[ 2515.753010] [<ffffffff810aa198>] kthread+0xd8/0xf0
[ 2515.753010] [<ffffffff816d797f>] ret_from_fork+0x1f/0x40
[ 2515.753010] [<ffffffff810aa0c0>] ? kthread_park+0x60/0x60
[ 2515.753010] Code: 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 f1 41 89 d0 48 c7 c6 30 69 18 a0 48 89 fa 31 c0 48 89 e5 31 ff e8 ae f8 ff ff <0f> 0b 66 90 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48
[ 2515.753010] RIP [<ffffffffa01489a2>] assfail+0x22/0x30 [xfs]
[ 2515.753010] RSP <ffff880210a9ba00>
[ 2515.773793] ---[ end trace d8064b1e521d0bfb ]---
[ 2515.774123] Kernel panic - not syncing: Fatal exception
[ 2515.774534] Kernel Offset: disabled
[ 2515.774774] ---[ end Kernel panic - not syncing: Fatal exception
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118 on 4.8-rc1 kernel
2016-08-12 14:47 ` Eryu Guan
@ 2016-08-12 17:07 ` Brian Foster
2016-08-13 6:50 ` Eryu Guan
0 siblings, 1 reply; 4+ messages in thread
From: Brian Foster @ 2016-08-12 17:07 UTC (permalink / raw)
To: Eryu Guan; +Cc: xfs
On Fri, Aug 12, 2016 at 10:47:52PM +0800, Eryu Guan wrote:
> On Fri, Aug 12, 2016 at 10:04:14PM +0800, Eryu Guan wrote:
> > Hi,
> >
> > I hit oops while building kernel on XFS, 4.8-rc1 kernel, hit twice in
> > six kernel builds. I'm not sure if it's a regression since 4.7 kernel
> > yet, will do more testings.
>
> Just hit again on 4.8-rc1 kernel, I was doing
>
> # clean partial builds from previous run and build again
> make clean
> make -j 8
>
> Seems I have to do kernel build on 4.7 kernel to finish the bisect.
>
> Thanks,
> Eryu
>
> [ 2515.752039] XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118
This is commit 9c7504aa7 ("xfs: track and serialize in-flight async
buffers against unmount"). The assert is actually incorrect, as Dave had
previously pointed out[1]. A patch was posted[2] to fix it, but hasn't
been merged yet.
Brian
[1] http://oss.sgi.com/pipermail/xfs/2016-August/050613.html
[2] http://oss.sgi.com/pipermail/xfs/2016-August/050634.html
> [ 2515.752649] ------------[ cut here ]------------
> [ 2515.752949] kernel BUG at fs/xfs/xfs_message.c:113!
> [ 2515.753010] invalid opcode: 0000 [#1] SMP
> [ 2515.753010] Modules linked in: btrfs xor raid6_pq ppdev i2c_piix4 parport_pc sg pcspkr i2c_core parport virtio_balloon acpi_cpufreq nfsd auth_rpcgss nfs_acl lockd grace sunrp
> c ip_tables xfs libcrc32c sd_mod ata_generic pata_acpi virtio_scsi serio_raw ata_piix virtio_pci 8139too floppy libata virtio_ring virtio 8139cp mii
> [ 2515.753010] CPU: 1 PID: 57 Comm: kswapd0 Not tainted 4.8.0-rc1 #17
> [ 2515.753010] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
> [ 2515.753010] task: ffff880215cde680 task.stack: ffff880210a98000
> [ 2515.753010] RIP: 0010:[<ffffffffa01489a2>] [<ffffffffa01489a2>] assfail+0x22/0x30 [xfs]
> [ 2515.753010] RSP: 0000:ffff880210a9ba00 EFLAGS: 00010246
> [ 2515.753010] RAX: 0000000000000000 RBX: ffff8801289fb9d8 RCX: 0000000000000000
> [ 2515.753010] RDX: ffff880210a9b908 RSI: 000000000000000a RDI: ffffffffa017ab95
> [ 2515.753010] RBP: ffff880210a9ba00 R08: 0000000000000000 R09: 0000000000000000
> [ 2515.753010] R10: 000000000000000a R11: f000000000000000 R12: ffff8801289fb980
> [ 2515.753010] R13: ffff88020f701c98 R14: ffff88020f701c00 R15: 0000000000000000
> [ 2515.753010] FS: 0000000000000000(0000) GS:ffff88021fc80000(0000) knlGS:0000000000000000
> [ 2515.753010] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 2515.753010] CR2: 00002ab2aa17d000 CR3: 0000000208cd6000 CR4: 00000000000006e0
> [ 2515.753010] Stack:
> [ 2515.753010] ffff880210a9ba38 ffffffffa012f332 ffff880103b4b000 ffff880103b4b124
> [ 2515.753010] ffff8801289fb980 ffff88020f701c00 0000000000000000 ffff880210a9ba88
> [ 2515.753010] ffffffffa013a05d 0000000008405ead ffff8801289fb980 000000009df3522a
> [ 2515.753010] Call Trace:
> [ 2515.753010] [<ffffffffa012f332>] xfs_buf_rele+0x2f2/0x380 [xfs]
> [ 2515.753010] [<ffffffffa013a05d>] xfs_reclaim_inode+0x38d/0x3a0 [xfs]
> [ 2515.753010] [<ffffffffa013a293>] xfs_reclaim_inodes_ag+0x223/0x360 [xfs]
> [ 2515.753010] [<ffffffff810b5638>] ? try_to_wake_up+0x58/0x390
> [ 2515.753010] [<ffffffff810b5985>] ? wake_up_process+0x15/0x20
> [ 2515.753010] [<ffffffffa013a4b3>] xfs_reclaim_inodes_nr+0x33/0x40 [xfs]
> [ 2515.753010] [<ffffffffa014b709>] xfs_fs_free_cached_objects+0x19/0x20 [xfs]
> [ 2515.753010] [<ffffffff81225f81>] super_cache_scan+0x181/0x190
> [ 2515.753010] [<ffffffff811a8837>] shrink_slab+0x237/0x400
> [ 2515.753010] [<ffffffff811ad4c3>] shrink_node+0x303/0x310
> [ 2515.753010] [<ffffffff811ae2d2>] kswapd+0x302/0x6f0
> [ 2515.753010] [<ffffffff811adfd0>] ? mem_cgroup_shrink_node+0x180/0x180
> [ 2515.753010] [<ffffffff810aa198>] kthread+0xd8/0xf0
> [ 2515.753010] [<ffffffff816d797f>] ret_from_fork+0x1f/0x40
> [ 2515.753010] [<ffffffff810aa0c0>] ? kthread_park+0x60/0x60
> [ 2515.753010] Code: 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 f1 41 89 d0 48 c7 c6 30 69 18 a0 48 89 fa 31 c0 48 89 e5 31 ff e8 ae f8 ff ff <0f> 0b 66 90 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48
> [ 2515.753010] RIP [<ffffffffa01489a2>] assfail+0x22/0x30 [xfs]
> [ 2515.753010] RSP <ffff880210a9ba00>
> [ 2515.773793] ---[ end trace d8064b1e521d0bfb ]---
> [ 2515.774123] Kernel panic - not syncing: Fatal exception
> [ 2515.774534] Kernel Offset: disabled
> [ 2515.774774] ---[ end Kernel panic - not syncing: Fatal exception
>
> _______________________________________________
> xfs mailing list
> xfs@oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118 on 4.8-rc1 kernel
2016-08-12 17:07 ` Brian Foster
@ 2016-08-13 6:50 ` Eryu Guan
0 siblings, 0 replies; 4+ messages in thread
From: Eryu Guan @ 2016-08-13 6:50 UTC (permalink / raw)
To: Brian Foster; +Cc: xfs
On Fri, Aug 12, 2016 at 01:07:15PM -0400, Brian Foster wrote:
> On Fri, Aug 12, 2016 at 10:47:52PM +0800, Eryu Guan wrote:
> > On Fri, Aug 12, 2016 at 10:04:14PM +0800, Eryu Guan wrote:
> > > Hi,
> > >
> > > I hit oops while building kernel on XFS, 4.8-rc1 kernel, hit twice in
> > > six kernel builds. I'm not sure if it's a regression since 4.7 kernel
> > > yet, will do more testings.
> >
> > Just hit again on 4.8-rc1 kernel, I was doing
> >
> > # clean partial builds from previous run and build again
> > make clean
> > make -j 8
> >
> > Seems I have to do kernel build on 4.7 kernel to finish the bisect.
> >
> > Thanks,
> > Eryu
> >
> > [ 2515.752039] XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118
>
> This is commit 9c7504aa7 ("xfs: track and serialize in-flight async
> buffers against unmount"). The assert is actually incorrect, as Dave had
> previously pointed out[1]. A patch was posted[2] to fix it, but hasn't
> been merged yet.
>
> Brian
>
> [1] http://oss.sgi.com/pipermail/xfs/2016-August/050613.html
> [2] http://oss.sgi.com/pipermail/xfs/2016-August/050634.html
Thanks for the reminder, I had impression of this thread and patch, but
didn't realize I was hitting the same problem. I don't have to do bisect
then :)
Thanks,
Eryu
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2016-08-13 6:51 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2016-08-12 14:04 XFS: Assertion failed: bp->b_flags & XBF_ASYNC, file: fs/xfs/xfs_buf.c, line: 118 on 4.8-rc1 kernel Eryu Guan
2016-08-12 14:47 ` Eryu Guan
2016-08-12 17:07 ` Brian Foster
2016-08-13 6:50 ` Eryu Guan
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox