* [RFC PATCH] proc_sysctl: free invalidate proc_sys_dentry
@ 2016-08-11 7:11 Xishi Qiu
2016-08-22 2:17 ` Xishi Qiu
0 siblings, 1 reply; 2+ messages in thread
From: Xishi Qiu @ 2016-08-11 7:11 UTC (permalink / raw)
To: viro, jlayton, dhowells, jkosina, smfrench, viresh.kumar,
Fengtiantian, Miao Xie
Cc: LKML
From: Fengtiantian <fengtiantian@huawei.com>
I find a issue in dentry cache used by sysctl proc.
If register sysctl proc file ,access the file and then unregister this file, dentry in cache will keep increasing, and cause CPU softlockup。
I test in the kernel 3.10.0-327.
My testcase is :
#/bin/sh
while :
do
brctl addbr abc
cat /proc/sys/net/ipv6/conf/abc/autoconf
brctl delbr abc
done
run this script , see the dentry in slabinfo keep increasing:
cat /proc/slabinfo | grep den
dentry 106624 187026 192 42 2 : tunables 0 0 0 : slabdata 4453 4453 0
And because the dentry path is same, their dentry name hash is same, so all dentry will link in one hash list. The function __d_lookup time cost will increase too.
In the situation, if run anther script:
#/bin/sh
touch testfile1
while :
do
mv testfile1 testfile2
mv testfile2 testfile1
done
The CPU softlocup happen:
[45029.115429] BUG: soft lockup - CPU#10 stuck for 22s! [cat:18953]
[45029.121607] Modules linked in: bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter openvswitch(OE) nf_defrag_ipv6 nf_defrag_ipv4 nf_conntrack gre libcrc32c kboxdriver(O) kbox(O) ipmi_devintf ipmi_si ipmi_msghandler intel_powerclamp coretemp intel_rapl crc32_pclmul ghash_clmulni_intel aesni_intel sr_mod cdrom iTCO_wdt iTCO_vendor_support lrw gf128mul mei_me glue_helper sb_edac ablk_helper cryptd mei sg ioatdma edac_core shpchp i2c_i801 pcspkr lpc_ich mfd_core vhost_net tun vhost macvtap macvlan vfio_pci ip_tables ext3 mbcache jbd usb_storage sd_mod crc_t10dif crct10dif_generic kvm_intel(O) kvm(O) irqbypass crct10dif_pclmul crct10dif_common crc32c_intel serio_raw igb ahci libahci i2c_algo_bit libata i2c_core dca megaraid_sas ptp pps_core dm_mod vfio_iommu_type1 vfio [last unloaded: signo_catch]
[45029.121649] CPU: 10 PID: 18953 Comm: cat Tainted: G OEL ---- ------- 3.10.0-327.22.2.23.next.x86_64 #1
[45029.121650] Hardware name: HUAWEI TECHNOLOGIES CO.,LTD. Tecal BH622 V2/BC01SRSA0, BIOS RMISV019 05/10/2012
[45029.121652] task: ffff880486c1e780 ti: ffff8804c5698000 task.ti: ffff8804c5698000
[45029.121653] RIP: 0010:[<ffffffff81257c29>] [<ffffffff81257c29>] proc_sys_compare+0x49/0xd0
[45029.121658] RSP: 0018:ffff8804c569bbb0 EFLAGS: 00000246
[45029.121659] RAX: 0000000000000000 RBX: 1308000000000000 RCX: 0000000000000002
[45029.121660] RDX: 0000000000000002 RSI: ffff8804921173b8 RDI: ffff8804a239f038
[45029.121661] RBP: ffff8804c569bbc8 R08: 0000000000000063 R09: 0000000000000000
[45029.121662] R10: 1308000000000000 R11: ffff880492117380 R12: ffff880a182c3b00
[45029.121663] R13: ffff8804c569bbc8 R14: ffff88067ffdb008 R15: ffffffff8116db65
[45029.121664] FS: 00007fae0d59f740(0000) GS:ffff8806676c0000(0000) knlGS:0000000000000000
[45029.121665] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[45029.121666] CR2: 00007fae0d0a3540 CR3: 00000004a014d000 CR4: 00000000000407e0
[45029.121667] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[45029.121668] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[45029.121669] Stack:
[45029.121670] ffff880492117388 ffff88065ba2ccc0 ffff8804c569be60 ffff8804c569bc18
[45029.121672] ffffffff811fa47c ffff880492117380 ffff8804a239f038 ffff880400000003
[45029.121674] 0000000005d9368a ffff8804c569be60 ffff88065ba2ccc0 ffff8804c569bc97
[45029.121676] Call Trace:
[45029.121680] [<ffffffff811fa47c>] __d_lookup+0x14c/0x160
[45029.121681] [<ffffffff811fa4ba>] d_lookup+0x2a/0x50
[45029.121684] [<ffffffff811eb550>] lookup_dcache+0x30/0xb0
[45029.121685] [<ffffffff811eb5fd>] __lookup_hash+0x2d/0x60
[45029.121689] [<ffffffff81635670>] lookup_slow+0x42/0xa7
[45029.121691] [<ffffffff811efc4f>] link_path_walk+0x83f/0x8e0
[45029.121695] [<ffffffff812fc522>] ? radix_tree_lookup_slot+0x22/0x50
[45029.121697] [<ffffffff811f0c93>] path_openat+0xa3/0x4c0
[45029.121700] [<ffffffff81195151>] ? __do_fault+0x401/0x510
[45029.121702] [<ffffffff811f24ab>] do_filp_open+0x4b/0xb0
[45029.121705] [<ffffffff811ff017>] ? __alloc_fd+0xa7/0x130
[45029.121707] [<ffffffff811dfdb3>] do_sys_open+0xf3/0x1f0
[45029.121709] [<ffffffff811dfece>] SyS_open+0x1e/0x20
Signed-off-by: Fengtiantian <fengtiantian@huawei.com>
---
fs/proc/proc_sysctl.c | 2 ++
1 file changed, 2 insertions(+)
diff --git a/fs/proc/proc_sysctl.c b/fs/proc/proc_sysctl.c
index 5e57c3e..4ee1093 100644
--- a/fs/proc/proc_sysctl.c
+++ b/fs/proc/proc_sysctl.c
@@ -850,6 +850,8 @@ static int proc_sys_compare(const struct dentry *parent, const struct dentry *de
return 1;
if (memcmp(name->name, str, len))
return 1;
+ if (!PROC_I(dentry->d_inode)->sysctl->unregistering == 0)
+ return 0;
head = rcu_dereference(PROC_I(inode)->sysctl);
return !head || !sysctl_is_seen(head);
}
--
1.8.3.1
^ permalink raw reply related [flat|nested] 2+ messages in thread
* Re: [RFC PATCH] proc_sysctl: free invalidate proc_sys_dentry
2016-08-11 7:11 [RFC PATCH] proc_sysctl: free invalidate proc_sys_dentry Xishi Qiu
@ 2016-08-22 2:17 ` Xishi Qiu
0 siblings, 0 replies; 2+ messages in thread
From: Xishi Qiu @ 2016-08-22 2:17 UTC (permalink / raw)
To: viro, jlayton, dhowells, jkosina, smfrench, viresh.kumar,
Fengtiantian, Miao Xie
Cc: LKML
On 2016/8/11 15:11, Xishi Qiu wrote:
> From: Fengtiantian <fengtiantian@huawei.com>
>
ping
> I find a issue in dentry cache used by sysctl proc.
> If register sysctl proc file ,access the file and then unregister this file, dentry in cache will keep increasing, and cause CPU softlockup。
>
> I test in the kernel 3.10.0-327.
>
> My testcase is :
> #/bin/sh
> while :
> do
> brctl addbr abc
> cat /proc/sys/net/ipv6/conf/abc/autoconf
> brctl delbr abc
> done
>
> run this script , see the dentry in slabinfo keep increasing:
> cat /proc/slabinfo | grep den
> dentry 106624 187026 192 42 2 : tunables 0 0 0 : slabdata 4453 4453 0
>
> And because the dentry path is same, their dentry name hash is same, so all dentry will link in one hash list. The function __d_lookup time cost will increase too.
> In the situation, if run anther script:
>
> #/bin/sh
> touch testfile1
> while :
> do
> mv testfile1 testfile2
> mv testfile2 testfile1
> done
>
> The CPU softlocup happen:
> [45029.115429] BUG: soft lockup - CPU#10 stuck for 22s! [cat:18953]
> [45029.121607] Modules linked in: bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter openvswitch(OE) nf_defrag_ipv6 nf_defrag_ipv4 nf_conntrack gre libcrc32c kboxdriver(O) kbox(O) ipmi_devintf ipmi_si ipmi_msghandler intel_powerclamp coretemp intel_rapl crc32_pclmul ghash_clmulni_intel aesni_intel sr_mod cdrom iTCO_wdt iTCO_vendor_support lrw gf128mul mei_me glue_helper sb_edac ablk_helper cryptd mei sg ioatdma edac_core shpchp i2c_i801 pcspkr lpc_ich mfd_core vhost_net tun vhost macvtap macvlan vfio_pci ip_tables ext3 mbcache jbd usb_storage sd_mod crc_t10dif crct10dif_generic kvm_intel(O) kvm(O) irqbypass crct10dif_pclmul crct10dif_common crc32c_intel serio_raw igb ahci libahci i2c_algo_bit libata i2c_core dca megaraid_sas ptp pps_core dm_mod vfio_iommu_type1 vfio [last unloaded: signo_catch]
> [45029.121649] CPU: 10 PID: 18953 Comm: cat Tainted: G OEL ---- ------- 3.10.0-327.22.2.23.next.x86_64 #1
> [45029.121650] Hardware name: HUAWEI TECHNOLOGIES CO.,LTD. Tecal BH622 V2/BC01SRSA0, BIOS RMISV019 05/10/2012
> [45029.121652] task: ffff880486c1e780 ti: ffff8804c5698000 task.ti: ffff8804c5698000
> [45029.121653] RIP: 0010:[<ffffffff81257c29>] [<ffffffff81257c29>] proc_sys_compare+0x49/0xd0
> [45029.121658] RSP: 0018:ffff8804c569bbb0 EFLAGS: 00000246
> [45029.121659] RAX: 0000000000000000 RBX: 1308000000000000 RCX: 0000000000000002
> [45029.121660] RDX: 0000000000000002 RSI: ffff8804921173b8 RDI: ffff8804a239f038
> [45029.121661] RBP: ffff8804c569bbc8 R08: 0000000000000063 R09: 0000000000000000
> [45029.121662] R10: 1308000000000000 R11: ffff880492117380 R12: ffff880a182c3b00
> [45029.121663] R13: ffff8804c569bbc8 R14: ffff88067ffdb008 R15: ffffffff8116db65
> [45029.121664] FS: 00007fae0d59f740(0000) GS:ffff8806676c0000(0000) knlGS:0000000000000000
> [45029.121665] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [45029.121666] CR2: 00007fae0d0a3540 CR3: 00000004a014d000 CR4: 00000000000407e0
> [45029.121667] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [45029.121668] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [45029.121669] Stack:
> [45029.121670] ffff880492117388 ffff88065ba2ccc0 ffff8804c569be60 ffff8804c569bc18
> [45029.121672] ffffffff811fa47c ffff880492117380 ffff8804a239f038 ffff880400000003
> [45029.121674] 0000000005d9368a ffff8804c569be60 ffff88065ba2ccc0 ffff8804c569bc97
> [45029.121676] Call Trace:
> [45029.121680] [<ffffffff811fa47c>] __d_lookup+0x14c/0x160
> [45029.121681] [<ffffffff811fa4ba>] d_lookup+0x2a/0x50
> [45029.121684] [<ffffffff811eb550>] lookup_dcache+0x30/0xb0
> [45029.121685] [<ffffffff811eb5fd>] __lookup_hash+0x2d/0x60
> [45029.121689] [<ffffffff81635670>] lookup_slow+0x42/0xa7
> [45029.121691] [<ffffffff811efc4f>] link_path_walk+0x83f/0x8e0
> [45029.121695] [<ffffffff812fc522>] ? radix_tree_lookup_slot+0x22/0x50
> [45029.121697] [<ffffffff811f0c93>] path_openat+0xa3/0x4c0
> [45029.121700] [<ffffffff81195151>] ? __do_fault+0x401/0x510
> [45029.121702] [<ffffffff811f24ab>] do_filp_open+0x4b/0xb0
> [45029.121705] [<ffffffff811ff017>] ? __alloc_fd+0xa7/0x130
> [45029.121707] [<ffffffff811dfdb3>] do_sys_open+0xf3/0x1f0
> [45029.121709] [<ffffffff811dfece>] SyS_open+0x1e/0x20
>
> Signed-off-by: Fengtiantian <fengtiantian@huawei.com>
> ---
> fs/proc/proc_sysctl.c | 2 ++
> 1 file changed, 2 insertions(+)
>
> diff --git a/fs/proc/proc_sysctl.c b/fs/proc/proc_sysctl.c
> index 5e57c3e..4ee1093 100644
> --- a/fs/proc/proc_sysctl.c
> +++ b/fs/proc/proc_sysctl.c
> @@ -850,6 +850,8 @@ static int proc_sys_compare(const struct dentry *parent, const struct dentry *de
> return 1;
> if (memcmp(name->name, str, len))
> return 1;
> + if (!PROC_I(dentry->d_inode)->sysctl->unregistering == 0)
> + return 0;
> head = rcu_dereference(PROC_I(inode)->sysctl);
> return !head || !sysctl_is_seen(head);
> }
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2016-08-22 2:18 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2016-08-11 7:11 [RFC PATCH] proc_sysctl: free invalidate proc_sys_dentry Xishi Qiu
2016-08-22 2:17 ` Xishi Qiu
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.