Re: Hang on large copy_from_user with PREEMPT_NONE

[Sasha Levin <sasha.levin@oracle.com>]

On 04/06/2015 03:36 PM, Borislav Petkov wrote:
> On Mon, Apr 06, 2015 at 03:08:24PM -0400, Sasha Levin wrote:
>> > Your patch just makes it hang in memset instead:
>> > 
>> > [  963.104556] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [trinity-c224:9845]
>> > [  963.104556] Modules linked in:
>> > [  963.104556] irq event stamp: 3773324
>> > [  963.104556] hardirqs last  enabled at (3773323): [<ffffffffb7af8e3c>] restore_args+0x0/0x34
>> > [  963.104556] hardirqs last disabled at (3773324): [<ffffffffb7af919e>] apic_timer_interrupt+0x6e/0x80
>> > [  963.104556] softirqs last  enabled at (3773322): [<ffffffffad1f6589>] __do_softirq+0x709/0xd40
>> > [  963.104556] softirqs last disabled at (3773317): [<ffffffffad1f746d>] irq_exit+0x29d/0x320
>> > [  963.104556] CPU: 1 PID: 9845 Comm: trinity-c224 Not tainted 4.0.0-rc6-next-20150402-sasha-00039-ge0bdae3-dirty #2130
>> > [  963.104556] task: ffff8802a3560000 ti: ffff8802a3568000 task.ti: ffff8802a3568000
>> > [  963.104556] RIP: 0010:[<ffffffffaefbd173>]  [<ffffffffaefbd173>] memset_orig+0x33/0xb0
> memset_orig?
> 
> Hmmm, your box doesn't set X86_FEATURE_REP_GOOD. And looking at your
> dmesg I can see why - that's a kvm guest and you're emulating some qemu
> -cpu kvm64 or so thing, AFAICT.
> 
> Can you give me your full command line?

I'm running kvmtool rather than qemu.

I've changed the cpu that the guest sees, and it just moved to the optimized memset:

[  843.403237] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [trinity-c123:9780]
[  843.403265] Modules linked in:
[  843.403265] irq event stamp: 7340472
[  843.403265] hardirqs last  enabled at (7340471): [<ffffffffafaf8e3c>] restore_args+0x0/0x34
[  843.403265] hardirqs last disabled at (7340472): [<ffffffffafaf919e>] apic_timer_interrupt+0x6e/0x80
[  843.403265] softirqs last  enabled at (7340470): [<ffffffffa51f6589>] __do_softirq+0x709/0xd40
[  843.403265] softirqs last disabled at (7340455): [<ffffffffa51f746d>] irq_exit+0x29d/0x320
[  843.403265] CPU: 0 PID: 9780 Comm: trinity-c123 Not tainted 4.0.0-rc6-next-20150402-sasha-00039-ge0bda
e3-dirty #2130
[  843.403265] task: ffff88034ffb0000 ti: ffff88034ffb8000 task.ti: ffff88034ffb8000
[  843.403265] RIP: 0010:[<ffffffffa6fbd124>]  [<ffffffffa6fbd124>] __memset+0x24/0x30
[  843.403265] RSP: 0000:ffff88034ffbfdf0  EFLAGS: 00010206
[  843.403265] RAX: 0000000000000000 RBX: 00000000fffff000 RCX: 0000000004a8a000
[  843.403265] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffc900ecdbd000
[  843.403265] RBP: ffff88034ffbfe18 R08: 000000001ffffe00 R09: ffffc9001220e000
[  843.403265] R10: ffffc9011220cfff R11: fffff52022441a00 R12: 000000001ffffe00
[  843.403265] R13: fffff52022399988 R14: 000000001ffffe00 R15: fffff520224419ff
[  843.403265] FS:  00007f0600ec4700(0000) GS:ffff880050600000(0000) knlGS:0000000000000000
[  843.403265] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[  843.403265] CR2: 00000000ff355000 CR3: 000000034f73f000 CR4: 00000000000007f0
[  843.403265] Stack:
[  843.403265]  ffffffffa563b4ac ffffffffafafd69c 00000000fffff000 ffff88034ffbfe78
[  843.403265]  ffff88034ffbff18 ffff88034ffbfe38 ffffffffa6fbd759 0000000000010246
[  843.403265]  1ffff10069ff7fcb ffff88034ffbff48 ffffffffa53c5ef0 ffffc9001220e000
[  843.403265] Call Trace:
[  843.403265]  [<ffffffffa563b4ac>] ? memset+0x2c/0x40
[  843.403265]  [<ffffffffafafd69c>] ? bad_to_user+0x66/0x1391
[  843.403265]  [<ffffffffa6fbd759>] copy_user_handle_tail+0x69/0x80
[  843.403265]  [<ffffffffa53c5ef0>] SyS_init_module+0x150/0x210
[  843.403265]  [<ffffffffa53c5da0>] ? load_module+0x96a0/0x96a0
[  843.403265]  [<ffffffffafafad49>] ia32_do_call+0x13/0x13
[  843.403265] Code: 90 90 90 90 90 90 90 66 66 90 66 90 49 89 f9 48 89 d1 83 e2 07 48 c1 e9 03 40 0f b6 f6 48 b8 01 01 01 01 01 01 01 01 48 0f af c6 <f3> 48 ab 89 d1 f3 aa 4c 89 c8 c3 90 49 89 f9 40 88 f0 48 89 d1
> 
> Btw, maybe you should try to trigger this on real metal, just in case,
> to rule out virt issues. Or have you, already?

I'll give it a go tomorrow.


Thanks,
Sasha