[Bug 30042] New: page allocation failure when using jumbo frames with kvm guests

[Bug 30042] New: page allocation failure when using jumbo frames with kvm guests

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=30042

           Summary: page allocation failure when using jumbo frames with
                    kvm guests
           Product: Virtualization
           Version: unspecified
    Kernel Version: 2.6.35
          Platform: All
        OS/Version: Linux
              Tree: Mainline
            Status: NEW
          Severity: low
          Priority: P1
         Component: kvm
        AssignedTo: virtualization_kvm@kernel-bugs.osdl.org
        ReportedBy: kernelbug_mer@russenmafia.at
        Regression: No


i've got a intel e1000 based network card in my ubuntu 10.10 host, using jumbo
frames (mtu 9000).
my kvm guest (ubuntu 10.10) i'm using the "virtio" network card - also
configured with jumbo frames (mtu 9000).
netio shows me about 190MB/s, which is almost double the performance i get from
the standard mtu size (1500).
the only problems i get is when rtorrent starts hash checking. it's awful slow,
cpu at 100% idle, and kernel errors appearing.

Feb 27 21:09:48 vmbuntu kernel: [348422.309070] rtorrent: page allocation
failure. order:2, mode:0x4020
Feb 27 21:09:48 vmbuntu kernel: [348422.309075] Pid: 984, comm: rtorrent Not
tainted 2.6.35-25-virtual #44-Ubuntu
Feb 27 21:09:48 vmbuntu kernel: [348422.309078] Call Trace:
Feb 27 21:09:48 vmbuntu kernel: [348422.309087]  [<ffffffff81107956>]
__alloc_pages_slowpath+0x4b6/0x5a0
Feb 27 21:09:48 vmbuntu kernel: [348422.309091]  [<ffffffff81107bac>]
__alloc_pages_nodemask+0x16c/0x1d0
Feb 27 21:09:48 vmbuntu kernel: [348422.309096]  [<ffffffff8113f742>]
kmalloc_large_node+0x62/0xb0
Feb 27 21:09:48 vmbuntu kernel: [348422.309100]  [<ffffffff8114322c>]
__kmalloc_node_track_caller+0x11c/0x1d0
Feb 27 21:09:48 vmbuntu kernel: [348422.309105]  [<ffffffff814f1f81>] ?
sk_stream_alloc_skb+0x41/0x110
Feb 27 21:09:48 vmbuntu kernel: [348422.309109]  [<ffffffff814a8033>]
__alloc_skb+0x83/0x170
Feb 27 21:09:48 vmbuntu kernel: [348422.309112]  [<ffffffff814f1f81>]
sk_stream_alloc_skb+0x41/0x110
Feb 27 21:09:48 vmbuntu kernel: [348422.309116]  [<ffffffff814f5868>]
tcp_sendmsg+0x3c8/0xa60
Feb 27 21:09:48 vmbuntu kernel: [348422.309121]  [<ffffffff81071096>] ?
mod_timer+0x176/0x2d0
Feb 27 21:09:48 vmbuntu kernel: [348422.309126]  [<ffffffff814a07d3>]
sock_sendmsg+0xf3/0x120
Feb 27 21:09:48 vmbuntu kernel: [348422.309129]  [<ffffffff814f5c28>] ?
tcp_sendmsg+0x788/0xa60
Feb 27 21:09:48 vmbuntu kernel: [348422.309134]  [<ffffffff812975f6>] ?
blkcipher_walk_next+0x1b6/0x3e0
Feb 27 21:09:48 vmbuntu kernel: [348422.309137]  [<ffffffff814a07d3>] ?
sock_sendmsg+0xf3/0x120
Feb 27 21:09:48 vmbuntu kernel: [348422.309141]  [<ffffffff814a0841>]
kernel_sendmsg+0x41/0x60
Feb 27 21:09:48 vmbuntu kernel: [348422.309160]  [<ffffffffa0052bee>]
xs_send_kvec+0x8e/0xa0 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309177]  [<ffffffffa01158be>] ?
reserve_space+0xe/0x20 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309185]  [<ffffffffa0052db2>]
xs_sendpages+0x1b2/0x210 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309194]  [<ffffffffa0052f4d>]
xs_tcp_send_request+0x5d/0x170 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309202]  [<ffffffffa0050fb3>]
xprt_transmit+0x83/0x2f0 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309210]  [<ffffffffa004e118>]
call_transmit+0xa8/0x130 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309219]  [<ffffffffa00564a2>]
__rpc_execute+0xa2/0x290 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309227]  [<ffffffffa0056713>]
rpc_execute+0x83/0xa0 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309235]  [<ffffffffa004ec99>]
rpc_run_task+0x29/0x40 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309244]  [<ffffffffa010198f>]
nfs_read_rpcsetup+0x18f/0x1f0 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309254]  [<ffffffffa01027b0>] ?
readpage_async_filler+0x0/0x160 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309264]  [<ffffffffa0101dd9>]
nfs_pagein_one+0xa9/0xf0 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309272]  [<ffffffffa00ff6c7>]
nfs_pageio_doio+0x37/0x80 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309281]  [<ffffffffa00ff764>]
nfs_pageio_add_request+0x54/0x100 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309296]  [<ffffffffa0102838>]
readpage_async_filler+0x88/0x160 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309306]  [<ffffffffa01027b0>] ?
readpage_async_filler+0x0/0x160 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309311]  [<ffffffff8110b49a>]
read_cache_pages+0xba/0x130
Feb 27 21:09:48 vmbuntu kernel: [348422.309425]  [<ffffffffa0101676>]
nfs_readpages+0x146/0x210 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309435]  [<ffffffffa0101d30>] ?
nfs_pagein_one+0x0/0xf0 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309439]  [<ffffffff8110b1db>]
__do_page_cache_readahead+0x13b/0x210
Feb 27 21:09:48 vmbuntu kernel: [348422.309443]  [<ffffffff8110b351>]
force_page_cache_readahead+0x71/0xa0
Feb 27 21:09:48 vmbuntu kernel: [348422.309448]  [<ffffffff8111b28b>]
madvise_vma+0xcb/0x210
Feb 27 21:09:48 vmbuntu kernel: [348422.309452]  [<ffffffff811265f5>] ?
do_mmap_pgoff+0x335/0x380
Feb 27 21:09:48 vmbuntu kernel: [348422.309455]  [<ffffffff8111b535>]
sys_madvise+0x165/0x290
Feb 27 21:09:48 vmbuntu kernel: [348422.309461]  [<ffffffff8100a0f2>]
system_call_fastpath+0x16/0x1b
Feb 27 21:09:48 vmbuntu kernel: [348422.309464] Mem-Info:
Feb 27 21:09:48 vmbuntu kernel: [348422.309465] Node 0 DMA per-cpu:
Feb 27 21:09:48 vmbuntu kernel: [348422.309468] CPU    0: hi:    0, btch:   1
usd:   0
Feb 27 21:09:48 vmbuntu kernel: [348422.309469] Node 0 DMA32 per-cpu:
Feb 27 21:09:48 vmbuntu kernel: [348422.309472] CPU    0: hi:  186, btch:  31
usd:  50
Feb 27 21:09:48 vmbuntu kernel: [348422.309476] active_anon:558
inactive_anon:14286 isolated_anon:0
Feb 27 21:09:48 vmbuntu kernel: [348422.309505]  active_file:62168
inactive_file:160876 isolated_file:0
Feb 27 21:09:48 vmbuntu kernel: [348422.309506]  unevictable:0 dirty:0
writeback:0 unstable:0
Feb 27 21:09:48 vmbuntu kernel: [348422.309507]  free:2170
slab_reclaimable:3884 slab_unreclaimable:2493
Feb 27 21:09:48 vmbuntu kernel: [348422.309508]  mapped:3454 shmem:112
pagetables:1452 bounce:0
Feb 27 21:09:48 vmbuntu kernel: [348422.309510] Node 0 DMA free:4008kB min:60kB
low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:780kB
inactive_file:10996kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
present:15
700kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB
slab_reclaimable:72kB slab_unreclaimable:4kB kernel_stack:0kB pagetables:0kB
unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Feb 27 21:09:48 vmbuntu kernel: [348422.309520] lowmem_reserve[]: 0 994 994 994
Feb 27 21:09:48 vmbuntu kernel: [348422.309523] Node 0 DMA32 free:4672kB
min:4000kB low:5000kB high:6000kB active_anon:2232kB inactive_anon:57144kB
active_file:247892kB inactive_file:632508kB unevictable:0kB isolated(anon):0kB
isolated(f
ile):0kB present:1018068kB mlocked:0kB dirty:0kB writeback:0kB mapped:13816kB
shmem:448kB slab_reclaimable:15464kB slab_unreclaimable:9968kB
kernel_stack:1456kB pagetables:5808kB unstable:0kB bounce:0kB writeback_tmp:0kB
pages_scanned:0 
all_unreclaimable? no
Feb 27 21:09:48 vmbuntu kernel: [348422.309532] lowmem_reserve[]: 0 0 0 0
Feb 27 21:09:48 vmbuntu kernel: [348422.309535] Node 0 DMA: 2*4kB 8*8kB 4*16kB
7*32kB 7*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 4008kB
Feb 27 21:09:48 vmbuntu kernel: [348422.309544] Node 0 DMA32: 392*4kB 340*8kB
3*16kB 11*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB =
4688kB
Feb 27 21:09:48 vmbuntu kernel: [348422.309552] 223212 total pagecache pages
Feb 27 21:09:48 vmbuntu kernel: [348422.309554] 43 pages in swap cache
Feb 27 21:09:48 vmbuntu kernel: [348422.309556] Swap cache stats: add 108,
delete 65, find 30135/30140
Feb 27 21:09:48 vmbuntu kernel: [348422.309557] Free swap  = 976624kB
Feb 27 21:09:48 vmbuntu kernel: [348422.309559] Total swap = 976892kB
Feb 27 21:09:48 vmbuntu kernel: [348422.313348] 262125 pages RAM
Feb 27 21:09:48 vmbuntu kernel: [348422.313351] 6524 pages reserved
Feb 27 21:09:48 vmbuntu kernel: [348422.313352] 49320 pages shared
Feb 27 21:09:48 vmbuntu kernel: [348422.313353] 224583 pages non-shared

when i disable jumbo frames on the guest and host, everything works fine.

host:
ubuntu 10.10
Intel(R) Core(TM)2 Quad CPU    Q6600
04:00.0 Ethernet controller: Intel Corporation 82572EI Gigabit Ethernet
Controller (Copper) (rev 06)
2.6.35-25-generic #44-Ubuntu SMP Fri Jan 21 17:40:44 UTC 2011 x86_64 GNU/Linux
QEMU PC emulator version 0.12.5 (qemu-kvm-0.12.5), Copyright (c) 2003-2008
Fabrice Bellard

guest:
ubuntu 10.10
'x86_64' machine='pc-0.12'
1 cpu configured
virtio network interface
2.6.35-25-virtual #44-Ubuntu SMP Fri Jan 21 20:39:04 UTC 2011 x86_64 GNU/Linux

-- 
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are watching the assignee of the bug.

[Bug 30042] page allocation failure when using jumbo frames with kvm guests

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=30042


Avi Kivity <avi@redhat.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |avi@redhat.com




--- Comment #1 from Avi Kivity <avi@redhat.com>  2011-02-28 08:42:25 ---
The problem is likely not related to virtualization or virtio.

-- 
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are watching the assignee of the bug.

[Bug 30042] page allocation failure when using jumbo frames with kvm guests

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=30042





--- Comment #2 from Peter Merhaut <kernelbug_mer@russenmafia.at>  2011-02-28 11:47:51 ---
uh i should add that the file rtorrent hashes is on a nfs filesystem. so this
generates a lot of network traffic. between the host (which also serves as nfs
server) and the guest.

-- 
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are watching the assignee of the bug.

[Bug 30042] page allocation failure when using jumbo frames with kvm guests

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=30042


Alan <alan@lxorguk.ukuu.org.uk> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
                 CC|                            |alan@lxorguk.ukuu.org.uk
         Resolution|                            |OBSOLETE




-- 
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are watching the assignee of the bug.