From: simon.guinot@sequanux.org (Simon Guinot)
To: linux-arm-kernel@lists.infradead.org
Subject: [PATCH] net: mvneta: fix refilling for Rx DMA buffers
Date: Thu, 16 Jul 2015 02:25:30 +0200 [thread overview]
Message-ID: <20150716002530.GD10671@kw.sim.vm.gnt> (raw)
In-Reply-To: <20150715.155256.1854323748613951804.davem@davemloft.net>
On Wed, Jul 15, 2015 at 03:52:56PM -0700, David Miller wrote:
> From: Simon Guinot <simon.guinot@sequanux.org>
> Date: Mon, 13 Jul 2015 00:04:57 +0200
>
> > On some Armada 370-based NAS, I have experimented kernel bugs and
> > crashes when the mvneta Ethernet driver fails to refill Rx DMA buffers
> > due to memory shortage.
> >
> > With the actual code, if the memory allocation fails while refilling a
> > Rx DMA buffer, then the corresponding descriptor is let with the address
> > of an unmapped DMA buffer already passed to the network stack. Since the
> > driver still increments the non-occupied counter for Rx descriptor (if a
> > next packet is handled successfully), then the Ethernet controller is
> > allowed to reuse the unfilled Rx descriptor...
> >
> > As a fix, this patch first refills a Rx descriptor before handling the
> > stored data and unmapping the associated Rx DMA buffer. Additionally the
> > occupied and non-occupied counters for the Rx descriptors queues are now
> > both updated with the rx_done value: the number of descriptors ready to
> > be returned to the networking controller. Moreover note that there is no
> > point in using different values for this counters because both the
> > mvneta driver and the Ethernet controller are unable to handle holes in
> > the Rx descriptors queues.
> >
> > Signed-off-by: Simon Guinot <simon.guinot@sequanux.org>
> > Fixes: c5aff18204da ("net: mvneta: driver for Marvell Armada 370/XP network unit")
> > Cc: <stable@vger.kernel.org> # v3.8+
> > Tested-by: Yoann Sculo <yoann@sculo.fr>
Hi David,
>
> Failed memory allocations, are normal and if necessary kernel log
> messages will be triggered by the core memory allocator. So there is
> zero reason to do anything other than bump the drop counter in your
> driver.
Sure.
>
> If I understand the rest of your logic, if the allocator fails, we
> will reuse the original SKB and place it back into the RX ring?
> Right?
Yes that's what does the patch.
Without this patch, in case of memory allocation error, the original
buffer is both passed to the networking stack in a SKB _and_ let in
the Rx ring. This leads to various kernel oops and crashes.
Here are the problems with the original code:
- Rx descriptor refilling is tried after passing the SKB to the
networking stack.
- In case of refilling error, the buffer (passed in the SKB) is also
let in the Rx ring (as an unmapped DMA buffer).
- And (always in case of refilling error), the non-occupied counter of
the Rx queue (hardware register) is not incremented. The idea was
maybe to prevent the networking controller to reuse the non-refilled
descriptor. But since this counter is incremented as soon as a next
descriptor is handled successfully, it is not correct.
The patch:
- Moves Rx descriptor refilling ahead of passing the SKB to the
networking stack.
- places the buffer back into the Rx ring in case of refilling error.
- And updates correctly the non-occupied descriptors counter of the Rx
queue.
Simon
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 181 bytes
Desc: Digital signature
URL: <http://lists.infradead.org/pipermail/linux-arm-kernel/attachments/20150716/96102ace/attachment.sig>
WARNING: multiple messages have this Message-ID (diff)
From: Simon Guinot <simon.guinot@sequanux.org>
To: David Miller <davem@davemloft.net>
Cc: thomas.petazzoni@free-electrons.com, jason@lakedaemon.net,
andrew@lunn.ch, gregory.clement@free-electrons.com,
sebastian.hesselbarth@gmail.com, netdev@vger.kernel.org,
linux-arm-kernel@lists.infradead.org, vdonnefort@gmail.com,
yoann@sculo.fr, stable@vger.kernel.org
Subject: Re: [PATCH] net: mvneta: fix refilling for Rx DMA buffers
Date: Thu, 16 Jul 2015 02:25:30 +0200 [thread overview]
Message-ID: <20150716002530.GD10671@kw.sim.vm.gnt> (raw)
In-Reply-To: <20150715.155256.1854323748613951804.davem@davemloft.net>
[-- Attachment #1: Type: text/plain, Size: 3099 bytes --]
On Wed, Jul 15, 2015 at 03:52:56PM -0700, David Miller wrote:
> From: Simon Guinot <simon.guinot@sequanux.org>
> Date: Mon, 13 Jul 2015 00:04:57 +0200
>
> > On some Armada 370-based NAS, I have experimented kernel bugs and
> > crashes when the mvneta Ethernet driver fails to refill Rx DMA buffers
> > due to memory shortage.
> >
> > With the actual code, if the memory allocation fails while refilling a
> > Rx DMA buffer, then the corresponding descriptor is let with the address
> > of an unmapped DMA buffer already passed to the network stack. Since the
> > driver still increments the non-occupied counter for Rx descriptor (if a
> > next packet is handled successfully), then the Ethernet controller is
> > allowed to reuse the unfilled Rx descriptor...
> >
> > As a fix, this patch first refills a Rx descriptor before handling the
> > stored data and unmapping the associated Rx DMA buffer. Additionally the
> > occupied and non-occupied counters for the Rx descriptors queues are now
> > both updated with the rx_done value: the number of descriptors ready to
> > be returned to the networking controller. Moreover note that there is no
> > point in using different values for this counters because both the
> > mvneta driver and the Ethernet controller are unable to handle holes in
> > the Rx descriptors queues.
> >
> > Signed-off-by: Simon Guinot <simon.guinot@sequanux.org>
> > Fixes: c5aff18204da ("net: mvneta: driver for Marvell Armada 370/XP network unit")
> > Cc: <stable@vger.kernel.org> # v3.8+
> > Tested-by: Yoann Sculo <yoann@sculo.fr>
Hi David,
>
> Failed memory allocations, are normal and if necessary kernel log
> messages will be triggered by the core memory allocator. So there is
> zero reason to do anything other than bump the drop counter in your
> driver.
Sure.
>
> If I understand the rest of your logic, if the allocator fails, we
> will reuse the original SKB and place it back into the RX ring?
> Right?
Yes that's what does the patch.
Without this patch, in case of memory allocation error, the original
buffer is both passed to the networking stack in a SKB _and_ let in
the Rx ring. This leads to various kernel oops and crashes.
Here are the problems with the original code:
- Rx descriptor refilling is tried after passing the SKB to the
networking stack.
- In case of refilling error, the buffer (passed in the SKB) is also
let in the Rx ring (as an unmapped DMA buffer).
- And (always in case of refilling error), the non-occupied counter of
the Rx queue (hardware register) is not incremented. The idea was
maybe to prevent the networking controller to reuse the non-refilled
descriptor. But since this counter is incremented as soon as a next
descriptor is handled successfully, it is not correct.
The patch:
- Moves Rx descriptor refilling ahead of passing the SKB to the
networking stack.
- places the buffer back into the Rx ring in case of refilling error.
- And updates correctly the non-occupied descriptors counter of the Rx
queue.
Simon
[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 181 bytes --]
next prev parent reply other threads:[~2015-07-16 0:25 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-07-12 22:04 [PATCH] net: mvneta: fix refilling for Rx DMA buffers Simon Guinot
2015-07-12 22:04 ` Simon Guinot
2015-07-15 22:52 ` David Miller
2015-07-15 22:52 ` David Miller
2015-07-16 0:25 ` Simon Guinot [this message]
2015-07-16 0:25 ` Simon Guinot
2015-07-16 0:29 ` David Miller
2015-07-16 0:29 ` David Miller
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20150716002530.GD10671@kw.sim.vm.gnt \
--to=simon.guinot@sequanux.org \
--cc=linux-arm-kernel@lists.infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.