All of lore.kernel.org
 help / color / mirror / Atom feed
From: Santosh <santosh.shilimkar@ti.com>
To: ming.lei@canonical.com
Cc: greg@kroah.com, linux-omap@vger.kernel.org,
	stern@rowland.harvard.edu, linux-usb@vger.kernel.org,
	linux-arm-kernel@lists.infradead.org
Subject: Re: [PATCH] usb: ehci: fix update qtd->token in qh_append_tds
Date: Sat, 27 Aug 2011 20:33:50 +0530	[thread overview]
Message-ID: <4E590756.9030307@ti.com> (raw)
In-Reply-To: <1314456515-16419-1-git-send-email-ming.lei@canonical.com>

Hi,

On Saturday 27 August 2011 08:18 PM, ming.lei@canonical.com wrote:
> From: Ming Lei<ming.lei@canonical.com>
>
> This patch fixs one performance bug on ARM Cortex A9 dual core platform,
> which has been reported on quite a few ARM machines(OMAP4, Tegra 2, snowball...),
> see details from link of https://bugs.launchpad.net/bugs/709245.
>
> In fact, one mb() on ARM is enough to flush L2 cache, but
> 'dummy->hw_token = token;' after mb() is added just for obeying
> correct mb() usage.
>
Who said "one mb() on ARM is enough to flush L2 cache" ?
It's just a memory barrier and it doesn't flush any cache.
What it cleans is the CPU write buffers and the L2 cache
write buffers.

> The patch has been tested ok on OMAP4 panda A1 board, the performance
> of 'dd' over usb mass storage can be increased from 4~5MB/sec to
> 14~16MB/sec after applying this patch.
>
Though number looks great, how is the below patch helping to get better
numbers.

> Signed-off-by: Ming Lei<ming.lei@canonical.com>
> ---
>   drivers/usb/host/ehci-q.c |   14 ++++++++++++++
>   1 files changed, 14 insertions(+), 0 deletions(-)
>
> diff --git a/drivers/usb/host/ehci-q.c b/drivers/usb/host/ehci-q.c
> index 0917e3a..65b5021 100644
> --- a/drivers/usb/host/ehci-q.c
> +++ b/drivers/usb/host/ehci-q.c
> @@ -1082,6 +1082,20 @@ static struct ehci_qh *qh_append_tds (
>   			wmb ();
>   			dummy->hw_token = token;
>
> +			/* The mb() below is added to make sure that
> +			 * 'token' can be writen into qtd, so that ehci
> +			 * HC can see the up-to-date qtd descriptor. On
> +			 * some archs(at least on ARM Cortex A9 dual core),
> +			 * writing into coherenet memory doesn't mean the
> +			 * value written can reach physical memory
> +			 * immediately, and the value may be buffered
> +			 * inside L2 cache. 'dummy->hw_token = token;'
> +			 * after mb() is added for obeying correct mb()
> +			 * usage.
> +			 * */
> +			mb();
> +			token = dummy->hw_token;
> +

This patch at max fix some corruption if the memory buffer
used is buffer-able. Infact I see there is already a write memory
barrier above. So just pushing that down by one line should
be enough.

 >   			dummy->hw_token = token;
 >   			wmb ();

Is there another patch along with this which removes, some cache clean
on this buffer ?

Regards
Santosh

WARNING: multiple messages have this Message-ID (diff)
From: santosh.shilimkar@ti.com (Santosh)
To: linux-arm-kernel@lists.infradead.org
Subject: [PATCH] usb: ehci: fix update qtd->token in qh_append_tds
Date: Sat, 27 Aug 2011 20:33:50 +0530	[thread overview]
Message-ID: <4E590756.9030307@ti.com> (raw)
In-Reply-To: <1314456515-16419-1-git-send-email-ming.lei@canonical.com>

Hi,

On Saturday 27 August 2011 08:18 PM, ming.lei at canonical.com wrote:
> From: Ming Lei<ming.lei@canonical.com>
>
> This patch fixs one performance bug on ARM Cortex A9 dual core platform,
> which has been reported on quite a few ARM machines(OMAP4, Tegra 2, snowball...),
> see details from link of https://bugs.launchpad.net/bugs/709245.
>
> In fact, one mb() on ARM is enough to flush L2 cache, but
> 'dummy->hw_token = token;' after mb() is added just for obeying
> correct mb() usage.
>
Who said "one mb() on ARM is enough to flush L2 cache" ?
It's just a memory barrier and it doesn't flush any cache.
What it cleans is the CPU write buffers and the L2 cache
write buffers.

> The patch has been tested ok on OMAP4 panda A1 board, the performance
> of 'dd' over usb mass storage can be increased from 4~5MB/sec to
> 14~16MB/sec after applying this patch.
>
Though number looks great, how is the below patch helping to get better
numbers.

> Signed-off-by: Ming Lei<ming.lei@canonical.com>
> ---
>   drivers/usb/host/ehci-q.c |   14 ++++++++++++++
>   1 files changed, 14 insertions(+), 0 deletions(-)
>
> diff --git a/drivers/usb/host/ehci-q.c b/drivers/usb/host/ehci-q.c
> index 0917e3a..65b5021 100644
> --- a/drivers/usb/host/ehci-q.c
> +++ b/drivers/usb/host/ehci-q.c
> @@ -1082,6 +1082,20 @@ static struct ehci_qh *qh_append_tds (
>   			wmb ();
>   			dummy->hw_token = token;
>
> +			/* The mb() below is added to make sure that
> +			 * 'token' can be writen into qtd, so that ehci
> +			 * HC can see the up-to-date qtd descriptor. On
> +			 * some archs(at least on ARM Cortex A9 dual core),
> +			 * writing into coherenet memory doesn't mean the
> +			 * value written can reach physical memory
> +			 * immediately, and the value may be buffered
> +			 * inside L2 cache. 'dummy->hw_token = token;'
> +			 * after mb() is added for obeying correct mb()
> +			 * usage.
> +			 * */
> +			mb();
> +			token = dummy->hw_token;
> +

This patch at max fix some corruption if the memory buffer
used is buffer-able. Infact I see there is already a write memory
barrier above. So just pushing that down by one line should
be enough.

 >   			dummy->hw_token = token;
 >   			wmb ();

Is there another patch along with this which removes, some cache clean
on this buffer ?

Regards
Santosh

  reply	other threads:[~2011-08-27 15:03 UTC|newest]

Thread overview: 53+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-08-27 14:48 [PATCH] usb: ehci: fix update qtd->token in qh_append_tds ming.lei-Z7WLFzj8eWMS+FvcfC7Uqw
2011-08-27 14:48 ` ming.lei at canonical.com
2011-08-27 15:03 ` Santosh [this message]
2011-08-27 15:03   ` Santosh
     [not found]   ` <4E590756.9030307-l0cyMroinI0@public.gmane.org>
2011-08-27 15:18     ` Ming Lei
2011-08-27 15:18       ` Ming Lei
     [not found]       ` <CACVXFVPPPUsntdCT=m=vRJ9XVksn6rGMzqJVvdD+sj=eOcTadg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-08-27 15:46         ` Santosh
2011-08-27 15:46           ` Santosh
     [not found] ` <1314456515-16419-1-git-send-email-ming.lei-Z7WLFzj8eWMS+FvcfC7Uqw@public.gmane.org>
2011-08-27 15:13   ` Greg KH
2011-08-27 15:13     ` Greg KH
2011-08-27 15:33     ` Ming Lei
2011-08-27 15:33       ` Ming Lei
2011-08-27 16:07       ` Greg KH
2011-08-27 16:07         ` Greg KH
2011-08-27 16:57         ` Ming Lei
2011-08-27 16:57           ` Ming Lei
     [not found]           ` <CACVXFVNz_ic_PPM_vNn1Dz85A2z94kRFso4rcqrvJfuLSqRSCg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-08-27 17:20             ` Ming Lei
2011-08-27 17:20               ` Ming Lei
2011-08-27 20:11               ` Alan Stern
2011-08-27 20:11                 ` Alan Stern
2011-08-28  3:35                 ` Ming Lei
2011-08-28  3:35                   ` Ming Lei
2011-08-27 20:06           ` Alan Stern
2011-08-27 20:06             ` Alan Stern
2011-08-28  3:13             ` Ming Lei
2011-08-28  3:13               ` Ming Lei
     [not found]               ` <CACVXFVP8Lr=ggH4FjvMQd6r9poLAT1r+_S3Z-NimP0i08DsQ8g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-08-28 17:00                 ` Alan Stern
2011-08-28 17:00                   ` Alan Stern
2011-08-28 23:36                   ` Russell King - ARM Linux
2011-08-28 23:36                     ` Russell King - ARM Linux
2011-08-29  1:51                     ` Alan Stern
2011-08-29  1:51                       ` Alan Stern
2011-08-29  8:52                       ` Russell King - ARM Linux
2011-08-29  8:52                         ` Russell King - ARM Linux
2011-08-29 13:57                         ` Alan Stern
2011-08-29 13:57                           ` Alan Stern
     [not found]                           ` <Pine.LNX.4.44L0.1108290951250.2525-100000-IYeN2dnnYyZXsRXLowluHWD2FQJk+8+b@public.gmane.org>
2011-08-29 15:55                             ` Ming Lei
2011-08-29 15:55                               ` Ming Lei
2011-08-29 16:24                               ` Mark Salter
2011-08-29 16:24                                 ` Mark Salter
     [not found]                   ` <Pine.LNX.4.44L0.1108281233270.3742-100000-pYrvlCTfrz9XsRXLowluHWD2FQJk+8+b@public.gmane.org>
2011-08-29 14:25                     ` Ming Lei
2011-08-29 14:25                       ` Ming Lei
     [not found]                       ` <CACVXFVOvw6bSfcOYR2RWJO=k1WLgSCUygmSwZmtRDdM_tZNWEA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-08-29 15:03                         ` Alan Stern
2011-08-29 15:03                           ` Alan Stern
     [not found]                           ` <Pine.LNX.4.44L0.1108291046540.2525-100000-IYeN2dnnYyZXsRXLowluHWD2FQJk+8+b@public.gmane.org>
2011-08-29 15:21                             ` Ming Lei
2011-08-29 15:21                               ` Ming Lei
2011-08-29 16:33                               ` Alan Stern
2011-08-29 16:33                                 ` Alan Stern
     [not found]                                 ` <Pine.LNX.4.44L0.1108291218040.2525-100000-IYeN2dnnYyZXsRXLowluHWD2FQJk+8+b@public.gmane.org>
2011-08-30 14:02                                   ` Ming Lei
2011-08-30 14:02                                     ` Ming Lei
2011-08-27 16:31   ` Sergei Shtylyov
2011-08-27 16:31     ` Sergei Shtylyov
  -- strict thread matches above, loose matches on Subject: below --
2011-08-27 14:46 ming.lei-Z7WLFzj8eWMS+FvcfC7Uqw

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4E590756.9030307@ti.com \
    --to=santosh.shilimkar@ti.com \
    --cc=greg@kroah.com \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-omap@vger.kernel.org \
    --cc=linux-usb@vger.kernel.org \
    --cc=ming.lei@canonical.com \
    --cc=stern@rowland.harvard.edu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.