From: Roland Dreier <rdreier-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
To: Ralph Campbell <ralph.campbell-h88ZbnxC6KDQT0dZR+AlfA@public.gmane.org>
Cc: "linux-rdma@vger.kernel.org"
<linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>
Subject: Re: [PATCH 1/3] IB/core: use IB_CQ_REPORT_MISSED_EVENTS to avoid missed CQ callbacks
Date: Wed, 31 Mar 2010 17:12:05 -0700 [thread overview]
Message-ID: <ada4ojwghey.fsf@roland-alpha.cisco.com> (raw)
In-Reply-To: <1270063245.4192.299.camel-/vjeY7uYZjrPXfVEPVhPGq6RkeBMCJyt@public.gmane.org> (Ralph Campbell's message of "Wed, 31 Mar 2010 12:20:45 -0700")
> The way I understand the sequence of events w/o the
> patch is:
>
> ib_req_notify_cq(IB_CQ_NEXT_COMP)
> CQE 1 added to queue
> callback scheduled via tasklet
> future callbacks disarmed
> callback function calls ib_req_notify_cq(IB_CQ_NEXT_COMP)
> callback function calls ib_poll_cq() and gets CQE 1
> callback function calls ib_poll_cq() and gets none
> CQE 2 added to queue via IRQ
> callback scheduled via tasklet
> future callbacks disarmed
> callback function returns
> some time later, tasklet runs and calls CQ callback function.
> callback function calls ib_req_notify_cq(IB_CQ_NEXT_COMP)
> callback function calls ib_poll_cq() and gets CQE 2
>
> Since a tasklet or workqueue can be scheduled in the
> callback function, the second CQE isn't "missed" but
> there is a scheduling delay before the callback happens
> and sees CQE 2.
Sure but a tasklet at least is likely to have pretty low latency. And
maybe there's a better chance of batching completion processing by
introducing a little delay there. So maybe it helps, maybe it doesn't.
> I'm willing to withdraw the 1-3 patches.
>
> I still don't understand why the timing difference matters
> to RDS.
I'd like to have some data showing an improvement before making this
change. And as I already said it would be good to know what's really
going on with RDS before we change that.
- R.
--
Roland Dreier <rolandd-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org> || For corporate legal information go to:
http://www.cisco.com/web/about/doing_business/legal/cri/index.html
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2010-04-01 0:12 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-03-31 17:57 [PATCH 0/3] best practice for setting IB_CQ_REPORT_MISSED_EVENTS Ralph Campbell
[not found] ` <20100331175742.24522.17850.stgit-/vjeY7uYZjrPXfVEPVhPGq6RkeBMCJyt@public.gmane.org>
2010-03-31 17:57 ` [PATCH 1/3] IB/core: use IB_CQ_REPORT_MISSED_EVENTS to avoid missed CQ callbacks Ralph Campbell
[not found] ` <20100331175747.24522.88472.stgit-/vjeY7uYZjrPXfVEPVhPGq6RkeBMCJyt@public.gmane.org>
2010-03-31 18:07 ` Sean Hefty
2010-03-31 18:17 ` Roland Dreier
[not found] ` <ada4ojwjqz7.fsf-BjVyx320WGW9gfZ95n9DRSW4+XlvGpQz@public.gmane.org>
2010-03-31 19:20 ` Ralph Campbell
[not found] ` <1270063245.4192.299.camel-/vjeY7uYZjrPXfVEPVhPGq6RkeBMCJyt@public.gmane.org>
2010-04-01 0:12 ` Roland Dreier [this message]
[not found] ` <ada4ojwghey.fsf-BjVyx320WGW9gfZ95n9DRSW4+XlvGpQz@public.gmane.org>
2010-04-02 19:54 ` Andy Grover
2010-03-31 17:57 ` [PATCH 2/3] IB/srp: " Ralph Campbell
[not found] ` <20100331175752.24522.66519.stgit-/vjeY7uYZjrPXfVEPVhPGq6RkeBMCJyt@public.gmane.org>
2010-03-31 18:11 ` Bart Van Assche
[not found] ` <y2ie2e108261003311111uec1ec00g746ba0ffe3d98799-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2010-03-31 18:18 ` Roland Dreier
[not found] ` <adazl1oiccb.fsf-BjVyx320WGW9gfZ95n9DRSW4+XlvGpQz@public.gmane.org>
2010-03-31 18:36 ` Bart Van Assche
[not found] ` <u2ze2e108261003311136l4bcf1627n9ba4d3414167eef3-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2010-03-31 18:57 ` Roland Dreier
[not found] ` <adask7giak4.fsf-BjVyx320WGW9gfZ95n9DRSW4+XlvGpQz@public.gmane.org>
2010-03-31 19:16 ` Bart Van Assche
2010-03-31 17:57 ` [PATCH 3/3] IB/iser: " Ralph Campbell
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ada4ojwghey.fsf@roland-alpha.cisco.com \
--to=rdreier-fyb4gu1cfyuavxtiumwx3w@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=ralph.campbell-h88ZbnxC6KDQT0dZR+AlfA@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox