From: Sagi Grimberg <sagi-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>
To: "Matan Barak (External)"
<matanb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
Christoph Hellwig <hch-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
Cc: Doug Ledford <dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
Majd Dibbiny <majd-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
Subject: Re: [PATCH for-next 0/2] IB/mlx5: Use tasklet to decrease completions processing time in interrupts
Date: Mon, 18 Apr 2016 17:33:46 +0300 [thread overview]
Message-ID: <5714F04A.9020406@grimberg.me> (raw)
In-Reply-To: <5714DF68.6040509-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
Hey Matan, Christoph,
>> Just curious: how much of this time is spent inside the mlx5 driver,
>> and how much is spent in the callbacks from the consumers? We've now
>> more than half done with switch the kernel ULPs to the new CQ API
>> which will always offload the callbacks to softirq or workqueue context,
>> so if we can avoid a previous offload the completions would be a lot
>> more efficient.
>>
>
> In short, you could hit a situation where processing the completions in
> the interrupt takes longer than the rate at which they arrive (lab cases
> that use one event queue, but still).
> I agree that going to softirqs/WQs (like the rest of the offloads) is a
> good solution too - maybe even better than this one as the mechanism
> already exists, but why would it be a lot more efficient?
The reasons are:
- irq_poll mechanism correctly budgets the time you spend in soft-IRQ.
- it maintains fairness for all the CQs directed to the same EQ.
- it has the perk that you only re-arm the CQ when you consumed all the
completions (without staying in soft-IRQ forever).
Basically it's the same answer as to why using napi is better...
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2016-04-18 14:33 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-04-17 14:08 [PATCH for-next 0/2] IB/mlx5: Use tasklet to decrease completions processing time in interrupts Matan Barak
[not found] ` <1460902121-5567-1-git-send-email-matanb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2016-04-17 14:08 ` [PATCH for-next 1/2] net/mlx5_core: Use tasklet for user-space CQ completion events Matan Barak
2016-04-17 14:08 ` [PATCH for-next 2/2] IB/mlx5: Fire the CQ completion handler from tasklet Matan Barak
2016-04-18 13:04 ` [PATCH for-next 0/2] IB/mlx5: Use tasklet to decrease completions processing time in interrupts Christoph Hellwig
[not found] ` <20160418130456.GA11508-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2016-04-18 13:21 ` Matan Barak (External)
[not found] ` <5714DF68.6040509-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2016-04-18 14:33 ` Sagi Grimberg [this message]
2016-05-13 20:16 ` Doug Ledford
[not found] ` <a93b20ca-42bf-ca2b-2995-aa2837a1bafe-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2016-05-15 7:31 ` Matan Barak
[not found] ` <868e5bcf-18c5-30f4-fe3f-b361c0ce43ec-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2016-05-18 14:48 ` Doug Ledford
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=5714F04A.9020406@grimberg.me \
--to=sagi-nqwnxtmzq1alnmji0ikvqw@public.gmane.org \
--cc=dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org \
--cc=hch-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=majd-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
--cc=matanb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox