public inbox for linux-rdma@vger.kernel.org
 help / color / mirror / Atom feed
From: "Bob Pearson" <rpearson-klaOcWyJdxkshyMvu7JE4pqQE7yCjDx5@public.gmane.org>
To: 'Roland Dreier' <roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>,
	'Or Gerlitz' <or.gerlitz-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>,
	Jim Schutt <jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
Cc: 'Or Gerlitz' <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
	'linux-rdma' <linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	'Vladimir Sokolovsky'
	<vlad-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org>
Subject: RE: [PATCH] mlx4: allow for 4K mtu configuration of IB ports
Date: Wed, 25 May 2011 17:19:15 -0500	[thread overview]
Message-ID: <055701cc1b29$c8fcc6c0$5af65440$@systemfabricworks.com> (raw)
In-Reply-To: <BANLkTikrJ_3f+LwN_R=-AcwCde-KdHJhOQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>

With lash+mesh redsky required 6-7 VLs to wire up without deadlocks. I think
that Jim's version uses 8 SLs but only 2VLs to work.
If someone was using a torus and also wanted to support QOS and also wanted
to separate multicast and management on a separate VL to be absolutely sure
that there is no possibility of a deadlock you might end up with #QOS * 2 +
1 which would be 5 using the current algorithm.

-----Original Message-----
From: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
[mailto:linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org] On Behalf Of Roland Dreier
Sent: Wednesday, May 25, 2011 4:28 PM
To: Or Gerlitz
Cc: Or Gerlitz; linux-rdma; Vladimir Sokolovsky
Subject: Re: [PATCH] mlx4: allow for 4K mtu configuration of IB ports

On Wed, May 25, 2011 at 2:05 PM, Or Gerlitz <or.gerlitz-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
>> Does anyone really care about max VL cap with 2K MTU?
>
> I'm not with you... can you elaborate a little further here? the 
> current HW generation support four VLs with 4k mtu, newer HW might 
> support more.

I mean is there anyone who really uses >4 VLs?  Presumably the HW designers
didn't think so, because they limited HW to 4 VLs with 4K MTU.

At least can we make this a runtime thing?  If we're able to set a port as
IB vs ethernet then # of VLs seems like it should be doable too.

And 4K MTU should probably be the default, since almost all users want 4K
MTU vs. caring about VLs.  (Probably 99% of IB users never set SL of
anything)

 - R.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the
body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at
http://vger.kernel.org/majordomo-info.html

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2011-05-25 22:19 UTC|newest]

Thread overview: 18+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-05-25 12:10 [PATCH] mlx4: allow for 4K mtu configuration of IB ports Or Gerlitz
     [not found] ` <alpine.LRH.2.00.1105251507140.16147-VYr5/9ddeaGSIdy2EShu12Xnswh1EIUO@public.gmane.org>
2011-05-25 16:13   ` Roland Dreier
     [not found]     ` <BANLkTi=bKdVXm+f+HVeg2tBzT4RBJDCN_w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-25 21:05       ` Or Gerlitz
     [not found]         ` <BANLkTinDCbPXi8zS46wcVW_Yn0fxzbSikw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-25 21:27           ` Roland Dreier
     [not found]             ` <BANLkTikrJ_3f+LwN_R=-AcwCde-KdHJhOQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-25 21:46               ` Or Gerlitz
     [not found]                 ` <BANLkTinT5OJdP38Xq=PCtx1wgxDhjVfndA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-25 22:07                   ` Jason Gunthorpe
2011-05-25 22:10                   ` Roland Dreier
     [not found]                     ` <BANLkTi=NkZQX2JFa99qkVpLAchRjNoYOhg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-26  6:24                       ` Or Gerlitz
     [not found]                         ` <4DDDF212.4080700-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2011-05-26 15:53                           ` Roland Dreier
     [not found]                             ` <BANLkTimrm7bqTT8qAzxdf9tsJuv7+NPO+g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-30 22:12                               ` Or Gerlitz
2011-05-25 22:19               ` Bob Pearson [this message]
2011-05-25 23:14                 ` Roland Dreier
     [not found]                   ` <BANLkTikLeWHYLKrX8O=syt-Q+b6LP2PCtw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-26  6:18                     ` Or Gerlitz
     [not found]                       ` <4DDDF0B1.6090305-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2011-05-26 14:24                         ` Jim Schutt
     [not found]                       ` <17495_1306419903_p4QEMqSb018281_4DDE6291.1090809@sandia.gov>
     [not found]                         ` <17495_1306419903_p4QEMqSb018281_4DDE6291.1090809-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
2011-05-26 14:30                           ` Jim Schutt
     [not found]                             ` <4DDE63F9.8060502-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
2011-05-26 15:56                               ` Roland Dreier
     [not found]                                 ` <BANLkTimGioibPTUYV046ObOPhHntHxx72w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-30 22:07                                   ` Or Gerlitz
     [not found]                                     ` <BANLkTinK+YHUyF4ThHQAwFeZ4FNswpY-tw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2011-05-31 16:11                                       ` Jim Schutt

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='055701cc1b29$c8fcc6c0$5af65440$@systemfabricworks.com' \
    --to=rpearson-klaocwyjdxkshymvu7je4pqqe7ycjdx5@public.gmane.org \
    --cc=jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
    --cc=or.gerlitz-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org \
    --cc=roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
    --cc=vlad-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox