From: Or Gerlitz <or.gerlitz@gmail.com>
To: Pawit Pornkitprasan <p.pawit@gmail.com>
Cc: netdev@vger.kernel.org,
Ryousei Takano <takano-ryousei@aist.go.jp>,
"Rose, Gregory V" <gregory.v.rose@intel.com>,
Stephen Hemminger <stephen@networkplumber.org>,
Amir Vadai <amirv@mellanox.com>, Yan Burman <yanb@mellanox.com>
Subject: Re: PROBLEM: Bridging does not work with Mellanox ConnectX-2 (mlx4_en) card in SR-IOV mode
Date: Mon, 24 Jun 2013 22:42:10 +0300 [thread overview]
Message-ID: <CAJZOPZLCG8_zfsP76EnEcGj3nUfP9batXMfvOqsPyNc63JqLSA@mail.gmail.com> (raw)
In-Reply-To: <CAJA5wJQDRztwtMxJopUWfmqEOH39Xp0g-hCrY8gMZ2TKccSuhw@mail.gmail.com>
On Mon, Jun 24, 2013 at 10:55 AM, Pawit Pornkitprasan <p.pawit@gmail.com> wrote:
> [1.] One line summary of the problem:
> Bridging does not work with Mellanox ConnectX-2 (mlx4_en) card in SR-IOV mode
>
> [2.] Full description of the problem/report:
> I am using Mellanox ConnectX-2 card with SR-IOV support enabled.
> (options mlx4_core num_vfs=8). When I use the device as a part of the
> bridge, devices behind the bridge can see broadcast network packets,
> but cannot see unicast packets directed to them. Devices behind the
> bridge can send packets properly (though not so useful since it cannot
> receive any reply). Further detail provided under reproduction
> section.
>
> When SR-IOV is disabled (num_vfs=0), bridging works as expected
>
> [3.] Keywords (i.e., modules, networking, kernel):
> mlx4_en, networking, sr-iov, bridge
>
> [4.] Kernel information
> [4.1.] Kernel version (from /proc/version):
> Linux version 3.10.0-rc7+ (root@khonmek-16) (gcc version 4.7.3
> (Ubuntu/Linaro 4.7.3-1ubuntu1) ) #1 SMP Mon Jun 24 11:42:32 JST 2013
Pawit,
As Greg indicdated, this (== stetting a bridge over a PF or VF in
SRIOV moded) can actually work, if you make sure to use FDB operations
to add the VM unicast MAC to the uplink (the mellanox device) tables,
this is trivial (google for ndo_fdb_add ...) and should work, let us
know if it doesn't.
> also happens with latest Ubuntu-Raring kernel
> Linux version 3.8.0-25-generic (buildd@roseapple) (gcc version 4.7.3
> (Ubuntu/Linaro 4.7.3-1ubuntu1) ) #37-Ubuntu SMP Thu Jun 6 20:47:07 UTC 2013
so on 3.10 it "just" doesn't work (but should as I explained above)
but on 3.8 you're crashing? can you send the oops listings?
Or.
next prev parent reply other threads:[~2013-06-24 19:42 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-06-24 7:55 PROBLEM: Bridging does not work with Mellanox ConnectX-2 (mlx4_en) card in SR-IOV mode Pawit Pornkitprasan
2013-06-24 15:42 ` Stephen Hemminger
2013-06-24 16:48 ` Greg Rose
2013-06-24 19:42 ` Or Gerlitz [this message]
2013-06-24 22:45 ` Pawit Pornkitprasan
2013-06-25 0:46 ` Pawit Pornkitprasan
2013-06-25 5:36 ` Or Gerlitz
2013-06-25 6:13 ` John Fastabend
2013-06-25 13:44 ` Michael S. Tsirkin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAJZOPZLCG8_zfsP76EnEcGj3nUfP9batXMfvOqsPyNc63JqLSA@mail.gmail.com \
--to=or.gerlitz@gmail.com \
--cc=amirv@mellanox.com \
--cc=gregory.v.rose@intel.com \
--cc=netdev@vger.kernel.org \
--cc=p.pawit@gmail.com \
--cc=stephen@networkplumber.org \
--cc=takano-ryousei@aist.go.jp \
--cc=yanb@mellanox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).