* Re: [PATCH] PCI/IOV: "virtfn4294967295\0" requires 17 bytes
2022-12-18 22:19 ` Matthew Wilcox
@ 2022-12-18 23:24 ` Alexey V. Vissarionov
2022-12-19 10:16 ` Niklas Schnelle
2022-12-29 18:12 ` Bjorn Helgaas
2 siblings, 0 replies; 9+ messages in thread
From: Alexey V. Vissarionov @ 2022-12-18 23:24 UTC (permalink / raw)
To: Matthew Wilcox
Cc: Alexey V. Vissarionov, Krzysztof Wilczyński, Bjorn Helgaas,
Alex Williamson, Jesse Barnes, Yu Zhao, linux-pci, lvc-project
On 2022-12-18 22:19:24 +0000, Matthew Wilcox wrote:
>>> Thank you for sending the patch over! However, if possible,
>>> can you send it as plain text without any multi-part MIME
>>> involved?
>> ACK.
>>> If possible, it would be nice to mention that this needed
>>> to make sure that there is enough space to correctly
>>> NULL-terminate the ID string.
>> ACK.
>> So, here goes the corrected text:
>> Although unlikely, the 'id' value may be as big as 4294967295
>> (uint32_max) and "virtfn4294967295\0" would require 17 bytes
>> instead of 16 to make sure that buffer has enough space to
>> properly NULL-terminate the ID string.
> Wait, what? How can we get to a number that large for the
> virtual function ID? devfn is 8 bits, bus is a further 8 bits.
> Sure, domain is an extra 16 bits on top of that but I'm pretty
> sure that virtual functions can't span multiple domains.
> Unless that's changed recently? Even if they can, we'd need
> to span 2^14 domains to get up to a billion IDs. That's a
> hell of a system and I think overflowing here is the least
> of our problems.
Possibly in some synthetic cases this may be achieved with some
specially crafted "BadPCI" (similar to "BadUSB") device...
> So while this is typed as u32, I don't think it can get
> anywhere close.
Anyway, the final decision is up to you.
--
Alexey V. Vissarionov
gremlin ПРИ altlinux ТЧК org; +vii-cmiii-ccxxix-lxxix-xlii
GPG: 0D92F19E1C0DC36E27F61A29CD17E2B43D879005 @ hkp://keys.gnupg.net
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [PATCH] PCI/IOV: "virtfn4294967295\0" requires 17 bytes
2022-12-18 22:19 ` Matthew Wilcox
2022-12-18 23:24 ` Alexey V. Vissarionov
@ 2022-12-19 10:16 ` Niklas Schnelle
2022-12-29 18:12 ` Bjorn Helgaas
2 siblings, 0 replies; 9+ messages in thread
From: Niklas Schnelle @ 2022-12-19 10:16 UTC (permalink / raw)
To: Matthew Wilcox, Alexey V. Vissarionov
Cc: Krzysztof Wilczyński, Bjorn Helgaas, Alex Williamson,
Jesse Barnes, Yu Zhao, linux-pci, lvc-project
On Sun, 2022-12-18 at 22:19 +0000, Matthew Wilcox wrote:
> On Sun, Dec 18, 2022 at 03:21:39PM +0300, Alexey V. Vissarionov wrote:
> > On 2022-12-18 19:57:02 +0900, Krzysztof Wilczyński wrote:
> >
> > > Thank you for sending the patch over! However, if possible,
> > > can you send it as plain text without any multi-part MIME
> > > involved?
> >
> > ACK.
> >
> > > If possible, it would be nice to mention that this needed
> > > to make sure that there is enough space to correctly
> > > NULL-terminate the ID string.
> >
> > ACK.
> >
> > So, here goes the corrected text:
> >
> > Although unlikely, the 'id' value may be as big as 4294967295
> > (uint32_max) and "virtfn4294967295\0" would require 17 bytes
> > instead of 16 to make sure that buffer has enough space to
> > properly NULL-terminate the ID string.
>
> Wait, what? How can we get to a number that large for the virtual
> function ID? devfn is 8 bits, bus is a further 8 bits. Sure, domain
> is an extra 16 bits on top of that but I'm pretty sure that virtual
> functions can't span multiple domains. Unless that's changed recently?
>
> Even if they can, we'd need to span 2^14 domains to get up to a billion
> IDs. That's a hell of a system and I think overflowing here is the
> least of our problems.
>
> So while this is typed as u32, I don't think it can get anywhere close.
While we can't realistically get such high IDs on s390 at the moment
it's important to note that we do use the PCI domains differently and
will use the entire 16 bit namespace. As s390 aka mainframes always has
a virtualization layer which does the PCI enumeration for us and just
presents us with single PCI functions from which we reconstruct a PCI
hiearchy. Historically the only PCI devices available were Virtual
Functions which then use bus and devfn 0 with either an incrementing or
user defined domain ID as virtual PCI domain. Meaning that
"ffff:00:00.0" can and does occur. Since commit d1379279f2d6b
("s390/pci: Handling multifunctions") we may also present multiple
functions under the same domain with the a local topology matching the
hardware, though currently limited to a single fixed bus 0, but still
with a virtual and user defined domain ID. So at least on s390 we would
"only" need 2^16 VFs to see ffff:ff:ff.f.
That said, as far as I can tell this wouldn't actually create a virtfn
ID of such a high value as I don't think the domain actually plays into
that. For example with the following (sub) topology of 2 PFs with 4 VFs
each:
+-[0008:00]-+-00.0 Mellanox Technologies MT28800 Family [ConnectX-5 Ex]
| +-00.1 Mellanox Technologies MT28800 Family [ConnectX-5 Ex]
| +-00.2 Mellanox Technologies MT28800 Family [ConnectX-5 Ex Virtual Function]
| +-00.3 Mellanox Technologies MT28800 Family [ConnectX-5 Ex Virtual Function]
| +-00.4 Mellanox Technologies MT28800 Family [ConnectX-5 Ex Virtual Function]
| +-00.5 Mellanox Technologies MT28800 Family [ConnectX-5 Ex Virtual Function]
| +-08.2 Mellanox Technologies MT28800 Family [ConnectX-5 Ex Virtual Function]
| +-08.3 Mellanox Technologies MT28800 Family [ConnectX-5 Ex Virtual Function]
| +-08.4 Mellanox Technologies MT28800 Family [ConnectX-5 Ex Virtual Function]
| \-08.5 Mellanox Technologies MT28800 Family [ConnectX-5 Ex Virtual Function]
I actually get:
# ls -l /sys/bus/pci/devices/0008\:00\:00.0/virtfn*
... /sys/bus/pci/devices/0008:00:00.0/virtfn0 -> ../0008:00:00.2
... /sys/bus/pci/devices/0008:00:00.0/virtfn1 -> ../0008:00:00.3
... /sys/bus/pci/devices/0008:00:00.0/virtfn2 -> ../0008:00:00.4
... /sys/bus/pci/devices/0008:00:00.0/virtfn3 -> ../0008:00:00.5
# ls -l /sys/bus/pci/devices/0008\:00\:00.1/virtfn*
... /sys/bus/pci/devices/0008:00:00.1/virtfn0 -> ../0008:00:08.2
... /sys/bus/pci/devices/0008:00:00.1/virtfn1 -> ../0008:00:08.3
... /sys/bus/pci/devices/0008:00:00.1/virtfn2 -> ../0008:00:08.4
... /sys/bus/pci/devices/0008:00:00.1/virtfn3 -> ../0008:00:08.5
Thanks,
Niklas
^ permalink raw reply [flat|nested] 9+ messages in thread* Re: [PATCH] PCI/IOV: "virtfn4294967295\0" requires 17 bytes
2022-12-18 22:19 ` Matthew Wilcox
2022-12-18 23:24 ` Alexey V. Vissarionov
2022-12-19 10:16 ` Niklas Schnelle
@ 2022-12-29 18:12 ` Bjorn Helgaas
2022-12-29 21:09 ` Matthew Wilcox
2 siblings, 1 reply; 9+ messages in thread
From: Bjorn Helgaas @ 2022-12-29 18:12 UTC (permalink / raw)
To: Matthew Wilcox
Cc: Alexey V. Vissarionov, Krzysztof Wilczyński, Bjorn Helgaas,
Alex Williamson, Jesse Barnes, Yu Zhao, linux-pci, lvc-project
On Sun, Dec 18, 2022 at 10:19:24PM +0000, Matthew Wilcox wrote:
> On Sun, Dec 18, 2022 at 03:21:39PM +0300, Alexey V. Vissarionov wrote:
> > On 2022-12-18 19:57:02 +0900, Krzysztof Wilczyński wrote:
> ...
> > Although unlikely, the 'id' value may be as big as 4294967295
> > (uint32_max) and "virtfn4294967295\0" would require 17 bytes
> > instead of 16 to make sure that buffer has enough space to
> > properly NULL-terminate the ID string.
>
> Wait, what? How can we get to a number that large for the virtual
> function ID? devfn is 8 bits, bus is a further 8 bits. Sure, domain
> is an extra 16 bits on top of that but I'm pretty sure that virtual
> functions can't span multiple domains. Unless that's changed recently?
>
> Even if they can, we'd need to span 2^14 domains to get up to a billion
> IDs. That's a hell of a system and I think overflowing here is the
> least of our problems.
>
> So while this is typed as u32, I don't think it can get anywhere close.
Is there an argument *against* this patch (as opposed to "this is
probably unnecessary and it requires a lot of analysis to prove that
we don't need it")?
My biggest concern here is that there's no connection between the
VIRTFN_ID_LEN definition and the use. Even a comment about how the
value of 16 or 17 was derived would help.
Bjorn
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [PATCH] PCI/IOV: "virtfn4294967295\0" requires 17 bytes
2022-12-29 18:12 ` Bjorn Helgaas
@ 2022-12-29 21:09 ` Matthew Wilcox
0 siblings, 0 replies; 9+ messages in thread
From: Matthew Wilcox @ 2022-12-29 21:09 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: Alexey V. Vissarionov, Krzysztof Wilczyński, Bjorn Helgaas,
Alex Williamson, Jesse Barnes, Yu Zhao, linux-pci, lvc-project
On Thu, Dec 29, 2022 at 12:12:58PM -0600, Bjorn Helgaas wrote:
> On Sun, Dec 18, 2022 at 10:19:24PM +0000, Matthew Wilcox wrote:
> > On Sun, Dec 18, 2022 at 03:21:39PM +0300, Alexey V. Vissarionov wrote:
> > > On 2022-12-18 19:57:02 +0900, Krzysztof Wilczyński wrote:
> > ...
>
> > > Although unlikely, the 'id' value may be as big as 4294967295
> > > (uint32_max) and "virtfn4294967295\0" would require 17 bytes
> > > instead of 16 to make sure that buffer has enough space to
> > > properly NULL-terminate the ID string.
> >
> > Wait, what? How can we get to a number that large for the virtual
> > function ID? devfn is 8 bits, bus is a further 8 bits. Sure, domain
> > is an extra 16 bits on top of that but I'm pretty sure that virtual
> > functions can't span multiple domains. Unless that's changed recently?
> >
> > Even if they can, we'd need to span 2^14 domains to get up to a billion
> > IDs. That's a hell of a system and I think overflowing here is the
> > least of our problems.
> >
> > So while this is typed as u32, I don't think it can get anywhere close.
>
> Is there an argument *against* this patch (as opposed to "this is
> probably unnecessary and it requires a lot of analysis to prove that
> we don't need it")?
It consumes additional stack space? It's an example of changing code
to shut up a tool that is of dubious value?
^ permalink raw reply [flat|nested] 9+ messages in thread