xen & MacVtap

xen & MacVtap

[topperxin]

[-- Attachment #1.1: Type: text/plain, Size: 360 bytes --]

Hi list
        As we all know, SR-IOV technology can improve VNIC's performance, while it can not support live migration. I get some information recently that on KVM+Virtio platform, if we use MacVtap + SR-IOV, the live migration could be done successfully. What I want to know is may I configure MacVtap on Xen? 
       Any replies are welcome! Thanks a lot.

[-- Attachment #1.2: Type: text/html, Size: 588 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: xen & MacVtap

[Pasi Kärkkäinen]

On Wed, Jan 08, 2014 at 06:22:06PM +0800, topperxin wrote:
>    Hi list
>            As we all know, SR-IOV technology can improve VNIC's performance,
>    while it can not support live migration. I get some information recently
>    that on KVM+Virtio platform, if we use MacVtap + SR-IOV, the live
>    migration could be done successfully. What I want to know is may I
>    configure MacVtap on Xen?
>           Any replies are welcome! Thanks a lot.

I think years ago (2009, perhaps) when SR-IOV was first demoed with Xen
it was demoed with live migration.. it was a mixture of SR-IOV VF + Xen vif.

So with some toolstack/script hackery you can do it. (=use the vif pv driver during migration, normally sr-iov vf).

-- Pasi

Re: xen & MacVtap

[David Vrabel]

On 08/01/14 12:27, Pasi Kärkkäinen wrote:
> On Wed, Jan 08, 2014 at 06:22:06PM +0800, topperxin wrote:
>>    Hi list
>>            As we all know, SR-IOV technology can improve VNIC's performance,
>>    while it can not support live migration. I get some information recently
>>    that on KVM+Virtio platform, if we use MacVtap + SR-IOV, the live
>>    migration could be done successfully. What I want to know is may I
>>    configure MacVtap on Xen?
>>           Any replies are welcome! Thanks a lot.
> 
> I think years ago (2009, perhaps) when SR-IOV was first demoed with Xen
> it was demoed with live migration.. it was a mixture of SR-IOV VF + Xen vif.
> 
> So with some toolstack/script hackery you can do it. (=use the vif pv driver during migration, normally sr-iov vf).

You may find creating an active-backup bond in the guest useful.  The
active bond link is the SR-IOV device and the backup is the VIF.

I've not tried this myself.

David

Re: xen & MacVtap

[Wei Liu]

On Wed, Jan 08, 2014 at 06:22:06PM +0800, topperxin wrote:
> Hi list
>         As we all know, SR-IOV technology can improve VNIC's
>         performance, while it can not support live migration. I get
>         some information recently that on KVM+Virtio platform, if we
>         use MacVtap + SR-IOV, the live migration could be done
>         successfully. What I want to know is may I configure MacVtap
>         on Xen? 
>        Any replies are welcome! Thanks a lot.

AIUI MacVtap runs in emulation mode and connects to VirtIO to implement
the feature you want. That would mean you also need to use VirtIO
network driver for Xen's HVM domain, if you manage to configure MacVtap
for Xen.

Basically that means a configuration that nobody ever tried. Good luck.
:-)

Wei.


> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

Re: xen & MacVtap

[Konrad Rzeszutek Wilk]

On Wed, Jan 08, 2014 at 06:44:05PM +0000, Wei Liu wrote:
> On Wed, Jan 08, 2014 at 06:22:06PM +0800, topperxin wrote:
> > Hi list
> >         As we all know, SR-IOV technology can improve VNIC's
> >         performance, while it can not support live migration. I get
> >         some information recently that on KVM+Virtio platform, if we
> >         use MacVtap + SR-IOV, the live migration could be done
> >         successfully. What I want to know is may I configure MacVtap
> >         on Xen? 
> >        Any replies are welcome! Thanks a lot.
> 
> AIUI MacVtap runs in emulation mode and connects to VirtIO to implement
> the feature you want. That would mean you also need to use VirtIO
> network driver for Xen's HVM domain, if you manage to configure MacVtap
> for Xen.
> 
> Basically that means a configuration that nobody ever tried. Good luck.
> :-)

Do you know what would be needed to make MacVtap run with Xen's drivers?

Re: xen & MacVtap

[Wei Liu]

On Wed, Jan 08, 2014 at 02:58:03PM -0500, Konrad Rzeszutek Wilk wrote:
> On Wed, Jan 08, 2014 at 06:44:05PM +0000, Wei Liu wrote:
> > On Wed, Jan 08, 2014 at 06:22:06PM +0800, topperxin wrote:
> > > Hi list
> > >         As we all know, SR-IOV technology can improve VNIC's
> > >         performance, while it can not support live migration. I get
> > >         some information recently that on KVM+Virtio platform, if we
> > >         use MacVtap + SR-IOV, the live migration could be done
> > >         successfully. What I want to know is may I configure MacVtap
> > >         on Xen? 
> > >        Any replies are welcome! Thanks a lot.
> > 
> > AIUI MacVtap runs in emulation mode and connects to VirtIO to implement
> > the feature you want. That would mean you also need to use VirtIO
> > network driver for Xen's HVM domain, if you manage to configure MacVtap
> > for Xen.
> > 
> > Basically that means a configuration that nobody ever tried. Good luck.
> > :-)
> 
> Do you know what would be needed to make MacVtap run with Xen's drivers?

No idea. Never looked into it.

Wei.

Re: xen & MacVtap

[topperxin]

[-- Attachment #1.1: Type: text/plain, Size: 1181 bytes --]









hi Pasi
    Thanks for your reply, I think we know what you said, we have ever tried these ways.
     While you know, these ways are not stable enough for the engineering requirement, we have to apply many patches, and there are many restrictions for the Guest VM types.
     We need a more general & engineering  solution.
     Any way thanks for your reply.

At 2014-01-08 20:27:10,"Pasi Kärkkäinen" <pasik@iki.fi> wrote:
>On Wed, Jan 08, 2014 at 06:22:06PM +0800, topperxin wrote:
>>    Hi list
>>            As we all know, SR-IOV technology can improve VNIC's performance,
>>    while it can not support live migration. I get some information recently
>>    that on KVM+Virtio platform, if we use MacVtap + SR-IOV, the live
>>    migration could be done successfully. What I want to know is may I
>>    configure MacVtap on Xen?
>>           Any replies are welcome! Thanks a lot.
>
>I think years ago (2009, perhaps) when SR-IOV was first demoed with Xen
>it was demoed with live migration.. it was a mixture of SR-IOV VF + Xen vif.
>
>So with some toolstack/script hackery you can do it. (=use the vif pv driver during migration, normally sr-iov vf).
>
>-- Pasi
>

[-- Attachment #1.2: Type: text/html, Size: 2334 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: xen & MacVtap

[topperxin]

[-- Attachment #1.1: Type: text/plain, Size: 1236 bytes --]

Hi David
Thanks for your reply.
I have ever heard bond way, not try.
What I want to know is whether bond driver can provide stable and engineering solution for the live migration?


在 2014-01-08 21:18:32，"David Vrabel" <david.vrabel@citrix.com> 写道：
>On 08/01/14 12:27, Pasi Kärkkäinen wrote:
>> On Wed, Jan 08, 2014 at 06:22:06PM +0800, topperxin wrote:
>>>    Hi list
>>>            As we all know, SR-IOV technology can improve VNIC's performance,
>>>    while it can not support live migration. I get some information recently
>>>    that on KVM+Virtio platform, if we use MacVtap + SR-IOV, the live
>>>    migration could be done successfully. What I want to know is may I
>>>    configure MacVtap on Xen?
>>>           Any replies are welcome! Thanks a lot.
>> 
>> I think years ago (2009, perhaps) when SR-IOV was first demoed with Xen
>> it was demoed with live migration.. it was a mixture of SR-IOV VF + Xen vif.
>> 
>> So with some toolstack/script hackery you can do it. (=use the vif pv driver during migration, normally sr-iov vf).
>
>You may find creating an active-backup bond in the guest useful.  The
>active bond link is the SR-IOV device and the backup is the VIF.
>
>I've not tried this myself.
>
>David

[-- Attachment #1.2: Type: text/html, Size: 2919 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: xen & MacVtap

[topperxin]

[-- Attachment #1.1: Type: text/plain, Size: 1999 bytes --]




Hi Wei

     Thanks for your reply, I know you are in charge of porting Virtio to xen, how about the process? May we configure Virtio on xen?
     So far as you said, the MacVtap was written specially for Virtio, other virtual NIC driver model can not use it, right?
      I get the information from http://virt.kernelnewbies.org/MacVTap
      "Macvtap is a new device driver meant to simplify virtualized bridged networking. It replaces the combination of the tun/tap and bridge drivers with a single module based on the macvlan device driver. A macvtap endpoint is a character device that largely follows the tun/tap ioctl interface and can be used directly by kvm/qemu and other hypervisors that support the tun/tap interface." 
       So far as I comprehend, any hypervisors can configure MacVtap so long as it can support tun/tap interface, right?  So May I say there is no so closely relationship between MacVtap and Virtio , right? 
         Looking forward to your reply. thanks.

At 2014-01-09 02:44:05,"Wei Liu" <wei.liu2@citrix.com> wrote:
>On Wed, Jan 08, 2014 at 06:22:06PM +0800, topperxin wrote:
>> Hi list
>>         As we all know, SR-IOV technology can improve VNIC's
>>         performance, while it can not support live migration. I get
>>         some information recently that on KVM+Virtio platform, if we
>>         use MacVtap + SR-IOV, the live migration could be done
>>         successfully. What I want to know is may I configure MacVtap
>>         on Xen? 
>>        Any replies are welcome! Thanks a lot.
>
>AIUI MacVtap runs in emulation mode and connects to VirtIO to implement
>the feature you want. That would mean you also need to use VirtIO
>network driver for Xen's HVM domain, if you manage to configure MacVtap
>for Xen.
>
>Basically that means a configuration that nobody ever tried. Good luck.
>:-)
>
>Wei.
>
>
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@lists.xen.org
>> http://lists.xen.org/xen-devel
>

[-- Attachment #1.2: Type: text/html, Size: 4280 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: xen & MacVtap

[Wei Liu]

On Thu, Jan 09, 2014 at 11:52:23AM +0800, topperxin wrote:
> 
> 
> 
> Hi Wei
> 
>      Thanks for your reply, I know you are in charge of porting Virtio to xen, how about the process? May we configure Virtio on xen?

I wouldn't say "I'm in charge". That was sort of experimental project
two years ago. And I stopped after that. So my knowledge is in fact
quite out dated.

I tried VirtIO on HVM guest about two months ago. It worked for me.
That's the only thing I'm qualified to say. However Fabio reported it
didn't work for him. So in short your mileage may vary.

>      So far as you said, the MacVtap was written specially for Virtio, other virtual NIC driver model can not use it, right?

No, I didn't say that.

>       I get the information from http://virt.kernelnewbies.org/MacVTap
>       "Macvtap is a new device driver meant to simplify virtualized bridged networking. It replaces the combination of the tun/tap and bridge drivers with a single module based on the macvlan device driver. A macvtap endpoint is a character device that largely follows the tun/tap ioctl interface and can be used directly by kvm/qemu and other hypervisors that support the tun/tap interface." 
>        So far as I comprehend, any hypervisors can configure MacVtap so long as it can support tun/tap interface, right?  So May I say there is no so closely relationship between MacVtap and Virtio , right? 

I can't speak for the thing I'm not familiar with. It would make sense
to just try that configuration and see if it works or not.

Wei.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: xen & MacVtap

[topperxin]

[-- Attachment #1.1: Type: text/plain, Size: 1742 bytes --]



在 2014-01-09 20:14:08，"Wei Liu" <wei.liu2@citrix.com> 写道：
>On Thu, Jan 09, 2014 at 11:52:23AM +0800, topperxin wrote:
>> 
>> 
>> 
>> Hi Wei
>> 
>>      Thanks for your reply, I know you are in charge of porting Virtio to xen, how about the process? May we configure Virtio on xen?
>
>I wouldn't say "I'm in charge". That was sort of experimental project
>two years ago. And I stopped after that. So my knowledge is in fact
>quite out dated.
>
>I tried VirtIO on HVM guest about two months ago. It worked for me.
>That's the only thing I'm qualified to say. However Fabio reported it
>didn't work for him. So in short your mileage may vary.


Could you please share us the elaborate steps about how to enable VirtIO on xen HVM guest? Thanks a lot

>>      So far as you said, the MacVtap was written specially for Virtio, other virtual NIC driver model can not use it, right?
>
>No, I didn't say that.
>
>>       I get the information from http://virt.kernelnewbies.org/MacVTap
>>       "Macvtap is a new device driver meant to simplify virtualized bridged networking. It replaces the combination of the tun/tap and bridge drivers with a single module based on the macvlan device driver. A macvtap endpoint is a character device that largely follows the tun/tap ioctl interface and can be used directly by kvm/qemu and other hypervisors that support the tun/tap interface." 
>>        So far as I comprehend, any hypervisors can configure MacVtap so long as it can support tun/tap interface, right?  So May I say there is no so closely relationship between MacVtap and Virtio , right? 
>
>I can't speak for the thing I'm not familiar with. It would make sense
>to just try that configuration and see if it works or not.
>
>Wei.

[-- Attachment #1.2: Type: text/html, Size: 3508 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: xen & MacVtap

[Wei Liu]

On Fri, Jan 10, 2014 at 04:54:34PM +0800, topperxin wrote:
> 
> 
> 在 2014-01-09 20:14:08，"Wei Liu" <wei.liu2@citrix.com> 写道：
> >On Thu, Jan 09, 2014 at 11:52:23AM +0800, topperxin wrote:
> >> 
> >> 
> >> 
> >> Hi Wei
> >> 
> >>      Thanks for your reply, I know you are in charge of porting Virtio to xen, how about the process? May we configure Virtio on xen?
> >
> >I wouldn't say "I'm in charge". That was sort of experimental project
> >two years ago. And I stopped after that. So my knowledge is in fact
> >quite out dated.
> >
> >I tried VirtIO on HVM guest about two months ago. It worked for me.
> >That's the only thing I'm qualified to say. However Fabio reported it
> >didn't work for him. So in short your mileage may vary.
> 
> 
> Could you please share us the elaborate steps about how to enable VirtIO on xen HVM guest? Thanks a lot
> 

In your vif configuration, add in "model=virtio-net-pci" to specify
VirtIO net as your emulated device. You also need to add in
xen_emul_unplug=never in your *guest* kernel command line.

You might also find device_model_args= useful for appending arbitratry
arguments to QEMU. Presumably you need to append some runes to QEMU to
enable MacVtap.

Wei.


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel