Features and bug fixes for Linux kernel 3.2.

Features and bug fixes for Linux kernel 3.2.

[Konrad Rzeszutek Wilk]

Hey,

Please keep in mind that there is some outstanding work going on which
could make it in 3.2 depending on when the merge window opens. I will
enumerate those in the next email.

Anyhow, for 3.2 Linux kernel we have these items loaded and ready to go:

 - A new mechanism to parse the E820 resulting in better ballooning.
 - hwclock support. Meaning you can do 'date XX' and it will be saved by machine.
 - Support for PCI multi-segmented machines (big big iron boxes)
 - Optimizations in DMA API.
 - "feature-barrier" in the xen-blkback so that older kernels (SLES10)
   can issue those.
 - "feature-discard" so that TRIM/SCSI UNMAP operations can be utilized.
 - kexec/kdump support for PVonHVM.
 - Cleanups in the code (mostly scripts/cleanpatch.pl)
 - Static analyzer (smatch) run results fixing bugs.
 - Tons of bug fixes.

If you think I missed something - please please email me immediately.


The list is as follow.

Dan Carpenter (1):
      xen/pciback: double lock typo

David Vrabel (9):
      xen/balloon: account for pages released during memory setup
      xen/balloon: simplify test for the end of usable RAM
      xen: allow balloon driver to use more than one memory region
      xen: allow extra memory to be in multiple regions
      xen: release all pages within 1-1 p2m mappings
      xen: use generic functions instead of xen_{alloc, free}_vm_area()
      block: xen-blkback: use API provided by xenbus module to map rings
      net: xen-netback: use API provided by xenbus module to map rings
      xen: map foreign pages for shared rings by updating the PTEs directly

Jan Beulich (5):
      xen/pci: make bus notifier handler return sane values
      xen/pciback: use mutex rather than spinlock in passthrough backend
      xen/pciback: miscellaneous adjustments
      xen/pci: support multi-segment systems
      xen-blkback: use kzalloc() in favor of kmalloc()+memset()

Jeremy Fitzhardinge (2):
      xen: add dom0_op hypercall
      xen/dom0: set wallclock time in Xen

Joe Jin (1):
      xen-blkback: fixed indentation and comments

Konrad Rzeszutek Wilk (24):
      Revert "xen/debug: WARN_ON when identity PFN has no _PAGE_IOMAP flag set."
      xen-pcifront: Update warning comment to use 'e820_host' option.
      xen-swiotlb: Retry up three times to allocate Xen-SWIOTLB
      xen-swiotlb: Fix wrong panic.
      xen-swiotlb: When doing coherent alloc/dealloc check before swizzling the MFNs.
      xen/pciback: Use mutexes when working with Xenbus state transitions.
      xen/pciback: use mutex rather than spinlock in vpci backend
      xen/p2m: Make debug/xen/mmu/p2m visible again.
      xen/p2m: Use SetPagePrivate and its friends for M2P overrides.
      x86/paravirt: Partially revert "remove lazy mode in interrupts"
      xen/pv-on-hvm:kexec: Fix implicit declaration of function 'xen_hvm_domain'
      xen/pciback: Do not dereference psdev during printk when it is NULL.
      xen-blkfront: If no barrier or flush is supported, use invalid operation.
      xen/blkback: Support 'feature-barrier' aka old-style BARRIER requests.
      xen/blkback: Report VBD_WSECT (wr_sect) properly.
      xen/blkback: Fix the inhibition to map pages when discarding sector ranges.
      xen/pciback: Check if the device is found instead of blindly assuming so.
      xen/events: BUG() when we can't allocate our event->irq array.
      xen/events: Don't check the info for NULL as it is already done.
      xen/irq: If we fail during msi_capability_init return proper error code.
      xen/xenbus: Remove the unnecessary check.
      xen/enlighten: Fix compile warnings and set cx to known value.
      xen/p2m/debugfs: Fix potential pointer exception.
      xen/p2m/debugfs: Make type_name more obvious.

Laszlo Ersek (1):
      xen-blkfront: plug device number leak in xlblk_init() error path

Li Dongyang (4):
      xen-blkfront: add BLKIF_OP_DISCARD and discard request struct
      xen-blkback: Implement discard requests ('feature-discard')
      xen-blkfront: Handle discard requests.
      xen-blkfront: fix a deadlock while handling discard response

Olaf Hering (6):
      xen: use static initializers in xen-balloon.c
      xen/pv-on-hvm kexec: prevent crash in xenwatch_thread() when stale watch events arrive
      xen/pv-on-hvm kexec: rebind virqs to existing eventchannel ports
      xen/pv-on-hvm kexec+kdump: reset PV devices in kexec or crash kernel
      xen/pv-on-hvm kexec: update xs_wire.h:xsd_sockmsg_type from xen-unstable
      xen/pv-on-hvm kexec: add xs_reset_watches to shutdown watches from old kernel

Randy Dunlap (1):
      xen-swiotlb: fix printk and panic args

Ruslan Pisarev (6):
      Xen: fix whitespaces,tabs coding style issue in drivers/xen/balloon.c
      Xen: fix whitespaces,tabs coding style issue in drivers/xen/events.c
      Xen: fix braces coding style issue in gntdev.c and grant-table.c
      Xen: fix whitespaces,tabs coding style issue in drivers/xen/pci.c
      Xen: fix braces coding style issue in xenbus_probe.h
      Xen: fix braces and tabs coding style issue in xenbus_probe.c

Stefano Stabellini (4):
      xen: add an "highmem" parameter to alloc_xenballooned_pages
      xen: modify kernel mappings corresponding to granted pages
      xen: XEN_PVHVM depends on PCI
      xen: remove XEN_PLATFORM_PCI config option

Thomas Meyer (1):
      xen/pciback: use resource_size()

Yu Ke (1):
      xen/acpi: Domain0 acpi parser related platform hypercall

Re: Features and bug fixes for Linux kernel 3.2.

[Igor Mammedov]

On 10/13/2011 09:09 PM, Konrad Rzeszutek Wilk wrote:
> Hey,
>
> Please keep in mind that there is some outstanding work going on which
> could make it in 3.2 depending on when the merge window opens. I will
> enumerate those in the next email.
>
> Anyhow, for 3.2 Linux kernel we have these items loaded and ready to go:
>
>   - A new mechanism to parse the E820 resulting in better ballooning.
>   - hwclock support. Meaning you can do 'date XX' and it will be saved by machine.
>   - Support for PCI multi-segmented machines (big big iron boxes)
>   - Optimizations in DMA API.
>   - "feature-barrier" in the xen-blkback so that older kernels (SLES10)
>     can issue those.
>   - "feature-discard" so that TRIM/SCSI UNMAP operations can be utilized.
>   - kexec/kdump support for PVonHVM.
>   - Cleanups in the code (mostly scripts/cleanpatch.pl)
>   - Static analyzer (smatch) run results fixing bugs.
>   - Tons of bug fixes.
>
> If you think I missed something - please please email me immediately.
>
>
> The list is as follow.
>
> Dan Carpenter (1):
>        xen/pciback: double lock typo
>
> David Vrabel (9):
>        xen/balloon: account for pages released during memory setup
>        xen/balloon: simplify test for the end of usable RAM
>        xen: allow balloon driver to use more than one memory region
>        xen: allow extra memory to be in multiple regions
>        xen: release all pages within 1-1 p2m mappings
>        xen: use generic functions instead of xen_{alloc, free}_vm_area()
>        block: xen-blkback: use API provided by xenbus module to map rings
>        net: xen-netback: use API provided by xenbus module to map rings
>        xen: map foreign pages for shared rings by updating the PTEs directly
>
> Jan Beulich (5):
>        xen/pci: make bus notifier handler return sane values
>        xen/pciback: use mutex rather than spinlock in passthrough backend
>        xen/pciback: miscellaneous adjustments
>        xen/pci: support multi-segment systems
>        xen-blkback: use kzalloc() in favor of kmalloc()+memset()
>
> Jeremy Fitzhardinge (2):
>        xen: add dom0_op hypercall
>        xen/dom0: set wallclock time in Xen
>
> Joe Jin (1):
>        xen-blkback: fixed indentation and comments
>
> Konrad Rzeszutek Wilk (24):
>        Revert "xen/debug: WARN_ON when identity PFN has no _PAGE_IOMAP flag set."
>        xen-pcifront: Update warning comment to use 'e820_host' option.
>        xen-swiotlb: Retry up three times to allocate Xen-SWIOTLB
>        xen-swiotlb: Fix wrong panic.
>        xen-swiotlb: When doing coherent alloc/dealloc check before swizzling the MFNs.
>        xen/pciback: Use mutexes when working with Xenbus state transitions.
>        xen/pciback: use mutex rather than spinlock in vpci backend
>        xen/p2m: Make debug/xen/mmu/p2m visible again.
>        xen/p2m: Use SetPagePrivate and its friends for M2P overrides.
>        x86/paravirt: Partially revert "remove lazy mode in interrupts"

Have You meant ^^^ "x86/paravirt: PTE updates in k(un)map_atomic need to be synchronous, regardless of lazy_mmu mode" there?

>        xen/pv-on-hvm:kexec: Fix implicit declaration of function 'xen_hvm_domain'
>        xen/pciback: Do not dereference psdev during printk when it is NULL.
>        xen-blkfront: If no barrier or flush is supported, use invalid operation.
>        xen/blkback: Support 'feature-barrier' aka old-style BARRIER requests.
>        xen/blkback: Report VBD_WSECT (wr_sect) properly.
>        xen/blkback: Fix the inhibition to map pages when discarding sector ranges.
>        xen/pciback: Check if the device is found instead of blindly assuming so.
>        xen/events: BUG() when we can't allocate our event->irq array.
>        xen/events: Don't check the info for NULL as it is already done.
>        xen/irq: If we fail during msi_capability_init return proper error code.
>        xen/xenbus: Remove the unnecessary check.
>        xen/enlighten: Fix compile warnings and set cx to known value.
>        xen/p2m/debugfs: Fix potential pointer exception.
>        xen/p2m/debugfs: Make type_name more obvious.
>
> Laszlo Ersek (1):
>        xen-blkfront: plug device number leak in xlblk_init() error path
>
> Li Dongyang (4):
>        xen-blkfront: add BLKIF_OP_DISCARD and discard request struct
>        xen-blkback: Implement discard requests ('feature-discard')
>        xen-blkfront: Handle discard requests.
>        xen-blkfront: fix a deadlock while handling discard response
>
> Olaf Hering (6):
>        xen: use static initializers in xen-balloon.c
>        xen/pv-on-hvm kexec: prevent crash in xenwatch_thread() when stale watch events arrive
>        xen/pv-on-hvm kexec: rebind virqs to existing eventchannel ports
>        xen/pv-on-hvm kexec+kdump: reset PV devices in kexec or crash kernel
>        xen/pv-on-hvm kexec: update xs_wire.h:xsd_sockmsg_type from xen-unstable
>        xen/pv-on-hvm kexec: add xs_reset_watches to shutdown watches from old kernel
>
> Randy Dunlap (1):
>        xen-swiotlb: fix printk and panic args
>
> Ruslan Pisarev (6):
>        Xen: fix whitespaces,tabs coding style issue in drivers/xen/balloon.c
>        Xen: fix whitespaces,tabs coding style issue in drivers/xen/events.c
>        Xen: fix braces coding style issue in gntdev.c and grant-table.c
>        Xen: fix whitespaces,tabs coding style issue in drivers/xen/pci.c
>        Xen: fix braces coding style issue in xenbus_probe.h
>        Xen: fix braces and tabs coding style issue in xenbus_probe.c
>
> Stefano Stabellini (4):
>        xen: add an "highmem" parameter to alloc_xenballooned_pages
>        xen: modify kernel mappings corresponding to granted pages
>        xen: XEN_PVHVM depends on PCI
>        xen: remove XEN_PLATFORM_PCI config option
>
> Thomas Meyer (1):
>        xen/pciback: use resource_size()
>
> Yu Ke (1):
>        xen/acpi: Domain0 acpi parser related platform hypercall
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel

-- 
Thanks,
  Igor

Re: Features and bug fixes for Linux kernel 3.2.

[Konrad Rzeszutek Wilk]

On Fri, Oct 14, 2011 at 02:06:04PM +0200, Igor Mammedov wrote:
> On 10/13/2011 09:09 PM, Konrad Rzeszutek Wilk wrote:
> >Hey,
> >
> >Please keep in mind that there is some outstanding work going on which
> >could make it in 3.2 depending on when the merge window opens. I will
> >enumerate those in the next email.
> >
> >Anyhow, for 3.2 Linux kernel we have these items loaded and ready to go:
> >
> >  - A new mechanism to parse the E820 resulting in better ballooning.
> >  - hwclock support. Meaning you can do 'date XX' and it will be saved by machine.
> >  - Support for PCI multi-segmented machines (big big iron boxes)
> >  - Optimizations in DMA API.
> >  - "feature-barrier" in the xen-blkback so that older kernels (SLES10)
> >    can issue those.
> >  - "feature-discard" so that TRIM/SCSI UNMAP operations can be utilized.
> >  - kexec/kdump support for PVonHVM.
> >  - Cleanups in the code (mostly scripts/cleanpatch.pl)
> >  - Static analyzer (smatch) run results fixing bugs.
> >  - Tons of bug fixes.
> >
> >If you think I missed something - please please email me immediately.
> >
> >
> >The list is as follow.
> >
> >Dan Carpenter (1):
> >       xen/pciback: double lock typo
> >
> >David Vrabel (9):
> >       xen/balloon: account for pages released during memory setup
> >       xen/balloon: simplify test for the end of usable RAM
> >       xen: allow balloon driver to use more than one memory region
> >       xen: allow extra memory to be in multiple regions
> >       xen: release all pages within 1-1 p2m mappings
> >       xen: use generic functions instead of xen_{alloc, free}_vm_area()
> >       block: xen-blkback: use API provided by xenbus module to map rings
> >       net: xen-netback: use API provided by xenbus module to map rings
> >       xen: map foreign pages for shared rings by updating the PTEs directly
> >
> >Jan Beulich (5):
> >       xen/pci: make bus notifier handler return sane values
> >       xen/pciback: use mutex rather than spinlock in passthrough backend
> >       xen/pciback: miscellaneous adjustments
> >       xen/pci: support multi-segment systems
> >       xen-blkback: use kzalloc() in favor of kmalloc()+memset()
> >
> >Jeremy Fitzhardinge (2):
> >       xen: add dom0_op hypercall
> >       xen/dom0: set wallclock time in Xen
> >
> >Joe Jin (1):
> >       xen-blkback: fixed indentation and comments
> >
> >Konrad Rzeszutek Wilk (24):
> >       Revert "xen/debug: WARN_ON when identity PFN has no _PAGE_IOMAP flag set."
> >       xen-pcifront: Update warning comment to use 'e820_host' option.
> >       xen-swiotlb: Retry up three times to allocate Xen-SWIOTLB
> >       xen-swiotlb: Fix wrong panic.
> >       xen-swiotlb: When doing coherent alloc/dealloc check before swizzling the MFNs.
> >       xen/pciback: Use mutexes when working with Xenbus state transitions.
> >       xen/pciback: use mutex rather than spinlock in vpci backend
> >       xen/p2m: Make debug/xen/mmu/p2m visible again.
> >       xen/p2m: Use SetPagePrivate and its friends for M2P overrides.
> >       x86/paravirt: Partially revert "remove lazy mode in interrupts"
> 
> Have You meant ^^^ "x86/paravirt: PTE updates in k(un)map_atomic need to be synchronous, regardless of lazy_mmu mode" there?

Ah, yes, and I believe that patch is actually carried by Andrew Morton,
so let me drop it here.

Thanks for spotting that!

Re: Features and bug fixes for Linux kernel 3.2.

[Ian Campbell]

On Thu, 2011-10-13 at 20:09 +0100, Konrad Rzeszutek Wilk wrote:
> Hey,
> 
> Please keep in mind that there is some outstanding work going on which
> could make it in 3.2 depending on when the merge window opens. I will
> enumerate those in the next email.
> 
> Anyhow, for 3.2 Linux kernel we have these items loaded and ready to go:
> 
>  - A new mechanism to parse the E820 resulting in better ballooning.
>  - hwclock support. Meaning you can do 'date XX' and it will be saved by machine.
>  - Support for PCI multi-segmented machines (big big iron boxes)
>  - Optimizations in DMA API.
>  - "feature-barrier" in the xen-blkback so that older kernels (SLES10)
>    can issue those.
>  - "feature-discard" so that TRIM/SCSI UNMAP operations can be utilized.
>  - kexec/kdump support for PVonHVM.
>  - Cleanups in the code (mostly scripts/cleanpatch.pl)
>  - Static analyzer (smatch) run results fixing bugs.
>  - Tons of bug fixes.
> 
> If you think I missed something - please please email me immediately.

It's more a precursor to a Xen thing but the ground work for SKB
fragment lifecycle tracking should be going in via the networking tree
in the next merge window.

That work will eventually lead to the reintroduction of the mapping mode
of guest network tx as opposed to the copy mode we have in upstream
right now. That's more like 3.3 or 3.4 material though.

Ian.

> 
> 
> The list is as follow.
> 
> Dan Carpenter (1):
>       xen/pciback: double lock typo
> 
> David Vrabel (9):
>       xen/balloon: account for pages released during memory setup
>       xen/balloon: simplify test for the end of usable RAM
>       xen: allow balloon driver to use more than one memory region
>       xen: allow extra memory to be in multiple regions
>       xen: release all pages within 1-1 p2m mappings
>       xen: use generic functions instead of xen_{alloc, free}_vm_area()
>       block: xen-blkback: use API provided by xenbus module to map rings
>       net: xen-netback: use API provided by xenbus module to map rings
>       xen: map foreign pages for shared rings by updating the PTEs directly
> 
> Jan Beulich (5):
>       xen/pci: make bus notifier handler return sane values
>       xen/pciback: use mutex rather than spinlock in passthrough backend
>       xen/pciback: miscellaneous adjustments
>       xen/pci: support multi-segment systems
>       xen-blkback: use kzalloc() in favor of kmalloc()+memset()
> 
> Jeremy Fitzhardinge (2):
>       xen: add dom0_op hypercall
>       xen/dom0: set wallclock time in Xen
> 
> Joe Jin (1):
>       xen-blkback: fixed indentation and comments
> 
> Konrad Rzeszutek Wilk (24):
>       Revert "xen/debug: WARN_ON when identity PFN has no _PAGE_IOMAP flag set."
>       xen-pcifront: Update warning comment to use 'e820_host' option.
>       xen-swiotlb: Retry up three times to allocate Xen-SWIOTLB
>       xen-swiotlb: Fix wrong panic.
>       xen-swiotlb: When doing coherent alloc/dealloc check before swizzling the MFNs.
>       xen/pciback: Use mutexes when working with Xenbus state transitions.
>       xen/pciback: use mutex rather than spinlock in vpci backend
>       xen/p2m: Make debug/xen/mmu/p2m visible again.
>       xen/p2m: Use SetPagePrivate and its friends for M2P overrides.
>       x86/paravirt: Partially revert "remove lazy mode in interrupts"
>       xen/pv-on-hvm:kexec: Fix implicit declaration of function 'xen_hvm_domain'
>       xen/pciback: Do not dereference psdev during printk when it is NULL.
>       xen-blkfront: If no barrier or flush is supported, use invalid operation.
>       xen/blkback: Support 'feature-barrier' aka old-style BARRIER requests.
>       xen/blkback: Report VBD_WSECT (wr_sect) properly.
>       xen/blkback: Fix the inhibition to map pages when discarding sector ranges.
>       xen/pciback: Check if the device is found instead of blindly assuming so.
>       xen/events: BUG() when we can't allocate our event->irq array.
>       xen/events: Don't check the info for NULL as it is already done.
>       xen/irq: If we fail during msi_capability_init return proper error code.
>       xen/xenbus: Remove the unnecessary check.
>       xen/enlighten: Fix compile warnings and set cx to known value.
>       xen/p2m/debugfs: Fix potential pointer exception.
>       xen/p2m/debugfs: Make type_name more obvious.
> 
> Laszlo Ersek (1):
>       xen-blkfront: plug device number leak in xlblk_init() error path
> 
> Li Dongyang (4):
>       xen-blkfront: add BLKIF_OP_DISCARD and discard request struct
>       xen-blkback: Implement discard requests ('feature-discard')
>       xen-blkfront: Handle discard requests.
>       xen-blkfront: fix a deadlock while handling discard response
> 
> Olaf Hering (6):
>       xen: use static initializers in xen-balloon.c
>       xen/pv-on-hvm kexec: prevent crash in xenwatch_thread() when stale watch events arrive
>       xen/pv-on-hvm kexec: rebind virqs to existing eventchannel ports
>       xen/pv-on-hvm kexec+kdump: reset PV devices in kexec or crash kernel
>       xen/pv-on-hvm kexec: update xs_wire.h:xsd_sockmsg_type from xen-unstable
>       xen/pv-on-hvm kexec: add xs_reset_watches to shutdown watches from old kernel
> 
> Randy Dunlap (1):
>       xen-swiotlb: fix printk and panic args
> 
> Ruslan Pisarev (6):
>       Xen: fix whitespaces,tabs coding style issue in drivers/xen/balloon.c
>       Xen: fix whitespaces,tabs coding style issue in drivers/xen/events.c
>       Xen: fix braces coding style issue in gntdev.c and grant-table.c
>       Xen: fix whitespaces,tabs coding style issue in drivers/xen/pci.c
>       Xen: fix braces coding style issue in xenbus_probe.h
>       Xen: fix braces and tabs coding style issue in xenbus_probe.c
> 
> Stefano Stabellini (4):
>       xen: add an "highmem" parameter to alloc_xenballooned_pages
>       xen: modify kernel mappings corresponding to granted pages
>       xen: XEN_PVHVM depends on PCI
>       xen: remove XEN_PLATFORM_PCI config option
> 
> Thomas Meyer (1):
>       xen/pciback: use resource_size()
> 
> Yu Ke (1):
>       xen/acpi: Domain0 acpi parser related platform hypercall
> 
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel

Re: Features and bug fixes for Linux kernel 3.2.

[Konrad Rzeszutek Wilk]

On Thu, Oct 13, 2011 at 03:09:46PM -0400, Konrad Rzeszutek Wilk wrote:
> Hey,
> 
> Please keep in mind that there is some outstanding work going on which
> could make it in 3.2 depending on when the merge window opens. I will
> enumerate those in the next email.
> 
> Anyhow, for 3.2 Linux kernel we have these items loaded and ready to go:
> 
>  - A new mechanism to parse the E820 resulting in better ballooning.
>  - hwclock support. Meaning you can do 'date XX' and it will be saved by machine.
>  - Support for PCI multi-segmented machines (big big iron boxes)
>  - Optimizations in DMA API.
>  - "feature-barrier" in the xen-blkback so that older kernels (SLES10)
>    can issue those.
>  - "feature-discard" so that TRIM/SCSI UNMAP operations can be utilized.
>  - kexec/kdump support for PVonHVM.
>  - Cleanups in the code (mostly scripts/cleanpatch.pl)
>  - Static analyzer (smatch) run results fixing bugs.
>  - Tons of bug fixes.
> 
> If you think I missed something - please please email me immediately.

These are some extra ones I put in since yesterday:

Dan Magenheimer (1):
      xen: Fix selfballooning and ensure it doesn't go too far

Daniel De Graaf (3):
      xenbus: Fix loopback event channel assuming domain 0
      xenbus: don't rely on xen_initial_domain to detect local xenstore
      xen/gntdev: Fix sleep-inside-spinlock

Konrad Rzeszutek Wilk (1):
      xen/blkback: Check for proper operation.