* [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-qemuu-nested-intel
@ 2019-12-22 20:52 osstest service owner
2019-12-24 14:23 ` Roger Pau Monné
0 siblings, 1 reply; 3+ messages in thread
From: osstest service owner @ 2019-12-22 20:52 UTC (permalink / raw)
To: xen-devel, osstest-admin
[-- Attachment #1: Type: text/plain, Size: 13262 bytes --]
branch xen-unstable
xenbranch xen-unstable
job test-amd64-amd64-qemuu-nested-intel
testid debian-hvm-install/l1/l2
Tree: linux git://xenbits.xen.org/linux-pvops.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: b1710040ca9628a6517bfc06f87dcbb670f8743e
Bug not present: 3d05407025ed1f83f492f81ba8175fa26b1e2fb3
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/145120/
commit b1710040ca9628a6517bfc06f87dcbb670f8743e
Author: Roger Pau Monné <roger.pau@citrix.com>
Date: Fri Dec 20 16:29:22 2019 +0100
x86/apic: allow enabling x2APIC mode regardless of interrupt remapping
x2APIC mode doesn't mandate interrupt remapping, and hence can be
enabled independently. This patch enables x2APIC when available,
regardless of whether there's interrupt remapping support.
This is beneficial specially when running on virtualized environments,
since it reduces the amount of vmexits. For example when sending an
IPI in xAPIC mode Xen performs at least 3 different accesses to the
APIC MMIO region, while when using x2APIC mode a single wrmsr is used.
The following numbers are from a lock profiling of a Xen PV shim
running a Linux PV kernel with 32 vCPUs and xAPIC mode:
(XEN) Global lock flush_lock: addr=ffff82d0804af1c0, lockval=03190319, not locked
(XEN) lock:656153(892606463454), block:602183(9495067321843)
Average lock time: 1360363ns
Average block time: 15767743ns
While the following are from the same configuration but with the shim
using x2APIC mode:
(XEN) Global lock flush_lock: addr=ffff82d0804b01c0, lockval=1adb1adb, not locked
(XEN) lock:1841883(1375128998543), block:1658716(10193054890781)
Average lock time: 746588ns
Average block time: 6145147ns
Enabling x2APIC has halved the average lock time, thus reducing
contention.
Signed-off-by: Roger Pau Monné <roger.pau@citrix.com>
Reviewed-by: Jan Beulich <jbeulich@suse.com>
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2 --summary-out=tmp/145120.bisection-summary --basis-template=145025 --blessings=real,real-bisect xen-unstable test-amd64-amd64-qemuu-nested-intel debian-hvm-install/l1/l2
Searching for failure / basis pass:
145107 fail [host=debina1] / 145025 [host=chardonnay0] 144990 [host=elbling1] 144972 [host=huxelrebe1] 144959 [host=albana1] 144936 [host=fiano0] 144924 [host=fiano1] 144905 [host=italia0] 144887 [host=huxelrebe0] 144878 [host=chardonnay1] 144850 [host=albana0] 144827 [host=elbling0] 144813 [host=godello1] 144776 ok.
Failure / basis pass flights: 145107 / 144776
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: linux git://xenbits.xen.org/linux-pvops.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef dffe18cf81a3c4c2260791d2246220a4d4f0cc8f
Basis pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 5852ca48526316918cd82fba1033a6a5379fbc4c
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/linux-pvops.git#b98aebd298246df37b472c52a2ee1023256d02e3-b98aebd298246df37b472c52a2ee1023256d02e3 git://xenbits.xen.org/osstest/linux-firmware.git#c530a75c1e6a472b0eb9558310b518f0dfcd8860-c530a75c1e6a472b0eb9558310b518f0dfcd8860 git://xenbits.xen.org/qemu-xen-traditional.git#d0d8ad39ecb51cd7497cd524484fe09f50876798-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#933ebad2470a169504799a1d95b8e41\
0bd9847ef-933ebad2470a169504799a1d95b8e410bd9847ef git://xenbits.xen.org/xen.git#5852ca48526316918cd82fba1033a6a5379fbc4c-dffe18cf81a3c4c2260791d2246220a4d4f0cc8f
Loaded 5001 nodes in revision graph
Searching for test results:
144824 [host=godello1]
144813 [host=godello1]
144804 [host=godello1]
144776 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 5852ca48526316918cd82fba1033a6a5379fbc4c
144821 [host=godello1]
144827 [host=elbling0]
144850 [host=albana0]
144878 [host=chardonnay1]
144887 [host=huxelrebe0]
144924 [host=fiano1]
144905 [host=italia0]
144990 [host=elbling1]
144936 [host=fiano0]
144959 [host=albana1]
144972 [host=huxelrebe1]
145058 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef dffe18cf81a3c4c2260791d2246220a4d4f0cc8f
145025 [host=chardonnay0]
145071 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef dffe18cf81a3c4c2260791d2246220a4d4f0cc8f
145083 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef dffe18cf81a3c4c2260791d2246220a4d4f0cc8f
145092 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef f9dee1f945ebb6fb5f9df6f5d95b15c25727f48e
145080 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 5852ca48526316918cd82fba1033a6a5379fbc4c
145090 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 25164571fc11ed3010c5885a98a68fac3b891d33
145086 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 581deaa82952ac652ca1d838da34307a15031046
145088 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef dffe18cf81a3c4c2260791d2246220a4d4f0cc8f
145096 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 9356f9de41628f0675dd3458540b3558c52c4a8a
145105 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef b1710040ca9628a6517bfc06f87dcbb670f8743e
145101 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 3d05407025ed1f83f492f81ba8175fa26b1e2fb3
145109 blocked b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 3d05407025ed1f83f492f81ba8175fa26b1e2fb3
145111 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 3d05407025ed1f83f492f81ba8175fa26b1e2fb3
145114 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef b1710040ca9628a6517bfc06f87dcbb670f8743e
145107 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef dffe18cf81a3c4c2260791d2246220a4d4f0cc8f
145117 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 3d05407025ed1f83f492f81ba8175fa26b1e2fb3
145120 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef b1710040ca9628a6517bfc06f87dcbb670f8743e
Searching for interesting versions
Result found: flight 144776 (pass), for basis pass
Result found: flight 145058 (fail), for basis failure
Repro found: flight 145080 (pass), for basis pass
Repro found: flight 145083 (fail), for basis failure
0 revisions at b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 3d05407025ed1f83f492f81ba8175fa26b1e2fb3
No revisions left to test, checking graph state.
Result found: flight 145101 (pass), for last pass
Result found: flight 145105 (fail), for first failure
Repro found: flight 145111 (pass), for last pass
Repro found: flight 145114 (fail), for first failure
Repro found: flight 145117 (pass), for last pass
Repro found: flight 145120 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: b1710040ca9628a6517bfc06f87dcbb670f8743e
Bug not present: 3d05407025ed1f83f492f81ba8175fa26b1e2fb3
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/145120/
commit b1710040ca9628a6517bfc06f87dcbb670f8743e
Author: Roger Pau Monné <roger.pau@citrix.com>
Date: Fri Dec 20 16:29:22 2019 +0100
x86/apic: allow enabling x2APIC mode regardless of interrupt remapping
x2APIC mode doesn't mandate interrupt remapping, and hence can be
enabled independently. This patch enables x2APIC when available,
regardless of whether there's interrupt remapping support.
This is beneficial specially when running on virtualized environments,
since it reduces the amount of vmexits. For example when sending an
IPI in xAPIC mode Xen performs at least 3 different accesses to the
APIC MMIO region, while when using x2APIC mode a single wrmsr is used.
The following numbers are from a lock profiling of a Xen PV shim
running a Linux PV kernel with 32 vCPUs and xAPIC mode:
(XEN) Global lock flush_lock: addr=ffff82d0804af1c0, lockval=03190319, not locked
(XEN) lock:656153(892606463454), block:602183(9495067321843)
Average lock time: 1360363ns
Average block time: 15767743ns
While the following are from the same configuration but with the shim
using x2APIC mode:
(XEN) Global lock flush_lock: addr=ffff82d0804b01c0, lockval=1adb1adb, not locked
(XEN) lock:1841883(1375128998543), block:1658716(10193054890781)
Average lock time: 746588ns
Average block time: 6145147ns
Enabling x2APIC has halved the average lock time, thus reducing
contention.
Signed-off-by: Roger Pau Monné <roger.pau@citrix.com>
Reviewed-by: Jan Beulich <jbeulich@suse.com>
Revision graph left in /home/logs/results/bisect/xen-unstable/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2.{dot,ps,png,html,svg}.
----------------------------------------
145120: tolerable ALL FAIL
flight 145120 xen-unstable real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/145120/
Failures :-/ but no regressions.
Tests which did not succeed,
including tests which could not be run:
test-amd64-amd64-qemuu-nested-intel 18 capture-logs/l1(18) fail baseline untested
test-amd64-amd64-qemuu-nested-intel 17 debian-hvm-install/l1/l2 fail baseline untested
jobs:
test-amd64-amd64-qemuu-nested-intel fail
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
[-- Attachment #2: Type: text/plain, Size: 157 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 3+ messages in thread* Re: [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-qemuu-nested-intel
2019-12-22 20:52 [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-qemuu-nested-intel osstest service owner
@ 2019-12-24 14:23 ` Roger Pau Monné
0 siblings, 0 replies; 3+ messages in thread
From: Roger Pau Monné @ 2019-12-24 14:23 UTC (permalink / raw)
To: osstest service owner; +Cc: xen-devel
On Sun, Dec 22, 2019 at 08:52:02PM +0000, osstest service owner wrote:
> branch xen-unstable
> xenbranch xen-unstable
> job test-amd64-amd64-qemuu-nested-intel
> testid debian-hvm-install/l1/l2
>
> Tree: linux git://xenbits.xen.org/linux-pvops.git
> Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
> Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
> Tree: qemuu git://xenbits.xen.org/qemu-xen.git
> Tree: xen git://xenbits.xen.org/xen.git
>
> *** Found and reproduced problem changeset ***
>
> Bug is in tree: xen git://xenbits.xen.org/xen.git
> Bug introduced: b1710040ca9628a6517bfc06f87dcbb670f8743e
> Bug not present: 3d05407025ed1f83f492f81ba8175fa26b1e2fb3
> Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/145120/
>
>
> commit b1710040ca9628a6517bfc06f87dcbb670f8743e
> Author: Roger Pau Monn?? <roger.pau@citrix.com>
> Date: Fri Dec 20 16:29:22 2019 +0100
>
> x86/apic: allow enabling x2APIC mode regardless of interrupt remapping
>
> x2APIC mode doesn't mandate interrupt remapping, and hence can be
> enabled independently. This patch enables x2APIC when available,
> regardless of whether there's interrupt remapping support.
>
> This is beneficial specially when running on virtualized environments,
> since it reduces the amount of vmexits. For example when sending an
> IPI in xAPIC mode Xen performs at least 3 different accesses to the
> APIC MMIO region, while when using x2APIC mode a single wrmsr is used.
>
> The following numbers are from a lock profiling of a Xen PV shim
> running a Linux PV kernel with 32 vCPUs and xAPIC mode:
>
> (XEN) Global lock flush_lock: addr=ffff82d0804af1c0, lockval=03190319, not locked
> (XEN) lock:656153(892606463454), block:602183(9495067321843)
>
> Average lock time: 1360363ns
> Average block time: 15767743ns
>
> While the following are from the same configuration but with the shim
> using x2APIC mode:
>
> (XEN) Global lock flush_lock: addr=ffff82d0804b01c0, lockval=1adb1adb, not locked
> (XEN) lock:1841883(1375128998543), block:1658716(10193054890781)
>
> Average lock time: 746588ns
> Average block time: 6145147ns
>
> Enabling x2APIC has halved the average lock time, thus reducing
> contention.
>
> Signed-off-by: Roger Pau Monn?? <roger.pau@citrix.com>
> Reviewed-by: Jan Beulich <jbeulich@suse.com>
This change causes a vmlaunch failure on debina* boxes, but not
others (ie: tried to reproduce it on albana0 and failed). Here is the
relevant trace:
Dec 23 20:06:54.444025 (XEN) d3v0 VMLAUNCH error: 0x7
Dec 23 20:08:32.848081 (XEN) *** Guest State ***
Dec 23 20:08:32.848091 (XEN) CR0: actual=0x0000000000000031, shadow=0x0000000000000011, gh_mask=ffffffffffffffff
Dec 23 20:08:32.860079 (XEN) CR4: actual=0x0000000000002050, shadow=0x0000000000000000, gh_mask=fffffffffff8f870
Dec 23 20:08:32.860091 (XEN) CR3 = 0x0000000000000000
Dec 23 20:08:32.872075 (XEN) RSP = 0x0000000000000000 (0x0000000000000000) RIP = 0x0000000000100036 (0x0000000000100036)
Dec 23 20:08:32.872086 (XEN) RFLAGS=0x00000002 (0x00000002) DR7 = 0x0000000000000400
Dec 23 20:08:32.884078 (XEN) Sysenter RSP=0000000000000000 CS:RIP=0000:0000000000000000
Dec 23 20:08:32.884088 (XEN) sel attr limit base
Dec 23 20:08:32.884094 (XEN) CS: 0000 0c09b ffffffff 0000000000000000
Dec 23 20:08:32.896078 (XEN) DS: 0000 0c093 ffffffff 0000000000000000
Dec 23 20:08:32.896087 (XEN) SS: 0000 0c093 ffffffff 0000000000000000
Dec 23 20:08:32.908080 (XEN) ES: 0000 10000 00000000 0000000000000000
Dec 23 20:08:32.908088 (XEN) FS: 0000 10000 00000000 0000000000000000
Dec 23 20:08:32.908094 (XEN) GS: 0000 10000 00000000 0000000000000000
Dec 23 20:08:32.920077 (XEN) GDTR: 00000000 0000000000000000
Dec 23 20:08:32.920086 (XEN) LDTR: 0000 10000 00000000 0000000000000000
Dec 23 20:08:32.920091 (XEN) IDTR: 00000000 0000000000000000
Dec 23 20:08:32.932106 (XEN) TR: 0000 0008b 00000067 0000000000000000
Dec 23 20:08:32.932115 (XEN) EFER(VMCS) = 0x0000000000000000 PAT = 0x0007040600070406
Dec 23 20:08:32.944076 (XEN) PreemptionTimer = 0x00000000 SM Base = 0x00000000
Dec 23 20:08:32.944086 (XEN) DebugCtl = 0x0000000000000000 DebugExceptions = 0x0000000000000000
Dec 23 20:08:32.956075 (XEN) Interruptibility = 00000000 ActivityState = 00000000
Dec 23 20:08:32.956085 (XEN) InterruptStatus = 0000
Dec 23 20:08:32.956090 (XEN) *** Host State ***
Dec 23 20:08:32.956095 (XEN) RIP = 0xffff82d08033ba20 (vmx_asm_vmexit_handler) RSP = 0xffff83047c637f70
Dec 23 20:08:32.968082 (XEN) CS=e008 SS=0000 DS=0000 ES=0000 FS=0000 GS=0000 TR=e040
Dec 23 20:08:32.968091 (XEN) FSBase=0000000000000000 GSBase=0000000000000000 TRBase=ffff83047c640000
Dec 23 20:08:32.980107 (XEN) GDTBase=ffff83047c630000 IDTBase=ffff83047c63c000
Dec 23 20:08:32.980116 (XEN) CR0=0000000080050033 CR3=000000045a98b000 CR4=00000000003526e0
Dec 23 20:08:32.992080 (XEN) Sysenter RSP=ffff83047c637fa0 CS:RIP=e008:ffff82d08038d440
Dec 23 20:08:32.992090 (XEN) EFER = 0x0000000000000d01 PAT = 0x0000050100070406
Dec 23 20:08:33.004078 (XEN) *** Control State ***
Dec 23 20:08:33.004086 (XEN) PinBased=0000003f CPUBased=b6a075fe SecondaryExec=000014fb
Dec 23 20:08:33.016077 (XEN) EntryControls=000011ff ExitControls=002fefff
Dec 23 20:08:33.016086 (XEN) ExceptionBitmap=00060002 PFECmask=00000000 PFECmatch=00000000
Dec 23 20:08:33.016093 (XEN) VMEntry: intr_info=00000000 errcode=00000000 ilen=00000000
Dec 23 20:08:33.028084 (XEN) VMExit: intr_info=00000000 errcode=00000000 ilen=00000004
Dec 23 20:08:33.028093 (XEN) reason=0000001b qualification=0000000000000000
Dec 23 20:08:33.040081 (XEN) IDTVectoring: info=00000000 errcode=00000000
Dec 23 20:08:33.040090 (XEN) TSC Offset = 0xffff297781d67b60 TSC Multiplier = 0x0000000000000000
Dec 23 20:08:33.052076 (XEN) TPR Threshold = 0x00 PostedIntrVec = 0xf4
Dec 23 20:08:33.052085 (XEN) EPT pointer = 0x000000047f72301e EPTP index = 0x0000
Dec 23 20:08:33.064087 (XEN) PLE Gap=00000080 Window=00001000
Dec 23 20:08:33.064096 (XEN) Virtual processor ID = 0x8f0f VMfunc controls = 0000000000000000
Dec 23 20:08:33.064103 (XEN) domain_crash called from vmcs.c:1830
Dec 23 20:08:33.076076 (XEN) Domain 3 (vcpu#0) crashed on cpu#6:
Dec 23 20:08:33.076085 (XEN) ----[ Xen-4.14-unstable x86_64 debug=y Not tainted ]----
Dec 23 20:08:33.076092 (XEN) CPU: 6
Dec 23 20:08:33.088079 (XEN) RIP: 0000:[<0000000000100036>]
Dec 23 20:08:33.088087 (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (d3v0)
Dec 23 20:08:33.088094 (XEN) rax: 0000000000000000 rbx: 00000000001aa000 rcx: 0000000000000000
Dec 23 20:08:33.100078 (XEN) rdx: 0000000000000000 rsi: 0000000000000000 rdi: 0000000000000000
Dec 23 20:08:33.100087 (XEN) rbp: 0000000000000000 rsp: 0000000000000000 r8: 0000000000000000
Dec 23 20:08:33.112039 (XEN) r9: 0000000000000000 r10: 0000000000000000 r11: 0000000000000000
Dec 23 20:08:33.124074 (XEN) r12: 0000000000000000 r13: 0000000000000000 r14: 0000000000000000
Dec 23 20:08:33.124084 (XEN) r15: 0000000000000000 cr0: 0000000000000031 cr4: 0000000000002050
Dec 23 20:08:33.136075 (XEN) cr3: 0000000000000000 cr2: 0000000000000000
Dec 23 20:08:33.136084 (XEN) fsb: 0000000000000000 gsb: 0000000000000000 gss: 0000000000000000
Dec 23 20:08:33.148050 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: 0000
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 3+ messages in thread
* [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-qemuu-nested-intel
@ 2019-11-17 9:28 osstest service owner
0 siblings, 0 replies; 3+ messages in thread
From: osstest service owner @ 2019-11-17 9:28 UTC (permalink / raw)
To: xen-devel, osstest-admin
branch xen-unstable
xenbranch xen-unstable
job test-amd64-amd64-qemuu-nested-intel
testid debian-hvm-install/l1/l2
Tree: linux git://xenbits.xen.org/linux-pvops.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 59e89cdabc71b5c3a956028ef1c439e6bae947f0
Bug not present: 6dacdcd439c1ddd32110d4a008de346e367409ec
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/144183/
commit 59e89cdabc71b5c3a956028ef1c439e6bae947f0
Author: Andrew Cooper <andrew.cooper3@citrix.com>
Date: Thu Dec 20 17:25:29 2018 +0000
x86/vtx: Disable executable EPT superpages to work around CVE-2018-12207
CVE-2018-12207 covers a set of errata on various Intel processors, whereby a
machine check exception can be generated in a corner case when an executable
mapping changes size or cacheability without TLB invalidation. HVM guest
kernels can trigger this to DoS the host.
To mitigate, in affected hardware, all EPT superpages are marked NX. When an
instruction fetch violation is observed against the superpage, the superpage
is shattered to 4k and has execute permissions restored. This prevents the
guest kernel from being able to create the necessary preconditions in the iTLB
to exploit the vulnerability.
This does come with a workload-dependent performance overhead, caused by
increased TLB pressure. Performance can be restored, if guest kernels are
trusted not to mount an attack, by specifying ept=exec-sp on the command line.
This is part of XSA-304 / CVE-2018-12207
Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
Acked-by: George Dunlap <george.dunlap@citrix.com>
Reviewed-by: Jan Beulich <jbeulich@suse.com>
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2 --summary-out=tmp/144183.bisection-summary --basis-template=144042 --blessings=real,real-bisect xen-unstable test-amd64-amd64-qemuu-nested-intel debian-hvm-install/l1/l2
Searching for failure / basis pass:
144171 fail [host=chardonnay1] / 144042 [host=debina0] 144020 [host=huxelrebe0] 144001 [host=albana1] 143985 [host=chardonnay0] 143967 [host=godello0] 143937 [host=italia0] 143895 [host=godello1] 143715 [host=baroque0] 143563 [host=huxelrebe1] 143437 [host=albana0] 143360 [host=fiano1] 143288 [host=debina1] 143250 [host=albana1] 143205 [host=elbling1] 143172 [host=fiano0] 143133 ok.
Failure / basis pass flights: 144171 / 143133
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: linux git://xenbits.xen.org/linux-pvops.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef b92a286cfb72eacbc988b500f4bb04dbe6bedc0c
Basis pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 4f05a0c775871abd4b8147048f067c1cfe408645
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/linux-pvops.git#b98aebd298246df37b472c52a2ee1023256d02e3-b98aebd298246df37b472c52a2ee1023256d02e3 git://xenbits.xen.org/osstest/linux-firmware.git#c530a75c1e6a472b0eb9558310b518f0dfcd8860-c530a75c1e6a472b0eb9558310b518f0dfcd8860 git://xenbits.xen.org/qemu-xen-traditional.git#d0d8ad39ecb51cd7497cd524484fe09f50876798-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#933ebad2470a169504799a1d95b8e41\
0bd9847ef-933ebad2470a169504799a1d95b8e410bd9847ef git://xenbits.xen.org/xen.git#4f05a0c775871abd4b8147048f067c1cfe408645-b92a286cfb72eacbc988b500f4bb04dbe6bedc0c
Loaded 5002 nodes in revision graph
Searching for test results:
143133 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 4f05a0c775871abd4b8147048f067c1cfe408645
143250 [host=albana1]
143172 [host=fiano0]
143205 [host=elbling1]
143288 [host=debina1]
143437 [host=albana0]
143360 [host=fiano1]
143563 [host=huxelrebe1]
143715 [host=baroque0]
143895 [host=godello1]
143937 [host=italia0]
143985 [host=chardonnay0]
144001 [host=albana1]
143967 [host=godello0]
144020 [host=huxelrebe0]
144042 [host=debina0]
144067 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 8c4330818f6ee70cbf7428a40a28a73df1272d10
144160 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef c40b33d72630dcfa506d6fd856532d6152cb97dc
144167 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 8f1d6c049c0439d8c5b175a0f8369cfde57ba08c
144091 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 85e1424de2dda289a4ee92e6b4f5328dd10e75ae
144149 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 09242da55b32e2d1c3728c23cd43d0377b74bed6
144164 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 09242da55b32e2d1c3728c23cd43d0377b74bed6
144124 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 85e1424de2dda289a4ee92e6b4f5328dd10e75ae
144156 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 4f05a0c775871abd4b8147048f067c1cfe408645
144159 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 85e1424de2dda289a4ee92e6b4f5328dd10e75ae
144161 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 92f91d283d8149dbd6a083589ec6d73c34c06459
144166 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef ad591454f069647c36a7daaa9ec23384c0263f0b
144162 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef b92a286cfb72eacbc988b500f4bb04dbe6bedc0c
144175 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 6dacdcd439c1ddd32110d4a008de346e367409ec
144168 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 59e89cdabc71b5c3a956028ef1c439e6bae947f0
144172 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 4f05a0c775871abd4b8147048f067c1cfe408645
144178 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 6dacdcd439c1ddd32110d4a008de346e367409ec
144170 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef d13dfb02aafaba376b24ff0dc64e19ba1c360803
144173 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef b92a286cfb72eacbc988b500f4bb04dbe6bedc0c
144183 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 59e89cdabc71b5c3a956028ef1c439e6bae947f0
144177 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 59e89cdabc71b5c3a956028ef1c439e6bae947f0
144171 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef b92a286cfb72eacbc988b500f4bb04dbe6bedc0c
144179 fail b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 59e89cdabc71b5c3a956028ef1c439e6bae947f0
144182 pass b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 6dacdcd439c1ddd32110d4a008de346e367409ec
Searching for interesting versions
Result found: flight 143133 (pass), for basis pass
Result found: flight 144162 (fail), for basis failure
Repro found: flight 144172 (pass), for basis pass
Repro found: flight 144173 (fail), for basis failure
0 revisions at b98aebd298246df37b472c52a2ee1023256d02e3 c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 6dacdcd439c1ddd32110d4a008de346e367409ec
No revisions left to test, checking graph state.
Result found: flight 144175 (pass), for last pass
Result found: flight 144177 (fail), for first failure
Repro found: flight 144178 (pass), for last pass
Repro found: flight 144179 (fail), for first failure
Repro found: flight 144182 (pass), for last pass
Repro found: flight 144183 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 59e89cdabc71b5c3a956028ef1c439e6bae947f0
Bug not present: 6dacdcd439c1ddd32110d4a008de346e367409ec
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/144183/
commit 59e89cdabc71b5c3a956028ef1c439e6bae947f0
Author: Andrew Cooper <andrew.cooper3@citrix.com>
Date: Thu Dec 20 17:25:29 2018 +0000
x86/vtx: Disable executable EPT superpages to work around CVE-2018-12207
CVE-2018-12207 covers a set of errata on various Intel processors, whereby a
machine check exception can be generated in a corner case when an executable
mapping changes size or cacheability without TLB invalidation. HVM guest
kernels can trigger this to DoS the host.
To mitigate, in affected hardware, all EPT superpages are marked NX. When an
instruction fetch violation is observed against the superpage, the superpage
is shattered to 4k and has execute permissions restored. This prevents the
guest kernel from being able to create the necessary preconditions in the iTLB
to exploit the vulnerability.
This does come with a workload-dependent performance overhead, caused by
increased TLB pressure. Performance can be restored, if guest kernels are
trusted not to mount an attack, by specifying ept=exec-sp on the command line.
This is part of XSA-304 / CVE-2018-12207
Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
Acked-by: George Dunlap <george.dunlap@citrix.com>
Reviewed-by: Jan Beulich <jbeulich@suse.com>
Revision graph left in /home/logs/results/bisect/xen-unstable/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2.{dot,ps,png,html,svg}.
----------------------------------------
144183: tolerable ALL FAIL
flight 144183 xen-unstable real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/144183/
Failures :-/ but no regressions.
Tests which did not succeed,
including tests which could not be run:
test-amd64-amd64-qemuu-nested-intel 17 debian-hvm-install/l1/l2 fail baseline untested
jobs:
test-amd64-amd64-qemuu-nested-intel fail
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2019-12-24 14:25 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2019-12-22 20:52 [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-qemuu-nested-intel osstest service owner
2019-12-24 14:23 ` Roger Pau Monné
-- strict thread matches above, loose matches on Subject: below --
2019-11-17 9:28 osstest service owner
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.