From: Jens Axboe <jens.axboe@oracle.com>
To: Yinghai Lu <yinghai@kernel.org>
Cc: Jesse Barnes <jbarnes@virtuousgeek.org>,
Linux Kernel <linux-kernel@vger.kernel.org>,
mingo@elte.hu, rdreier@cisco.com,
Suresh Siddha <suresh.b.siddha@intel.com>,
"linux-pci@vger.kernel.org" <linux-pci@vger.kernel.org>
Subject: Re: kexec boot regression
Date: Tue, 15 Dec 2009 20:22:27 +0100 [thread overview]
Message-ID: <20091215192226.GR28252@kernel.dk> (raw)
In-Reply-To: <4B27E0C7.9060909@kernel.org>
On Tue, Dec 15 2009, Yinghai Lu wrote:
> Jens Axboe wrote:
> > On Tue, Dec 15 2009, Yinghai Lu wrote:
> >> Jens Axboe wrote:
> >>> On Tue, Dec 15 2009, Yinghai Lu wrote:
> >>>> [ 13.018720] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> >>>>
> >>>> [ 13.100724] [Firmware Bug]: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
> >>> On a "normal" non-kexec boot, I get:
> >>>
> >>> [ 12.173583] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> >>> [ 12.184075] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
> >>> [ 12.216874] PCI: Using configuration type 1 for base access
> >>>
> >> can you run following scripts in first kernel?
> >>
> >> cd /sys/firmware/memmap
> >> for dir in * ; do
> >> start=$(cat $dir/start)
> >> end=$(cat $dir/end)
> >> type=$(cat $dir/type)
> >> printf "%016x-%016x (%s)\n" $start $[ $end +1] "$type" >> /tmp/memmap.txt
> >> done
> >>
> >> and send out /tmp/memmap.txt
> >
> > Below.
> >
> >> what is your kexec tools version? could be too old?
> >
> > It says:
> >
> > kexec-tools-testing 20080324 released 24th March 2008
> >
> >
> > 0000000000000000-0000000000098800 (System RAM)
> > 0000000000098800-00000000000a0000 (reserved)
> > 0000000079301000-0000000079303000 (reserved)
> > 0000000079303000-0000000079305000 (ACPI Tables)
> > 0000000079305000-0000000079310000 (reserved)
> > 0000000079310000-0000000079314000 (ACPI Tables)
> > 0000000079314000-0000000079319000 (reserved)
> > 0000000079319000-0000000079336000 (ACPI Tables)
> > 0000000079336000-0000000079358000 (reserved)
> > 0000000079358000-0000000079388000 (ACPI Tables)
> > 0000000079388000-00000000793c9000 (reserved)
> > 00000000793c9000-000000007968f000 (ACPI Tables)
> > 00000000000e0000-0000000000100000 (reserved)
> > 000000007968f000-00000000796bb000 (reserved)
> > 00000000796bb000-00000000799d8000 (ACPI Tables)
> > 00000000799d8000-0000000079bd8000 (ACPI Non-volatile Storage)
> > 0000000079bd8000-0000000079d8b000 (ACPI Tables)
> > 0000000079d8b000-0000000079d8c000 (reserved)
> > 0000000079d8c000-0000000079dc8000 (ACPI Tables)
> > 0000000079dc8000-0000000079dcb000 (reserved)
> > 0000000079dcb000-0000000079e1c000 (ACPI Tables)
> > 0000000079e1c000-0000000079e87000 (reserved)
> > 0000000079e87000-000000007bd5f000 (ACPI Tables)
> > 0000000000100000-0000000078c59000 (System RAM)
> > 000000007bd5f000-000000007be4f000 (reserved)
> > 000000007be4f000-000000007bf87000 (ACPI Tables)
> > 000000007bf87000-000000007bfcf000 (ACPI Non-volatile Storage)
> > 000000007bfcf000-000000007bfff000 (ACPI Tables)
> > 000000007bfff000-0000000090000000 (reserved)
> > 00000000fc000000-00000000fd000000 (reserved)
> > 00000000fed1c000-00000000fed20000 (reserved)
> > 00000000ff000000-0000000100000000 (reserved)
> > 0000000100000000-0000001080000000 (System RAM)
> > 0000000078c59000-0000000078e6d000 (ACPI Non-volatile Storage)
> > 0000000078e6d000-000000007924e000 (ACPI Tables)
> > 000000007924e000-00000000792c2000 (reserved)
> > 00000000792c2000-00000000792d2000 (ACPI Tables)
> > 00000000792d2000-00000000792e7000 (reserved)
> > 00000000792e7000-0000000079301000 (ACPI Tables)
> >
>
> boot log of first kernel?
Hmm not completely sure, let me re-do it after a cold boot.
BTW, I just checked, and 2.6.32 has NUMA working fine. Below is the SRAT
and NUMA output from 2.6.32 (kexec'ed kernel). Is the check a newly
introduced one?
[ 0.000000] SRAT: PXM 0 -> APIC 0 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 64 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 32 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 96 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 2 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 66 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 34 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 98 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 4 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 68 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 36 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 100 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 6 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 70 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 38 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 102 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 16 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 80 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 48 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 112 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 18 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 82 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 50 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 114 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 20 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 84 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 52 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 116 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 22 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 86 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 54 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 118 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 1 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 65 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 33 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 97 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 3 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 67 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 35 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 99 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 5 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 69 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 37 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 101 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 7 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 71 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 39 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 103 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 17 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 81 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 49 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 113 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 19 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 83 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 51 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 115 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 21 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 85 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 53 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 117 -> Node 3
[ 0.000000] SRAT: PXM 0 -> APIC 23 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 87 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 55 -> Node 2
[ 0.000000] SRAT: PXM 3 -> APIC 119 -> Node 3
[ 0.000000] SRAT: Node 0 PXM 0 0-80000000
[ 0.000000] SRAT: Node 0 PXM 0 100000000-480000000
[ 0.000000] SRAT: Node 2 PXM 1 480000000-880000000
[ 0.000000] SRAT: Node 1 PXM 2 880000000-c80000000
[ 0.000000] SRAT: Node 3 PXM 3 c80000000-1080000000
[ 0.000000] NUMA: Using 31 for the hash shift.
[ 0.000000] Bootmem setup node 0 0000000000000000-0000000480000000
[ 0.000000] NODE_DATA [0000000000048000 - 000000000004cfff]
[ 0.000000] bootmap [0000000000100000 - 000000000018ffff] pages 90
[ 0.000000] (8 early reservations) ==> bootmem [0000000000 - 0480000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
[ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
[ 0.000000] #2 [0001000000 - 000200f260] TEXT DATA BSS ==> [0001000000 - 000200f260]
[ 0.000000] #3 [0000098800 - 0000100000] BIOS reserved ==> [0000098800 - 0000100000]
[ 0.000000] #4 [0002010000 - 000201035c] BRK ==> [0002010000 - 000201035c]
[ 0.000000] #5 [0000008000 - 000000a000] PGTABLE ==> [0000008000 - 000000a000]
[ 0.000000] #6 [000000a000 - 0000048000] PGTABLE ==> [000000a000 - 0000048000]
[ 0.000000] #7 [0000001000 - 000000103c] ACPI SLIT ==> [0000001000 - 000000103c]
[ 0.000000] Bootmem setup node 1 0000000880000000-0000000c80000000
[ 0.000000] NODE_DATA [0000000880000000 - 0000000880004fff]
[ 0.000000] bootmap [0000000880005000 - 0000000880084fff] pages 80
[ 0.000000] (8 early reservations) ==> bootmem [0880000000 - 0c80000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page
[ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE
[ 0.000000] #2 [0001000000 - 000200f260] TEXT DATA BSS
[ 0.000000] #3 [0000098800 - 0000100000] BIOS reserved
[ 0.000000] #4 [0002010000 - 000201035c] BRK
[ 0.000000] #5 [0000008000 - 000000a000] PGTABLE
[ 0.000000] #6 [000000a000 - 0000048000] PGTABLE
[ 0.000000] #7 [0000001000 - 000000103c] ACPI SLIT
[ 0.000000] Bootmem setup node 2 0000000480000000-0000000880000000
[ 0.000000] NODE_DATA [0000000480000000 - 0000000480004fff]
[ 0.000000] bootmap [0000000480005000 - 0000000480084fff] pages 80
[ 0.000000] (8 early reservations) ==> bootmem [0480000000 - 0880000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page
[ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE
[ 0.000000] #2 [0001000000 - 000200f260] TEXT DATA BSS
[ 0.000000] #3 [0000098800 - 0000100000] BIOS reserved
[ 0.000000] #4 [0002010000 - 000201035c] BRK
[ 0.000000] #5 [0000008000 - 000000a000] PGTABLE
[ 0.000000] #6 [000000a000 - 0000048000] PGTABLE
[ 0.000000] #7 [0000001000 - 000000103c] ACPI SLIT
[ 0.000000] Bootmem setup node 3 0000000c80000000-0000001080000000
[ 0.000000] NODE_DATA [0000000c80000000 - 0000000c80004fff]
[ 0.000000] bootmap [0000000c80005000 - 0000000c80084fff] pages 80
[ 0.000000] (8 early reservations) ==> bootmem [0c80000000 - 1080000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page
[ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE
[ 0.000000] #2 [0001000000 - 000200f260] TEXT DATA BSS
[ 0.000000] #3 [0000098800 - 0000100000] BIOS reserved
[ 0.000000] #4 [0002010000 - 000201035c] BRK
[ 0.000000] #5 [0000008000 - 000000a000] PGTABLE
[ 0.000000] #6 [000000a000 - 0000048000] PGTABLE
[ 0.000000] #7 [0000001000 - 000000103c] ACPI SLIT
[ 0.000000] found SMP MP-table at [ffff8800000fddb0] fddb0
[ 0.000000] [ffffea0000000000-ffffea001d3fffff] PMD -> [ffff880028600000-ffff8800425fffff] on node 0
[ 0.000000] [ffffea001d400000-ffffea00373fffff] PMD -> [ffff880480200000-ffff88049a1fffff] on node 2
[ 0.000000] [ffffea0037400000-ffffea003fffffff] PMD -> [ffff880880200000-ffff880888dfffff] on node 1
[ 0.000000] [ffffea0040000000-ffffea00513fffff] PMD -> [ffff880889000000-ffff88089a3fffff] on node 1
[ 0.000000] [ffffea0051400000-ffffea006b3fffff] PMD -> [ffff880c80200000-ffff880c9a1fffff] on node 3
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000001 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x01080000
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[6] active PFN ranges
[ 0.000000] 0: 0x00000001 -> 0x00000098
[ 0.000000] 0: 0x00000100 -> 0x00078c59
[ 0.000000] 0: 0x00100000 -> 0x00480000
[ 0.000000] 2: 0x00480000 -> 0x00880000
[ 0.000000] 1: 0x00880000 -> 0x00c80000
[ 0.000000] 3: 0x00c80000 -> 0x01080000
[ 0.000000] On node 0 totalpages: 4164592
[ 0.000000] DMA zone: 104 pages used for memmap
[ 0.000000] DMA zone: 185 pages reserved
[ 0.000000] DMA zone: 3702 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 26520 pages used for memmap
[ 0.000000] DMA32 zone: 464065 pages, LIFO batch:31
[ 0.000000] Normal zone: 93184 pages used for memmap
[ 0.000000] Normal zone: 3576832 pages, LIFO batch:31
[ 0.000000] On node 1 totalpages: 4194304
[ 0.000000] Normal zone: 106496 pages used for memmap
[ 0.000000] Normal zone: 4087808 pages, LIFO batch:31
[ 0.000000] On node 2 totalpages: 4194304
[ 0.000000] Normal zone: 106496 pages used for memmap
[ 0.000000] Normal zone: 4087808 pages, LIFO batch:31
[ 0.000000] On node 3 totalpages: 4194304
[ 0.000000] Normal zone: 106496 pages used for memmap
[ 0.000000] Normal zone: 4087808 pages, LIFO batch:31
--
Jens Axboe
next prev parent reply other threads:[~2009-12-15 19:22 UTC|newest]
Thread overview: 42+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-12-15 11:50 kexec boot regression Jens Axboe
2009-12-15 12:01 ` Yinghai Lu
2009-12-15 12:14 ` Jens Axboe
2009-12-15 12:31 ` Yinghai Lu
2009-12-15 12:39 ` Jens Axboe
2009-12-15 12:55 ` Yinghai Lu
2009-12-15 14:11 ` Jens Axboe
2009-12-15 18:39 ` Yinghai Lu
2009-12-15 18:47 ` Matthew Wilcox
2009-12-15 18:54 ` Jens Axboe
2009-12-15 18:59 ` Jens Axboe
2009-12-15 19:04 ` Yinghai Lu
2009-12-15 19:11 ` Jens Axboe
2009-12-15 19:17 ` Yinghai Lu
2009-12-15 19:22 ` Jens Axboe [this message]
2009-12-15 19:28 ` Jens Axboe
2009-12-15 19:44 ` Yinghai Lu
2009-12-15 19:48 ` Jens Axboe
2009-12-15 19:49 ` Yinghai Lu
2009-12-15 19:57 ` Jens Axboe
2009-12-15 21:30 ` Markus Trippelsdorf
2009-12-15 23:02 ` kexec boot regression radeon/kms (bisected) Markus Trippelsdorf
2009-12-15 19:43 ` kexec boot regression Jens Axboe
2009-12-15 19:48 ` Yinghai Lu
2009-12-15 19:51 ` Jens Axboe
2009-12-15 19:56 ` Yinghai Lu
2009-12-15 20:09 ` Jens Axboe
2009-12-15 20:14 ` Yinghai Lu
2009-12-15 20:19 ` Jens Axboe
2009-12-15 20:21 ` Yinghai Lu
2009-12-15 20:42 ` Jens Axboe
2009-12-15 20:55 ` Jens Axboe
2009-12-15 21:01 ` Jens Axboe
2009-12-15 21:26 ` Yinghai Lu
2009-12-15 21:30 ` Jens Axboe
2009-12-15 21:40 ` Jens Axboe
2009-12-15 21:43 ` Yinghai Lu
2009-12-15 21:47 ` Jens Axboe
2009-12-15 21:50 ` Yinghai Lu
2009-12-15 21:52 ` Jens Axboe
2009-12-15 22:24 ` Yinghai Lu
2009-12-16 10:01 ` Jens Axboe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20091215192226.GR28252@kernel.dk \
--to=jens.axboe@oracle.com \
--cc=jbarnes@virtuousgeek.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-pci@vger.kernel.org \
--cc=mingo@elte.hu \
--cc=rdreier@cisco.com \
--cc=suresh.b.siddha@intel.com \
--cc=yinghai@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox