Issue with OpenSolaris kernels on GRUB2

[Patrick Georgi <patrick@georgi-clan.de>]

Hi,

OpenSolaris uses GRUB (legacy) to boot using the multiboot interface. I 
tried loading the kernel with GRUB2 tonight, and it failed (with a very 
confusing message: "attempt to seek outside of the file").

Investigating this a bit, I found the issue:
It's the aout loader that complains, and it fails because it gets to 
parse an ELF file.
How comes this? The kernel contains the MULTIBOOT_AOUT_KLUDGE in the 
header flags (0x10000), while it's delivered as ELF image. I reported 
this to OpenSolaris, and I guess they'll fix it eventually.

Yet, GRUB2 differs in behaviour from GRUB legacy:

GRUB first looks if the file is multiboot and an ELF image. If not, it 
looks for the aout flag, and handles the file accordingly. So in case of 
the OpenSolaris kernel, it never looks at the flag.

GRUB2 first looks if the flag is set and assumes the file is aout (and 
fails), and only if not, tries ELF.

I'm not sure if that change in behaviour is intended, which is why I ask 
here. If the new behaviour is to stay, making the aout parser more 
robust, and fail with a more meaningful error, might be a good idea.


Thanks,
Patrick Georgi