Re: Realtek 8169 problems with net booting

[Michael Brown <mbrown@fensystems.co.uk>]

On Thursday 04 December 2008 18:15:03 David Miller wrote:
> > The assumption that the chip is quiescent is invalid in the case of any
> > kind of boot from SAN (e.g. iSCSI, AoE) via the net device.  The
> > INT13-based bootloader has no way to signal to the boot firmware that it
> > is finished using the INT13 interface, so the card will always be left in
> > an active state.
>
> So there is no "close" method for the boot loader to call?
> Who designs this crud? :-(

I believe that would be IBM, circa 1980.  Pity they didn't consider the needs 
of iSCSI boot in a protected-mode OS.

For SAN boot, the network boot loader (e.g. gPXE) emulates a BIOS disk using 
INT 13, and the next-stage boot loader (e.g. lilo/grub) believes that it is 
operating a physical disk; it doesn't even know that there's a NIC involved 
that may need to be shut down.

> > In gPXE, we do what we can to ensure that the card is safe to use when
> > the OS loads; we edit the RX buffers, ISR, etc. out of the system memory
> > map prior to starting an iSCSI boot.  We don't, however, get a chance to
> > actually quiesce the chip before the OS driver loads up, so the OS driver
> > must be prepared to discover the chip in an active state.
>
> It's really unfortunate that things have been setup so poorly.
>
> So OK, we have to handle this.

Agreed.  From our point of view, we will guarantee that the card is left in a 
state that is "active but harmless"; if the OS never touches the card then 
nothing bad will happen.  The driver should, as its first action, reset 
everything except the chip's PCI core.  (Some chips have only the facility to 
reset everything including the PCI core; I've seen drivers that back up PCI 
config space prior to reset and restore it afterwards, which seems to work.)

Michael