During testing I got an OOPS with the brcmsmac (see attachment). I 
suspect mac80211 is using a driver callback after the module is removed 
(could be wrong here). The connection with the AP is dropped, and after 
1 sec. the driver is unloaded using rmmod, which causes the driver to 
unregister from mac80211.

Any clues?

Gr. AvS