infiniband limit of 32 cards per system?

Alex Chiang
2010-01-25T23:50:13Z

Hello,

I'm pretty unfamiliar with Infiniband, so apologies for the
stupid question.

Is there a limit on how many IB devices a system might support?

My colleague points out the following enum in uverbs_main.c:

enum {
IB_UVERBS_MAJOR = 231,
IB_UVERBS_BASE_MINOR = 192,
IB_UVERBS_MAX_DEVICES = 32
};

Experimentally, we've determined that on a system where we
plugged in 40 IB cards, OFED only reports 32 cards are present.

If that enum is indeed the limiting factor, would someone mind
explaining (or pointing me at TFM ;) why it's limited to 32
devices?

Thanks,
/ac