答复: RE: bfa driver on xen

答复: RE: bfa driver on xen

[Joe Jin]

Jing, thanks for you suggestion.

----- 原始邮件 -----
发件人: huangj@Brocade.COM
收件人: joe.jin@oracle.com, linux-scsi@vger.kernel.org
抄送: soeren.binner@oracle.com, haobo.zhou@oracle.com
发送时间: 2010年 5 月 01日 星期六  上午 5:13:36 GMT +08:00 北京/重庆/香港/乌鲁木齐
主题: RE: bfa driver on xen

Hi Joe,

Thanks for reporting the issue. We have noticed this during the netapp/oracal ovm test to include bfa driver as part of ovm distro. As a workaround, we suggested to set num_sgpg=512 and num_ios=512. 

We are working on a fix and it will be available in our 2.3 driver.

Regards,

Jing

>-----Original Message-----
>From: Joe Jin [mailto:joe.jin@oracle.com]
>Sent: Friday, April 30, 2010 2:34 AM
>To: Jing Huang; linux-scsi@vger.kernel.org
>Cc: soeren.binner@oracle.com; haobo.zhou@oracle.com; joe.jin@oracle.com
>Subject: bfa driver on xen
>
>Hi Jing Huang,
>
>I'm Joe Jin from Oracle Linux team, recently we tried brocade device
>on HP DL385 with OracleVM and  found the device could not worked for
>driver could not applied enough memory with below error message:
>
>bfad[0]: memory allocation failed with num_sgpgs: 2048
>bfad[0]: trying to allocate memory with num_sgpgs: 1024
>bfad[0]: memory allocation failed with num_sgpgs: 1024
>bfad[0]: trying to allocate memory with num_sgpgs: 512
>bfad0 bfad_hal_mem_alloc failure
>Not enough memory to attach all Brocade HBA ports, System may need more
>
>I have did some investigated, here are some information:
>OracleVM xen it 64bit and Dom0 is 32bit, the root cause is when 32bit Dom0
>running on 64bit hypervisor(xen), it on compat mode and xen just allowed
>to allocate 1M(order = 8) contiguous memory, if not of compat mode,
>Dom0 would successed applied 2M(order=9) contiguous memory.
>
>To let it the device works, we have to decrease driver config params
>like num_sgpgs, reqq_size, rspq_size and so on, I'm not sure if
>there are some releations among them, also did not known what values
>is good enough for performance, woule you like give me some advices
>for those? we have to reduce bfa driver DMA memory no more than 1M.
>
>Thanks,
>Joe
>

--
To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html