Re: Encountering errors while using RNBD over rxe for v5.14

[Guoqing Jiang <guoqing.jiang@linux.dev>]

Hi Haris,

On 4/20/22 6:28 PM, Haris Iqbal wrote:
> Hello,
>
> We are facing some issues with the rxe driver in v5.14 (tested with 5.14.21)
>
> After mapping a single RNBD device with 2 rxe interfaces, and with the
> below fio config,
>
> [global]
> description=Emulation of Storage Server Access Pattern
> bssplit=512/20:1k/16:2k/9:4k/12:8k/19:16k/10:32k/8:64k/4
> fadvise_hint=0
> rw=randrw:2
> direct=1
> random_distribution=zipf:1.2
> time_based=1
> runtime=60
> ramp_time=1
> ioengine=libaio
> iodepth=128
> iodepth_batch_submit=128
> iodepth_batch_complete_min=1
> iodepth_batch_complete_max=128
> numjobs=1
> group_reporting
>
> [job1]
> filename=/dev/rnbd0
>
>
> We observe the following error,
>
> [Fri Mar 25 19:08:03 2022] rtrs_client L353: <blya>: Failed
> IB_WR_LOCAL_INV: WR flushed
> [Fri Mar 25 19:08:03 2022] rtrs_client L333: <blya>: Failed
> IB_WR_REG_MR: WR flushed
> [Fri Mar 25 19:08:03 2022] rtrs_client L333: <blya>: Failed
> IB_WR_REG_MR: WR flushed
> [Fri Mar 25 19:08:34 2022] rtrs_client L353: <blya>: Failed
> IB_WR_LOCAL_INV: WR flushed
> [Fri Mar 25 19:08:34 2022] rtrs_client L353: <blya>:*Failed IB_WR_LOCAL_INV: WR flushed*

I got similar message but I am not certain it is the same one, pls see 
the previous report,

https://lore.kernel.org/linux-rdma/20220210073655.42281-1-guoqing.jiang@linux.dev/

Thanks,
Guoqing