public inbox for linux-rdma@vger.kernel.org
 help / color / mirror / Atom feed
From: Karandeep Chahal <kchahal-LfVdkaOWEx8@public.gmane.org>
To: Or Gerlitz <or.gerlitz-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
Cc: David Dillow <dillowda-1Heg1YXhbW8@public.gmane.org>,
	linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: Re: [PATCH 1/1] ib_srp: Infiniband srp fast failover patch.
Date: Mon, 12 Nov 2012 18:46:05 -0500	[thread overview]
Message-ID: <50A18A3D.9070304@ddn.com> (raw)
In-Reply-To: <CAJZOPZL0cj6Sb_xs7prV0k8HjWkELD7Y89Bxxp-xXnnGqxvXyg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>

In my experience with ib-srp, I am not sure if there is such a thing as 
link going down for a short time. When the link goes down, no matter how 
short the duration (< 1s), IO fails over, this failover takes very long 
time currently. Or, I would like to know if you can get a ib-srp 
failover time of less than a minute somehow (by tweaking OS or multipath 
settings). I was unable to get it to work even after a pretty exhaustive 
attempt.

Dave, on a separate note, with OFED-1.5.4 and RHEL-6x, I have tried 
setting ib_srp.srp_dev_loss_tmo=5 seconds, it does not seem to help 
failover time.

Karan

On 11/12/2012 06:10 PM, Or Gerlitz wrote:
> On Wed, May 30, 2012 at 7:06 AM, David Dillow <dillowda-1Heg1YXhbW8@public.gmane.org> wrote:
>> On Tue, 2012-05-29 at 17:07 -0400, Karandeep Chahal wrote:
>>> Subject: [PATCH] Infiniband srp fast failover patch.
>> This conflicts with Bart's patches to improve failover; it will be much
>> better to use his approach to block the target rather than remove it
>> wholesale -- we could have lost connectivity as a transient and may get
>> it back quickly if someone grabbed the wrong cable, etc.
>>
>> Also, we should only kill the one target on DREQ, and we already have a
>> pointer to it from the CM context -- no need to search.
>>
>> It is a good idea to hook into the event mechanism;
> Dave,
>
> I wonder why this hooking is the correct way to go, if the IB link
> went down for very short time, why should we care, what's missing in
> relying on probes done by HA SW such as multipath and RC timeouts?
>
> Or.
>
>> this is something I've long wanted to incorporate (as Vu did in OFED). I'm looking at
>> getting Bart's series to a point I can merge it, and I'll pull in your
>> ideas -- with credit -- there.

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2012-11-12 23:46 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-05-29 21:07 [PATCH 1/1] ib_srp: Infiniband srp fast failover patch Karandeep Chahal
2012-05-29 21:51 ` Michael Reed
2012-05-29 22:27   ` Karandeep Chahal
     [not found]     ` <4FC54D62.3080003-LfVdkaOWEx8@public.gmane.org>
2012-05-29 22:53       ` Michael Reed
     [not found] ` <4FC53AAA.3060203-LfVdkaOWEx8@public.gmane.org>
2012-05-30  5:06   ` David Dillow
2012-05-30 14:39     ` Karandeep Chahal
     [not found]     ` <1338354377.2361.13.camel-1q1vX8mYZiGLUyTwlgNVppKKF0rrzTr+@public.gmane.org>
2012-11-12 23:10       ` Or Gerlitz
     [not found]         ` <CAJZOPZL0cj6Sb_xs7prV0k8HjWkELD7Y89Bxxp-xXnnGqxvXyg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-11-12 23:46           ` Karandeep Chahal [this message]
     [not found]             ` <50A18A3D.9070304-LfVdkaOWEx8@public.gmane.org>
2012-11-13 21:07               ` Or Gerlitz

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=50A18A3D.9070304@ddn.com \
    --to=kchahal-lfvdkaowex8@public.gmane.org \
    --cc=dillowda-1Heg1YXhbW8@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=or.gerlitz-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox