public inbox for linux-rdma@vger.kernel.org
 help / color / mirror / Atom feed
From: Jason Gunthorpe <jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
To: Steve Wise <swise-7bPotxP6k4+P2YhJcF5u+vpXobYPEAuW@public.gmane.org>
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: Re: rdma-core, cmake/ninja question
Date: Thu, 22 Sep 2016 10:31:43 -0600	[thread overview]
Message-ID: <20160922163143.GC6994@obsidianresearch.com> (raw)
In-Reply-To: <014501d214ed$6e4472f0$4acd58d0$@opengridcomputing.com>

On Thu, Sep 22, 2016 at 11:21:53AM -0500, Steve Wise wrote:
> > 
> > I recommend *against* running 'make install' to /usr. This is a big
> > package now, it is hard to unwind it once it installs over your
> > system. I really should finish the run in place patch :|
> > 
> > If you do this:
> > 
> > $ echo /usr/local/lib64/ > /etc/ld.so.conf.d/usrlocal.conf && ldconfig
> > 
> > Then you can install to /usr/local/ and things will work as you
> > expect. Note, this depends on a verbs patch that is still only in my
> > preview tree.
> 
> So I have a dev system setup with everything installed from the distro in /usr.
> I have my rdma-core git tree.  I change libcxgb4 to fix a bug.  I want to test
> it.  I install it to /usr/local and add /etc/ld.so.conf.d/usrlocal.conf.  But
> that still doesn't work because ldconfig still finds libcxgb4 in /usr/lib64
> first...

Apply this patch:

https://github.com/jgunthorpe/rdma-plumbing/commit/64ed4fd30a2157bdaf0a8f7f1b04d2dad02c1b8f

It hardwires the search path into libverbs and libverbs will look into
the place it was installed before searching the system library
path. That will eliminate the problem you mentioned above.

Further, after that patch is applied you can do a rough imitation of
'run-in-place' like this:

$ cmake .. -DVERBS_PROVIDER_DIR:PATH=`pwd`/lib -DSYSCONF_INSTALL_DIR:PATH=/etc

(untested) That hardwires the build directory into libibverbs, so it
will try to load all drivers from there first.

Then use

$ export LD_LIBRARY_PATH=`pwd`/lib

And all verbs using programs started from that shell will use the full
new library set and the new providers without having to do make
install at all.

I plan to automate this basic approach for 'run in place', please let
me know if it works for you and makes sense.

Jason
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  reply	other threads:[~2016-09-22 16:31 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-09-22 15:35 rdma-core, cmake/ninja question Steve Wise
2016-09-22 15:48 ` Jason Gunthorpe
     [not found]   ` <20160922154814.GB15212-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2016-09-22 16:21     ` Steve Wise
2016-09-22 16:31       ` Jason Gunthorpe [this message]
     [not found]         ` <20160922163143.GC6994-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2016-09-22 18:43           ` Steve Wise
2016-09-22 19:29             ` Jason Gunthorpe
     [not found]               ` <20160922192932.GA25659-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2016-09-22 19:34                 ` Steve Wise
2016-09-22 19:38                   ` Jason Gunthorpe
     [not found]   ` <014601d214ed$6e4a8d70$4adfa850$@opengridcomputing.com>
2016-09-22 16:23     ` Steve Wise

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20160922163143.GC6994@obsidianresearch.com \
    --to=jgunthorpe-epgobjl8dl3ta4ec/59zmfatqe2ktcn/@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=swise-7bPotxP6k4+P2YhJcF5u+vpXobYPEAuW@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox