* Re: RELEASE CANDIDATE - nfs-utils-1.1.0-rc1
2007-03-29 9:31 ` Neil Brown
@ 2007-03-29 12:44 ` Jan Rekorajski
2007-03-29 14:20 ` Trond Myklebust
2007-03-29 14:24 ` Trond Myklebust
` (2 subsequent siblings)
3 siblings, 1 reply; 15+ messages in thread
From: Jan Rekorajski @ 2007-03-29 12:44 UTC (permalink / raw)
To: Neil Brown; +Cc: nfs
On Thu, 29 Mar 2007, Neil Brown wrote:
> On Thursday March 29, baggins@sith.mimuw.edu.pl wrote:
> > On Thu, 29 Mar 2007, Neil Brown wrote:
> >
> > > Run "statd" only when starting the NFS server.
> > > "statd" should be run before starting the NFS server.
> >
> > While you're at it, can you tell me what should be the order of starting
> > all NFS/NFS4 daemons? So far I got to this:
> >
> > 1) statd
> > 2) mountd
> > 3) nfsd
> > 4) idmapd
> > 5) svcgssd
> > 6) gssd
> > 7) rquotad
> > 8) any NFS mounts
> >
> > Is it correct?
>
> Hmm... good question.
>
> I think:
>
> - idmapd and gssd should be started before any nfs mount
That's quite obvious.
> - idmapd and svcgssd should be started before nfsd
Here I must disagree, my experience shows that idmapd must be started (or
at least restarted) after mountd (or exportfs) is run.
I had no id mapping when I started idmapd before mountd/nfsd.
[...]
> idmapd/svcgssd/gssd:
> simply provide service to the kernel modules. So they should
> be running before the kernel wants them.
What's troubling me here is svcgssd - does it behave like idmapd and
requires mountd? My quick investigation in the source telss me it is so.
Jan
--
Jan Rekorajski | ALL SUSPECTS ARE GUILTY. PERIOD!
baggins<at>mimuw.edu.pl | OTHERWISE THEY WOULDN'T BE SUSPECTS, WOULD THEY?
BOFH, MANIAC | -- TROOPS by Kevin Rubio
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
NFS maillist - NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
^ permalink raw reply [flat|nested] 15+ messages in thread* Re: RELEASE CANDIDATE - nfs-utils-1.1.0-rc1
2007-03-29 12:44 ` Jan Rekorajski
@ 2007-03-29 14:20 ` Trond Myklebust
2007-03-29 16:35 ` J. Bruce Fields
0 siblings, 1 reply; 15+ messages in thread
From: Trond Myklebust @ 2007-03-29 14:20 UTC (permalink / raw)
To: Jan Rekorajski; +Cc: Neil Brown, nfs
On Thu, 2007-03-29 at 14:44 +0200, Jan Rekorajski wrote:
> > - idmapd and svcgssd should be started before nfsd
>
> Here I must disagree, my experience shows that idmapd must be started (or
> at least restarted) after mountd (or exportfs) is run.
> I had no id mapping when I started idmapd before mountd/nfsd.
The only reason I can think of why you might have to restart idmapd
after mountd is if your idmapd init script is failing to
mount /proc/fs/nfsd.
> > idmapd/svcgssd/gssd:
> > simply provide service to the kernel modules. So they should
> > be running before the kernel wants them.
>
> What's troubling me here is svcgssd - does it behave like idmapd and
> requires mountd? My quick investigation in the source telss me it is so.
Ditto. svcgssd also assumes that you have mounted /proc/fs/nfsd. Fix
your svcgssd init script if this is not already the case.
Trond
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
NFS maillist - NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: RELEASE CANDIDATE - nfs-utils-1.1.0-rc1
2007-03-29 14:20 ` Trond Myklebust
@ 2007-03-29 16:35 ` J. Bruce Fields
2007-03-29 16:45 ` Talpey, Thomas
0 siblings, 1 reply; 15+ messages in thread
From: J. Bruce Fields @ 2007-03-29 16:35 UTC (permalink / raw)
To: Trond Myklebust; +Cc: Neil Brown, nfs, Jan Rekorajski
On Thu, Mar 29, 2007 at 10:20:43AM -0400, Trond Myklebust wrote:
> On Thu, 2007-03-29 at 14:44 +0200, Jan Rekorajski wrote:
>
> > > - idmapd and svcgssd should be started before nfsd
> >
> > Here I must disagree, my experience shows that idmapd must be started (or
> > at least restarted) after mountd (or exportfs) is run.
> > I had no id mapping when I started idmapd before mountd/nfsd.
>
> The only reason I can think of why you might have to restart idmapd
> after mountd is if your idmapd init script is failing to
> mount /proc/fs/nfsd.
>
> > > idmapd/svcgssd/gssd:
> > > simply provide service to the kernel modules. So they should
> > > be running before the kernel wants them.
> >
> > What's troubling me here is svcgssd - does it behave like idmapd and
> > requires mountd? My quick investigation in the source telss me it is so.
>
> Ditto. svcgssd also assumes that you have mounted /proc/fs/nfsd. Fix
> your svcgssd init script if this is not already the case.
That's been a common source of errors in the past. Maybe svcgssd and
idmapd should be taught to watch for changes to the /proc/ directories
it cares about, maybe using dnotify or inotify.
--b.
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
NFS maillist - NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: RELEASE CANDIDATE - nfs-utils-1.1.0-rc1
2007-03-29 16:35 ` J. Bruce Fields
@ 2007-03-29 16:45 ` Talpey, Thomas
0 siblings, 0 replies; 15+ messages in thread
From: Talpey, Thomas @ 2007-03-29 16:45 UTC (permalink / raw)
To: J. Bruce Fields; +Cc: Neil Brown, nfs, Jan Rekorajski, Trond Myklebust
At 12:35 PM 3/29/2007, J. Bruce Fields wrote:
>> Ditto. svcgssd also assumes that you have mounted /proc/fs/nfsd. Fix
>> your svcgssd init script if this is not already the case.
>
>That's been a common source of errors in the past. Maybe svcgssd and
>idmapd should be taught to watch for changes to the /proc/ directories
>it cares about, maybe using dnotify or inotify.
Does inotify work on /proc? Cool!
Anyway, I totally agree on the /proc/fs/nfsd pipefs. I remember being
quite surprised when I first discovered that it usually is mounted by a
single-line shell script deeply buried in /etc/modprobe.d/modprobe.conf.dist.
Tom.
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
NFS maillist - NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: RELEASE CANDIDATE - nfs-utils-1.1.0-rc1
2007-03-29 9:31 ` Neil Brown
2007-03-29 12:44 ` Jan Rekorajski
@ 2007-03-29 14:24 ` Trond Myklebust
2007-03-29 14:30 ` Talpey, Thomas
2007-04-01 12:16 ` Frank van Maarseveen
3 siblings, 0 replies; 15+ messages in thread
From: Trond Myklebust @ 2007-03-29 14:24 UTC (permalink / raw)
To: Neil Brown; +Cc: nfs, Jan Rekorajski
On Thu, 2007-03-29 at 19:31 +1000, Neil Brown wrote:
> - idmapd and gssd should be started before any nfs mount
> - idmapd and svcgssd should be started before nfsd
> - mountd should start before nfsd.
> - sm-notify should start *after* nfsd.
...and _after_ statd. If the server is not ready to accept lock reclaim
requests, then it is wrong to be sending out sm-notify requests.
Trond
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
NFS maillist - NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: RELEASE CANDIDATE - nfs-utils-1.1.0-rc1
2007-03-29 9:31 ` Neil Brown
2007-03-29 12:44 ` Jan Rekorajski
2007-03-29 14:24 ` Trond Myklebust
@ 2007-03-29 14:30 ` Talpey, Thomas
2007-04-01 12:16 ` Frank van Maarseveen
3 siblings, 0 replies; 15+ messages in thread
From: Talpey, Thomas @ 2007-03-29 14:30 UTC (permalink / raw)
To: nfs
At 05:31 AM 3/29/2007, Neil Brown wrote:
>On Thursday March 29, baggins@sith.mimuw.edu.pl wrote:
>> On Thu, 29 Mar 2007, Neil Brown wrote:
>>
>> > Run "statd" only when starting the NFS server.
>> > "statd" should be run before starting the NFS server.
>>
>> While you're at it, can you tell me what should be the order of starting
>> all NFS/NFS4 daemons? So far I got to this:
>>
Don't forget...
0) portmapper
*This* is the most important one! ;-) Interesting things happen when
portmapper isn't present btw, some clients fail to retry if they get errors
on portmap lookups. They often fail to retry if the portmapper replies
with a zero port (service not found), which is the more common startup
ordering issue.
Really interesting things happen after the statmon notifications, if clients
start to reclaim and fail to find the portmapper or the lock manager. Solaris,
for example, starts killing client processes with SIGLOST. So I agree that
it is critical to ensure that portmap, statd and nfsd (which implies lockd
on Linux of course) are started before the server's notifications.
Tom.
>> 1) statd
>> 2) mountd
>> 3) nfsd
>> 4) idmapd
>> 5) svcgssd
>> 6) gssd
>> 7) rquotad
>> 8) any NFS mounts
>>
>> Is it correct?
>
>Hmm... good question.
>
>I think:
>
> - idmapd and gssd should be started before any nfs mount
> - idmapd and svcgssd should be started before nfsd
> - mountd should start before nfsd.
> - sm-notify should start *after* nfsd.
> - on reflection, statd can probably start slightly after nfsd,
> and if statd is doing the notify, it should definitely be
> after, so my above comment is wrong. I'll fix it in the
> next RC.
> Similarly it should start before, or atmost slightly after, any
> NFS mount.
> - rquotad should probably start before nfsd, but it probably isn't
> very important.
>
>Rationale:
>
> sm-notify:
> On an NFS server, this tells the client to reclaim locks. They
> will try to do so straight away. If nfsd hasn't started lockd yet,
> they will fail and give up. This is the most important
> dependency.
> On an NFS client, it simply tells the server to forget about old
> locks, so when it starts isn't terribly important.
> statd:
> This provides service to nfsd/lockd, but also it responds to
> SM_NOTIFY from peers and then needs to talk to the kernel.
> So kernel needs to talk to statd, and statd need to talk to kernel.
> Both sides will retry on failure, so order isn't too important,
> but there should not be a long gap between startup time.
> mountd:
> provides "is this exported" service to nfsd. If it isn't running
> when the first nfs request arrives, it might be rejected
> incorrectly. This is probably the second most important
> dependency.
> rquotad:
> provides service to clients completely independently of nfsd
> so when it starts probably doesn't matter.
> idmapd/svcgssd/gssd:
> simply provide service to the kernel modules. So they should
> be running before the kernel wants them.
>
>I think that covers everything.
>
>NeilBrown
>
>-------------------------------------------------------------------------
>Take Surveys. Earn Cash. Influence the Future of IT
>Join SourceForge.net's Techsay panel and you'll get the chance to share your
>opinions on IT & business topics through brief surveys-and earn cash
>http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>_______________________________________________
>NFS maillist - NFS@lists.sourceforge.net
>https://lists.sourceforge.net/lists/listinfo/nfs
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
NFS maillist - NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: RELEASE CANDIDATE - nfs-utils-1.1.0-rc1
2007-03-29 9:31 ` Neil Brown
` (2 preceding siblings ...)
2007-03-29 14:30 ` Talpey, Thomas
@ 2007-04-01 12:16 ` Frank van Maarseveen
2007-04-01 23:35 ` Neil Brown
3 siblings, 1 reply; 15+ messages in thread
From: Frank van Maarseveen @ 2007-04-01 12:16 UTC (permalink / raw)
To: Neil Brown; +Cc: nfs, Jan Rekorajski
On Thu, Mar 29, 2007 at 07:31:25PM +1000, Neil Brown wrote:
> On Thursday March 29, baggins@sith.mimuw.edu.pl wrote:
> > On Thu, 29 Mar 2007, Neil Brown wrote:
> >
> > > Run "statd" only when starting the NFS server.
> > > "statd" should be run before starting the NFS server.
> >
> > While you're at it, can you tell me what should be the order of starting
> > all NFS/NFS4 daemons? So far I got to this:
> >
> > 1) statd
> > 2) mountd
> > 3) nfsd
> > 4) idmapd
> > 5) svcgssd
> > 6) gssd
> > 7) rquotad
> > 8) any NFS mounts
> >
> > Is it correct?
>
> Hmm... good question.
>
> I think:
>
> - idmapd and gssd should be started before any nfs mount
> - idmapd and svcgssd should be started before nfsd
> - mountd should start before nfsd.
At first that seems the logically correct order but suppose a client
succeeds in mounting something but issues NFS requests before nfsd got
started on the server?
where's the exportfs?
Consider a "sleep 30" at every point in the startup sequence and think
about what would go wrong. Also consider a dead-again server at every
point in the startup sequence.
--
Frank
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
NFS maillist - NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
^ permalink raw reply [flat|nested] 15+ messages in thread* Re: RELEASE CANDIDATE - nfs-utils-1.1.0-rc1
2007-04-01 12:16 ` Frank van Maarseveen
@ 2007-04-01 23:35 ` Neil Brown
0 siblings, 0 replies; 15+ messages in thread
From: Neil Brown @ 2007-04-01 23:35 UTC (permalink / raw)
To: Frank van Maarseveen; +Cc: nfs, Jan Rekorajski
On Sunday April 1, frankvm@frankvm.com wrote:
> On Thu, Mar 29, 2007 at 07:31:25PM +1000, Neil Brown wrote:
> >
> > Hmm... good question.
> >
> > I think:
> >
> > - idmapd and gssd should be started before any nfs mount
> > - idmapd and svcgssd should be started before nfsd
> > - mountd should start before nfsd.
>
> At first that seems the logically correct order but suppose a client
> succeeds in mounting something but issues NFS requests before nfsd got
> started on the server?
That shouldn't matter. The NFS server will not respond so the client
will retry.
Ofcourse if you have a soft mount it could get messy, but then soft
mounts are always messy.
>
> where's the exportfs?
Good point. exportfs should be run before mountd is started, and
after nfsd filesystem is mounted.
NeilBrown
>
> Consider a "sleep 30" at every point in the startup sequence and think
> about what would go wrong. Also consider a dead-again server at every
> point in the startup sequence.
>
> --
> Frank
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
NFS maillist - NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
^ permalink raw reply [flat|nested] 15+ messages in thread