From: Jeff Garzik <jeff@garzik.org>
To: Evgeniy Polyakov <johnpol@2ka.mipt.ru>
Cc: linux-kernel@vger.kernel.org, netdev@vger.kernel.org,
linux-fsdevel@vger.kernel.org
Subject: Re: POHMELFS high performance network filesystem. Cache coherency, transactions, parallels.
Date: Sun, 25 May 2008 21:41:19 -0400 [thread overview]
Message-ID: <483A153F.7000907@garzik.org> (raw)
In-Reply-To: <20080525134055.GA30630@2ka.mipt.ru>
Evgeniy Polyakov wrote on the blog page:
> Probably there will be some kind of a status messages for servers (i.e.
> going offline, do not send me data, or I'm becoming slow, do not read
> from me and so on).
Often you can capture this information in a more scalable manner, by
having the clients measure an observable _output_ such as latency, over
time.
Each transaction gives the client new feedback about the server(s) being
offline (i.e. timeout), becoming slow, etc.
Another potential tool is having the server(s) send an abstract number,
from 0-100, indicating their level of desire for new { read | write }
transactions. Let us call this client hint "weight". Rather than have
a bunch of status messages that indicate server load average, or
do-not-read state, summarize this information into read_weight and
write_weight hints to the client.
With just a few (two?) simple variables, the client is given the ability
to automatically balance and scale load across the cluster, work around
failing servers, etc.
Write balancing need not be overly complex...
Jeff
next prev parent reply other threads:[~2008-05-26 1:41 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-05-25 13:40 POHMELFS high performance network filesystem. Cache coherency, transactions, parallels Evgeniy Polyakov
2008-05-25 19:55 ` Jeff Garzik
2008-05-25 20:21 ` Evgeniy Polyakov
2008-05-26 1:15 ` Jeff Garzik
2008-05-26 6:22 ` Evgeniy Polyakov
2008-05-26 6:33 ` Jeff Garzik
2008-05-26 7:07 ` Evgeniy Polyakov
2008-05-26 7:27 ` Jeff Garzik
2008-05-26 7:44 ` Evgeniy Polyakov
2008-05-26 7:51 ` Jeff Garzik
2008-05-26 9:13 ` Evgeniy Polyakov
2008-05-26 1:41 ` Jeff Garzik [this message]
2008-05-26 7:12 ` Evgeniy Polyakov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=483A153F.7000907@garzik.org \
--to=jeff@garzik.org \
--cc=johnpol@2ka.mipt.ru \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).