* State of the Reiser4 FS
@ 2006-03-14 10:41 Avuton Olrich
2006-03-14 11:45 ` Vladimir V. Saveliev
2006-03-15 8:45 ` Hans Reiser
0 siblings, 2 replies; 27+ messages in thread
From: Avuton Olrich @ 2006-03-14 10:41 UTC (permalink / raw)
To: ReiserFS List
Hello,
I just saw a thread on the LKML a minute ago asking about the state of
getting the patch into vanilla linux. I read Andrew Morton's post
about a month ago stating that it could happen soon, but was unlikely
due to there not actually being a need for it to go into mainline (no
major distro default, etc...). I was wondering, myself, earlier in the
day what the state of the patch was, if anything further has been said
about getting it into mainline. Was also wondering if there was a lot
of work going into it right now, or are people tied up doing other
things?
If anyone has time for an answer it'd be appreciated by everyone I'm sure,
Gratefully,
avuton
--
Anyone who quotes me in their sig is an idiot. -- Rusty Russell.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-14 10:41 State of the Reiser4 FS Avuton Olrich
@ 2006-03-14 11:45 ` Vladimir V. Saveliev
2006-03-14 15:32 ` Clemens Eisserer
2006-03-15 8:45 ` Hans Reiser
1 sibling, 1 reply; 27+ messages in thread
From: Vladimir V. Saveliev @ 2006-03-14 11:45 UTC (permalink / raw)
To: Avuton Olrich; +Cc: ReiserFS List
Hello
On Tue, 2006-03-14 at 02:41 -0800, Avuton Olrich wrote:
> Hello,
>
> I just saw a thread on the LKML a minute ago asking about the state of
> getting the patch into vanilla linux. I read Andrew Morton's post
> about a month ago stating that it could happen soon, but was unlikely
> due to there not actually being a need for it to go into mainline (no
> major distro default, etc...). I was wondering, myself, earlier in the
> day what the state of the patch was, if anything further has been said
> about getting it into mainline. Was also wondering if there was a lot
> of work going into it right now, or are people tied up doing other
> things?
>
> If anyone has time for an answer it'd be appreciated by everyone I'm sure,
>
AFAIK, the most recent reason why reiser4 does not get included is that
reiser4 developers have to change reiser4 to use generic code to
implement read/write.
AFAICS, reiser4 developers do not work on that.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-14 11:45 ` Vladimir V. Saveliev
@ 2006-03-14 15:32 ` Clemens Eisserer
2006-03-15 7:14 ` Hans Reiser
0 siblings, 1 reply; 27+ messages in thread
From: Clemens Eisserer @ 2006-03-14 15:32 UTC (permalink / raw)
To: reiserfs-list
> AFAIK, the most recent reason why reiser4 does not get included is that
> reiser4 developers have to change reiser4 to use generic code to
> implement read/write.
> AFAICS, reiser4 developers do not work on that.
Has this really become a reason to not include reiser4 into mainline?
I also don't see a reason for that - at least it would bind reiser4
more close to linux making ports to other OS harder.
Furthermore if it would decrease performance its simply no way to go.
(btw. I think this could be a way to generate some revenue - I think
there is demand for a modern fs which is supported by both, windows
and linux).
lg Clemens
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-14 15:32 ` Clemens Eisserer
@ 2006-03-15 7:14 ` Hans Reiser
2006-03-15 8:57 ` Andreas Schäfer
2006-03-15 19:45 ` State of the Reiser4 FS Jonathan Briggs
0 siblings, 2 replies; 27+ messages in thread
From: Hans Reiser @ 2006-03-15 7:14 UTC (permalink / raw)
To: Clemens Eisserer; +Cc: reiserfs-list
Clemens Eisserer wrote:
>>AFAIK, the most recent reason why reiser4 does not get included is that
>>reiser4 developers have to change reiser4 to use generic code to
>>implement read/write.
>>AFAICS, reiser4 developers do not work on that.
>>
>>
>Has this really become a reason to not include reiser4 into mainline?
>
>
Yes, this is the official reason.
>I also don't see a reason for that - at least it would bind reiser4
>more close to linux making ports to other OS harder.
>
>
You are entirely correct. It is an interesting social phenomenom that
we must do this, yes? Using the ext3 (err, generic) code makes it much
harder to license and port reiser4.
>Furthermore if it would decrease performance its simply no way to go.
>
>
What we are currently doing is rewriting the reiser4 read and write code
to not operate 4k at a time. The design specification was that it was
supposed to do as much as possible once per write, and as little as
possible every 4k. Unfortunately, when I reviewed our code the design
specification had not been adhered to. After the reiser4 code adheres
to the reiser4 design specification, it will be possible to argue that
the reiser4 design specification is technically superior, and the
generic code should change. I generally believe that the per 4k
approach used throughout the linux kernel is not as CPU efficient as
sending larger groups of pages through the layers all at once. In other
words, there is a reason we have bios, and we need to learn the lesson
from them that they teach us, and abstract it into a general design
approach.
We must make reiser4 adhere to the reiser4 design specification before
we can deal with their demand that we change the generic code so that it
does what reiser4 does. I have no desire to touch their code, but they
require it. Generally speaking, they don't really like any feature
existing in reiser4 that is not in their code, and ask that we add it to
their code before reiser4 is allowed to have it. They call the ext3
code the "generic" code. They claim that if we don't use the ext3 code
in our fs then they will be forced to shoulder an extra burden to
maintain our code. We are not allowed to specify that they should not
maintain our code at all. I need to read more Kafka I think, it is hard
for me to understand it all.
>(btw. I think this could be a way to generate some revenue - I think
>there is demand for a modern fs which is supported by both, windows
>and linux).
>
>
There are so many ways to generate revenue by spending revenue I don't
have in my pocket right now..... forgive me, yes, someday we should do
that and will do that.
>lg Clemens
>
>
>
>
If any of you users want to see a reiser4, you have to strenuously
clamor for it to go into mainline, or you simply will not get it.
Namesys cannot survive indefinitely with it not going into the kernel.
This is a political issue, and viewing it as otherwise is simply naive.
It is sad, I chose Linux over BSD to develop for because BSD used to be
like this.
Hans
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-14 10:41 State of the Reiser4 FS Avuton Olrich
2006-03-14 11:45 ` Vladimir V. Saveliev
@ 2006-03-15 8:45 ` Hans Reiser
2006-03-15 12:59 ` Avuton Olrich
1 sibling, 1 reply; 27+ messages in thread
From: Hans Reiser @ 2006-03-15 8:45 UTC (permalink / raw)
To: Avuton Olrich; +Cc: ReiserFS List
Avuton Olrich wrote:
>Hello,
>
>I just saw a thread on the LKML a minute ago asking about the state of
>getting the patch into vanilla linux. I read Andrew Morton's post
>about a month ago stating that it could happen soon, but was unlikely
>due to there not actually being a need for it to go into mainline (no
>major distro default, etc...).
>
Can you supply a reference to this post? The only distro which is not
influenced by performance numbers when selecting a filesystem is RedHat,
and most of the rest are just waiting to be sure that politics will not
kill reiser4 inclusion. I am sure I can come up with a "we will support
it if you let it in" petition of distros if such a silliness is needed.
> I was wondering, myself, earlier in the
>day what the state of the patch was, if anything further has been said
>about getting it into mainline. Was also wondering if there was a lot
>of work going into it right now, or are people tied up doing other
>things?
>
>If anyone has time for an answer it'd be appreciated by everyone I'm sure,
>
>Gratefully,
>
>avuton
>--
> Anyone who quotes me in their sig is an idiot. -- Rusty Russell.
>
>
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 7:14 ` Hans Reiser
@ 2006-03-15 8:57 ` Andreas Schäfer
2006-03-15 18:29 ` Hans Reiser
2006-03-15 19:45 ` State of the Reiser4 FS Jonathan Briggs
1 sibling, 1 reply; 27+ messages in thread
From: Andreas Schäfer @ 2006-03-15 8:57 UTC (permalink / raw)
To: Hans Reiser; +Cc: reiserfs-list
On 23:14 Tue 14 Mar , Hans Reiser wrote:
> I generally believe that the per 4k
> approach used throughout the linux kernel is not as CPU efficient as
> sending larger groups of pages through the layers all at once. In other
> words, there is a reason we have bios, and we need to learn the lesson
> from them that they teach us, and abstract it into a general design
> approach.
This is a bit OT, but still: I think you're absolutely right there. This 4k
approach causes funny thing even in completely different areas.
I've recently been playing around with openMosix (transparent process
migration between Linux hosts over the network) and there the write
preformance is totally spoiled (>50% performance loss) just because
copy_from_user is only called for 4k block when writing (and these
requests then suffer from the high network latency).
If larger blocks would be used, this performance flaw wouldn't exist at
all... Just my 2 cents
-Andreas
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 8:45 ` Hans Reiser
@ 2006-03-15 12:59 ` Avuton Olrich
2006-03-15 18:33 ` Hans Reiser
0 siblings, 1 reply; 27+ messages in thread
From: Avuton Olrich @ 2006-03-15 12:59 UTC (permalink / raw)
To: Hans Reiser; +Cc: ReiserFS List
On 3/15/06, Hans Reiser <reiser@namesys.com> wrote:
> Avuton Olrich wrote:
> >I just saw a thread on the LKML a minute ago asking about the state of
> >getting the patch into vanilla linux. I read Andrew Morton's post
> >about a month ago stating that it could happen soon, but was unlikely
> >due to there not actually being a need for it to go into mainline (no
> >major distro default, etc...).
> >
> Can you supply a reference to this post? The only distro which is not
> influenced by performance numbers when selecting a filesystem is RedHat,
> and most of the rest are just waiting to be sure that politics will not
> kill reiser4 inclusion. I am sure I can come up with a "we will support
> it if you let it in" petition of distros if such a silliness is needed.
I was refering to this post:
http://marc.theaimsgroup.com/?l=linux-kernel&m=113775878722100&w=2
Thanks for all the answers
--
avuton
--
Anyone who quotes me in their sig is an idiot. -- Rusty Russell.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 8:57 ` Andreas Schäfer
@ 2006-03-15 18:29 ` Hans Reiser
2006-03-15 19:27 ` Andreas Schäfer
0 siblings, 1 reply; 27+ messages in thread
From: Hans Reiser @ 2006-03-15 18:29 UTC (permalink / raw)
To: Andreas Schäfer; +Cc: reiserfs-list
Andreas Schäfer wrote:
>On 23:14 Tue 14 Mar , Hans Reiser wrote:
>
>
>>I generally believe that the per 4k
>>approach used throughout the linux kernel is not as CPU efficient as
>>sending larger groups of pages through the layers all at once. In other
>>words, there is a reason we have bios, and we need to learn the lesson
>>from them that they teach us, and abstract it into a general design
>>approach.
>>
>>
>
>This is a bit OT, but still: I think you're absolutely right there. This 4k
>approach causes funny thing even in completely different areas.
>
>I've recently been playing around with openMosix (transparent process
>migration between Linux hosts over the network) and there the write
>preformance is totally spoiled (>50% performance loss) just because
>copy_from_user is only called for 4k block when writing (and these
>requests then suffer from the high network latency).
>
>
Tell the mosix guys we would be willing to cooperate with them regarding
their problem.
>If larger blocks would be used, this performance flaw wouldn't exist at
>all... Just my 2 cents
>
>-Andreas
>
>
>
>
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 12:59 ` Avuton Olrich
@ 2006-03-15 18:33 ` Hans Reiser
2006-03-26 11:27 ` 2.6.16 patch jp
0 siblings, 1 reply; 27+ messages in thread
From: Hans Reiser @ 2006-03-15 18:33 UTC (permalink / raw)
To: Avuton Olrich; +Cc: ReiserFS List
Avuton Olrich wrote:
>On 3/15/06, Hans Reiser <reiser@namesys.com> wrote:
>
>
>>Avuton Olrich wrote:
>>
>>
>>>I just saw a thread on the LKML a minute ago asking about the state of
>>>getting the patch into vanilla linux. I read Andrew Morton's post
>>>about a month ago stating that it could happen soon, but was unlikely
>>>due to there not actually being a need for it to go into mainline (no
>>>major distro default, etc...).
>>>
>>>
>>>
>>Can you supply a reference to this post? The only distro which is not
>>influenced by performance numbers when selecting a filesystem is RedHat,
>>and most of the rest are just waiting to be sure that politics will not
>>kill reiser4 inclusion. I am sure I can come up with a "we will support
>>it if you let it in" petition of distros if such a silliness is needed.
>>
>>
>
>I was refering to this post:
>http://marc.theaimsgroup.com/?l=linux-kernel&m=113775878722100&w=2
>
>Thanks for all the answers
>--
>avuton
>--
> Anyone who quotes me in their sig is an idiot. -- Rusty Russell.
>
>
Oh, well, the overall tone of that email is not all that negative.
We will work on the 4k at a time issue, overcome that issue technically,
and then after that is resolved deal with generating desire for a
filesystem that is 2x (reiser4.0) to 4x (4.1alpha with compression) faster.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 18:29 ` Hans Reiser
@ 2006-03-15 19:27 ` Andreas Schäfer
2006-03-15 21:08 ` Andreas Dilger
2006-03-16 0:58 ` 4k at a time only works well for an OS that does less per iteration than Linux does Hans Reiser
0 siblings, 2 replies; 27+ messages in thread
From: Andreas Schäfer @ 2006-03-15 19:27 UTC (permalink / raw)
To: Hans Reiser; +Cc: reiserfs-list
On 10:29 Wed 15 Mar , Hans Reiser wrote:
> Tell the mosix guys we would be willing to cooperate with them regarding
> their problem.
If it was that easy... The problem for openMosix is that most devices
fetch data in 4k blocks via copy_from_user(). For migrated processes,
openMosix intercepts these calls and forwards them to the node which
currently hosts the process. This forwarding yields a high latency
penalty.
Obviously there are two ways to get rid of this problem:
* modify _every_ Linux device driver to use a
_a_lot_more_than_4k_at_a_time_ approach or
* implement a second "read ahead" buffer which fetches large blocks via
the network in the background and answers calls to copy_from_user()
directly from the local buffer
In my _very_ humble opinion the first approach would be much nicer,
but after you guys had so many trouble with just your filesystem, I
don't see that one coming, not at all.
So I think the long term strategy for oM will the second, double
buffering approach. At least I couldn't think of any other realistic,
feasible way.
BTW: how are you guys planning to solve this 4k issue? Will you revert
to small blocks or will you "pretend" to perform 4k transfers and
assemble those in the background to, again, process large chunks at
once? If yes, wouldn't this seriously increase CPU usage due to
(most likely) unnecessary data duplication?
Regards
-Andreas
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 7:14 ` Hans Reiser
2006-03-15 8:57 ` Andreas Schäfer
@ 2006-03-15 19:45 ` Jonathan Briggs
2006-03-15 20:43 ` Hans Reiser
1 sibling, 1 reply; 27+ messages in thread
From: Jonathan Briggs @ 2006-03-15 19:45 UTC (permalink / raw)
To: Hans Reiser; +Cc: reiserfs-list
[-- Attachment #1: Type: text/plain, Size: 1784 bytes --]
On Tue, 2006-03-14 at 23:14 -0800, Hans Reiser wrote:
[snip]
> They claim that if we don't use the ext3 code
> in our fs then they will be forced to shoulder an extra burden to
> maintain our code. We are not allowed to specify that they should not
> maintain our code at all. I need to read more Kafka I think, it is hard
> for me to understand it all.
Err, this actually does make a lot of sense Hans.
The mainline Linux Kernel code is maintained by everyone that can
convince Linus or a sub-maintainer to accept their patch. In order to
produce an acceptable patch to core kernel code that provides
file-system services, a patch author must also change the file systems
that use it. He or she cannot just leave the change laying around for
everyone else to fix. (At least, not usually.)
The only code that doesn't have to be maintained by main-line patch
contributors is out of tree, which is where Reiser4 is now. Code that
no one is interested in maintaining or can't be maintained gets kicked
out of tree.
Some of your reasons to get it into main-line kernel include: more trust
by end users that your code is stable, avoiding your team having to do
their own fixes for cross-kernel changes, and a wider user base through
ease of use (not having to apply extra kernel patches).
Right?
User trust comes through passing the code reviews, and users knowing
that if the Reiser4 team vaporizes, the code can still be maintained and
the file-system won't disappear.
Avoiding extra work for cross-kernel patches means that other people
have to be able to make changes to your code.
That all means that accepting Reiser4 code into main-line does mean they
have to maintain it.
--
Jonathan Briggs <jbriggs@esoft.com>
eSoft, Inc.
[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 191 bytes --]
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 19:45 ` State of the Reiser4 FS Jonathan Briggs
@ 2006-03-15 20:43 ` Hans Reiser
2006-03-15 21:25 ` Andreas Schäfer
0 siblings, 1 reply; 27+ messages in thread
From: Hans Reiser @ 2006-03-15 20:43 UTC (permalink / raw)
To: Jonathan Briggs; +Cc: reiserfs-list
Jonathan Briggs wrote:
>On Tue, 2006-03-14 at 23:14 -0800, Hans Reiser wrote:
>[snip]
>
>
>>They claim that if we don't use the ext3 code
>>in our fs then they will be forced to shoulder an extra burden to
>>maintain our code. We are not allowed to specify that they should not
>>maintain our code at all. I need to read more Kafka I think, it is hard
>>for me to understand it all.
>>
>>
>
>Err, this actually does make a lot of sense Hans.
>
>The mainline Linux Kernel code is maintained by everyone that can
>convince Linus or a sub-maintainer to accept their patch. In order to
>
>
I am the reiserfs/reiser4 sub-maintainer. So, if reiser4 works well,
and is faster than any other Linux FS, and it is, maintaining it over
time is for me to worry about, not them.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 19:27 ` Andreas Schäfer
@ 2006-03-15 21:08 ` Andreas Dilger
2006-03-16 0:58 ` 4k at a time only works well for an OS that does less per iteration than Linux does Hans Reiser
1 sibling, 0 replies; 27+ messages in thread
From: Andreas Dilger @ 2006-03-15 21:08 UTC (permalink / raw)
To: Andreas Sch�fer; +Cc: Hans Reiser, reiserfs-list
On Mar 15, 2006 20:27 +0100, Andreas Sch�fer wrote:
> If it was that easy... The problem for openMosix is that most devices
> fetch data in 4k blocks via copy_from_user(). For migrated processes,
> openMosix intercepts these calls and forwards them to the node which
> currently hosts the process. This forwarding yields a high latency
> penalty.
>
> Obviously there are two ways to get rid of this problem:
>
> * modify _every_ Linux device driver to use a
> _a_lot_more_than_4k_at_a_time_ approach or
>
> * implement a second "read ahead" buffer which fetches large blocks via
> the network in the background and answers calls to copy_from_user()
> directly from the local buffer
Or you can use a network filesystem like Lustre that handles this
itself ;-). Sadly, though, it has to do both of these to get
good performance, via {sub,per}version of the VFS/VM.
Clients do delayed-write (writeback cache, with write credits from
the server to accound for space) to avoid small RPCs. They also
do large amounts of readahead (in large chunks) to improve reads
for applications and the VM that breaks up all reads into 4kB chunks.
Servers also do batch block allocation and then large direct writes
instead of going through the VFS/VM. There are still a number of
device drivers that break up bios into chunks smaller than 1MB, and
that hurts performance.
Having a generic delayed/batch allocation mechanism is definitely
the right way to go, and from my reading of linux-fsdevel this is
underway by some folks at IBM. Since we have to support customers
dating back to 2.4.21 it will be a while before we can move over to
the newer APIs, once they are available.
> BTW: how are you guys planning to solve this 4k issue? Will you revert
> to small blocks or will you "pretend" to perform 4k transfers and
> assemble those in the background to, again, process large chunks at
> once? If yes, wouldn't this seriously increase CPU usage due to
> (most likely) unnecessary data duplication?
It doesn't result in data duplication, per se, since the pages are
copied into kernel space only once. What it does mean is that there
needs to be a duplication of infrastructure in order to reassemble
and track all of these pages.
Cheers, Andreas
--
Andreas Dilger
Principal Software Engineer
Cluster File Systems, Inc.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: State of the Reiser4 FS
2006-03-15 20:43 ` Hans Reiser
@ 2006-03-15 21:25 ` Andreas Schäfer
0 siblings, 0 replies; 27+ messages in thread
From: Andreas Schäfer @ 2006-03-15 21:25 UTC (permalink / raw)
To: Hans Reiser; +Cc: Jonathan Briggs, reiserfs-list
On 12:43 Wed 15 Mar , Hans Reiser wrote:
> I am the reiserfs/reiser4 sub-maintainer. So, if reiser4 works well,
> and is faster than any other Linux FS, and it is, maintaining it over
> time is for me to worry about, not them.
I feel this thread is about to trail off to shores we all know too
well. AFAICS we do have two completely different issues here:
* The core maintainers want the whole code to adhere to certain
standards. This doesn't have anything to do with performance
etc. It's just for the fact that this standard is both, a sign of
reliability and maintainability (even for the unlikely case that
Namesys would disappear)
* Reiser4 doesn't adhere to some of these standards because they don't
make much sense from a performance (and design) point of view.
I think the short term solution should be to adapt Reiser4 to the
standard, but in the long run keep bugging the Linux people to change
some paradigms (as one of Linux' core advantages has always been the
ability and willingness to throw decayed code overboard).
When you think about it, both POV do make sense. It's just so sad this
whole debate has become much more a political than a style debate.
-Andreas
^ permalink raw reply [flat|nested] 27+ messages in thread
* 4k at a time only works well for an OS that does less per iteration than Linux does
2006-03-15 19:27 ` Andreas Schäfer
2006-03-15 21:08 ` Andreas Dilger
@ 2006-03-16 0:58 ` Hans Reiser
1 sibling, 0 replies; 27+ messages in thread
From: Hans Reiser @ 2006-03-16 0:58 UTC (permalink / raw)
To: Andreas Schäfer; +Cc: reiserfs-list, Nate Diller, LKML
To sum up for akpm what was said previously in this thread:
Linux needs to take the lesson learned from bios about how going up and
down through various software layers once per 4k is too expensive, and
generalize it to where in general, in all of the layers, we are
operating many pages at a time. It would be nice for code simplicity if
the same struct, with perhaps some optional attachments to it, was used
the whole trip (rather than pagevecs in once place and bios in another).
For kernel newbies on lkml let me summarize it as for every trip made
through these layers, a whole lot more than 4k of code gets traversed,
all of it seeming to have some legitimate purpose;-), so only handling
4k per trip is more expensive than you might guess.
Now, for the question that was raised:
Andreas Schäfer wrote:
>On 10:29 Wed 15 Mar , Hans Reiser wrote:
>
>
>>Tell the mosix guys we would be willing to cooperate with them regarding
>>their problem.
>>
>>
>
>If it was that easy... The problem for openMosix is that most devices
>fetch data in 4k blocks via copy_from_user(). For migrated processes,
>openMosix intercepts these calls and forwards them to the node which
>currently hosts the process. This forwarding yields a high latency
>penalty.
>
>Obviously there are two ways to get rid of this problem:
>
>* modify _every_ Linux device driver to use a
> _a_lot_more_than_4k_at_a_time_ approach or
>
>
I suspect that if the code benefitted more than mosix in its
implementation, and I think it would, then akpm might not be opposed to
the one above provided someone wrote it. There is a rumor he already
understands this is a problem. Maybe he can comment on the rumor.;-)
>* implement a second "read ahead" buffer which fetches large blocks via
> the network in the background and answers calls to copy_from_user()
> directly from the local buffer
>
>In my _very_ humble opinion the first approach would be much nicer,
>but after you guys had so many trouble with just your filesystem, I
>don't see that one coming, not at all.
>
>So I think the long term strategy for oM will the second, double
>buffering approach. At least I couldn't think of any other realistic,
>feasible way.
>
>BTW: how are you guys planning to solve this 4k issue? Will you revert
>to small blocks
>
not sure what that means. You mean surrender? Not yet.;-) First we
fix our code so that reiser4 really does what I am arguing it needs to
do, then we will argue it is the right approach.
>or will you "pretend" to perform 4k transfers and
>assemble those in the background to, again, process large chunks at
>once?
>
Oh is that ugly.... no. Dynamically sized pagevecs (I call them
pagezams) are better.
We will process things in large chunks all the way down to the io layer,
and then wait for Nate or others to fix the io layer someday.
>If yes, wouldn't this seriously increase CPU usage due to
>(most likely) unnecessary data duplication?
>
>Regards
>-Andreas
>
>
>
>
^ permalink raw reply [flat|nested] 27+ messages in thread
* 2.6.16 patch
2006-03-15 18:33 ` Hans Reiser
@ 2006-03-26 11:27 ` jp
2006-03-27 17:27 ` jp
2006-03-27 20:10 ` Marcus Furlong
0 siblings, 2 replies; 27+ messages in thread
From: jp @ 2006-03-26 11:27 UTC (permalink / raw)
To: ReiserFS List
Hi,
I would like to know when I can expect the reiser4 patch to be available
for vanilla 2.6.16 ?
Thanks
Best regards
Jean-Philippe Guillemin
Zenwalk.org
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-26 11:27 ` 2.6.16 patch jp
@ 2006-03-27 17:27 ` jp
2006-03-28 11:42 ` Vladimir V. Saveliev
2006-03-27 20:10 ` Marcus Furlong
1 sibling, 1 reply; 27+ messages in thread
From: jp @ 2006-03-27 17:27 UTC (permalink / raw)
Cc: ReiserFS List
Hi,
I would really like to get an answer to my question below ;)
Did I forget to write "please" ?
Best regards
JP
jp wrote:
> Hi,
>
> I would like to know when I can expect the reiser4 patch to be
> available for vanilla 2.6.16 ?
>
> Thanks
>
> Best regards
>
> Jean-Philippe Guillemin
> Zenwalk.org
>
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-27 20:10 ` Marcus Furlong
@ 2006-03-27 19:44 ` Tassilo Horn
2006-03-27 21:32 ` Marcus Furlong
0 siblings, 1 reply; 27+ messages in thread
From: Tassilo Horn @ 2006-03-27 19:44 UTC (permalink / raw)
To: reiserfs-list
Marcus Furlong <furlongm@hotmail.com> writes:
Hi Marcus,
> There is a unofficial clean-up of the 2.6.15 patch here:
>
> https://www.cs.tcd.ie/~furlongm/reiser4/2.6.16/
>
> along with a clean-up the enable-metas patch.
I tried these two patches which applied fine, but when compiling the
kernel I get:
# LC_ALL=C make
CHK include/linux/version.h
CHK include/linux/compile.h
CHK usr/initramfs_list
GEN .version
CHK include/linux/compile.h
UPD include/linux/compile.h
CC init/version.o
LD init/built-in.o
LD .tmp_vmlinux1
fs/built-in.o: In function `items_stop':
pseudo.c:(.text+0x8b848): undefined reference to `unlock'
make: *** [.tmp_vmlinux1] Error 1
The mentioned function is:
,----[ fs/reiser4/plugin/pseudo/pseudo.c ]
| /*
| * stop iteration over a sequence of items for the host file
| */
| static void items_stop(struct seq_file *m, void *v)
| {
| unlock(&get_seq_pseudo_host(m)->i_mutex);
| finish(v);
| }
`----
Any pointer to what could be wrong would be appreciated.
Kind regards,
Tassilo
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-26 11:27 ` 2.6.16 patch jp
2006-03-27 17:27 ` jp
@ 2006-03-27 20:10 ` Marcus Furlong
2006-03-27 19:44 ` Tassilo Horn
1 sibling, 1 reply; 27+ messages in thread
From: Marcus Furlong @ 2006-03-27 20:10 UTC (permalink / raw)
To: reiserfs-list
Hi,
jp wrote:
> I would like to know when I can expect the reiser4 patch to be available
> for vanilla 2.6.16 ?
There is a unofficial clean-up of the 2.6.15 patch here:
https://www.cs.tcd.ie/~furlongm/reiser4/2.6.16/
along with a clean-up the enable-metas patch.
It applies to vanilla 2.6.16, but it doesn't contain any of the fixes in -mm
(e.g. don't build as a module without applying the export symbol patches in
-mm). It's working ok for me.
Marcus.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-27 21:32 ` Marcus Furlong
@ 2006-03-27 20:41 ` Tassilo Horn
2006-03-27 21:29 ` Tassilo Horn
1 sibling, 0 replies; 27+ messages in thread
From: Tassilo Horn @ 2006-03-27 20:41 UTC (permalink / raw)
To: reiserfs-list
Marcus Furlong <furlongm@hotmail.com> writes:
Hi Marcus,
> Sorry about that, must have put the wrong patch up. Change unlock to
> mutex_unlock and it should be fine.
Yes, thought that. And now it works.
Thanks,
Tassilo
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-27 21:32 ` Marcus Furlong
2006-03-27 20:41 ` Tassilo Horn
@ 2006-03-27 21:29 ` Tassilo Horn
1 sibling, 0 replies; 27+ messages in thread
From: Tassilo Horn @ 2006-03-27 21:29 UTC (permalink / raw)
To: reiserfs-list
Marcus Furlong <furlongm@hotmail.com> writes:
Hello Marcus,
> Sorry about that, must have put the wrong patch up. Change unlock to
> mutex_unlock and it should be fine.
My last posting was a littlebit too fast. It compiles cleanly as I said
before, but my machine does not boot with this new kernel. I used my
current /proc/config.gz as kernel configuration.
But at least I have to admit that I don't use a vanilla 2.6.16 kernel,
but gentoo-sources, so perhaps this is the problem...
The last messages are:
,----
| CPU1: Intel Genuine Intel(R) CPU T2300 @ 1.66GHz stepping 08
| Total of 2 processors activated (6653.92 BogoMIPS).
| ENABLING IO-APIC IRQs
| ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
`----
Kind regards,
Tassilo
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-27 19:44 ` Tassilo Horn
@ 2006-03-27 21:32 ` Marcus Furlong
2006-03-27 20:41 ` Tassilo Horn
2006-03-27 21:29 ` Tassilo Horn
0 siblings, 2 replies; 27+ messages in thread
From: Marcus Furlong @ 2006-03-27 21:32 UTC (permalink / raw)
To: reiserfs-list
Tassilo Horn wrote:
> I tried these two patches which applied fine, but when compiling the
> kernel I get:
>
> # LC_ALL=C make
> CHK include/linux/version.h
> CHK include/linux/compile.h
> CHK usr/initramfs_list
> GEN .version
> CHK include/linux/compile.h
> UPD include/linux/compile.h
> CC init/version.o
> LD init/built-in.o
> LD .tmp_vmlinux1
> fs/built-in.o: In function `items_stop':
> pseudo.c:(.text+0x8b848): undefined reference to `unlock'
> make: *** [.tmp_vmlinux1] Error 1
>
> The mentioned function is:
>
> ,----[ fs/reiser4/plugin/pseudo/pseudo.c ]
> | /*
> | * stop iteration over a sequence of items for the host file
> | */
> | static void items_stop(struct seq_file *m, void *v)
> | {
> | unlock(&get_seq_pseudo_host(m)->i_mutex);
> | finish(v);
> | }
> `----
>
> Any pointer to what could be wrong would be appreciated.
Sorry about that, must have put the wrong patch up. Change unlock to
mutex_unlock and it should be fine.
Marcus.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-27 17:27 ` jp
@ 2006-03-28 11:42 ` Vladimir V. Saveliev
2006-03-28 12:54 ` Tassilo Horn
2006-03-28 23:22 ` Jake Maciejewski
0 siblings, 2 replies; 27+ messages in thread
From: Vladimir V. Saveliev @ 2006-03-28 11:42 UTC (permalink / raw)
To: jp; +Cc: ReiserFS List
Hello
On Mon, 2006-03-27 at 19:27 +0200, jp wrote:
> Hi,
>
> I would really like to get an answer to my question below ;)
>
sorry for delay:
ftp://ftp.namesys.com/pub/reiser4-for-2.6/2.6.16/reiser4-for-2.6.16-1.patch.gz
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-28 11:42 ` Vladimir V. Saveliev
@ 2006-03-28 12:54 ` Tassilo Horn
2006-03-28 17:12 ` Danny Milosavljevic
2006-03-28 23:22 ` Jake Maciejewski
1 sibling, 1 reply; 27+ messages in thread
From: Tassilo Horn @ 2006-03-28 12:54 UTC (permalink / raw)
To: reiserfs-list
"Vladimir V. Saveliev" <vs@namesys.com> writes:
Hi Vladimir,
> sorry for delay:
No problem.
> ftp://ftp.namesys.com/pub/reiser4-for-2.6/2.6.16/reiser4-for-2.6.16-1.patch.gz
The machine seems to be not available...
Regards,
Tassilo
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-28 12:54 ` Tassilo Horn
@ 2006-03-28 17:12 ` Danny Milosavljevic
2006-03-28 18:00 ` Tassilo Horn
0 siblings, 1 reply; 27+ messages in thread
From: Danny Milosavljevic @ 2006-03-28 17:12 UTC (permalink / raw)
To: Tassilo Horn; +Cc: reiserfs-list
Hi,
Am Dienstag, den 28.03.2006, 14:54 +0200 schrieb Tassilo Horn:
> "Vladimir V. Saveliev" <vs@namesys.com> writes:
>
> Hi Vladimir,
>
> > sorry for delay:
>
> No problem.
>
> > ftp://ftp.namesys.com/pub/reiser4-for-2.6/2.6.16/reiser4-for-2.6.16-1.patch.gz
>
> The machine seems to be not available...
works here
cheers,
Danny
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-28 17:12 ` Danny Milosavljevic
@ 2006-03-28 18:00 ` Tassilo Horn
0 siblings, 0 replies; 27+ messages in thread
From: Tassilo Horn @ 2006-03-28 18:00 UTC (permalink / raw)
To: reiserfs-list
Danny Milosavljevic <danny.milo@gmx.net> writes:
>> The machine seems to be not available...
>
> works here
Ah, yes. Now it works here, too.
Regards,
Tassilo
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: 2.6.16 patch
2006-03-28 11:42 ` Vladimir V. Saveliev
2006-03-28 12:54 ` Tassilo Horn
@ 2006-03-28 23:22 ` Jake Maciejewski
1 sibling, 0 replies; 27+ messages in thread
From: Jake Maciejewski @ 2006-03-28 23:22 UTC (permalink / raw)
To: Vladimir V. Saveliev; +Cc: jp, ReiserFS List
Thanks, so far it's survived a few hours of stress testing on amd64,
compiled with gcc 4.1.0.
On Tue, 2006-03-28 at 15:42 +0400, Vladimir V. Saveliev wrote:
> Hello
>
> On Mon, 2006-03-27 at 19:27 +0200, jp wrote:
> > Hi,
> >
> > I would really like to get an answer to my question below ;)
> >
> sorry for delay:
> ftp://ftp.namesys.com/pub/reiser4-for-2.6/2.6.16/reiser4-for-2.6.16-1.patch.gz
>
--
Jake Maciejewski <maciejej@msoe.edu>
^ permalink raw reply [flat|nested] 27+ messages in thread
end of thread, other threads:[~2006-03-28 23:22 UTC | newest]
Thread overview: 27+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2006-03-14 10:41 State of the Reiser4 FS Avuton Olrich
2006-03-14 11:45 ` Vladimir V. Saveliev
2006-03-14 15:32 ` Clemens Eisserer
2006-03-15 7:14 ` Hans Reiser
2006-03-15 8:57 ` Andreas Schäfer
2006-03-15 18:29 ` Hans Reiser
2006-03-15 19:27 ` Andreas Schäfer
2006-03-15 21:08 ` Andreas Dilger
2006-03-16 0:58 ` 4k at a time only works well for an OS that does less per iteration than Linux does Hans Reiser
2006-03-15 19:45 ` State of the Reiser4 FS Jonathan Briggs
2006-03-15 20:43 ` Hans Reiser
2006-03-15 21:25 ` Andreas Schäfer
2006-03-15 8:45 ` Hans Reiser
2006-03-15 12:59 ` Avuton Olrich
2006-03-15 18:33 ` Hans Reiser
2006-03-26 11:27 ` 2.6.16 patch jp
2006-03-27 17:27 ` jp
2006-03-28 11:42 ` Vladimir V. Saveliev
2006-03-28 12:54 ` Tassilo Horn
2006-03-28 17:12 ` Danny Milosavljevic
2006-03-28 18:00 ` Tassilo Horn
2006-03-28 23:22 ` Jake Maciejewski
2006-03-27 20:10 ` Marcus Furlong
2006-03-27 19:44 ` Tassilo Horn
2006-03-27 21:32 ` Marcus Furlong
2006-03-27 20:41 ` Tassilo Horn
2006-03-27 21:29 ` Tassilo Horn
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.