Re: [rfc][patch] store-free path walking

[Linus Torvalds <torvalds@linux-foundation.org>]

On Wed, 7 Oct 2009, Linus Torvalds wrote:
>
> Every extra line you fetch pushes out another line. No amount of 
> prefetching will hide that.

Side note: what it _will_ do is hide the cost, and spread it out to other 
places where you don't see it any more, or you see it but can't do 
anything about it.

And that's not a good thing. You end up with "muddy" profiles that don't 
have nice clear problem spots any more, so you may think that your profile 
looks better ("Look ma, no nasty hotspots!"), but actual performance 
hasn't improved one whit, and may well have decreased.

This, btw, is exactly the kind of thing we saw with some of the 
non-temporal work, when we used nontemporal stores to copy pages on COW 
faults, or when doing pre-zeroing of pages. You get rid of some of the 
hot-spots in the kernel, and you then replace them with user space taking 
the cache misses in random spots instead. The kernel profile looks better, 
and system time may go down, but actual performace never went down - you 
just moved your cache miss cost from one place to another.

There's no question that prefetching cannot help, but it helps only if 
it's about fetching data that you would need anyway early. In contrast, if 
the option is "don't touch the other cacheline at all", prefetching is 
_always_ a loss. No ifs, buts and maybes about it.

			Linus