From: Maxim Levitsky <maximlevitsky@gmail.com>
To: Chris Snook <csnook@redhat.com>
Cc: linux-kernel@vger.kernel.org
Subject: Re: [Slightly off topic] A question about R/B trees.
Date: Sat, 18 Oct 2008 00:47:46 +0200 [thread overview]
Message-ID: <48F91612.5020901@gmail.com> (raw)
In-Reply-To: <48F90E96.3060800@redhat.com>
Chris Snook wrote:
> Maxim Levitsky wrote:
>> I am working on my small project, and I need a fast container to hold
>> a large sparse array.
>> Balanced trees seem to fit perfectly.
>
> Balanced trees take O(log n) to perform a great many operations, and
> traversing a binary tree is a particularly bad case for branch
> prediction. Hash tables will perform much better, unless you get them
> horribly wrong.
Let me explain.
I am writing a userspace packet writing application.
One of things I need is to have a cache of the disk.
I need an 'array' that will hold cache of written blocks in ascending order,
I need to be able to insert a block anywhere in the array, and be able to read it
from lowest block to highest.
Hash tables can't be read this way, right?
I could use a linked list, but insertion will be slower.
>
>> I decided to implement a red/black tree, and took a look at kernel rb
>> tree for reference,
>> and I noticed that tree item has no parent pointer, while it seems
>> that it should have it.
>>
>> I know now that it has parent pointer, but it is mixed with current
>> and parent node colour.
>> Thus it is assumed that last two bits of this pointer are zero.
>
> Not quite. Read this:
>
> http://lwn.net/Articles/184495/
What do you mean?
I have read this article, I haven't yet spotted anything suspicious about parent pointer there yet.
>
>> I can see anywhere that this restriction is applied.
>> I see that structure is "aligned" but that I think only ensures that
>> compiler places it
>> aligned in static data, does the alignment ensures that it will always
>> place it on aligned address in a structure?
>> But then, the whole container structure can be misaligned, can't it?
>
> GCC will only misalign the contents of a struct if you explicitly tell
> it to pack the struct. That's one of those things you only do if you're
> 100% certain it's the right thing, and you're prepared to accept the
> consequences if you screw it up.
Why gcc?
Say you allocate a piece of memory using kmalloc, and write there, a structure that contains a r/b tree item.
I agree that gcc will ensure that offset from start of that structure to first byte of the tree item will be aligned.
But what if malloc returned a misaligned pointer?
This will ensure that virtual address of the tree item won't be aligned.
(I know it doesn't, but this isn't a assumption about gcc anymore)
>
>> Besides a comment there states that alignment is only for CRIS
>
> I'm not sure this check is still necessary, but CRIS is a rather niche
> architecture. On most architectures, word-aligning structures boosts
> performance at negligible memory cost, so compilers do it automatically.
>
>> How about a check for misalignment?
>
> The kernel is written in a dialect of C that makes several assumptions
> about the compiler, among them that the compiler won't screw this up
> unless you tell it to. Any compiler that has alignment problems with
> the rbtree code is going to have similar problems in lots of other
> places too. We don't support those compilers.
>
Best regards,
Maxim Levitsky
next prev parent reply other threads:[~2008-10-17 22:48 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-10-17 21:34 [Slightly off topic] A question about R/B trees Maxim Levitsky
2008-10-17 22:15 ` Chris Snook
2008-10-17 22:47 ` Maxim Levitsky [this message]
2008-10-20 14:54 ` Chris Friesen
2008-10-18 7:53 ` Andi Kleen
2008-10-18 8:45 ` Pekka Enberg
2008-10-20 15:57 ` Maxim Levitsky
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=48F91612.5020901@gmail.com \
--to=maximlevitsky@gmail.com \
--cc=csnook@redhat.com \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox