netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Thomas Graf <tgraf@suug.ch>
To: Herbert Xu <herbert@gondor.apana.org.au>
Cc: "David S. Miller" <davem@davemloft.net>,
	Eric Dumazet <eric.dumazet@gmail.com>,
	Patrick McHardy <kaber@trash.net>,
	Josh Triplett <josh@joshtriplett.org>,
	"Paul E. McKenney" <paulmck@linux.vnet.ibm.com>,
	netdev@vger.kernel.org
Subject: Re: [v2 PATCH 7/10] rhashtable: Disable automatic shrinking
Date: Sun, 22 Mar 2015 12:17:55 +0000	[thread overview]
Message-ID: <20150322121755.GH1185@casper.infradead.org> (raw)
In-Reply-To: <E1YZard-0000wE-Se@gondolin.me.apana.org.au>

On 03/22/15 at 07:04pm, Herbert Xu wrote:
> Automatic shrinking is dangerous because it provides an easy
> way for an adversary to cause us to do unnecessary work.  Thus
> making the resizable hashtable a poor data structure.
> 
> This patch disables automatic shrinking but retains a manual
> shrink function for those cases where insertions and removals
> are overseen by a trusted entity, e.g., nft_hash.

This is misleading. I agree that unconditional shrinking is dangerous.
Shrinking was an optional feature disabled by default before. The
inlining enabled it by default for all users. What is the benefit of
requiring this logic outside of rhashtable over just adding a flag to
enable shrinking at 30% utilization?

> The shrink function will now also shrink to fit rather than halve
> the size of the table.

I like this part a lot

>  int rhashtable_shrink(struct rhashtable *ht)
>  {
> -	struct bucket_table *new_tbl, *old_tbl = rht_dereference(ht->tbl, ht);
> +	unsigned size = roundup_pow_of_two(atomic_read(&ht->nelems) * 4 / 3);

If rhashtable_shrink() is called near the 75% border it will cause an
immediate expansion again. Maybe make this * 3 / 2 so we shrink near
30% utilization as before?

> +	struct bucket_table *new_tbl;
> +	struct bucket_table *tbl;
> +	int err;
>  
> -	ASSERT_RHT_MUTEX(ht);
> +	if (size < ht->p.min_size)
> +		size = ht->p.min_size;

We should only shrink if size < old_tbl->size

> -	new_tbl = bucket_table_alloc(ht, old_tbl->size / 2);
> +	new_tbl = bucket_table_alloc(ht, size);
>  	if (new_tbl == NULL)
>  		return -ENOMEM;

  reply	other threads:[~2015-03-22 12:17 UTC|newest]

Thread overview: 44+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-03-22  8:03 [v2 PATCH 0/10] rhashtable: Multiple rehashing Herbert Xu
2015-03-22  8:03 ` [v2 PATCH 1/10] rhashtable: Add barrier to ensure we see new tables in walker Herbert Xu
2015-03-22 10:47   ` Thomas Graf
2015-03-22  8:04 ` [v2 PATCH 2/10] rhashtable: Eliminate unnecessary branch in rht_key_hashfn Herbert Xu
2015-03-22 11:07   ` Thomas Graf
2015-03-22  8:04 ` [v2 PATCH 3/10] rhashtable: Allow hashfn to be unset Herbert Xu
2015-03-22 11:55   ` Thomas Graf
2015-03-22 12:04     ` Herbert Xu
2015-03-22 12:32       ` Thomas Graf
2015-03-22 21:12         ` Herbert Xu
2015-03-23  9:58           ` Thomas Graf
2015-03-23 10:18             ` Herbert Xu
2015-03-23 14:29   ` David Laight
2015-03-22  8:04 ` [v2 PATCH 4/10] netlink: Use default rhashtable hashfn Herbert Xu
2015-03-22 11:55   ` Thomas Graf
2015-03-23  1:18   ` Simon Horman
2015-03-23 12:56     ` Herbert Xu
2015-03-22  8:04 ` [v2 PATCH 5/10] tipc: " Herbert Xu
2015-03-22 11:56   ` Thomas Graf
2015-03-22  8:04 ` [v2 PATCH 6/10] netfilter: " Herbert Xu
2015-03-22 11:56   ` Thomas Graf
2015-03-23 11:32     ` Herbert Xu
2015-03-22  8:04 ` [v2 PATCH 7/10] rhashtable: Disable automatic shrinking Herbert Xu
2015-03-22 12:17   ` Thomas Graf [this message]
2015-03-22 13:06     ` Thomas Graf
2015-03-23  0:07       ` Herbert Xu
2015-03-23  8:37         ` Thomas Graf
2015-03-23  9:29           ` Herbert Xu
2015-03-23  9:43             ` Thomas Graf
2015-03-23  0:09     ` Herbert Xu
2015-03-23  8:33       ` Thomas Graf
2015-03-23  9:28         ` Herbert Xu
2015-03-23  9:36           ` Thomas Graf
2015-03-23  9:39             ` Herbert Xu
2015-03-23  9:44               ` Herbert Xu
2015-03-23 10:08                 ` Thomas Graf
2015-03-23 10:19                   ` Herbert Xu
2015-03-23 16:45           ` David Miller
2015-03-23 16:44         ` David Miller
2015-03-23 21:48           ` Herbert Xu
2015-03-23 22:13           ` Thomas Graf
2015-03-22  8:04 ` [v2 PATCH 8/10] rhashtable: Add multiple rehash support Herbert Xu
2015-03-22  8:04 ` [v2 PATCH 9/10] rhashtable: Allow GFP_ATOMIC bucket table allocation Herbert Xu
2015-03-22  8:04 ` [v2 PATCH 10/10] rhashtable: Add immediate rehash during insertion Herbert Xu

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20150322121755.GH1185@casper.infradead.org \
    --to=tgraf@suug.ch \
    --cc=davem@davemloft.net \
    --cc=eric.dumazet@gmail.com \
    --cc=herbert@gondor.apana.org.au \
    --cc=josh@joshtriplett.org \
    --cc=kaber@trash.net \
    --cc=netdev@vger.kernel.org \
    --cc=paulmck@linux.vnet.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).