From: Alice Ryhl <aliceryhl@google.com>
To: Shivam Kalra <shivamklr@cock.li>
Cc: Danilo Krummrich <dakr@kernel.org>,
cmllamas@google.com, gregkh@linuxfoundation.org,
rust-for-linux@vger.kernel.org, linux-kernel@vger.kernel.org,
lorenzo.stoakes@oracle.com, vbabka@suse.cz,
Liam.Howlett@oracle.com, urezki@gmail.com
Subject: Re: [PATCH v2 1/3] rust: alloc: Add shrink_to and shrink_to_fit methods to Vec
Date: Wed, 4 Feb 2026 10:32:58 +0000 [thread overview]
Message-ID: <aYMgWr6iDTus0vDE@google.com> (raw)
In-Reply-To: <8006f30e-b794-4852-bc10-2981b5d010d8@cock.li>
On Tue, Feb 03, 2026 at 11:18:17PM +0530, Shivam Kalra wrote:
> On 03/02/26 21:13, Danilo Krummrich wrote:
> > On Tue Feb 3, 2026 at 4:38 PM CET, Alice Ryhl wrote:
> >> On Tue, Feb 03, 2026 at 04:19:14PM +0100, Danilo Krummrich wrote:
> >>> On Sat Jan 31, 2026 at 4:40 PM CET, Shivam Kalra wrote:
> >>>> This implementation guarantees shrinking (unless already optimal),
> >>>> because the kernel allocators don't support in-place shrinking,
> >>>> a new allocation is always made.
> >>>
> >>> I'm not sure we should go in this direction. There is a reason why krealloc()
> >>> does not migrate memory between kmalloc buckets, i.e. the cost of migration vs.
> >>> memory saving.
> >>>
> >>> For Vmalloc buffers the story is a bit different though. When I wrote vrealloc()
> >>> I left some TODO comments [1][2].
> >>>
> >>> (1) If a smaller buffer is requested we can shrink the vm_area, i.e. unmap and
> >>> free unused pages.
> >>>
> >>> (2) If a bigger buffer is requested we can grow the vm_area, i.e. allocate and
> >>> map additional pages. (At least as long as we have enough space in the
> >>> virtual address space.)
> >>>
> >>> So, I think we should just use A::realloc(), leave the rest to the underlying
> >>> specific realloc() implementations and address the TODOs in vrealloc() if
> >>> necessary.
> >>>
> >>> [1] https://elixir.bootlin.com/linux/v6.18.6/source/mm/vmalloc.c#L4162
> >>> [2] https://elixir.bootlin.com/linux/v6.18.6/source/mm/vmalloc.c#L4192
> >>
> >> If kvrealloc() does the right thing, then let's use it.
> >
> > It should once the TODOs of vrealloc() are addressed. The reason I left them as
> > TODOs was that I didn't want to implement all the shrink and grow logic for
> > struct vm_area without having a user that actually needs it.
> >
> > If binder needs it, I think we should do it.
> Hi Danilo, Alice,
>
> Thanks for the detailed feedback - I hadn't considered the kmalloc bucket
> migration costs.
>
> Given that:
> - krealloc() intentionally avoids migrating data to smaller buckets when
> shrinking
> - vrealloc() has TODOs for in-place shrinking
> - The immediate need is binder, which uses KVec (could use either allocator)
Binder uses KVVec not KVec, which is the one that could use either allocator.
> I'm thinking the pragmatic path is:
>
> 1. For v3: Simplify shrink_to() to use A::realloc() instead of
> alloc+copy+free. This ensures we get whatever optimization
> the allocator provides (including the bucket preservation for kmalloc).
>
> 2. The vrealloc() in-place shrinking could be a separate follow-up
> series, as it's a larger change to the allocator itself.
>
> Does this approach make sense, or would you prefer I tackle the
> vrealloc TODOs first?
I would kind of prefer that we do this in two steps. First have
shrink_to() use the implementation it does right now. Then a follow-up
patch fix the TODOs in vrealloc().
Alice
next prev parent reply other threads:[~2026-02-04 10:33 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-31 15:40 [PATCH v2 0/3] rust: alloc: add Vec shrinking methods Shivam Kalra
2026-01-31 15:40 ` [PATCH v2 1/3] rust: alloc: Add shrink_to and shrink_to_fit methods to Vec Shivam Kalra
2026-02-03 15:19 ` Danilo Krummrich
2026-02-03 15:38 ` Alice Ryhl
2026-02-03 15:43 ` Danilo Krummrich
2026-02-03 17:48 ` Shivam Kalra
2026-02-04 10:32 ` Alice Ryhl [this message]
2026-02-04 11:50 ` Danilo Krummrich
2026-02-04 21:55 ` Shivam Kalra
2026-01-31 15:40 ` [PATCH v2 2/3] rust: alloc: add KUnit tests for Vec shrinking Shivam Kalra
2026-02-01 0:08 ` [PATCH v2 3/3] binder: context: shrink all_procs vector to reclaim memory Shivam Kalra
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=aYMgWr6iDTus0vDE@google.com \
--to=aliceryhl@google.com \
--cc=Liam.Howlett@oracle.com \
--cc=cmllamas@google.com \
--cc=dakr@kernel.org \
--cc=gregkh@linuxfoundation.org \
--cc=linux-kernel@vger.kernel.org \
--cc=lorenzo.stoakes@oracle.com \
--cc=rust-for-linux@vger.kernel.org \
--cc=shivamklr@cock.li \
--cc=urezki@gmail.com \
--cc=vbabka@suse.cz \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox