From: Carlos Llamas <cmllamas@google.com>
To: Greg Kroah-Hartman <gregkh@linuxfoundation.org>
Cc: linux-kernel@vger.kernel.org, kernel-team@android.com,
Carlos Llamas <cmllamas@google.com>,
Alice Ryhl <aliceryhl@google.com>,
Barry Song <v-songbaohua@oppo.com>,
David Hildenbrand <david@redhat.com>,
"Liam R. Howlett" <Liam.Howlett@oracle.com>,
Matthew Wilcox <willy@infradead.org>,
Minchan Kim <minchan@kernel.org>, Nhat Pham <nphamcs@gmail.com>,
Johannes Weiner <hannes@cmpxchg.org>,
Suren Baghdasaryan <surenb@google.com>,
Todd Kjos <tkjos@google.com>,
Viktor Martensson <vmartensson@google.com>,
Hillf Danton <hdanton@sina.com>,
Lorenzo Stoakes <lorenzo.stoakes@oracle.com>
Subject: [PATCH v5 0/9] binder: faster page installations
Date: Tue, 26 Nov 2024 18:40:03 +0000 [thread overview]
Message-ID: <20241126184021.45292-1-cmllamas@google.com> (raw)
The main focus of these patches is to improve the performance of binder
page installations, primarily by reducing contention on the mmap_lock.
The idea is to allow concurrent page insertion by leveraging per-vma
locking and get_user_pages_remote().
Unfortunately, this required reverting the alloc->lock spinlock back
into a mutex in order to serialize with the shrinker. At least until
finding a better solution e.g. support page zapping with a spinlock.
The trade off is still quite worth it though.
Other patches are also included that remove unsafe and redundant things
such as the alloc->vma pointer or the struct binder_lru_page concept.
Note: I'll work on setting up a page fault handler for binder next.
I believe an idea from Alice Ryhl to deferred the page insertions will
make this finally feasible. I only need to figure out a few performance
bits but if/when done most of the manual page insertion code in binder
could be dropped. :)
Changelog:
v5:
* rebase and resolve conflicts with commit da0c02516c50 ("mm/list_lru:
simplify the list_lru walk callback function")
* add comment to binder_alloc_is_mapped() about valid vma check
* add note to commit log about future page->lru removal
* collect Reviewed-by tags from Suren
v4:
https://lore.kernel.org/all/20241119183250.3497547-1-cmllamas@google.com/
* add explicit FOLL_NOFAULT to get_user_pages_remote()
* per-vma locking to shrinker path (per Liam)
v3:
https://lore.kernel.org/all/20241108191057.3288442-1-cmllamas@google.com/
* collect "Reviewed-by" tags from Suren
* use full commit subject in revert (not only sha1)
* add "goto unlock" label for vma_lookup() failures
* address -ENOMEM error override in separate patch
* squash "remove alloc->vma" patch into alloc->mapped patch
* pass 'struct binder_alloc *' to binder_page_lookup() too
* factor out individual mmget_not_zero()/mmput_async() calls
* cleanup binder_page_insert() to avoid using goto
* document only one mapping allowed per binder instance
* check binder_alloc_is_mapped() in binder_page_lookup()
* remove no longer need local page_to_free pointer
v2:
https://lore.kernel.org/all/20241107040239.2847143-1-cmllamas@google.com/
* fix locking order when upgrading from vma lock to mmap lock
* switch folio_walk_start() for get_user_pages_remote()
* release vma/mmap locks and mmput() right after vm_insert_page()
* add binder_page_alloc() helper for binder_install_single_page()
v1:
https://lore.kernel.org/all/20241105200258.2380168-1-cmllamas@google.com/
Cc: Alice Ryhl <aliceryhl@google.com>
Cc: Barry Song <v-songbaohua@oppo.com>
Cc: David Hildenbrand <david@redhat.com>
Cc: Liam R. Howlett <Liam.Howlett@oracle.com>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Minchan Kim <minchan@kernel.org>
Cc: Nhat Pham <nphamcs@gmail.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Suren Baghdasaryan <surenb@google.com>
Cc: Todd Kjos <tkjos@google.com>
Cc: Viktor Martensson <vmartensson@google.com>
Cc: Hillf Danton <hdanton@sina.com>
Cc: Lorenzo Stoakes <lorenzo.stoakes@oracle.com>
Carlos Llamas (9):
Revert "binder: switch alloc->mutex to spinlock_t"
binder: concurrent page installation
binder: select correct nid for pages in LRU
binder: remove struct binder_lru_page
binder: replace alloc->vma with alloc->mapped
binder: rename alloc->buffer to vm_start
binder: use per-vma lock in page installation
binder: propagate vm_insert_page() errors
binder: use per-vma lock in page reclaiming
drivers/android/binder.c | 2 +-
drivers/android/binder_alloc.c | 346 +++++++++++++++---------
drivers/android/binder_alloc.h | 36 +--
drivers/android/binder_alloc_selftest.c | 18 +-
drivers/android/binder_trace.h | 2 +-
5 files changed, 234 insertions(+), 170 deletions(-)
--
2.47.0.338.g60cca15819-goog
next reply other threads:[~2024-11-26 18:40 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-11-26 18:40 Carlos Llamas [this message]
2024-11-26 18:40 ` [PATCH v5 1/9] Revert "binder: switch alloc->mutex to spinlock_t" Carlos Llamas
2024-11-26 18:40 ` [PATCH v5 2/9] binder: concurrent page installation Carlos Llamas
2024-11-26 18:40 ` [PATCH v5 3/9] binder: select correct nid for pages in LRU Carlos Llamas
2024-11-26 18:40 ` [PATCH v5 4/9] binder: remove struct binder_lru_page Carlos Llamas
2024-11-26 19:46 ` Matthew Wilcox
2024-11-26 22:38 ` Carlos Llamas
2024-11-26 18:40 ` [PATCH v5 5/9] binder: replace alloc->vma with alloc->mapped Carlos Llamas
2024-11-26 18:40 ` [PATCH v5 6/9] binder: rename alloc->buffer to vm_start Carlos Llamas
2024-11-26 18:40 ` [PATCH v5 7/9] binder: use per-vma lock in page installation Carlos Llamas
2024-11-26 18:40 ` [PATCH v5 8/9] binder: propagate vm_insert_page() errors Carlos Llamas
2024-11-26 18:40 ` [PATCH v5 9/9] binder: use per-vma lock in page reclaiming Carlos Llamas
2024-11-26 18:45 ` Suren Baghdasaryan
2024-11-26 18:46 ` Suren Baghdasaryan
2024-11-26 19:11 ` Carlos Llamas
2024-11-26 20:05 ` Suren Baghdasaryan
2024-11-26 23:32 ` Carlos Llamas
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20241126184021.45292-1-cmllamas@google.com \
--to=cmllamas@google.com \
--cc=Liam.Howlett@oracle.com \
--cc=aliceryhl@google.com \
--cc=david@redhat.com \
--cc=gregkh@linuxfoundation.org \
--cc=hannes@cmpxchg.org \
--cc=hdanton@sina.com \
--cc=kernel-team@android.com \
--cc=linux-kernel@vger.kernel.org \
--cc=lorenzo.stoakes@oracle.com \
--cc=minchan@kernel.org \
--cc=nphamcs@gmail.com \
--cc=surenb@google.com \
--cc=tkjos@google.com \
--cc=v-songbaohua@oppo.com \
--cc=vmartensson@google.com \
--cc=willy@infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox