linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Onur <work@onurozkan.dev>
To: Daniel Almeida <daniel.almeida@collabora.com>
Cc: Benno Lossin <lossin@kernel.org>, Lyude Paul <lyude@redhat.com>,
	linux-kernel@vger.kernel.org, rust-for-linux@vger.kernel.org,
	ojeda@kernel.org, alex.gaynor@gmail.com, boqun.feng@gmail.com,
	gary@garyguo.net, a.hindborg@kernel.org, aliceryhl@google.com,
	tmgross@umich.edu, dakr@kernel.org, peterz@infradead.org,
	mingo@redhat.com, will@kernel.org, longman@redhat.com,
	felipe_life@live.com, daniel@sedlak.dev,
	bjorn3_gh@protonmail.com
Subject: Re: [PATCH v5 0/3] rust: add `ww_mutex` support
Date: Wed, 3 Sep 2025 09:24:22 +0300	[thread overview]
Message-ID: <20250903092422.37b29315@nimda.home> (raw)
In-Reply-To: <20250902195328.6293b5d4@nimda.home>

On Tue, 2 Sep 2025 19:53:28 +0300
Onur <work@onurozkan.dev> wrote:

> On Thu, 14 Aug 2025 15:22:57 -0300
> Daniel Almeida <daniel.almeida@collabora.com> wrote:
> 
> > 
> > Hi Onur,
> > 
> > > On 14 Aug 2025, at 12:56, Onur <work@onurozkan.dev> wrote:
> > > 
> > > On Thu, 14 Aug 2025 09:38:38 -0300
> > > Daniel Almeida <daniel.almeida@collabora.com> wrote:
> > > 
> > >> Hi Onur,
> > >> 
> > >>> On 14 Aug 2025, at 08:13, Onur Özkan <work@onurozkan.dev> wrote:
> > >>> 
> > >>> Hi all,
> > >>> 
> > >>> I have been brainstorming on the auto-unlocking (on dynamic
> > >>> number of mutexes) idea we have been discussing for some time.
> > >>> 
> > >>> There is a challange with how we handle lock guards and my
> > >>> current thought is to remove direct data dereferencing from
> > >>> guards. Instead, data access would only be possible through a
> > >>> fallible method (e.g., `try_get`). If the guard is no longer
> > >>> valid, this method would fail to not allow data-accessing after
> > >>> auto-unlock.
> > >>> 
> > >>> In practice, it would work like this:
> > >>> 
> > >>> let a_guard = ctx.lock(mutex_a)?;
> > >>> let b_guard = ctx.lock(mutex_b)?;
> > >>> 
> > >>> // Suppose user tries to lock `mutex_c` without aborting the
> > >>> // entire function (for some reason). This means that even on
> > >>> // failure, `a_guard` and `b_guard` will still be accessible.
> > >>> if let Ok(c_guard) = ctx.lock(mutex_c) {
> > >>>    // ...some logic
> > >>> }
> > >>> 
> > >>> let a_data = a_guard.try_get()?;
> > >>> let b_data = b_guard.try_get()?;
> > >> 
> > >> Can you add more code here? How is this going to look like with
> > >> the two closures we’ve been discussing?
> > > 
> > > Didn't we said that tuple-based closures are not sufficient when
> > > dealing with a dynamic number of locks (ref [1]) and ww_mutex is
> > > mostly used with dynamic locks? I thought implementing that
> > > approach is not worth it (at least for now) because of that.
> > > 
> > > [1]:
> > > https://lore.kernel.org/all/DBS8REY5E82S.3937FAHS25ANA@kernel.org
> > > 
> > > Regards,
> > > Onur
> > 
> > 
> > 
> > I am referring to this [0]. See the discussion and itemized list at
> > the end.
> > 
> > To recap, I am proposing a separate type that is similar to
> > drm_exec, and that implements this:
> > 
> > ```
> > a) run a user closure where the user can indicate which ww_mutexes
> > they want to lock b) keep track of the objects above
> > c) keep track of whether a contention happened
> > d) rollback if a contention happened, releasing all locks
> > e) rerun the user closure from a clean slate after rolling back
> > f) run a separate user closure whenever we know that all objects
> > have been locked. ```
> > 
> 
> Finally, I was able to allocate some time to work on this week. The
> implementation covers all the items you listed above.
> 
> I am sharing some of the unit tests from my work. My intention is to
> demonstrate the user API and I would like your feedback on whether
> anything should be changed before I send the v6 patch.
> 
>     #[test]
>     fn test_with_different_input_type() -> Result {
>         stack_pin_init!(let class =
>     WwClass::new_wound_wait(c_str!("lock_all_ok")));
> 
>         let mu1 = Arc::pin_init(WwMutex::new(1, &class), GFP_KERNEL)?;
>         let mu2 = Arc::pin_init(WwMutex::new("hello", &class),
>         GFP_KERNEL)?;
> 
>         lock_all(
>             &class,
>             |ctx| {
>                 ctx.lock(&mu1)?;
>                 ctx.lock(&mu2)?;
>                 Ok(())
>             },
>             |ctx| {
>                 ctx.with_locked(&mu1, |v| assert_eq!(*v, 1))?;
>                 ctx.with_locked(&mu2, |v| assert_eq!(*v, "hello"))?;
>                 Ok(())
>             },
>         )?;
> 
>         Ok(())
>     }
> 
>     #[test]
>     fn test_lock_all_retries_on_deadlock() -> Result {
>         stack_pin_init!(let class =
>     WwClass::new_wound_wait(c_str!("lock_all_retry")));
> 
>         let mu = Arc::pin_init(WwMutex::new(99, &class), GFP_KERNEL)?;
>         let mut first_try = true;
> 
>         let res = lock_all(
>             &class,
>             |ctx| {
>                 if first_try {
>                     first_try = false;
>                     // simulate deadlock on first attempt
>                     return Err(EDEADLK);
>                 }
>                 ctx.lock(&mu)
>             },
>             |ctx| {
>                 ctx.with_locked(&mu, |v| {
>                     *v += 1;
>                     *v
>                 })
>             },
>         )?;
> 
>         assert_eq!(res, 100);
>         Ok(())
>     }
> 
>     #[test]
>     fn test_with_locked_on_unlocked_mutex() -> Result {
>         stack_pin_init!(let class =
>     WwClass::new_wound_wait(c_str!("with_unlocked_mutex")));
> 
>         let mu = Arc::pin_init(WwMutex::new(5, &class), GFP_KERNEL)?;
> 
>         let mut ctx = ExecContext::new(&class)?;
> 
>         let ecode = ctx.with_locked(&mu, |_v| {}).unwrap_err();
>         assert_eq!(EINVAL, ecode);
> 
>         Ok(())
>     }
> 
> 
> Please let me know if this looks fine in terms of user API so
> I can make any necessary adjustments before sending v6.
> 
> Regards,
> Onur

There will be some changes to this API, I found some design issues on
it. Previously, lock_all was an individual function, I will
move it under `impl ExecContext` so that we can track more mutexes.

I will send v6 in a day or two. To avoid confusion, please ignore the
previous mail and review v6 directly since there will be some
differences.

Thanks,
Onur

  reply	other threads:[~2025-09-03  6:24 UTC|newest]

Thread overview: 53+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-06-21 18:44 [PATCH v5 0/3] rust: add `ww_mutex` support Onur Özkan
2025-06-21 18:44 ` [PATCH v5 1/3] rust: add C wrappers for `ww_mutex` inline functions Onur Özkan
2025-06-21 18:44 ` [PATCH v5 2/3] implement ww_mutex abstraction for the Rust tree Onur Özkan
2025-06-22  9:18   ` Benno Lossin
2025-06-23 13:04     ` Boqun Feng
2025-06-23 13:44       ` Benno Lossin
2025-06-23 14:47         ` Boqun Feng
2025-06-23 15:14           ` Benno Lossin
2025-06-23 17:11             ` Boqun Feng
2025-06-23 23:22               ` Benno Lossin
2025-06-24  5:34                 ` Onur
2025-06-24  8:20                   ` Benno Lossin
2025-06-24 12:31                     ` Onur
2025-06-24 12:48                       ` Benno Lossin
2025-07-07 13:39             ` Onur
2025-07-07 15:31               ` Benno Lossin
2025-07-07 18:06                 ` Onur
2025-07-07 19:48                   ` Benno Lossin
2025-07-08 14:21                     ` Onur
2025-08-01 21:22                     ` Daniel Almeida
2025-08-02 10:42                       ` Benno Lossin
2025-08-02 13:41                         ` Miguel Ojeda
2025-08-02 14:15                         ` Daniel Almeida
2025-08-02 20:58                           ` Benno Lossin
2025-08-05 15:18                             ` Daniel Almeida
2025-08-05  9:08                           ` Onur Özkan
2025-08-05 12:41                             ` Daniel Almeida
2025-08-05 13:50                               ` Onur Özkan
2025-06-23 11:51   ` Alice Ryhl
2025-06-23 13:26   ` Boqun Feng
2025-06-23 18:17     ` Onur
2025-06-23 21:54       ` Boqun Feng
2025-06-21 18:44 ` [PATCH v5 3/3] add KUnit coverage on Rust `ww_mutex` implementation Onur Özkan
2025-06-22  9:16 ` [PATCH v5 0/3] rust: add `ww_mutex` support Benno Lossin
2025-07-24 13:53 ` Onur Özkan
2025-07-29 17:15   ` Benno Lossin
2025-07-30 10:24     ` Onur Özkan
2025-07-30 10:55       ` Benno Lossin
2025-08-05 16:22   ` Lyude Paul
2025-08-05 17:56     ` Daniel Almeida
2025-08-06  5:57     ` Onur Özkan
2025-08-06 17:37       ` Lyude Paul
2025-08-06 19:30         ` Benno Lossin
2025-08-14 11:13           ` Onur Özkan
2025-08-14 12:38             ` Daniel Almeida
2025-08-14 15:56               ` Onur
2025-08-14 18:22                 ` Daniel Almeida
2025-08-18 12:56                   ` Onur Özkan
2025-09-01 10:05                     ` Onur Özkan
2025-09-01 12:28                       ` Daniel Almeida
2025-09-02 16:53                   ` Onur
2025-09-03  6:24                     ` Onur [this message]
2025-09-03 13:04                       ` Daniel Almeida

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20250903092422.37b29315@nimda.home \
    --to=work@onurozkan.dev \
    --cc=a.hindborg@kernel.org \
    --cc=alex.gaynor@gmail.com \
    --cc=aliceryhl@google.com \
    --cc=bjorn3_gh@protonmail.com \
    --cc=boqun.feng@gmail.com \
    --cc=dakr@kernel.org \
    --cc=daniel.almeida@collabora.com \
    --cc=daniel@sedlak.dev \
    --cc=felipe_life@live.com \
    --cc=gary@garyguo.net \
    --cc=linux-kernel@vger.kernel.org \
    --cc=longman@redhat.com \
    --cc=lossin@kernel.org \
    --cc=lyude@redhat.com \
    --cc=mingo@redhat.com \
    --cc=ojeda@kernel.org \
    --cc=peterz@infradead.org \
    --cc=rust-for-linux@vger.kernel.org \
    --cc=tmgross@umich.edu \
    --cc=will@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).