* [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion. @ 2025-03-13 6:59 ` Oliver Mangold 2025-03-13 7:00 ` [PATCH v8 1/4] rust: types: Add Ownable/Owned types Oliver Mangold ` (4 more replies) 0 siblings, 5 replies; 13+ messages in thread From: Oliver Mangold @ 2025-03-13 6:59 UTC (permalink / raw) To: Miguel Ojeda, Alex Gaynor, Boqun Feng, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina Cc: rust-for-linux, linux-kernel, Oliver Mangold This allows to convert between ARef<T> and Owned<T> by implementing the new trait OwnedRefCounted. This way we will have a shared/unique reference counting scheme for types with built-in refcounts in analogy to Arc/UniqueArc. Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> --- Changes in v8: - Fix Co-developed-by and Suggested-by tags as suggested by Miguel and Boqun - Some small documentation fixes in Owned/Ownable patch - removing redundant trait constraint on DerefMut for Owned as suggested by Boqun Feng - make SimpleOwnedRefCounted no longer implement RefCounted as suggested by Boqun Feng - documentation for RefCounted as suggested by Boqun Feng - Link to v7: https://lore.kernel.org/r/20250310-unique-ref-v7-0-4caddb78aa05@pm.me Changes in v7: - Squash patch to make Owned::from_raw/into_raw public into parent - Added Signed-off-by to other people's commits - Link to v6: https://lore.kernel.org/r/20250310-unique-ref-v6-0-1ff53558617e@pm.me Changes in v6: - Changed comments/formatting as suggested by Miguel Ojeda - Included and used new config flag RUSTC_HAS_DO_NOT_RECOMMEND, thus no changes to types.rs will be needed when the attribute becomes available. - Fixed commit message for Owned patch. - Link to v5: https://lore.kernel.org/r/20250307-unique-ref-v5-0-bffeb633277e@pm.me Changes in v5: - Rebase the whole thing on top of the Ownable/Owned traits by Asahi Lina. - Rename AlwaysRefCounted to RefCounted and make AlwaysRefCounted a marker trait instead to allow to obtain an ARef<T> from an &T, which (as Alice pointed out) is unsound when combined with UniqueRef/Owned. - Change the Trait design and naming to implement this feature, UniqueRef/UniqueRefCounted is dropped in favor of Ownable/Owned and OwnableRefCounted is used to provide the functions to convert between Owned and ARef. - Link to v4: https://lore.kernel.org/r/20250305-unique-ref-v4-1-a8fdef7b1c2c@pm.me Changes in v4: - Just a minor change in naming by request from Andreas Hindborg, try_shared_to_unique() -> try_from_shared(), unique_to_shared() -> into_shared(), which is more in line with standard Rust naming conventions. - Link to v3: https://lore.kernel.org/r/Z8Wuud2UQX6Yukyr@mango --- Asahi Lina (1): rust: types: Add Ownable/Owned types Miguel Ojeda (1): rust: kbuild: provide `RUSTC_HAS_DO_NOT_RECOMMEND` symbol Oliver Mangold (2): rust: rename AlwaysRefCounted to RefCounted rust: adding OwnableRefCounted and SimpleOwnableRefCounted init/Kconfig | 3 + rust/kernel/block/mq/request.rs | 10 +- rust/kernel/cred.rs | 8 +- rust/kernel/device.rs | 8 +- rust/kernel/fs/file.rs | 10 +- rust/kernel/pid_namespace.rs | 8 +- rust/kernel/task.rs | 6 +- rust/kernel/types.rs | 404 ++++++++++++++++++++++++++++++++++++++-- 8 files changed, 426 insertions(+), 31 deletions(-) --- base-commit: 4b2ee22fe32ea9b255926effbb6f26450607c391 change-id: 20250305-unique-ref-29fcd675f9e9 Best regards, -- Oliver Mangold <oliver.mangold@pm.me> ^ permalink raw reply [flat|nested] 13+ messages in thread
* [PATCH v8 1/4] rust: types: Add Ownable/Owned types 2025-03-13 6:59 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Oliver Mangold @ 2025-03-13 7:00 ` Oliver Mangold 2025-03-21 16:08 ` Boqun Feng 2025-03-23 20:46 ` Andreas Hindborg 2025-03-13 7:00 ` [PATCH v8 2/4] rust: rename AlwaysRefCounted to RefCounted Oliver Mangold ` (3 subsequent siblings) 4 siblings, 2 replies; 13+ messages in thread From: Oliver Mangold @ 2025-03-13 7:00 UTC (permalink / raw) To: Miguel Ojeda, Alex Gaynor, Boqun Feng, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina Cc: rust-for-linux, linux-kernel, Oliver Mangold From: Asahi Lina <lina@asahilina.net> By analogy to AlwaysRefCounted and ARef, an Ownable type is a (typically C FFI) type that *may* be owned by Rust, but need not be. Unlike AlwaysRefCounted, this mechanism expects the reference to be unique within Rust, and does not allow cloning. Conceptually, this is similar to a KBox<T>, except that it delegates resource management to the T instead of using a generic allocator. Link: https://lore.kernel.org/all/20250202-rust-page-v1-1-e3170d7fe55e@asahilina.net/ Signed-off-by: Asahi Lina <lina@asahilina.net> [ om: make from_raw() and into_raw() public, small fixes to documentation ] Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> --- rust/kernel/types.rs | 109 +++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 109 insertions(+) diff --git a/rust/kernel/types.rs b/rust/kernel/types.rs index 55ddd50e8aaa075ac33d5f1088a7f72df05f74f4..65f6d0721f5f23c8db79c6735dc7d5e1ac984ea7 100644 --- a/rust/kernel/types.rs +++ b/rust/kernel/types.rs @@ -551,6 +551,115 @@ fn drop(&mut self) { } } +/// Types that may be owned by Rust code or borrowed, but have a lifetime managed by C code. +/// +/// It allows such types to define their own custom destructor function to be called when +/// a Rust-owned reference is dropped. +/// +/// This is usually implemented by wrappers to existing structures on the C side of the code. +/// +/// # Safety +/// +/// Implementers must ensure that any objects borrowed directly as `&T` stay alive for the duration +/// of the lifetime, and that any objects owned by Rust as [`Owned<T>`] stay alive while that owned +/// reference exists, until the [`Ownable::release()`] trait method is called. +pub unsafe trait Ownable { + /// Releases the object (frees it or returns it to foreign ownership). + /// + /// # Safety + /// + /// Callers must ensure that the object is no longer referenced after this call. + unsafe fn release(this: NonNull<Self>); +} + +/// A subtrait of Ownable that asserts that an [`Owned<T>`] Rust reference is not only unique +/// within Rust and keeps the `T` alive, but also guarantees that the C code follows the +/// usual mutable reference requirements. That is, the kernel will never mutate the +/// `T` (excluding internal mutability that follows the usual rules) while Rust owns it. +/// +/// When this type is implemented for an [`Ownable`] type, it allows [`Owned<T>`] to be +/// dereferenced into a &mut T. +/// +/// # Safety +/// +/// Implementers must ensure that the kernel never mutates the underlying type while +/// Rust owns it. +pub unsafe trait OwnableMut: Ownable {} + +/// An owned reference to an ownable kernel object. +/// +/// The object is automatically freed or released when an instance of [`Owned`] is +/// dropped. +/// +/// # Invariants +/// +/// The pointer stored in `ptr` is non-null and valid for the lifetime of the [`Owned`] instance. +pub struct Owned<T: Ownable> { + ptr: NonNull<T>, + _p: PhantomData<T>, +} + +// SAFETY: It is safe to send `Owned<T>` to another thread when the underlying `T` is `Send` because +// it effectively means sending a unique `&mut T` pointer (which is safe because `T` is `Send`). +unsafe impl<T: Ownable + Send> Send for Owned<T> {} + +// SAFETY: It is safe to send `&Owned<T>` to another thread when the underlying `T` is `Sync` +// because it effectively means sharing `&T` (which is safe because `T` is `Sync`). +unsafe impl<T: Ownable + Sync> Sync for Owned<T> {} + +impl<T: Ownable> Owned<T> { + /// Creates a new instance of [`Owned`]. + /// + /// It takes over ownership of the underlying object. + /// + /// # Safety + /// + /// Callers must ensure that the underlying object is acquired and can be considered owned by + /// Rust. + pub unsafe fn from_raw(ptr: NonNull<T>) -> Self { + // INVARIANT: The safety requirements guarantee that the new instance now owns the + // reference. + Self { + ptr, + _p: PhantomData, + } + } + + /// Consumes the [`Owned`], returning a raw pointer. + /// + /// This function does not actually relinquish ownership of the object. + /// After calling this function, the caller is responsible for ownership previously managed + /// by the [`Owned`]. + pub fn into_raw(me: Self) -> NonNull<T> { + ManuallyDrop::new(me).ptr + } +} + +impl<T: Ownable> Deref for Owned<T> { + type Target = T; + + fn deref(&self) -> &Self::Target { + // SAFETY: The type invariants guarantee that the object is valid. + unsafe { self.ptr.as_ref() } + } +} + +impl<T: OwnableMut> DerefMut for Owned<T> { + fn deref_mut(&mut self) -> &mut Self::Target { + // SAFETY: The type invariants guarantee that the object is valid, + // and that we can safely return a mutable reference to it. + unsafe { self.ptr.as_mut() } + } +} + +impl<T: Ownable> Drop for Owned<T> { + fn drop(&mut self) { + // SAFETY: The type invariants guarantee that the `Owned` owns the object we're about to + // release. + unsafe { T::release(self.ptr) }; + } +} + /// A sum type that always holds either a value of type `L` or `R`. /// /// # Examples -- 2.48.1 ^ permalink raw reply related [flat|nested] 13+ messages in thread
* Re: [PATCH v8 1/4] rust: types: Add Ownable/Owned types 2025-03-13 7:00 ` [PATCH v8 1/4] rust: types: Add Ownable/Owned types Oliver Mangold @ 2025-03-21 16:08 ` Boqun Feng 2025-03-25 12:00 ` Oliver Mangold 2025-03-23 20:46 ` Andreas Hindborg 1 sibling, 1 reply; 13+ messages in thread From: Boqun Feng @ 2025-03-21 16:08 UTC (permalink / raw) To: Oliver Mangold Cc: Miguel Ojeda, Alex Gaynor, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina, rust-for-linux, linux-kernel On Thu, Mar 13, 2025 at 07:00:04AM +0000, Oliver Mangold wrote: > From: Asahi Lina <lina@asahilina.net> > > By analogy to AlwaysRefCounted and ARef, an Ownable type is a (typically > C FFI) type that *may* be owned by Rust, but need not be. Unlike > AlwaysRefCounted, this mechanism expects the reference to be unique > within Rust, and does not allow cloning. > > Conceptually, this is similar to a KBox<T>, except that it delegates > resource management to the T instead of using a generic allocator. > > Link: https://lore.kernel.org/all/20250202-rust-page-v1-1-e3170d7fe55e@asahilina.net/ > Signed-off-by: Asahi Lina <lina@asahilina.net> > [ om: make from_raw() and into_raw() public, small fixes to documentation ] > Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> > --- > rust/kernel/types.rs | 109 +++++++++++++++++++++++++++++++++++++++++++++++++++ > 1 file changed, 109 insertions(+) > > diff --git a/rust/kernel/types.rs b/rust/kernel/types.rs > index 55ddd50e8aaa075ac33d5f1088a7f72df05f74f4..65f6d0721f5f23c8db79c6735dc7d5e1ac984ea7 100644 > --- a/rust/kernel/types.rs > +++ b/rust/kernel/types.rs > @@ -551,6 +551,115 @@ fn drop(&mut self) { > } > } > > +/// Types that may be owned by Rust code or borrowed, but have a lifetime managed by C code. > +/// > +/// It allows such types to define their own custom destructor function to be called when > +/// a Rust-owned reference is dropped. > +/// > +/// This is usually implemented by wrappers to existing structures on the C side of the code. > +/// > +/// # Safety > +/// > +/// Implementers must ensure that any objects borrowed directly as `&T` stay alive for the duration It may be more clear to use `&Ownable` instead of `&T`, but I will wait and see if others have better ideas. > +/// of the lifetime, and that any objects owned by Rust as [`Owned<T>`] stay alive while that owned > +/// reference exists, until the [`Ownable::release()`] trait method is called. > +pub unsafe trait Ownable { > + /// Releases the object (frees it or returns it to foreign ownership). > + /// > + /// # Safety > + /// > + /// Callers must ensure that the object is no longer referenced after this call. > + unsafe fn release(this: NonNull<Self>); > +} > + > +/// A subtrait of Ownable that asserts that an [`Owned<T>`] Rust reference is not only unique > +/// within Rust and keeps the `T` alive, but also guarantees that the C code follows the > +/// usual mutable reference requirements. That is, the kernel will never mutate the > +/// `T` (excluding internal mutability that follows the usual rules) while Rust owns it. > +/// > +/// When this type is implemented for an [`Ownable`] type, it allows [`Owned<T>`] to be > +/// dereferenced into a &mut T. > +/// > +/// # Safety > +/// > +/// Implementers must ensure that the kernel never mutates the underlying type while > +/// Rust owns it. > +pub unsafe trait OwnableMut: Ownable {} > + > +/// An owned reference to an ownable kernel object. > +/// > +/// The object is automatically freed or released when an instance of [`Owned`] is > +/// dropped. > +/// > +/// # Invariants > +/// > +/// The pointer stored in `ptr` is non-null and valid for the lifetime of the [`Owned`] instance. > +pub struct Owned<T: Ownable> { This can be: pub struct Owned<T: Ownable + ?Sized> right? Hmm.. but `ARef` doesn't support trait objects yet. Maybe it makes sense to support for both `Owned` and `ARef` later? > + ptr: NonNull<T>, > + _p: PhantomData<T>, > +} > + > +// SAFETY: It is safe to send `Owned<T>` to another thread when the underlying `T` is `Send` because > +// it effectively means sending a unique `&mut T` pointer (which is safe because `T` is `Send`). > +unsafe impl<T: Ownable + Send> Send for Owned<T> {} > + > +// SAFETY: It is safe to send `&Owned<T>` to another thread when the underlying `T` is `Sync` > +// because it effectively means sharing `&T` (which is safe because `T` is `Sync`). > +unsafe impl<T: Ownable + Sync> Sync for Owned<T> {} > + > +impl<T: Ownable> Owned<T> { > + /// Creates a new instance of [`Owned`]. > + /// > + /// It takes over ownership of the underlying object. > + /// > + /// # Safety > + /// > + /// Callers must ensure that the underlying object is acquired and can be considered owned by > + /// Rust. > + pub unsafe fn from_raw(ptr: NonNull<T>) -> Self { > + // INVARIANT: The safety requirements guarantee that the new instance now owns the > + // reference. > + Self { > + ptr, > + _p: PhantomData, > + } > + } > + > + /// Consumes the [`Owned`], returning a raw pointer. > + /// > + /// This function does not actually relinquish ownership of the object. > + /// After calling this function, the caller is responsible for ownership previously managed > + /// by the [`Owned`]. > + pub fn into_raw(me: Self) -> NonNull<T> { > + ManuallyDrop::new(me).ptr > + } > +} > + > +impl<T: Ownable> Deref for Owned<T> { > + type Target = T; > + > + fn deref(&self) -> &Self::Target { > + // SAFETY: The type invariants guarantee that the object is valid. > + unsafe { self.ptr.as_ref() } > + } > +} > + > +impl<T: OwnableMut> DerefMut for Owned<T> { > + fn deref_mut(&mut self) -> &mut Self::Target { > + // SAFETY: The type invariants guarantee that the object is valid, > + // and that we can safely return a mutable reference to it. > + unsafe { self.ptr.as_mut() } > + } > +} > + > +impl<T: Ownable> Drop for Owned<T> { > + fn drop(&mut self) { > + // SAFETY: The type invariants guarantee that the `Owned` owns the object we're about to > + // release. > + unsafe { T::release(self.ptr) }; > + } > +} > + Reviewed-by: Boqun Feng <boqun.feng@gmail.com> Regards, Boqun > /// A sum type that always holds either a value of type `L` or `R`. > /// > /// # Examples > > -- > 2.48.1 > > ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [PATCH v8 1/4] rust: types: Add Ownable/Owned types 2025-03-21 16:08 ` Boqun Feng @ 2025-03-25 12:00 ` Oliver Mangold 0 siblings, 0 replies; 13+ messages in thread From: Oliver Mangold @ 2025-03-25 12:00 UTC (permalink / raw) To: Boqun Feng Cc: Miguel Ojeda, Alex Gaynor, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina, rust-for-linux, linux-kernel On 250321 0908, Boqun Feng wrote: > > Reviewed-by: Boqun Feng <boqun.feng@gmail.com> > > Regards, > Boqun Hi, I only added the Reviewed-By tag to the Owned/Ownable commit from Asahi Lina for now, as you added this comment only to the reply to this commit. Let me know, if you want it added to the other commits, too. Best regards, Oliver ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [PATCH v8 1/4] rust: types: Add Ownable/Owned types 2025-03-13 7:00 ` [PATCH v8 1/4] rust: types: Add Ownable/Owned types Oliver Mangold 2025-03-21 16:08 ` Boqun Feng @ 2025-03-23 20:46 ` Andreas Hindborg 1 sibling, 0 replies; 13+ messages in thread From: Andreas Hindborg @ 2025-03-23 20:46 UTC (permalink / raw) To: Oliver Mangold Cc: Miguel Ojeda, Alex Gaynor, Boqun Feng, Gary Guo, Björn Roy Baron, Benno Lossin, Alice Ryhl, Trevor Gross, Asahi Lina, rust-for-linux, linux-kernel "Oliver Mangold" <oliver.mangold@pm.me> writes: > From: Asahi Lina <lina@asahilina.net> > > By analogy to AlwaysRefCounted and ARef, an Ownable type is a (typically > C FFI) type that *may* be owned by Rust, but need not be. Unlike > AlwaysRefCounted, this mechanism expects the reference to be unique > within Rust, and does not allow cloning. > > Conceptually, this is similar to a KBox<T>, except that it delegates > resource management to the T instead of using a generic allocator. > > Link: https://lore.kernel.org/all/20250202-rust-page-v1-1-e3170d7fe55e@asahilina.net/ > Signed-off-by: Asahi Lina <lina@asahilina.net> > [ om: make from_raw() and into_raw() public, small fixes to documentation ] > Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> Please see review comments for the original posting of the patch from Alice [1] and me [2]. Best regards, Andreas Hindborg [1] https://lore.kernel.org/all/CAH5fLggscATtCgQwCYSms77oSFOMkjTscRDqAOZsSgoHsOoPQw@mail.gmail.com [2] https://lore.kernel.org/all/87h64qe3dt.fsf@kernel.org ^ permalink raw reply [flat|nested] 13+ messages in thread
* [PATCH v8 2/4] rust: rename AlwaysRefCounted to RefCounted 2025-03-13 6:59 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Oliver Mangold 2025-03-13 7:00 ` [PATCH v8 1/4] rust: types: Add Ownable/Owned types Oliver Mangold @ 2025-03-13 7:00 ` Oliver Mangold 2025-03-21 16:20 ` Boqun Feng 2025-03-13 7:00 ` [PATCH v8 3/4] rust: kbuild: provide `RUSTC_HAS_DO_NOT_RECOMMEND` symbol Oliver Mangold ` (2 subsequent siblings) 4 siblings, 1 reply; 13+ messages in thread From: Oliver Mangold @ 2025-03-13 7:00 UTC (permalink / raw) To: Miguel Ojeda, Alex Gaynor, Boqun Feng, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina Cc: rust-for-linux, linux-kernel, Oliver Mangold AlwaysRefCounted will become a marker trait to indicate that it is allowed to obtain an ARef from a `&`, which cannot be allowed for types which are also Ownable. Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> Suggested-by: Alice Ryhl <aliceryhl@google.com> --- rust/kernel/block/mq/request.rs | 10 ++++++--- rust/kernel/cred.rs | 8 ++++++-- rust/kernel/device.rs | 8 ++++++-- rust/kernel/fs/file.rs | 10 ++++++--- rust/kernel/pid_namespace.rs | 8 ++++++-- rust/kernel/task.rs | 6 +++++- rust/kernel/types.rs | 45 ++++++++++++++++++++++++----------------- 7 files changed, 64 insertions(+), 31 deletions(-) diff --git a/rust/kernel/block/mq/request.rs b/rust/kernel/block/mq/request.rs index 2f2bb5a04709cc90ae8971da166fc83bb53fb86b..f6bee0932499e554f88907861997f8b9d1ffd51a 100644 --- a/rust/kernel/block/mq/request.rs +++ b/rust/kernel/block/mq/request.rs @@ -9,7 +9,7 @@ block::mq::Operations, error::Result, sync::Refcount, - types::{ARef, AlwaysRefCounted, Opaque}, + types::{ARef, AlwaysRefCounted, Opaque, RefCounted}, }; use core::{ marker::PhantomData, @@ -209,10 +209,10 @@ unsafe impl<T: Operations> Send for Request<T> {} unsafe impl<T: Operations> Sync for Request<T> {} // SAFETY: All instances of `Request<T>` are reference counted. This -// implementation of `AlwaysRefCounted` ensure that increments to the ref count +// implementation of `RefCounted` ensure that increments to the ref count // keeps the object alive in memory at least until a matching reference count // decrement is executed. -unsafe impl<T: Operations> AlwaysRefCounted for Request<T> { +unsafe impl<T: Operations> RefCounted for Request<T> { fn inc_ref(&self) { self.wrapper_ref().refcount().inc(); } @@ -234,3 +234,7 @@ unsafe fn dec_ref(obj: core::ptr::NonNull<Self>) { } } } + +// SAFETY: we currently do not implement `Ownable`, thus it is okay to can obtain an `ARef<Request>` +// from a `&Request` (but this will change in the future). +unsafe impl<T: Operations> AlwaysRefCounted for Request<T> {} diff --git a/rust/kernel/cred.rs b/rust/kernel/cred.rs index 81d67789b16f243e7832ff3b2e5e479a1ab2bf9e..e04d1021130eb1ec46fe48feb088959da7656d66 100644 --- a/rust/kernel/cred.rs +++ b/rust/kernel/cred.rs @@ -11,7 +11,7 @@ use crate::{ bindings, task::Kuid, - types::{AlwaysRefCounted, Opaque}, + types::{AlwaysRefCounted, Opaque, RefCounted}, }; /// Wraps the kernel's `struct cred`. @@ -71,7 +71,7 @@ pub fn euid(&self) -> Kuid { } // SAFETY: The type invariants guarantee that `Credential` is always ref-counted. -unsafe impl AlwaysRefCounted for Credential { +unsafe impl RefCounted for Credential { fn inc_ref(&self) { // SAFETY: The existence of a shared reference means that the refcount is nonzero. unsafe { bindings::get_cred(self.0.get()) }; @@ -83,3 +83,7 @@ unsafe fn dec_ref(obj: core::ptr::NonNull<Credential>) { unsafe { bindings::put_cred(obj.cast().as_ptr()) }; } } + +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `ARef<Credential>` from a +// `&Credential`. +unsafe impl AlwaysRefCounted for Credential {} diff --git a/rust/kernel/device.rs b/rust/kernel/device.rs index db2d9658ba47d9c492bc813ce3eb2ff29703ca31..189298518dc184405b1d62404b190d4c0b08b7ad 100644 --- a/rust/kernel/device.rs +++ b/rust/kernel/device.rs @@ -7,7 +7,7 @@ use crate::{ bindings, str::CStr, - types::{ARef, Opaque}, + types::{ARef, AlwaysRefCounted, Opaque, RefCounted}, }; use core::{fmt, ptr}; @@ -190,7 +190,7 @@ pub fn property_present(&self, name: &CStr) -> bool { } // SAFETY: Instances of `Device` are always reference-counted. -unsafe impl crate::types::AlwaysRefCounted for Device { +unsafe impl RefCounted for Device { fn inc_ref(&self) { // SAFETY: The existence of a shared reference guarantees that the refcount is non-zero. unsafe { bindings::get_device(self.as_raw()) }; @@ -202,6 +202,10 @@ unsafe fn dec_ref(obj: ptr::NonNull<Self>) { } } +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `Device<Task>` from a +// `&Device`. +unsafe impl AlwaysRefCounted for Device {} + // SAFETY: As by the type invariant `Device` can be sent to any thread. unsafe impl Send for Device {} diff --git a/rust/kernel/fs/file.rs b/rust/kernel/fs/file.rs index e03dbe14d62a566349c4100f2f78b17d4c79aab5..a7836cc754e7927b6addc3bd06cfe8c8119f1d9f 100644 --- a/rust/kernel/fs/file.rs +++ b/rust/kernel/fs/file.rs @@ -11,7 +11,7 @@ bindings, cred::Credential, error::{code::*, Error, Result}, - types::{ARef, AlwaysRefCounted, NotThreadSafe, Opaque}, + types::{ARef, AlwaysRefCounted, NotThreadSafe, Opaque, RefCounted}, }; use core::ptr; @@ -190,7 +190,7 @@ unsafe impl Sync for File {} // SAFETY: The type invariants guarantee that `File` is always ref-counted. This implementation // makes `ARef<File>` own a normal refcount. -unsafe impl AlwaysRefCounted for File { +unsafe impl RefCounted for File { #[inline] fn inc_ref(&self) { // SAFETY: The existence of a shared reference means that the refcount is nonzero. @@ -205,6 +205,10 @@ unsafe fn dec_ref(obj: ptr::NonNull<File>) { } } +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `ARef<File>` from a +/// `&File`. +unsafe impl AlwaysRefCounted for File {} + /// Wraps the kernel's `struct file`. Not thread safe. /// /// This type represents a file that is not known to be safe to transfer across thread boundaries. @@ -225,7 +229,7 @@ pub struct LocalFile { // SAFETY: The type invariants guarantee that `LocalFile` is always ref-counted. This implementation // makes `ARef<File>` own a normal refcount. -unsafe impl AlwaysRefCounted for LocalFile { +unsafe impl RefCounted for LocalFile { #[inline] fn inc_ref(&self) { // SAFETY: The existence of a shared reference means that the refcount is nonzero. diff --git a/rust/kernel/pid_namespace.rs b/rust/kernel/pid_namespace.rs index 0e93808e4639b37dd77add5d79f64058dac7cb87..3e45e945b7509b9607266b2e0e6ef130e7a1ed39 100644 --- a/rust/kernel/pid_namespace.rs +++ b/rust/kernel/pid_namespace.rs @@ -9,7 +9,7 @@ use crate::{ bindings, - types::{AlwaysRefCounted, Opaque}, + types::{AlwaysRefCounted, RefCounted, Opaque}, }; use core::ptr; @@ -44,7 +44,7 @@ pub unsafe fn from_ptr<'a>(ptr: *const bindings::pid_namespace) -> &'a Self { } // SAFETY: Instances of `PidNamespace` are always reference-counted. -unsafe impl AlwaysRefCounted for PidNamespace { +unsafe impl RefCounted for PidNamespace { #[inline] fn inc_ref(&self) { // SAFETY: The existence of a shared reference means that the refcount is nonzero. @@ -58,6 +58,10 @@ unsafe fn dec_ref(obj: ptr::NonNull<PidNamespace>) { } } +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `ARef<PidNamespace>` +// from a `&PidNamespace`. +unsafe impl AlwaysRefCounted for PidNamespace {} + // SAFETY: // - `PidNamespace::dec_ref` can be called from any thread. // - It is okay to send ownership of `PidNamespace` across thread boundaries. diff --git a/rust/kernel/task.rs b/rust/kernel/task.rs index 07bc22a7645c0c7d792a0a163dd55b8ff0fe5f92..1cc1b02cb7fada6703da8cad77549dee578fc08d 100644 --- a/rust/kernel/task.rs +++ b/rust/kernel/task.rs @@ -327,7 +327,7 @@ pub fn wake_up(&self) { } // SAFETY: The type invariants guarantee that `Task` is always refcounted. -unsafe impl crate::types::AlwaysRefCounted for Task { +unsafe impl crate::types::RefCounted for Task { fn inc_ref(&self) { // SAFETY: The existence of a shared reference means that the refcount is nonzero. unsafe { bindings::get_task_struct(self.as_ptr()) }; @@ -339,6 +339,10 @@ unsafe fn dec_ref(obj: ptr::NonNull<Self>) { } } +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `ARef<Task>` from a +// `&Task`. +unsafe impl crate::types::AlwaysRefCounted for Task {} + impl Kuid { /// Get the current euid. #[inline] diff --git a/rust/kernel/types.rs b/rust/kernel/types.rs index 65f6d0721f5f23c8db79c6735dc7d5e1ac984ea7..5a96da714348cc2369969200e6070972226c00fe 100644 --- a/rust/kernel/types.rs +++ b/rust/kernel/types.rs @@ -402,11 +402,9 @@ pub const fn raw_get(this: *const Self) -> *mut T { } } -/// Types that are _always_ reference counted. +/// Types that are internally reference counted. /// /// It allows such types to define their own custom ref increment and decrement functions. -/// Additionally, it allows users to convert from a shared reference `&T` to an owned reference -/// [`ARef<T>`]. /// /// This is usually implemented by wrappers to existing structures on the C side of the code. For /// Rust code, the recommendation is to use [`Arc`](crate::sync::Arc) to create reference-counted @@ -418,9 +416,9 @@ pub const fn raw_get(this: *const Self) -> *mut T { /// at least until matching decrements are performed. /// /// Implementers must also ensure that all instances are reference-counted. (Otherwise they -/// won't be able to honour the requirement that [`AlwaysRefCounted::inc_ref`] keep the object +/// won't be able to honour the requirement that [`RefCounted::inc_ref`] keep the object /// alive.) -pub unsafe trait AlwaysRefCounted { +pub unsafe trait RefCounted { /// Increments the reference count on the object. fn inc_ref(&self); @@ -433,11 +431,22 @@ pub unsafe trait AlwaysRefCounted { /// Callers must ensure that there was a previous matching increment to the reference count, /// and that the object is no longer used after its reference count is decremented (as it may /// result in the object being freed), unless the caller owns another increment on the refcount - /// (e.g., it calls [`AlwaysRefCounted::inc_ref`] twice, then calls - /// [`AlwaysRefCounted::dec_ref`] once). + /// (e.g., it calls [`RefCounted::inc_ref`] twice, then calls + /// [`RefCounted::dec_ref`] once). unsafe fn dec_ref(obj: NonNull<Self>); } +/// An extension to RefCounted, which declares that it is allowed to convert +/// from a shared reference `&T` to an owned reference [`ARef<T>`]. +/// +/// # Safety +/// +/// Implementers must ensure that no safety invariants are violated by upgrading an `&T` +/// to an [`ARef<T>`]. In particular that implies [`AlwaysRefCounted`] and [`Ownable`] +/// cannot be implemented for the same type, as this would allow to violate the uniqueness +/// guarantee of [`Owned<T>`] by derefencing it into an `&T` and obtaining an [`ARef`] from that. +pub unsafe trait AlwaysRefCounted: RefCounted {} + /// An owned reference to an always-reference-counted object. /// /// The object's reference count is automatically decremented when an instance of [`ARef`] is @@ -448,7 +457,7 @@ pub unsafe trait AlwaysRefCounted { /// /// The pointer stored in `ptr` is non-null and valid for the lifetime of the [`ARef`] instance. In /// particular, the [`ARef`] instance owns an increment on the underlying object's reference count. -pub struct ARef<T: AlwaysRefCounted> { +pub struct ARef<T: RefCounted> { ptr: NonNull<T>, _p: PhantomData<T>, } @@ -457,16 +466,16 @@ pub struct ARef<T: AlwaysRefCounted> { // it effectively means sharing `&T` (which is safe because `T` is `Sync`); additionally, it needs // `T` to be `Send` because any thread that has an `ARef<T>` may ultimately access `T` using a // mutable reference, for example, when the reference count reaches zero and `T` is dropped. -unsafe impl<T: AlwaysRefCounted + Sync + Send> Send for ARef<T> {} +unsafe impl<T: RefCounted + Sync + Send> Send for ARef<T> {} // SAFETY: It is safe to send `&ARef<T>` to another thread when the underlying `T` is `Sync` // because it effectively means sharing `&T` (which is safe because `T` is `Sync`); additionally, // it needs `T` to be `Send` because any thread that has a `&ARef<T>` may clone it and get an // `ARef<T>` on that thread, so the thread may ultimately access `T` using a mutable reference, for // example, when the reference count reaches zero and `T` is dropped. -unsafe impl<T: AlwaysRefCounted + Sync + Send> Sync for ARef<T> {} +unsafe impl<T: RefCounted + Sync + Send> Sync for ARef<T> {} -impl<T: AlwaysRefCounted> ARef<T> { +impl<T: RefCounted> ARef<T> { /// Creates a new instance of [`ARef`]. /// /// It takes over an increment of the reference count on the underlying object. @@ -495,12 +504,12 @@ pub unsafe fn from_raw(ptr: NonNull<T>) -> Self { /// /// ``` /// use core::ptr::NonNull; - /// use kernel::types::{ARef, AlwaysRefCounted}; + /// use kernel::types::{ARef, RefCounted}; /// /// struct Empty {} /// /// # // SAFETY: TODO. - /// unsafe impl AlwaysRefCounted for Empty { + /// unsafe impl RefCounted for Empty { /// fn inc_ref(&self) {} /// unsafe fn dec_ref(_obj: NonNull<Self>) {} /// } @@ -518,7 +527,7 @@ pub fn into_raw(me: Self) -> NonNull<T> { } } -impl<T: AlwaysRefCounted> Clone for ARef<T> { +impl<T: RefCounted> Clone for ARef<T> { fn clone(&self) -> Self { self.inc_ref(); // SAFETY: We just incremented the refcount above. @@ -526,7 +535,7 @@ fn clone(&self) -> Self { } } -impl<T: AlwaysRefCounted> Deref for ARef<T> { +impl<T: RefCounted> Deref for ARef<T> { type Target = T; fn deref(&self) -> &Self::Target { @@ -543,10 +552,10 @@ fn from(b: &T) -> Self { } } -impl<T: AlwaysRefCounted> Drop for ARef<T> { +impl<T: RefCounted> Drop for ARef<T> { fn drop(&mut self) { - // SAFETY: The type invariants guarantee that the `ARef` owns the reference we're about to - // decrement. + // SAFETY: The type invariants guarantee that the `ARef` owns the reference + // we're about to decrement. unsafe { T::dec_ref(self.ptr) }; } } -- 2.48.1 ^ permalink raw reply related [flat|nested] 13+ messages in thread
* Re: [PATCH v8 2/4] rust: rename AlwaysRefCounted to RefCounted 2025-03-13 7:00 ` [PATCH v8 2/4] rust: rename AlwaysRefCounted to RefCounted Oliver Mangold @ 2025-03-21 16:20 ` Boqun Feng 2025-03-24 7:32 ` Oliver Mangold 0 siblings, 1 reply; 13+ messages in thread From: Boqun Feng @ 2025-03-21 16:20 UTC (permalink / raw) To: Oliver Mangold Cc: Miguel Ojeda, Alex Gaynor, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina, rust-for-linux, linux-kernel On Thu, Mar 13, 2025 at 07:00:11AM +0000, Oliver Mangold wrote: > AlwaysRefCounted will become a marker trait to indicate that it is allowed > to obtain an ARef from a `&`, which cannot be allowed for types which are > also Ownable. > This commit log doesn't explain why we need to do this. > Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> > Suggested-by: Alice Ryhl <aliceryhl@google.com> > --- > rust/kernel/block/mq/request.rs | 10 ++++++--- > rust/kernel/cred.rs | 8 ++++++-- > rust/kernel/device.rs | 8 ++++++-- > rust/kernel/fs/file.rs | 10 ++++++--- > rust/kernel/pid_namespace.rs | 8 ++++++-- > rust/kernel/task.rs | 6 +++++- > rust/kernel/types.rs | 45 ++++++++++++++++++++++++----------------- > 7 files changed, 64 insertions(+), 31 deletions(-) > > diff --git a/rust/kernel/block/mq/request.rs b/rust/kernel/block/mq/request.rs > index 2f2bb5a04709cc90ae8971da166fc83bb53fb86b..f6bee0932499e554f88907861997f8b9d1ffd51a 100644 > --- a/rust/kernel/block/mq/request.rs > +++ b/rust/kernel/block/mq/request.rs > @@ -9,7 +9,7 @@ > block::mq::Operations, > error::Result, > sync::Refcount, > - types::{ARef, AlwaysRefCounted, Opaque}, > + types::{ARef, AlwaysRefCounted, Opaque, RefCounted}, > }; > use core::{ > marker::PhantomData, > @@ -209,10 +209,10 @@ unsafe impl<T: Operations> Send for Request<T> {} > unsafe impl<T: Operations> Sync for Request<T> {} > > // SAFETY: All instances of `Request<T>` are reference counted. This > -// implementation of `AlwaysRefCounted` ensure that increments to the ref count > +// implementation of `RefCounted` ensure that increments to the ref count > // keeps the object alive in memory at least until a matching reference count > // decrement is executed. > -unsafe impl<T: Operations> AlwaysRefCounted for Request<T> { > +unsafe impl<T: Operations> RefCounted for Request<T> { > fn inc_ref(&self) { > self.wrapper_ref().refcount().inc(); > } > @@ -234,3 +234,7 @@ unsafe fn dec_ref(obj: core::ptr::NonNull<Self>) { > } > } > } > + > +// SAFETY: we currently do not implement `Ownable`, thus it is okay to can obtain an `ARef<Request>` s/we/We > +// from a `&Request` (but this will change in the future). > +unsafe impl<T: Operations> AlwaysRefCounted for Request<T> {} > diff --git a/rust/kernel/cred.rs b/rust/kernel/cred.rs > index 81d67789b16f243e7832ff3b2e5e479a1ab2bf9e..e04d1021130eb1ec46fe48feb088959da7656d66 100644 > --- a/rust/kernel/cred.rs > +++ b/rust/kernel/cred.rs > @@ -11,7 +11,7 @@ > use crate::{ > bindings, > task::Kuid, > - types::{AlwaysRefCounted, Opaque}, > + types::{AlwaysRefCounted, Opaque, RefCounted}, > }; > > /// Wraps the kernel's `struct cred`. > @@ -71,7 +71,7 @@ pub fn euid(&self) -> Kuid { > } > > // SAFETY: The type invariants guarantee that `Credential` is always ref-counted. > -unsafe impl AlwaysRefCounted for Credential { > +unsafe impl RefCounted for Credential { > fn inc_ref(&self) { > // SAFETY: The existence of a shared reference means that the refcount is nonzero. > unsafe { bindings::get_cred(self.0.get()) }; > @@ -83,3 +83,7 @@ unsafe fn dec_ref(obj: core::ptr::NonNull<Credential>) { > unsafe { bindings::put_cred(obj.cast().as_ptr()) }; > } > } > + > +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `ARef<Credential>` from a > +// `&Credential`. > +unsafe impl AlwaysRefCounted for Credential {} > diff --git a/rust/kernel/device.rs b/rust/kernel/device.rs > index db2d9658ba47d9c492bc813ce3eb2ff29703ca31..189298518dc184405b1d62404b190d4c0b08b7ad 100644 > --- a/rust/kernel/device.rs > +++ b/rust/kernel/device.rs > @@ -7,7 +7,7 @@ > use crate::{ > bindings, > str::CStr, > - types::{ARef, Opaque}, > + types::{ARef, AlwaysRefCounted, Opaque, RefCounted}, > }; > use core::{fmt, ptr}; > > @@ -190,7 +190,7 @@ pub fn property_present(&self, name: &CStr) -> bool { > } > > // SAFETY: Instances of `Device` are always reference-counted. > -unsafe impl crate::types::AlwaysRefCounted for Device { > +unsafe impl RefCounted for Device { > fn inc_ref(&self) { > // SAFETY: The existence of a shared reference guarantees that the refcount is non-zero. > unsafe { bindings::get_device(self.as_raw()) }; > @@ -202,6 +202,10 @@ unsafe fn dec_ref(obj: ptr::NonNull<Self>) { > } > } > > +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `Device<Task>` from a > +// `&Device`. > +unsafe impl AlwaysRefCounted for Device {} > + > // SAFETY: As by the type invariant `Device` can be sent to any thread. > unsafe impl Send for Device {} > > diff --git a/rust/kernel/fs/file.rs b/rust/kernel/fs/file.rs > index e03dbe14d62a566349c4100f2f78b17d4c79aab5..a7836cc754e7927b6addc3bd06cfe8c8119f1d9f 100644 > --- a/rust/kernel/fs/file.rs > +++ b/rust/kernel/fs/file.rs > @@ -11,7 +11,7 @@ > bindings, > cred::Credential, > error::{code::*, Error, Result}, > - types::{ARef, AlwaysRefCounted, NotThreadSafe, Opaque}, > + types::{ARef, AlwaysRefCounted, NotThreadSafe, Opaque, RefCounted}, > }; > use core::ptr; > > @@ -190,7 +190,7 @@ unsafe impl Sync for File {} > > // SAFETY: The type invariants guarantee that `File` is always ref-counted. This implementation > // makes `ARef<File>` own a normal refcount. > -unsafe impl AlwaysRefCounted for File { > +unsafe impl RefCounted for File { > #[inline] > fn inc_ref(&self) { > // SAFETY: The existence of a shared reference means that the refcount is nonzero. > @@ -205,6 +205,10 @@ unsafe fn dec_ref(obj: ptr::NonNull<File>) { > } > } > > +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `ARef<File>` from a > +/// `&File`. > +unsafe impl AlwaysRefCounted for File {} > + > /// Wraps the kernel's `struct file`. Not thread safe. > /// > /// This type represents a file that is not known to be safe to transfer across thread boundaries. > @@ -225,7 +229,7 @@ pub struct LocalFile { > > // SAFETY: The type invariants guarantee that `LocalFile` is always ref-counted. This implementation > // makes `ARef<File>` own a normal refcount. > -unsafe impl AlwaysRefCounted for LocalFile { > +unsafe impl RefCounted for LocalFile { > #[inline] > fn inc_ref(&self) { > // SAFETY: The existence of a shared reference means that the refcount is nonzero. > diff --git a/rust/kernel/pid_namespace.rs b/rust/kernel/pid_namespace.rs > index 0e93808e4639b37dd77add5d79f64058dac7cb87..3e45e945b7509b9607266b2e0e6ef130e7a1ed39 100644 > --- a/rust/kernel/pid_namespace.rs > +++ b/rust/kernel/pid_namespace.rs > @@ -9,7 +9,7 @@ > > use crate::{ > bindings, > - types::{AlwaysRefCounted, Opaque}, > + types::{AlwaysRefCounted, RefCounted, Opaque}, > }; > use core::ptr; > > @@ -44,7 +44,7 @@ pub unsafe fn from_ptr<'a>(ptr: *const bindings::pid_namespace) -> &'a Self { > } > > // SAFETY: Instances of `PidNamespace` are always reference-counted. > -unsafe impl AlwaysRefCounted for PidNamespace { > +unsafe impl RefCounted for PidNamespace { > #[inline] > fn inc_ref(&self) { > // SAFETY: The existence of a shared reference means that the refcount is nonzero. > @@ -58,6 +58,10 @@ unsafe fn dec_ref(obj: ptr::NonNull<PidNamespace>) { > } > } > > +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `ARef<PidNamespace>` > +// from a `&PidNamespace`. > +unsafe impl AlwaysRefCounted for PidNamespace {} > + > // SAFETY: > // - `PidNamespace::dec_ref` can be called from any thread. > // - It is okay to send ownership of `PidNamespace` across thread boundaries. > diff --git a/rust/kernel/task.rs b/rust/kernel/task.rs > index 07bc22a7645c0c7d792a0a163dd55b8ff0fe5f92..1cc1b02cb7fada6703da8cad77549dee578fc08d 100644 > --- a/rust/kernel/task.rs > +++ b/rust/kernel/task.rs > @@ -327,7 +327,7 @@ pub fn wake_up(&self) { > } > > // SAFETY: The type invariants guarantee that `Task` is always refcounted. > -unsafe impl crate::types::AlwaysRefCounted for Task { > +unsafe impl crate::types::RefCounted for Task { > fn inc_ref(&self) { > // SAFETY: The existence of a shared reference means that the refcount is nonzero. > unsafe { bindings::get_task_struct(self.as_ptr()) }; > @@ -339,6 +339,10 @@ unsafe fn dec_ref(obj: ptr::NonNull<Self>) { > } > } > > +// SAFETY: We do not implement `Ownable`, thus it is okay to can obtain an `ARef<Task>` from a > +// `&Task`. > +unsafe impl crate::types::AlwaysRefCounted for Task {} > + > impl Kuid { > /// Get the current euid. > #[inline] > diff --git a/rust/kernel/types.rs b/rust/kernel/types.rs > index 65f6d0721f5f23c8db79c6735dc7d5e1ac984ea7..5a96da714348cc2369969200e6070972226c00fe 100644 > --- a/rust/kernel/types.rs > +++ b/rust/kernel/types.rs > @@ -402,11 +402,9 @@ pub const fn raw_get(this: *const Self) -> *mut T { > } > } > > -/// Types that are _always_ reference counted. > +/// Types that are internally reference counted. > /// > /// It allows such types to define their own custom ref increment and decrement functions. > -/// Additionally, it allows users to convert from a shared reference `&T` to an owned reference > -/// [`ARef<T>`]. > /// > /// This is usually implemented by wrappers to existing structures on the C side of the code. For > /// Rust code, the recommendation is to use [`Arc`](crate::sync::Arc) to create reference-counted > @@ -418,9 +416,9 @@ pub const fn raw_get(this: *const Self) -> *mut T { > /// at least until matching decrements are performed. > /// > /// Implementers must also ensure that all instances are reference-counted. (Otherwise they > -/// won't be able to honour the requirement that [`AlwaysRefCounted::inc_ref`] keep the object > +/// won't be able to honour the requirement that [`RefCounted::inc_ref`] keep the object > /// alive.) > -pub unsafe trait AlwaysRefCounted { > +pub unsafe trait RefCounted { > /// Increments the reference count on the object. > fn inc_ref(&self); > > @@ -433,11 +431,22 @@ pub unsafe trait AlwaysRefCounted { > /// Callers must ensure that there was a previous matching increment to the reference count, > /// and that the object is no longer used after its reference count is decremented (as it may > /// result in the object being freed), unless the caller owns another increment on the refcount > - /// (e.g., it calls [`AlwaysRefCounted::inc_ref`] twice, then calls > - /// [`AlwaysRefCounted::dec_ref`] once). > + /// (e.g., it calls [`RefCounted::inc_ref`] twice, then calls > + /// [`RefCounted::dec_ref`] once). > unsafe fn dec_ref(obj: NonNull<Self>); > } > > +/// An extension to RefCounted, which declares that it is allowed to convert > +/// from a shared reference `&T` to an owned reference [`ARef<T>`]. > +/// > +/// # Safety > +/// > +/// Implementers must ensure that no safety invariants are violated by upgrading an `&T` > +/// to an [`ARef<T>`]. In particular that implies [`AlwaysRefCounted`] and [`Ownable`] > +/// cannot be implemented for the same type, as this would allow to violate the uniqueness > +/// guarantee of [`Owned<T>`] by derefencing it into an `&T` and obtaining an [`ARef`] from that. > +pub unsafe trait AlwaysRefCounted: RefCounted {} > + > /// An owned reference to an always-reference-counted object. > /// > /// The object's reference count is automatically decremented when an instance of [`ARef`] is > @@ -448,7 +457,7 @@ pub unsafe trait AlwaysRefCounted { > /// > /// The pointer stored in `ptr` is non-null and valid for the lifetime of the [`ARef`] instance. In > /// particular, the [`ARef`] instance owns an increment on the underlying object's reference count. > -pub struct ARef<T: AlwaysRefCounted> { > +pub struct ARef<T: RefCounted> { > ptr: NonNull<T>, > _p: PhantomData<T>, > } > @@ -457,16 +466,16 @@ pub struct ARef<T: AlwaysRefCounted> { > // it effectively means sharing `&T` (which is safe because `T` is `Sync`); additionally, it needs > // `T` to be `Send` because any thread that has an `ARef<T>` may ultimately access `T` using a > // mutable reference, for example, when the reference count reaches zero and `T` is dropped. > -unsafe impl<T: AlwaysRefCounted + Sync + Send> Send for ARef<T> {} > +unsafe impl<T: RefCounted + Sync + Send> Send for ARef<T> {} > > // SAFETY: It is safe to send `&ARef<T>` to another thread when the underlying `T` is `Sync` > // because it effectively means sharing `&T` (which is safe because `T` is `Sync`); additionally, > // it needs `T` to be `Send` because any thread that has a `&ARef<T>` may clone it and get an > // `ARef<T>` on that thread, so the thread may ultimately access `T` using a mutable reference, for > // example, when the reference count reaches zero and `T` is dropped. > -unsafe impl<T: AlwaysRefCounted + Sync + Send> Sync for ARef<T> {} > +unsafe impl<T: RefCounted + Sync + Send> Sync for ARef<T> {} > > -impl<T: AlwaysRefCounted> ARef<T> { > +impl<T: RefCounted> ARef<T> { > /// Creates a new instance of [`ARef`]. > /// > /// It takes over an increment of the reference count on the underlying object. > @@ -495,12 +504,12 @@ pub unsafe fn from_raw(ptr: NonNull<T>) -> Self { > /// > /// ``` > /// use core::ptr::NonNull; > - /// use kernel::types::{ARef, AlwaysRefCounted}; > + /// use kernel::types::{ARef, RefCounted}; > /// > /// struct Empty {} > /// > /// # // SAFETY: TODO. While you at it, could you also finish this todo? ;-) Thanks! I believe this is just using a ZST to simulate a RefCounted type, therefore it's safe to assume `Empty` is ref-counted. Regards, Boqun > - /// unsafe impl AlwaysRefCounted for Empty { > + /// unsafe impl RefCounted for Empty { > /// fn inc_ref(&self) {} > /// unsafe fn dec_ref(_obj: NonNull<Self>) {} > /// } > @@ -518,7 +527,7 @@ pub fn into_raw(me: Self) -> NonNull<T> { > } > } > > -impl<T: AlwaysRefCounted> Clone for ARef<T> { > +impl<T: RefCounted> Clone for ARef<T> { > fn clone(&self) -> Self { > self.inc_ref(); > // SAFETY: We just incremented the refcount above. > @@ -526,7 +535,7 @@ fn clone(&self) -> Self { > } > } > > -impl<T: AlwaysRefCounted> Deref for ARef<T> { > +impl<T: RefCounted> Deref for ARef<T> { > type Target = T; > > fn deref(&self) -> &Self::Target { > @@ -543,10 +552,10 @@ fn from(b: &T) -> Self { > } > } > > -impl<T: AlwaysRefCounted> Drop for ARef<T> { > +impl<T: RefCounted> Drop for ARef<T> { > fn drop(&mut self) { > - // SAFETY: The type invariants guarantee that the `ARef` owns the reference we're about to > - // decrement. > + // SAFETY: The type invariants guarantee that the `ARef` owns the reference > + // we're about to decrement. > unsafe { T::dec_ref(self.ptr) }; > } > } > > -- > 2.48.1 > > ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [PATCH v8 2/4] rust: rename AlwaysRefCounted to RefCounted 2025-03-21 16:20 ` Boqun Feng @ 2025-03-24 7:32 ` Oliver Mangold 0 siblings, 0 replies; 13+ messages in thread From: Oliver Mangold @ 2025-03-24 7:32 UTC (permalink / raw) To: Boqun Feng Cc: Miguel Ojeda, Alex Gaynor, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina, rust-for-linux, linux-kernel On 250321 0920, Boqun Feng wrote: > On Thu, Mar 13, 2025 at 07:00:11AM +0000, Oliver Mangold wrote: > > AlwaysRefCounted will become a marker trait to indicate that it is allowed > > to obtain an ARef from a `&`, which cannot be allowed for types which are > > also Ownable. > > > > This commit log doesn't explain why we need to do this. Hi Boqun, what exactly do you have in mind? It mentions that it is to allow types that are both Ownable and RefCounted. That the next step is to introduce OwnableRefCounted? That we want to safely convert from ARef to Owned? > > + > > +// SAFETY: we currently do not implement `Ownable`, thus it is okay to can obtain an `ARef<Request>` > > s/we/We > Missed that one. Thanks. Best regards, Oliver ^ permalink raw reply [flat|nested] 13+ messages in thread
* [PATCH v8 3/4] rust: kbuild: provide `RUSTC_HAS_DO_NOT_RECOMMEND` symbol 2025-03-13 6:59 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Oliver Mangold 2025-03-13 7:00 ` [PATCH v8 1/4] rust: types: Add Ownable/Owned types Oliver Mangold 2025-03-13 7:00 ` [PATCH v8 2/4] rust: rename AlwaysRefCounted to RefCounted Oliver Mangold @ 2025-03-13 7:00 ` Oliver Mangold 2025-03-13 7:00 ` [PATCH v8 4/4] rust: adding OwnableRefCounted and SimpleOwnableRefCounted Oliver Mangold 2025-03-23 20:19 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Andreas Hindborg 4 siblings, 0 replies; 13+ messages in thread From: Oliver Mangold @ 2025-03-13 7:00 UTC (permalink / raw) To: Miguel Ojeda, Alex Gaynor, Boqun Feng, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina Cc: rust-for-linux, linux-kernel, Oliver Mangold From: Miguel Ojeda <ojeda@kernel.org> Rust 1.85.0 (current stable version) stabilized [1] `#[diagnostic::do_not_recommend]` [2]. In order to use it across all supported Rust versions, introduce a new Kconfig symbol for it. This allows to perform conditional compilation based on it, e.g. on the use site to enable the attribute: #[cfg_attr(RUSTC_HAS_DO_NOT_RECOMMEND, diagnostic::do_not_recommend)] impl A for i32 {} An alternative would have been to `allow` the following warning: #![allow(unknown_or_malformed_diagnostic_attributes)] However, that would lose the checking for typos across all versions, which we do not want to lose. One can also use the Kconfig symbol to allow the warning in older compilers instead, to avoid repeating the `cfg_attr` line above in all use sites: #![cfg_attr( not(RUSTC_HAS_DO_NOT_RECOMMEND), expect(unknown_or_malformed_diagnostic_attributes) )] That still loses the checking for typos in older versions, but we still keep it in newer ones, thus we should still catch mistakes eventually. In this case we can promote it to `expect` as shown above, so that we do not forget to remove these lines if we stop using the attribute somewhere. Link: https://github.com/rust-lang/rust/pull/132056 [1] Link: https://doc.rust-lang.org/reference/attributes/diagnostics.html#the-diagnosticdo_not_recommend-attribute [2] Link: https://lore.kernel.org/rust-for-linux/CANiq72mYfhuRWkjomb1vOMMPOaxvdS6qjfVLAwxUw6ecdqyh2A@mail.gmail.com/ Signed-off-by: Miguel Ojeda <ojeda@kernel.org> Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> --- init/Kconfig | 3 +++ 1 file changed, 3 insertions(+) diff --git a/init/Kconfig b/init/Kconfig index 12b0847603b20fe1d8c70c4c57dabc924efe697b..ed1abb1beec0767f3696dbb6ac9844ba7e0610c9 100644 --- a/init/Kconfig +++ b/init/Kconfig @@ -147,6 +147,9 @@ config CC_HAS_COUNTED_BY config RUSTC_HAS_COERCE_POINTEE def_bool RUSTC_VERSION >= 108400 +config RUSTC_HAS_DO_NOT_RECOMMEND + def_bool RUSTC_VERSION >= 108500 + config PAHOLE_VERSION int default $(shell,$(srctree)/scripts/pahole-version.sh $(PAHOLE)) -- 2.48.1 ^ permalink raw reply related [flat|nested] 13+ messages in thread
* [PATCH v8 4/4] rust: adding OwnableRefCounted and SimpleOwnableRefCounted 2025-03-13 6:59 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Oliver Mangold ` (2 preceding siblings ...) 2025-03-13 7:00 ` [PATCH v8 3/4] rust: kbuild: provide `RUSTC_HAS_DO_NOT_RECOMMEND` symbol Oliver Mangold @ 2025-03-13 7:00 ` Oliver Mangold 2025-03-21 16:37 ` Boqun Feng 2025-03-23 20:19 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Andreas Hindborg 4 siblings, 1 reply; 13+ messages in thread From: Oliver Mangold @ 2025-03-13 7:00 UTC (permalink / raw) To: Miguel Ojeda, Alex Gaynor, Boqun Feng, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina Cc: rust-for-linux, linux-kernel, Oliver Mangold Types implementing one of these traits can safely convert between an ARef<T> and an Owned<T>. Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> --- rust/kernel/types.rs | 250 +++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 250 insertions(+) diff --git a/rust/kernel/types.rs b/rust/kernel/types.rs index 5a96da714348cc2369969200e6070972226c00fe..cca3d65782eecc7e2ada91f116eb885391c454bf 100644 --- a/rust/kernel/types.rs +++ b/rust/kernel/types.rs @@ -552,6 +552,12 @@ fn from(b: &T) -> Self { } } +impl<T: OwnableRefCounted> From<Owned<T>> for ARef<T> { + fn from(b: Owned<T>) -> Self { + T::into_shared(b) + } +} + impl<T: RefCounted> Drop for ARef<T> { fn drop(&mut self) { // SAFETY: The type invariants guarantee that the `ARef` owns the reference @@ -669,6 +675,250 @@ fn drop(&mut self) { } } +/// A trait for objects that can be wrapped in either one of the reference types [`Owned`] and +/// [`ARef`]. +/// +/// # Safety +/// +/// Implementers must ensure that: +/// +/// - Both the safety requirements for [`Ownable`] and [`RefCounted`] are fulfilled. +/// - The uniqueness invariant of [`Owned`] is upheld until dropped. +/// - [`try_from_shared()`](OwnableRefCounted::into_shared) only returns an [`Owned`] if exactly +/// one [`ARef`] exists. +/// - [`into_shared()`](OwnableRefCounted::into_shared) set the reference count to the value which +/// the returned [`ARef`] expects for an object with a single reference +/// in existence. This implies that if [`into_shared()`](OwnableRefCounted::into_shared) is left +/// on the default implementation, which just rewraps the underlying object, the reference count +/// needs not to be modified when converting a [`Owned`] to an [`ARef`]. +/// +/// # Examples +/// +/// A minimal example implementation of [`OwnableRefCounted`], [`Ownable`] and its usage with +/// [`ARef`] and [`Owned`] looks like this: +/// +/// ``` +/// # #![expect(clippy::disallowed_names)] +/// use core::cell::Cell; +/// use core::ptr::NonNull; +/// use kernel::alloc::{flags, kbox::KBox, AllocError}; +/// use kernel::types::{ +/// ARef, RefCounted, Owned, Ownable, OwnableRefCounted, +/// }; +/// +/// struct Foo { +/// refcount: Cell<usize>, +/// } +/// +/// impl Foo { +/// fn new() -> Result<Owned<Self>, AllocError> { +/// // Use a `KBox` to handle the actual allocation. +/// let result = KBox::new( +/// Foo { +/// refcount: Cell::new(1), +/// }, +/// flags::GFP_KERNEL, +/// )?; +/// let result = NonNull::new(KBox::into_raw(result)) +/// .expect("Raw pointer to newly allocation KBox is null, this should never happen."); +/// // SAFETY: We just allocated the `Foo`, thus it is valid. +/// Ok(unsafe { Owned::from_raw(result) }) +/// } +/// } +/// +/// // SAFETY: We increment and decrement each time the respective function is called and only free +/// // the `Foo` when the refcount reaches zero. +/// unsafe impl RefCounted for Foo { +/// fn inc_ref(&self) { +/// self.refcount.replace(self.refcount.get() + 1); +/// } +/// +/// unsafe fn dec_ref(this: NonNull<Self>) { +/// // SAFETY: The underlying object is always valid when the function is called. +/// let refcount = unsafe { &this.as_ref().refcount }; +/// let new_refcount = refcount.get() - 1; +/// if new_refcount == 0 { +/// // The `Foo` will be dropped when `KBox` goes out of scope. +/// // SAFETY: The `Box<Foo>` is still alive as the old refcount is 1. +/// unsafe { KBox::from_raw(this.as_ptr()) }; +/// } else { +/// refcount.replace(new_refcount); +/// } +/// } +/// } +/// +/// // SAFETY: We only convert into an `Owned` when the refcount is 1. +/// unsafe impl OwnableRefCounted for Foo { +/// fn try_from_shared(this: ARef<Self>) -> Result<Owned<Self>, ARef<Self>> { +/// if this.refcount.get() == 1 { +/// // SAFETY: The `Foo` is still alive as the refcount is 1. +/// Ok(unsafe { Owned::from_raw(ARef::into_raw(this)) }) +/// } else { +/// Err(this) +/// } +/// } +/// } +/// +/// // SAFETY: We are not `AlwaysRefCounted`. +/// unsafe impl Ownable for Foo { +/// unsafe fn release(this: NonNull<Self>) { +/// // SAFETY: Using `dec_ref()` from `RefCounted` to release is okay, as the refcount is +/// // always 1 for an `Owned<Foo>`. +/// unsafe{ Foo::dec_ref(this) }; +/// } +/// } +/// +/// let foo = Foo::new().unwrap(); +/// let mut foo = ARef::from(foo); +/// { +/// let bar = foo.clone(); +/// assert!(Owned::try_from(bar).is_err()); +/// } +/// assert!(Owned::try_from(foo).is_ok()); +/// ``` +pub unsafe trait OwnableRefCounted: RefCounted + Ownable + Sized { + /// Checks if the [`ARef`] is unique and convert it to an [`Owned`] it that is that case. + /// Otherwise it returns again an [`ARef`] to the same underlying object. + fn try_from_shared(this: ARef<Self>) -> Result<Owned<Self>, ARef<Self>>; + /// Converts the [`Owned`] into an [`ARef`]. + + fn into_shared(this: Owned<Self>) -> ARef<Self> { + // SAFETY: Safe by the requirements on implementing the trait. + unsafe { ARef::from_raw(Owned::into_raw(this)) } + } +} + +/// This trait allows to implement [`Ownable`] and [`OwnableRefCounted`] together in a simplified +/// way, only requiring to implement [`RefCounted`] and providing the method +/// [`is_unique()`](SimpleOwnableRefCounted::is_unique). +/// +/// For non-standard cases where conversion between [`Ownable`] and [`RefCounted`] does not allow +/// [`Ownable::release()`] and [`RefCounted::dec_ref()`] to be the same method, [`Ownable`] +/// and [`OwnableRefCounted`] should be implemented separately. +/// +/// # Safety +/// +/// Implementers must ensure that: +/// +/// - The safety requirements for [`Ownable`] are fulfilled and [`RefCounted::dec_ref()`] can +/// be used for [`Ownable::release()`]. +/// - [`is_unique`](SimpleOwnableRefCounted::is_unique) must only return `true` in case only one +/// [`ARef`] exists and it is impossible for one to be obtained other than by cloning an existing +/// [`ARef`] or converting an [`Owned`] to an [`ARef`]. +/// - It is safe to convert an unique [`ARef`] into an [`Owned`] simply by re-wrapping the +/// underlying object without modifying the refcount. +/// +/// # Examples +/// +/// A minimal example implementation of [`RefCounted`] and [`SimpleOwnableRefCounted`] +/// and its usage with [`ARef`] and [`Owned`] looks like this: +/// +/// ``` +/// # #![expect(clippy::disallowed_names)] +/// use core::cell::Cell; +/// use core::ptr::NonNull; +/// use kernel::alloc::{flags, kbox::KBox, AllocError}; +/// use kernel::types::{ +/// ARef, Owned, RefCounted, SimpleOwnableRefCounted, +/// }; +/// +/// struct Foo { +/// refcount: Cell<usize>, +/// } +/// +/// impl Foo { +/// fn new() -> Result<Owned<Self>, AllocError> { +/// // Use a KBox to handle the actual allocation. +/// let result = KBox::new( +/// Foo { +/// refcount: Cell::new(1), +/// }, +/// flags::GFP_KERNEL, +/// )?; +/// let result = NonNull::new(KBox::into_raw(result)) +/// .expect("Raw pointer to newly allocation KBox is null, this should never happen."); +/// // SAFETY: We just allocated the `Foo`, thus it is valid. +/// Ok(unsafe { Owned::from_raw(result) }) +/// } +/// } +/// +/// // SAFETY: we ensure that: +/// // - The `Foo` is only dropped when the refcount is zero. +/// // - `is_unique()` only returns `true` when the refcount is 1. +/// unsafe impl RefCounted for Foo { +/// fn inc_ref(&self) { +/// self.refcount.replace(self.refcount.get() + 1); +/// } +/// +/// unsafe fn dec_ref(this: NonNull<Self>) { +/// // SAFETY: The underlying object is always valid when the function is called. +/// let refcount = unsafe { &this.as_ref().refcount }; +/// let new_refcount = refcount.get() - 1; +/// if new_refcount == 0 { +/// // The `Foo` will be dropped when KBox goes out of scope. +/// // SAFETY: The `Box<Foo>` is still alive as the old refcount is 1. +/// unsafe { KBox::from_raw(this.as_ptr()) }; +/// } else { +/// refcount.replace(new_refcount); +/// } +/// } +/// } +/// +/// // SAFETY: we ensure that: +/// // - `is_unique()` only returns `true` when the refcount is 1. +/// unsafe impl SimpleOwnableRefCounted for Foo { +/// fn is_unique(&self) -> bool { +/// self.refcount.get() == 1 +/// } +/// } +/// +/// let foo = Foo::new().unwrap(); +/// let mut foo = ARef::from(foo); +/// { +/// let bar = foo.clone(); +/// assert!(Owned::try_from(bar).is_err()); +/// } +/// assert!(Owned::try_from(foo).is_ok()); +/// ``` +pub unsafe trait SimpleOwnableRefCounted: RefCounted { + /// Checks if exactly one [`ARef`] to the object exists. In case the object is [`Sync`], the + /// check needs to be race-free. + fn is_unique(&self) -> bool; +} + +#[cfg_attr(RUSTC_HAS_DO_NOT_RECOMMEND, diagnostic::do_not_recommend)] +// SAFETY: Safe by the requirements on implementation of [`SimpleOwnableRefCounted`]. +unsafe impl<T: SimpleOwnableRefCounted> OwnableRefCounted for T { + fn try_from_shared(this: ARef<Self>) -> Result<Owned<Self>, ARef<Self>> { + if T::is_unique(&*this) { + // SAFETY: Safe by the requirements on implementation of [`SimpleOwnable`]. + Ok(unsafe { Owned::from_raw(ARef::into_raw(this)) }) + } else { + Err(this) + } + } +} + +#[cfg_attr(RUSTC_HAS_DO_NOT_RECOMMEND, diagnostic::do_not_recommend)] +// SAFETY: Safe by the requirements on implementation of [`SimpleOwnableRefCounted`]. +unsafe impl<T: SimpleOwnableRefCounted> Ownable for T { + unsafe fn release(this: NonNull<Self>) { + // SAFETY: Safe by the requirements on implementation of + // [`SimpleOwnableRefCounted::dec_ref()`]. + unsafe { RefCounted::dec_ref(this) }; + } +} + +impl<T: OwnableRefCounted> TryFrom<ARef<T>> for Owned<T> { + type Error = ARef<T>; + /// Tries to convert the [`ARef`] to an [`Owned`] by calling + /// [`try_from_shared()`](OwnableRefCounted::try_from_shared). In case the [`ARef`] is not + /// unique, it returns again an [`ARef`] to the same underlying object. + fn try_from(b: ARef<T>) -> Result<Owned<T>, Self::Error> { + T::try_from_shared(b) + } +} + /// A sum type that always holds either a value of type `L` or `R`. /// /// # Examples -- 2.48.1 ^ permalink raw reply related [flat|nested] 13+ messages in thread
* Re: [PATCH v8 4/4] rust: adding OwnableRefCounted and SimpleOwnableRefCounted 2025-03-13 7:00 ` [PATCH v8 4/4] rust: adding OwnableRefCounted and SimpleOwnableRefCounted Oliver Mangold @ 2025-03-21 16:37 ` Boqun Feng 2025-03-24 7:59 ` Oliver Mangold 0 siblings, 1 reply; 13+ messages in thread From: Boqun Feng @ 2025-03-21 16:37 UTC (permalink / raw) To: Oliver Mangold Cc: Miguel Ojeda, Alex Gaynor, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina, rust-for-linux, linux-kernel On Thu, Mar 13, 2025 at 07:00:26AM +0000, Oliver Mangold wrote: > Types implementing one of these traits can safely convert between an > ARef<T> and an Owned<T>. > Again, you need to mention why we need this. > Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> > --- > rust/kernel/types.rs | 250 +++++++++++++++++++++++++++++++++++++++++++++++++++ > 1 file changed, 250 insertions(+) > > diff --git a/rust/kernel/types.rs b/rust/kernel/types.rs > index 5a96da714348cc2369969200e6070972226c00fe..cca3d65782eecc7e2ada91f116eb885391c454bf 100644 > --- a/rust/kernel/types.rs > +++ b/rust/kernel/types.rs > @@ -552,6 +552,12 @@ fn from(b: &T) -> Self { > } > } > > +impl<T: OwnableRefCounted> From<Owned<T>> for ARef<T> { > + fn from(b: Owned<T>) -> Self { > + T::into_shared(b) > + } > +} > + > impl<T: RefCounted> Drop for ARef<T> { > fn drop(&mut self) { > // SAFETY: The type invariants guarantee that the `ARef` owns the reference > @@ -669,6 +675,250 @@ fn drop(&mut self) { > } > } > > +/// A trait for objects that can be wrapped in either one of the reference types [`Owned`] and > +/// [`ARef`]. > +/// > +/// # Safety > +/// > +/// Implementers must ensure that: > +/// > +/// - Both the safety requirements for [`Ownable`] and [`RefCounted`] are fulfilled. > +/// - The uniqueness invariant of [`Owned`] is upheld until dropped. Could you explain what this safety requirement means? Isn't this part of the safe requirement of `impl Ownable`? > +/// - [`try_from_shared()`](OwnableRefCounted::into_shared) only returns an [`Owned`] if exactly > +/// one [`ARef`] exists. > +/// - [`into_shared()`](OwnableRefCounted::into_shared) set the reference count to the value which > +/// the returned [`ARef`] expects for an object with a single reference > +/// in existence. This implies that if [`into_shared()`](OwnableRefCounted::into_shared) is left > +/// on the default implementation, which just rewraps the underlying object, the reference count > +/// needs not to be modified when converting a [`Owned`] to an [`ARef`]. > +/// > +/// # Examples > +/// > +/// A minimal example implementation of [`OwnableRefCounted`], [`Ownable`] and its usage with > +/// [`ARef`] and [`Owned`] looks like this: > +/// > +/// ``` > +/// # #![expect(clippy::disallowed_names)] > +/// use core::cell::Cell; > +/// use core::ptr::NonNull; > +/// use kernel::alloc::{flags, kbox::KBox, AllocError}; > +/// use kernel::types::{ > +/// ARef, RefCounted, Owned, Ownable, OwnableRefCounted, > +/// }; > +/// > +/// struct Foo { > +/// refcount: Cell<usize>, It's fine to use a Cell for now, but eventually we want to replace this with either Gary's Refcount [1] or LKMM atomics. [1]: https://lore.kernel.org/rust-for-linux/20250219201602.1898383-1-gary@garyguo.net/ (just keeping a note here) > +/// } > +/// > +/// impl Foo { > +/// fn new() -> Result<Owned<Self>, AllocError> { > +/// // Use a `KBox` to handle the actual allocation. > +/// let result = KBox::new( > +/// Foo { > +/// refcount: Cell::new(1), > +/// }, > +/// flags::GFP_KERNEL, > +/// )?; > +/// let result = NonNull::new(KBox::into_raw(result)) > +/// .expect("Raw pointer to newly allocation KBox is null, this should never happen."); > +/// // SAFETY: We just allocated the `Foo`, thus it is valid. > +/// Ok(unsafe { Owned::from_raw(result) }) > +/// } > +/// } > +/// > +/// // SAFETY: We increment and decrement each time the respective function is called and only free > +/// // the `Foo` when the refcount reaches zero. > +/// unsafe impl RefCounted for Foo { > +/// fn inc_ref(&self) { > +/// self.refcount.replace(self.refcount.get() + 1); > +/// } > +/// > +/// unsafe fn dec_ref(this: NonNull<Self>) { > +/// // SAFETY: The underlying object is always valid when the function is called. > +/// let refcount = unsafe { &this.as_ref().refcount }; > +/// let new_refcount = refcount.get() - 1; > +/// if new_refcount == 0 { > +/// // The `Foo` will be dropped when `KBox` goes out of scope. > +/// // SAFETY: The `Box<Foo>` is still alive as the old refcount is 1. > +/// unsafe { KBox::from_raw(this.as_ptr()) }; > +/// } else { > +/// refcount.replace(new_refcount); > +/// } > +/// } > +/// } > +/// > +/// // SAFETY: We only convert into an `Owned` when the refcount is 1. > +/// unsafe impl OwnableRefCounted for Foo { > +/// fn try_from_shared(this: ARef<Self>) -> Result<Owned<Self>, ARef<Self>> { > +/// if this.refcount.get() == 1 { > +/// // SAFETY: The `Foo` is still alive as the refcount is 1. > +/// Ok(unsafe { Owned::from_raw(ARef::into_raw(this)) }) > +/// } else { > +/// Err(this) > +/// } > +/// } > +/// } > +/// > +/// // SAFETY: We are not `AlwaysRefCounted`. > +/// unsafe impl Ownable for Foo { > +/// unsafe fn release(this: NonNull<Self>) { > +/// // SAFETY: Using `dec_ref()` from `RefCounted` to release is okay, as the refcount is > +/// // always 1 for an `Owned<Foo>`. > +/// unsafe{ Foo::dec_ref(this) }; > +/// } > +/// } > +/// > +/// let foo = Foo::new().unwrap(); > +/// let mut foo = ARef::from(foo); > +/// { > +/// let bar = foo.clone(); > +/// assert!(Owned::try_from(bar).is_err()); > +/// } > +/// assert!(Owned::try_from(foo).is_ok()); > +/// ``` > +pub unsafe trait OwnableRefCounted: RefCounted + Ownable + Sized { > + /// Checks if the [`ARef`] is unique and convert it to an [`Owned`] it that is that case. > + /// Otherwise it returns again an [`ARef`] to the same underlying object. > + fn try_from_shared(this: ARef<Self>) -> Result<Owned<Self>, ARef<Self>>; > + /// Converts the [`Owned`] into an [`ARef`]. > + ^ this blanket line seems to be at the wrong place. Regards, Boqun > + fn into_shared(this: Owned<Self>) -> ARef<Self> { > + // SAFETY: Safe by the requirements on implementing the trait. > + unsafe { ARef::from_raw(Owned::into_raw(this)) } > + } > +} > + > +/// This trait allows to implement [`Ownable`] and [`OwnableRefCounted`] together in a simplified > +/// way, only requiring to implement [`RefCounted`] and providing the method > +/// [`is_unique()`](SimpleOwnableRefCounted::is_unique). > +/// > +/// For non-standard cases where conversion between [`Ownable`] and [`RefCounted`] does not allow > +/// [`Ownable::release()`] and [`RefCounted::dec_ref()`] to be the same method, [`Ownable`] > +/// and [`OwnableRefCounted`] should be implemented separately. > +/// > +/// # Safety > +/// > +/// Implementers must ensure that: > +/// > +/// - The safety requirements for [`Ownable`] are fulfilled and [`RefCounted::dec_ref()`] can > +/// be used for [`Ownable::release()`]. > +/// - [`is_unique`](SimpleOwnableRefCounted::is_unique) must only return `true` in case only one > +/// [`ARef`] exists and it is impossible for one to be obtained other than by cloning an existing > +/// [`ARef`] or converting an [`Owned`] to an [`ARef`]. > +/// - It is safe to convert an unique [`ARef`] into an [`Owned`] simply by re-wrapping the > +/// underlying object without modifying the refcount. > +/// > +/// # Examples > +/// > +/// A minimal example implementation of [`RefCounted`] and [`SimpleOwnableRefCounted`] > +/// and its usage with [`ARef`] and [`Owned`] looks like this: > +/// > +/// ``` > +/// # #![expect(clippy::disallowed_names)] > +/// use core::cell::Cell; > +/// use core::ptr::NonNull; > +/// use kernel::alloc::{flags, kbox::KBox, AllocError}; > +/// use kernel::types::{ > +/// ARef, Owned, RefCounted, SimpleOwnableRefCounted, > +/// }; > +/// > +/// struct Foo { > +/// refcount: Cell<usize>, > +/// } > +/// > +/// impl Foo { > +/// fn new() -> Result<Owned<Self>, AllocError> { > +/// // Use a KBox to handle the actual allocation. > +/// let result = KBox::new( > +/// Foo { > +/// refcount: Cell::new(1), > +/// }, > +/// flags::GFP_KERNEL, > +/// )?; > +/// let result = NonNull::new(KBox::into_raw(result)) > +/// .expect("Raw pointer to newly allocation KBox is null, this should never happen."); > +/// // SAFETY: We just allocated the `Foo`, thus it is valid. > +/// Ok(unsafe { Owned::from_raw(result) }) > +/// } > +/// } > +/// > +/// // SAFETY: we ensure that: > +/// // - The `Foo` is only dropped when the refcount is zero. > +/// // - `is_unique()` only returns `true` when the refcount is 1. > +/// unsafe impl RefCounted for Foo { > +/// fn inc_ref(&self) { > +/// self.refcount.replace(self.refcount.get() + 1); > +/// } > +/// > +/// unsafe fn dec_ref(this: NonNull<Self>) { > +/// // SAFETY: The underlying object is always valid when the function is called. > +/// let refcount = unsafe { &this.as_ref().refcount }; > +/// let new_refcount = refcount.get() - 1; > +/// if new_refcount == 0 { > +/// // The `Foo` will be dropped when KBox goes out of scope. > +/// // SAFETY: The `Box<Foo>` is still alive as the old refcount is 1. > +/// unsafe { KBox::from_raw(this.as_ptr()) }; > +/// } else { > +/// refcount.replace(new_refcount); > +/// } > +/// } > +/// } > +/// > +/// // SAFETY: we ensure that: > +/// // - `is_unique()` only returns `true` when the refcount is 1. > +/// unsafe impl SimpleOwnableRefCounted for Foo { > +/// fn is_unique(&self) -> bool { > +/// self.refcount.get() == 1 > +/// } > +/// } > +/// > +/// let foo = Foo::new().unwrap(); > +/// let mut foo = ARef::from(foo); > +/// { > +/// let bar = foo.clone(); > +/// assert!(Owned::try_from(bar).is_err()); > +/// } > +/// assert!(Owned::try_from(foo).is_ok()); > +/// ``` > +pub unsafe trait SimpleOwnableRefCounted: RefCounted { > + /// Checks if exactly one [`ARef`] to the object exists. In case the object is [`Sync`], the > + /// check needs to be race-free. > + fn is_unique(&self) -> bool; > +} > + > +#[cfg_attr(RUSTC_HAS_DO_NOT_RECOMMEND, diagnostic::do_not_recommend)] > +// SAFETY: Safe by the requirements on implementation of [`SimpleOwnableRefCounted`]. > +unsafe impl<T: SimpleOwnableRefCounted> OwnableRefCounted for T { > + fn try_from_shared(this: ARef<Self>) -> Result<Owned<Self>, ARef<Self>> { > + if T::is_unique(&*this) { > + // SAFETY: Safe by the requirements on implementation of [`SimpleOwnable`]. > + Ok(unsafe { Owned::from_raw(ARef::into_raw(this)) }) > + } else { > + Err(this) > + } > + } > +} > + > +#[cfg_attr(RUSTC_HAS_DO_NOT_RECOMMEND, diagnostic::do_not_recommend)] > +// SAFETY: Safe by the requirements on implementation of [`SimpleOwnableRefCounted`]. > +unsafe impl<T: SimpleOwnableRefCounted> Ownable for T { > + unsafe fn release(this: NonNull<Self>) { > + // SAFETY: Safe by the requirements on implementation of > + // [`SimpleOwnableRefCounted::dec_ref()`]. > + unsafe { RefCounted::dec_ref(this) }; > + } > +} > + > +impl<T: OwnableRefCounted> TryFrom<ARef<T>> for Owned<T> { > + type Error = ARef<T>; > + /// Tries to convert the [`ARef`] to an [`Owned`] by calling > + /// [`try_from_shared()`](OwnableRefCounted::try_from_shared). In case the [`ARef`] is not > + /// unique, it returns again an [`ARef`] to the same underlying object. > + fn try_from(b: ARef<T>) -> Result<Owned<T>, Self::Error> { > + T::try_from_shared(b) > + } > +} > + > /// A sum type that always holds either a value of type `L` or `R`. > /// > /// # Examples > > -- > 2.48.1 > > ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [PATCH v8 4/4] rust: adding OwnableRefCounted and SimpleOwnableRefCounted 2025-03-21 16:37 ` Boqun Feng @ 2025-03-24 7:59 ` Oliver Mangold 0 siblings, 0 replies; 13+ messages in thread From: Oliver Mangold @ 2025-03-24 7:59 UTC (permalink / raw) To: Boqun Feng Cc: Miguel Ojeda, Alex Gaynor, Gary Guo, Björn Roy Baron, Benno Lossin, Andreas Hindborg, Alice Ryhl, Trevor Gross, Asahi Lina, rust-for-linux, linux-kernel On 250321 0937, Boqun Feng wrote: > > > > +/// A trait for objects that can be wrapped in either one of the reference types [`Owned`] and > > +/// [`ARef`]. > > +/// > > +/// # Safety > > +/// > > +/// Implementers must ensure that: > > +/// > > +/// - Both the safety requirements for [`Ownable`] and [`RefCounted`] are fulfilled. > > +/// - The uniqueness invariant of [`Owned`] is upheld until dropped. > > Could you explain what this safety requirement means? Isn't this part of > the safe requirement of `impl Ownable`? To be honest, I don't remember. Right now I also can't see a good reason for it. Might be I was confused by the documentation of the safety requirements for Ownable. Thinking about it, there seems to be something wrong with these: > /// # Safety > /// > /// Implementers must ensure that any objects borrowed directly as `&T` stay alive for the duration > /// of the lifetime, and that any objects owned by Rust as [`Owned<T>`] stay alive while that owned > /// reference exists, until the [`Ownable::release()`] trait method is called. > pub unsafe trait Ownable { > /// Releases the object (frees it or returns it to foreign ownership). > /// > /// # Safety > /// > /// Callers must ensure that the object is no longer referenced after this call. > unsafe fn release(this: NonNull<Self>); > } > > /// A subtrait of Ownable that asserts that an [`Owned<T>`] Rust reference is not only unique > /// within Rust and keeps the `T` alive, but also guarantees that the C code follows the > /// usual mutable reference requirements. That is, the kernel will never mutate the > /// `T` (excluding internal mutability that follows the usual rules) while Rust owns it. > /// > /// When this type is implemented for an [`Ownable`] type, it allows [`Owned<T>`] to be > /// dereferenced into a &mut T. > /// > /// # Safety > /// > /// Implementers must ensure that the kernel never mutates the underlying type while > /// Rust owns it. > pub unsafe trait OwnableMut: Ownable {} As an Owned hands out an `&` to an Ownable, the requirement about the kernel not mutating it should apply to an Ownable just the same as to an OwnableMut. The point of OwnableMut should by to declare that it is safe to hand out an `&mut` which implies that it is not pinned. I didn't want to mess too much with Asahi Lina's patch, so I left it as is. Maybe she wanted to assign a different meaning of these traits. Thoughts? > > +/// > > +/// struct Foo { > > +/// refcount: Cell<usize>, > > It's fine to use a Cell for now, but eventually we want to replace this > with either Gary's Refcount [1] or LKMM atomics. > > [1]: https://lore.kernel.org/rust-for-linux/20250219201602.1898383-1-gary@garyguo.net/ > > (just keeping a note here) Ok, then I will leave it as is. I was wondering if I should make it atomic, but I didn't because of the recent Rust atomics vs. kernel atomics discussion, which I understood as there being some unresolved questions. > > +pub unsafe trait OwnableRefCounted: RefCounted + Ownable + Sized { > > + /// Checks if the [`ARef`] is unique and convert it to an [`Owned`] it that is that case. > > + /// Otherwise it returns again an [`ARef`] to the same underlying object. > > + fn try_from_shared(this: ARef<Self>) -> Result<Owned<Self>, ARef<Self>>; > > + /// Converts the [`Owned`] into an [`ARef`]. > > + > > ^ this blanket line seems to be at the wrong place. Right. Thanks. Best regards, Oliver ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion. 2025-03-13 6:59 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Oliver Mangold ` (3 preceding siblings ...) 2025-03-13 7:00 ` [PATCH v8 4/4] rust: adding OwnableRefCounted and SimpleOwnableRefCounted Oliver Mangold @ 2025-03-23 20:19 ` Andreas Hindborg 4 siblings, 0 replies; 13+ messages in thread From: Andreas Hindborg @ 2025-03-23 20:19 UTC (permalink / raw) To: Oliver Mangold Cc: Miguel Ojeda, Alex Gaynor, Boqun Feng, Gary Guo, Björn Roy Baron, Benno Lossin, Alice Ryhl, Trevor Gross, Asahi Lina, rust-for-linux, linux-kernel Hi Oliver, Thanks for sending this! "Oliver Mangold" <oliver.mangold@pm.me> writes: > This allows to convert between ARef<T> and Owned<T> by > implementing the new trait OwnedRefCounted. > > This way we will have a shared/unique reference counting scheme > for types with built-in refcounts in analogy to Arc/UniqueArc. > > Signed-off-by: Oliver Mangold <oliver.mangold@pm.me> [...] > --- > base-commit: 4b2ee22fe32ea9b255926effbb6f26450607c391 > change-id: 20250305-unique-ref-29fcd675f9e9 I think you based the diff on a commit in one of my trees. It does not apply cleanly to upstream. Could you rebase this on something like v6.14-rc7? Best regards, Andreas Hindborg ^ permalink raw reply [flat|nested] 13+ messages in thread
end of thread, other threads:[~2025-03-25 12:00 UTC | newest] Thread overview: 13+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- [not found] <GwULoA3hxsCsNdxJ4lw7WqNC5bhCMacx5xMre9hZV2GWDdYmQx9rYVzHadna4KGiko3Glypv-AeXUsoECQB-EA==@protonmail.internalid> 2025-03-13 6:59 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Oliver Mangold 2025-03-13 7:00 ` [PATCH v8 1/4] rust: types: Add Ownable/Owned types Oliver Mangold 2025-03-21 16:08 ` Boqun Feng 2025-03-25 12:00 ` Oliver Mangold 2025-03-23 20:46 ` Andreas Hindborg 2025-03-13 7:00 ` [PATCH v8 2/4] rust: rename AlwaysRefCounted to RefCounted Oliver Mangold 2025-03-21 16:20 ` Boqun Feng 2025-03-24 7:32 ` Oliver Mangold 2025-03-13 7:00 ` [PATCH v8 3/4] rust: kbuild: provide `RUSTC_HAS_DO_NOT_RECOMMEND` symbol Oliver Mangold 2025-03-13 7:00 ` [PATCH v8 4/4] rust: adding OwnableRefCounted and SimpleOwnableRefCounted Oliver Mangold 2025-03-21 16:37 ` Boqun Feng 2025-03-24 7:59 ` Oliver Mangold 2025-03-23 20:19 ` [PATCH v8 0/4] New trait OwnableRefCounted for ARef<->Owned conversion Andreas Hindborg
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).