Discussion of the VIRTIO specification
 help / color / mirror / Atom feed
From: Zhu Lingshan <lingshan.zhu@intel.com>
To: jasowang@redhat.com, mst@redhat.com, eperezma@redhat.com,
	cohuck@redhat.com, stefanha@redhat.com
Cc: virtio-comment@lists.oasis-open.org,
	virtio-dev@lists.oasis-open.org,
	Zhu Lingshan <lingshan.zhu@intel.com>
Subject: [virtio-comment] [PATCH 2/5] virtio: introduce SUSPEND bit in device status
Date: Wed,  6 Sep 2023 16:16:34 +0800	[thread overview]
Message-ID: <20230906081637.32185-3-lingshan.zhu@intel.com> (raw)
In-Reply-To: <20230906081637.32185-1-lingshan.zhu@intel.com>

This patch introduces a new status bit in the device status: SUSPEND.

This SUSPEND bit can be used by the driver to suspend a device,
in order to stabilize the device states and virtqueue states.

Its main use case is live migration.

Signed-off-by: Zhu Lingshan <lingshan.zhu@intel.com>
Signed-off-by: Jason Wang <jasowang@redhat.com>
Signed-off-by: Eugenio Pérez <eperezma@redhat.com>
---
 content.tex | 31 +++++++++++++++++++++++++++++++
 1 file changed, 31 insertions(+)

diff --git a/content.tex b/content.tex
index 0e492cd..0fab537 100644
--- a/content.tex
+++ b/content.tex
@@ -47,6 +47,9 @@ \section{\field{Device Status} Field}\label{sec:Basic Facilities of a Virtio Dev
 \item[DRIVER_OK (4)] Indicates that the driver is set up and ready to
   drive the device.
 
+\item[SUSPEND (16)] When VIRTIO_F_SUSPEND is negotiated, indicates that the
+  device has been suspended by the driver.
+
 \item[DEVICE_NEEDS_RESET (64)] Indicates that the device has experienced
   an error from which it can't recover.
 \end{description}
@@ -73,6 +76,10 @@ \section{\field{Device Status} Field}\label{sec:Basic Facilities of a Virtio Dev
 recover by issuing a reset.
 \end{note}
 
+The driver SHOULD NOT set SUSPEND if FEATURES_OK is not set.
+
+When setting SUSPEND, the driver MUST re-read \field{device status} to ensure the SUSPEND bit is set.
+
 \devicenormative{\subsection}{Device Status Field}{Basic Facilities of a Virtio Device / Device Status Field}
 
 The device MUST NOT consume buffers or send any used buffer
@@ -82,6 +89,26 @@ \section{\field{Device Status} Field}\label{sec:Basic Facilities of a Virtio Dev
 that a reset is needed.  If DRIVER_OK is set, after it sets DEVICE_NEEDS_RESET, the device
 MUST send a device configuration change notification to the driver.
 
+The device MUST ignore SUSPEND if FEATURES_OK is not set.
+
+The device MUST ignore SUSPEND if VIRTIO_F_SUSPEND is not negotiated.
+
+The device SHOULD allow settings to \field{device status} even when SUSPEND is set.
+
+If VIRTIO_F_SUSPEND is negotiated and SUSPEND is set, the device SHOULD clear SUSPEND
+and resumes operation upon DRIVER_OK.
+
+If VIRTIO_F_SUSPEND is negotiated, when the driver sets SUSPEND,
+the device SHOULD perform the following actions before presenting SUSPEND bit in the \field{device status}:
+
+\begin{itemize}
+\item Stop consuming buffers of any virtqueues and mark all finished descritors as used.
+\item Wait until all descriptors that being processed to finish and mark them as used.
+\item Flush all used buffer and send used buffer notifications to the driver.
+\item Record Virtqueue State of each enabled virtqueue, see section \ref{sec:Virtqueues / Virtqueue State}
+\item Pause its operation except \field{device status} and preserve configurations in its Device Configuration Space, see \ref{sec:Basic Facilities of a Virtio Device / Device Configuration Space}
+\end{itemize}
+
 \section{Feature Bits}\label{sec:Basic Facilities of a Virtio Device / Feature Bits}
 
 Each virtio device offers all the features it understands.  During
@@ -937,6 +964,10 @@ \chapter{Reserved Feature Bits}\label{sec:Reserved Feature Bits}
 	\ref{devicenormative:Basic Facilities of a Virtio Device / Feature Bits} for
 	handling features reserved for future use.
 
+  \item[VIRTIO_F_SUSPEND(42)] This feature indicates that the driver can
+   SUSPEND the device.
+   See \ref{sec:Basic Facilities of a Virtio Device / Device Status Field}.
+
 \end{description}
 
 \drivernormative{\section}{Reserved Feature Bits}{Reserved Feature Bits}
-- 
2.35.3


This publicly archived list offers a means to provide input to the
OASIS Virtual I/O Device (VIRTIO) TC.

In order to verify user consent to the Feedback License terms and
to minimize spam in the list archive, subscription is required
before posting.

Subscribe: virtio-comment-subscribe@lists.oasis-open.org
Unsubscribe: virtio-comment-unsubscribe@lists.oasis-open.org
List help: virtio-comment-help@lists.oasis-open.org
List archive: https://lists.oasis-open.org/archives/virtio-comment/
Feedback License: https://www.oasis-open.org/who/ipr/feedback_license.pdf
List Guidelines: https://www.oasis-open.org/policies-guidelines/mailing-lists
Committee: https://www.oasis-open.org/committees/virtio/
Join OASIS: https://www.oasis-open.org/join/


  parent reply	other threads:[~2023-09-06  8:17 UTC|newest]

Thread overview: 148+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-09-06  8:16 [virtio-comment] [PATCH 0/5] virtio: introduce SUSPEND bit and vq state Zhu Lingshan
2023-09-06  8:16 ` [virtio-comment] [PATCH 1/5] virtio: introduce vq state as basic facility Zhu Lingshan
2023-09-06  8:28   ` Michael S. Tsirkin
2023-09-06  9:43     ` Zhu, Lingshan
2023-09-14 11:25   ` Michael S. Tsirkin
2023-09-15  2:46     ` Zhu, Lingshan
2023-09-06  8:16 ` Zhu Lingshan [this message]
2023-09-14 11:34   ` [virtio-comment] Re: [PATCH 2/5] virtio: introduce SUSPEND bit in device status Michael S. Tsirkin
2023-09-15  2:57     ` Zhu, Lingshan
2023-09-15 11:10       ` Michael S. Tsirkin
2023-09-18  2:56         ` Zhu, Lingshan
2023-09-18  4:42           ` Parav Pandit
2023-09-18  5:14             ` Zhu, Lingshan
2023-09-18  6:17               ` Parav Pandit
2023-09-18  6:38                 ` Zhu, Lingshan
2023-09-18  6:46                   ` Parav Pandit
2023-09-18  6:49                     ` Zhu, Lingshan
2023-09-18  6:50           ` Zhu, Lingshan
2023-09-06  8:16 ` [virtio-comment] [PATCH 3/5] virtqueue: constraints for virtqueue state Zhu Lingshan
2023-09-14 11:30   ` [virtio-comment] " Michael S. Tsirkin
2023-09-15  2:59     ` Zhu, Lingshan
2023-09-15 11:16       ` Michael S. Tsirkin
2023-09-18  3:02         ` Zhu, Lingshan
2023-09-18 17:30           ` Michael S. Tsirkin
2023-09-19  7:56             ` Zhu, Lingshan
2023-09-06  8:16 ` [virtio-comment] [PATCH 4/5] virtqueue: ignore resetting vqs when SUSPEND Zhu Lingshan
2023-09-14 11:09   ` [virtio-comment] " Michael S. Tsirkin
2023-09-15  4:06     ` Zhu, Lingshan
2023-09-06  8:16 ` [virtio-comment] [PATCH 5/5] virtio-pci: implement VIRTIO_F_QUEUE_STATE Zhu Lingshan
2023-09-06  8:32   ` Michael S. Tsirkin
2023-09-06  8:37     ` Parav Pandit
2023-09-06  9:37     ` Zhu, Lingshan
2023-09-11  3:01     ` Jason Wang
2023-09-11  4:11       ` Parav Pandit
2023-09-11  6:30         ` Jason Wang
2023-09-11  6:47           ` Parav Pandit
2023-09-11  6:58             ` Zhu, Lingshan
2023-09-11  7:07               ` Parav Pandit
2023-09-11  7:18                 ` Zhu, Lingshan
2023-09-11  7:30                   ` Parav Pandit
2023-09-11  7:58                     ` Zhu, Lingshan
2023-09-11  8:12                       ` Parav Pandit
2023-09-11  8:46                         ` Zhu, Lingshan
2023-09-11  9:05                           ` Parav Pandit
2023-09-11  9:32                             ` Zhu, Lingshan
2023-09-11 10:21                               ` Parav Pandit
2023-09-12  4:06                                 ` Zhu, Lingshan
2023-09-12  5:58                                   ` Parav Pandit
2023-09-12  6:33                                     ` Zhu, Lingshan
2023-09-12  6:47                                       ` Parav Pandit
2023-09-12  7:27                                         ` Zhu, Lingshan
2023-09-12  7:40                                           ` Parav Pandit
2023-09-12  9:02                                             ` Zhu, Lingshan
2023-09-12  9:21                                               ` Parav Pandit
2023-09-12 13:03                                                 ` Zhu, Lingshan
2023-09-12 13:43                                                   ` Parav Pandit
2023-09-13  4:01                                                     ` Zhu, Lingshan
2023-09-13  4:12                                                       ` Parav Pandit
2023-09-13  4:20                                                         ` Zhu, Lingshan
2023-09-13  4:36                                                           ` Parav Pandit
2023-09-14  8:19                                                             ` Zhu, Lingshan
2023-09-11 11:50                               ` Parav Pandit
2023-09-12  3:43                                 ` Jason Wang
2023-09-12  5:50                                   ` Parav Pandit
2023-09-13  4:44                                     ` Jason Wang
2023-09-13  6:05                                       ` Parav Pandit
2023-09-14  3:11                                         ` Jason Wang
2023-09-17  5:22                                           ` Parav Pandit
2023-09-19  4:35                                             ` Jason Wang
2023-09-19  7:33                                               ` Parav Pandit
2023-09-12  3:48                                 ` Zhu, Lingshan
2023-09-12  5:51                                   ` Parav Pandit
2023-09-12  6:37                                     ` Zhu, Lingshan
2023-09-12  6:49                                       ` Parav Pandit
2023-09-12  7:29                                         ` Zhu, Lingshan
2023-09-12  7:53                                           ` Parav Pandit
2023-09-12  9:06                                             ` Zhu, Lingshan
2023-09-12  9:08                                               ` Zhu, Lingshan
2023-09-12  9:35                                                 ` Parav Pandit
2023-09-12 10:14                                                   ` Zhu, Lingshan
2023-09-12 10:16                                                     ` Parav Pandit
2023-09-12 10:28                                                       ` Zhu, Lingshan
2023-09-13  2:23                                                     ` Parav Pandit
2023-09-13  4:03                                                       ` Zhu, Lingshan
2023-09-13  4:15                                                         ` Parav Pandit
2023-09-13  4:21                                                           ` Zhu, Lingshan
2023-09-13  4:37                                                             ` Parav Pandit
2023-09-14  3:11                                                               ` Jason Wang
2023-09-17  5:25                                                                 ` Parav Pandit
2023-09-19  4:34                                                                   ` Jason Wang
2023-09-19  7:32                                                                     ` Parav Pandit
2023-09-14  8:22                                                               ` Zhu, Lingshan
2023-09-12  9:28                                               ` Parav Pandit
2023-09-12 10:17                                                 ` Zhu, Lingshan
2023-09-12 10:25                                                   ` Parav Pandit
2023-09-12 10:32                                                     ` Zhu, Lingshan
2023-09-12 10:40                                                       ` Parav Pandit
2023-09-12 13:04                                                         ` Zhu, Lingshan
2023-09-12 13:36                                                           ` Parav Pandit
2023-09-12  4:10                         ` Jason Wang
2023-09-12  6:05                           ` Parav Pandit
2023-09-13  4:45                             ` Jason Wang
2023-09-13  6:39                               ` Parav Pandit
2023-09-14  3:08                                 ` Jason Wang
2023-09-17  5:22                                   ` Parav Pandit
2023-09-19  4:32                                     ` Jason Wang
2023-09-19  7:32                                       ` Parav Pandit
2023-09-13  8:27                               ` Michael S. Tsirkin
2023-09-14  3:11                                 ` Jason Wang
2023-09-12  4:18             ` Jason Wang
2023-09-12  6:11               ` Parav Pandit
2023-09-12  6:43                 ` Zhu, Lingshan
2023-09-12  6:52                   ` Parav Pandit
2023-09-12  7:36                     ` Zhu, Lingshan
2023-09-12  7:43                       ` Parav Pandit
2023-09-12 10:27                         ` Zhu, Lingshan
2023-09-12 10:33                           ` Parav Pandit
2023-09-12 10:35                             ` Zhu, Lingshan
2023-09-12 10:41                               ` Parav Pandit
2023-09-12 13:09                                 ` Zhu, Lingshan
2023-09-12 13:35                                   ` Parav Pandit
2023-09-13  4:13                                     ` Zhu, Lingshan
2023-09-13  4:19                                       ` Parav Pandit
2023-09-13  4:22                                         ` Zhu, Lingshan
2023-09-13  4:39                                           ` Parav Pandit
2023-09-14  8:24                                             ` Zhu, Lingshan
2023-09-13  4:56                                         ` Jason Wang
2023-09-13  4:43                 ` Jason Wang
2023-09-13  4:46                   ` Parav Pandit
2023-09-14  3:12                     ` Jason Wang
2023-09-17  5:29                       ` Parav Pandit
2023-09-19  4:25                         ` Jason Wang
2023-09-19  7:32                           ` Parav Pandit
2023-09-11  6:59           ` Parav Pandit
2023-09-11 10:15           ` Michael S. Tsirkin
2023-09-12  3:35             ` Jason Wang
2023-09-12  3:43               ` Zhu, Lingshan
2023-09-14 11:27   ` Michael S. Tsirkin
2023-09-15  4:13     ` Zhu, Lingshan
2023-09-06  8:29 ` [virtio-comment] [PATCH 0/5] virtio: introduce SUSPEND bit and vq state Michael S. Tsirkin
2023-09-06  8:38   ` Zhu, Lingshan
2023-09-06 13:49     ` Michael S. Tsirkin
2023-09-07  1:51       ` Zhu, Lingshan
2023-09-07 10:57       ` Eugenio Perez Martin
2023-09-07 19:55         ` Michael S. Tsirkin
2023-09-14 11:14 ` [virtio-comment] " Michael S. Tsirkin
2023-09-14 11:37 ` Michael S. Tsirkin
2023-09-15  4:41   ` [virtio-comment] Re: [virtio-dev] " Zhu, Lingshan

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20230906081637.32185-3-lingshan.zhu@intel.com \
    --to=lingshan.zhu@intel.com \
    --cc=cohuck@redhat.com \
    --cc=eperezma@redhat.com \
    --cc=jasowang@redhat.com \
    --cc=mst@redhat.com \
    --cc=stefanha@redhat.com \
    --cc=virtio-comment@lists.oasis-open.org \
    --cc=virtio-dev@lists.oasis-open.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox