From: keith.busch@intel.com (Keith Busch)
Subject: [PATCH] nvme: freeze IO accesses around format
Date: Fri, 27 Oct 2017 10:44:40 -0600 [thread overview]
Message-ID: <20171027164440.GA8644@localhost.localdomain> (raw)
In-Reply-To: <6951d74c-e765-1b5d-6e39-d88d261bf9b9@kernel.dk>
On Fri, Oct 27, 2017@10:35:58AM -0600, Jens Axboe wrote:
> If someone attempts to do IO to a drive while it is under format,
> we risk timing out that IO. That potentially leads to the driver
> triggering a controller reset, and subsequently the format is ruined and
> the device goes away.
>
> Prevents this by freezing IO access to the device around a format.
> Without this, the following set of commands can easily make your device
> disappear:
>
> parted -s /dev/nvme3n1 mklabel gpt
> parted -s /dev/nvme3n1 mkpart primary 0G 100G
> parted -s /dev/nvme3n1 rm 1
> nvme format /dev/nvme3
>
> since the last partition removal will trigger a udev partition reload,
> which happens while the format is running. If the format takes longer
> than the normal IO timeout, we start timing it out:
>
> [ 456.799438] nvme3n1:
> [ 456.833656] nvme3n1: p1
> [ 456.842025] nvme3n1: p1
> [ 456.887368] nvme3n1:
> [ 487.699023] nvme nvme3: I/O 879 QID 12 timeout, aborting
> [ 518.098840] nvme nvme3: I/O 879 QID 12 timeout, reset controller
> [ 571.700471] nvme nvme3: Abort status: 0x7
> [ 571.798306] nvme nvme3: Removing after probe failure status: -22
> [ 571.811330] nvme3n1: detected capacity change from 4000787030016 to 0
> [ 571.819189] print_req_error: I/O error, dev nvme3n1, sector 7814036992
>
> and the device is gone, needing a driver reload or reboot to bring it
> back. Same thing happens if you just do a dd from the device and then
> start a format. Behavior is vendor agnostic, basically just timing
> dependent.
>
> Signed-off-by: Jens Axboe <axboe at kernel.dk>
Looks good.
Reviewed-by: Keith Busch <keith.busch at intel.com>
next prev parent reply other threads:[~2017-10-27 16:44 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-10-27 16:35 [PATCH] nvme: freeze IO accesses around format Jens Axboe
2017-10-27 16:44 ` Keith Busch [this message]
2017-10-27 23:07 ` Keith Busch
2017-10-30 14:29 ` Jens Axboe
2017-11-01 15:56 ` Christoph Hellwig
2017-11-01 16:21 ` Keith Busch
2017-11-01 16:21 ` Christoph Hellwig
2017-10-28 6:45 ` Christoph Hellwig
2017-10-30 14:30 ` Jens Axboe
2017-11-01 15:42 ` Christoph Hellwig
2017-11-01 15:49 ` Keith Busch
2017-11-01 15:43 ` Christoph Hellwig
2017-11-01 15:45 ` Jens Axboe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20171027164440.GA8644@localhost.localdomain \
--to=keith.busch@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.