From: keith.busch@intel.com (Keith Busch)
Subject: [PATCH] nvme: freeze IO accesses around format
Date: Fri, 27 Oct 2017 10:44:40 -0600 [thread overview]
Message-ID: <20171027164440.GA8644@localhost.localdomain> (raw)
In-Reply-To: <6951d74c-e765-1b5d-6e39-d88d261bf9b9@kernel.dk>
On Fri, Oct 27, 2017@10:35:58AM -0600, Jens Axboe wrote:
> If someone attempts to do IO to a drive while it is under format,
> we risk timing out that IO. That potentially leads to the driver
> triggering a controller reset, and subsequently the format is ruined and
> the device goes away.
>
> Prevents this by freezing IO access to the device around a format.
> Without this, the following set of commands can easily make your device
> disappear:
>
> parted -s /dev/nvme3n1 mklabel gpt
> parted -s /dev/nvme3n1 mkpart primary 0G 100G
> parted -s /dev/nvme3n1 rm 1
> nvme format /dev/nvme3
>
> since the last partition removal will trigger a udev partition reload,
> which happens while the format is running. If the format takes longer
> than the normal IO timeout, we start timing it out:
>
> [ 456.799438] nvme3n1:
> [ 456.833656] nvme3n1: p1
> [ 456.842025] nvme3n1: p1
> [ 456.887368] nvme3n1:
> [ 487.699023] nvme nvme3: I/O 879 QID 12 timeout, aborting
> [ 518.098840] nvme nvme3: I/O 879 QID 12 timeout, reset controller
> [ 571.700471] nvme nvme3: Abort status: 0x7
> [ 571.798306] nvme nvme3: Removing after probe failure status: -22
> [ 571.811330] nvme3n1: detected capacity change from 4000787030016 to 0
> [ 571.819189] print_req_error: I/O error, dev nvme3n1, sector 7814036992
>
> and the device is gone, needing a driver reload or reboot to bring it
> back. Same thing happens if you just do a dd from the device and then
> start a format. Behavior is vendor agnostic, basically just timing
> dependent.
>
> Signed-off-by: Jens Axboe <axboe at kernel.dk>
Looks good.
Reviewed-by: Keith Busch <keith.busch at intel.com>
next prev parent reply other threads:[~2017-10-27 16:44 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-10-27 16:35 [PATCH] nvme: freeze IO accesses around format Jens Axboe
2017-10-27 16:44 ` Keith Busch [this message]
2017-10-27 23:07 ` Keith Busch
2017-10-30 14:29 ` Jens Axboe
2017-11-01 15:56 ` Christoph Hellwig
2017-11-01 16:21 ` Keith Busch
2017-11-01 16:21 ` Christoph Hellwig
2017-10-28 6:45 ` Christoph Hellwig
2017-10-30 14:30 ` Jens Axboe
2017-11-01 15:42 ` Christoph Hellwig
2017-11-01 15:49 ` Keith Busch
2017-11-01 15:43 ` Christoph Hellwig
2017-11-01 15:45 ` Jens Axboe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20171027164440.GA8644@localhost.localdomain \
--to=keith.busch@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox