public inbox for fstests@vger.kernel.org
 help / color / mirror / Atom feed
From: "Darrick J. Wong" <darrick.wong@oracle.com>
To: Amir Goldstein <amir73il@gmail.com>
Cc: Theodore Ts'o <tytso@mit.edu>, Eryu Guan <eguan@redhat.com>,
	Josef Bacik <jbacik@fb.com>,
	fstests@vger.kernel.org
Subject: Re: [PATCH] kvm-xfstests: use aio=native for test drives
Date: Mon, 4 Sep 2017 08:55:50 -0700	[thread overview]
Message-ID: <20170904155550.GC4660@magnolia> (raw)
In-Reply-To: <1504527328-24615-1-git-send-email-amir73il@gmail.com>

On Mon, Sep 04, 2017 at 03:15:28PM +0300, Amir Goldstein wrote:
> Lost IOs have been observed with the default aio=threads with
> QEMU 2.5.0 when running crash consistency tests.
> The issue has not been observed with QEMU 2.9.0.
> Native AIO is probably better for our goal which is test proofing
> production systems.
> 
> Signed-off-by: Amir Goldstein <amir73il@gmail.com>
> ---
> 
> Ted,
> 
> Not sure you have been following the crash consistency tests threads.
> 
> Anyway, I ran into an issue of sucessfuly completed bio's that
> did not make it to storage device when running in kvm-xfstests.
> 
> Josef reported that he did not observe the issue with newer QEMU
> and the issue is gone with aio=native on my version of QEMU.
> 
> Crash consistency tests still can't run properly on kvm-xfstests
> without this fix to kernel:
> https://git.kernel.org/pub/scm/linux/kernel/git/josef/btrfs-next.git/commit/?h=dm-log-writes-fixes&id=08c7d64773091c7d2e0147da7064aa4dc297629d
> After the fix is merged I will post a patch to enable running
> dm-log-write tests in kvm-xfstest.
> 
> Mean while, the change to aio=native seems like a good move
> anyway and if I observed a bio black hole in one test, who's to say
> they don't exist for other tests as well.
> 
> Amir.
> 
> 
>  kvm-xfstests/kvm-xfstests | 19 +++++++++++++------
>  1 file changed, 13 insertions(+), 6 deletions(-)
> 
> diff --git a/kvm-xfstests/kvm-xfstests b/kvm-xfstests/kvm-xfstests
> index 305e2f5..98bd76a 100755
> --- a/kvm-xfstests/kvm-xfstests
> +++ b/kvm-xfstests/kvm-xfstests
> @@ -101,15 +101,22 @@ chmod 400 "$VDH"
>  
>  mkdir -p /tmp/kvm-xfstests-$USER
>  
> +# Lost IOs have been observed with the default aio=threads with
> +# QEMU 2.5.0 when running crash consistency tests.

Note however that Ubuntu 16.04 LTS is still on qemu 2.5, so perhaps
it's worth the trouble to check the qemu version prior to enabling
native aio support?

--D

> +# The issue has not been observed with QEMU 2.9.0.
> +# Native AIO is probably better for our goal which is test proofing
> +# production systems.
> +AIO=",aio=native"
> +
>  $NO_ACTION $IONICE $QEMU -boot order=c $NET \
>  	-machine type=pc,accel=kvm:tcg \
>  	-drive file=$ROOT_FS,if=virtio$SNAPSHOT \
> -	-drive file=$VDB,cache=none,if=virtio,format=raw \
> -	-drive file=$VDC,cache=none,if=virtio,format=raw \
> -	-drive file=$VDD,cache=none,if=virtio,format=raw \
> -	-drive file=$VDE,cache=none,if=virtio,format=raw \
> -	-drive file=$VDF,cache=none,if=virtio,format=raw \
> -	-drive file=$VDG,cache=none,if=virtio,format=raw \
> +	-drive file=$VDB,cache=none,if=virtio,format=raw$AIO \
> +	-drive file=$VDC,cache=none,if=virtio,format=raw$AIO \
> +	-drive file=$VDD,cache=none,if=virtio,format=raw$AIO \
> +	-drive file=$VDE,cache=none,if=virtio,format=raw$AIO \
> +	-drive file=$VDF,cache=none,if=virtio,format=raw$AIO \
> +	-drive file=$VDG,cache=none,if=virtio,format=raw$AIO \
>  	-drive file=$VDH,cache=unsafe,readonly,if=virtio \
>  	-vga none -nographic -smp $NR_CPU -m $MEM \
>  	-fsdev local,id=v_tmp,path=/tmp/kvm-xfstests-$USER,security_model=none \
> -- 
> 2.7.4
> 
> --
> To unsubscribe from this list: send the line "unsubscribe fstests" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

  reply	other threads:[~2017-09-04 15:56 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-09-04 12:15 [PATCH] kvm-xfstests: use aio=native for test drives Amir Goldstein
2017-09-04 15:55 ` Darrick J. Wong [this message]
2017-09-04 17:11   ` Amir Goldstein
2017-09-04 17:32     ` Darrick J. Wong
2017-09-17 17:08 ` Eric Biggers

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20170904155550.GC4660@magnolia \
    --to=darrick.wong@oracle.com \
    --cc=amir73il@gmail.com \
    --cc=eguan@redhat.com \
    --cc=fstests@vger.kernel.org \
    --cc=jbacik@fb.com \
    --cc=tytso@mit.edu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox