All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Daniel P. Berrangé" <berrange@redhat.com>
To: Peter Xu <peterx@redhat.com>
Cc: "Dr. David Alan Gilbert (git)" <dgilbert@redhat.com>,
	qemu-devel@nongnu.org, huangy81@chinatelecom.cn,
	quintela@redhat.com, leobras@redhat.com, jdenemar@redhat.com
Subject: Re: [PULL 22/33] migration: remove the QEMUFileOps 'get_buffer' callback
Date: Mon, 27 Jun 2022 15:41:57 +0100	[thread overview]
Message-ID: <YrnBtWrjA5D8TlTP@redhat.com> (raw)
In-Reply-To: <YrS7YHglHhhDMvbP@xz-m1.local>

On Thu, Jun 23, 2022 at 03:13:36PM -0400, Peter Xu wrote:
> On Thu, Jun 23, 2022 at 09:47:51AM +0100, Daniel P. Berrangé wrote:
> > > Hmm, when I wanted to run the whole bunch of the migration-test again I
> > > found that precopy tls test hangs (/x86_64/migration/precopy/unix/tls/psk).
> > > Though for this time it also hangs for me even with the master branch, so
> > > maybe not anything wrong with this specific pull req but still something
> > > needs fixing..
> > 
> > That pre-existing test has been runnnig by default in CI for a while
> > now, under different OS builds, so I'm surprised. Is there anything
> > especially unusual / different about your setup that could explain
> > why you see hang that we don't get anywhere else ?
> 
> TL;DR: I think it's not run in CI?
> 
> Please see ufd_version_check(), as when uffd not detected we'll skip the
> whole thing.

Our CI should be passing that check for the private runners eg

https://gitlab.com/qemu-project/qemu/-/jobs/2641920502

shows us running 35 tests

  2/178 qemu:qtest+qtest-x86_64 / qtest-x86_64/migration-test         OK             65.57s   35 subtests passed

but yes, the container based jobs are all skipping

> 
> We really need to apply this patch, soon-ish..
> 
>   https://lore.kernel.org/all/20210615175523.439830-2-peterx@redhat.com/
> 
> I can easily reproduce the hang on two x86_64 hosts I have, with current
> master commit (2b049d2c8dc01de750410f8f1a4eac498c04c723).  Or am I the only
> one?
> 
> So I think it also means we don't run migration unit tests on non-Linux
> OSes for sure because uffd was never there, meanwhile it also requires
> (mostly) root privilege even for Linux hosts so if the sysctl knob was not
> set properly (on sysctl.unprivileged_userfaultfd=1) the test can be skipped
> too.

It appears Fedora at least set unprivileged_userfaultfd=1 by default,
hence why I've never seen it skipped.

With regards,
Daniel
-- 
|: https://berrange.com      -o-    https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org         -o-            https://fstop138.berrange.com :|
|: https://entangle-photo.org    -o-    https://www.instagram.com/dberrange :|



  reply	other threads:[~2022-06-27 14:43 UTC|newest]

Thread overview: 48+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-06-22 18:38 [PULL 00/33] migration queue Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 01/33] migration: Remove RDMA_UNREGISTRATION_EXAMPLE Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 02/33] QIOChannelSocket: Introduce assert and reduce ifdefs to improve readability Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 03/33] QIOChannelSocket: Fix zero-copy send so socket flush works Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 04/33] migration: Change zero_copy_send from migration parameter to migration capability Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 05/33] io: add a QIOChannelNull equivalent to /dev/null Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 06/33] migration: switch to use QIOChannelNull for dummy channel Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 07/33] migration: remove unreachble RDMA code in save_hook impl Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 08/33] migration: rename rate limiting fields in QEMUFile Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 09/33] migration: rename 'pos' field in QEMUFile to 'bytes_processed' Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 10/33] migration: rename qemu_ftell to qemu_file_total_transferred Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 11/33] migration: rename qemu_update_position to qemu_file_credit_transfer Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 12/33] migration: rename qemu_file_update_transfer to qemu_file_acct_rate_limit Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 13/33] migration: introduce a QIOChannel impl for BlockDriverState VMState Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 14/33] migration: convert savevm to use QIOChannelBlock for VMState Dr. David Alan Gilbert (git)
2022-06-22 18:38 ` [PULL 15/33] migration: stop passing 'opaque' parameter to QEMUFile hooks Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 16/33] migration: hardcode assumption that QEMUFile is backed with QIOChannel Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 17/33] migration: introduce new constructors for QEMUFile Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 18/33] migration: remove unused QEMUFileGetFD typedef / qemu_get_fd method Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 19/33] migration: remove the QEMUFileOps 'shut_down' callback Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 20/33] migration: remove the QEMUFileOps 'set_blocking' callback Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 21/33] migration: remove the QEMUFileOps 'close' callback Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 22/33] migration: remove the QEMUFileOps 'get_buffer' callback Dr. David Alan Gilbert (git)
2022-06-22 19:34   ` Peter Xu
2022-06-22 20:13     ` Peter Xu
2022-06-23  8:47       ` Daniel P. Berrangé
2022-06-23 19:13         ` Peter Xu
2022-06-27 14:41           ` Daniel P. Berrangé [this message]
2022-06-27 14:44             ` Daniel P. Berrangé
2022-06-27 20:32               ` Peter Xu
2022-06-23  8:40     ` Daniel P. Berrangé
2022-06-23  8:55       ` Dr. David Alan Gilbert
2022-06-27 15:03     ` Daniel P. Berrangé
2022-06-27 20:32       ` Peter Xu
2022-06-28  7:40         ` Daniel P. Berrangé
2022-06-22 18:39 ` [PULL 23/33] migration: remove the QEMUFileOps 'writev_buffer' callback Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 24/33] migration: remove the QEMUFileOps 'get_return_path' callback Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 25/33] migration: remove the QEMUFileOps abstraction Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 26/33] accel/kvm/kvm-all: Refactor per-vcpu dirty ring reaping Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 27/33] cpus: Introduce cpu_list_generation_id Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 28/33] migration/dirtyrate: Refactor dirty page rate calculation Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 29/33] softmmu/dirtylimit: Implement vCPU dirtyrate calculation periodically Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 30/33] accel/kvm/kvm-all: Introduce kvm_dirty_ring_size function Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 31/33] softmmu/dirtylimit: Implement virtual CPU throttle Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 32/33] softmmu/dirtylimit: Implement dirty page rate limit Dr. David Alan Gilbert (git)
2022-06-22 18:39 ` [PULL 33/33] tests: Add dirty page rate limit test Dr. David Alan Gilbert (git)
2022-06-23  8:55 ` [PULL 00/33] migration queue Dr. David Alan Gilbert
  -- strict thread matches above, loose matches on Subject: below --
2022-06-23  9:27 Dr. David Alan Gilbert (git)
2022-06-23  9:27 ` [PULL 22/33] migration: remove the QEMUFileOps 'get_buffer' callback Dr. David Alan Gilbert (git)

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=YrnBtWrjA5D8TlTP@redhat.com \
    --to=berrange@redhat.com \
    --cc=dgilbert@redhat.com \
    --cc=huangy81@chinatelecom.cn \
    --cc=jdenemar@redhat.com \
    --cc=leobras@redhat.com \
    --cc=peterx@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=quintela@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.