From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id A3F00C433FE for ; Wed, 2 Nov 2022 17:06:32 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id B35648E0002; Wed, 2 Nov 2022 13:06:31 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id B156C8E0001; Wed, 2 Nov 2022 13:06:31 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 9AC178E0002; Wed, 2 Nov 2022 13:06:31 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 89B6B8E0001 for ; Wed, 2 Nov 2022 13:06:31 -0400 (EDT) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 4750E141314 for ; Wed, 2 Nov 2022 17:06:31 +0000 (UTC) X-FDA: 80089130982.03.B8CE19A Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by imf24.hostedemail.com (Postfix) with ESMTP id B2060180003 for ; Wed, 2 Nov 2022 17:06:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1667408790; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MzSlArbLjLwuYh4coYhcF492GFrAwrpr5F1CiSw7i+g=; b=X8JFzNxThN7XnmSzsZ0/OUYU3lxfcGD9TgrUCRomQO7JwpE383OT3+Jzl9C9MNLkjPFvAq xoAV2w1C2u0mMLMwurd4mVvJKc3y0Wn7v4h2v9iMZZXd3vLHEwnq6VguyyynYlrFxjkUmO JMNn3fbQpkzoJbNKmQm4WjldrdKSqHM= Received: from mail-ej1-f69.google.com (mail-ej1-f69.google.com [209.85.218.69]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_128_GCM_SHA256) id us-mta-673-4BQGhTDbMvOI67uzADY_sA-1; Wed, 02 Nov 2022 13:06:26 -0400 X-MC-Unique: 4BQGhTDbMvOI67uzADY_sA-1 Received: by mail-ej1-f69.google.com with SMTP id hs34-20020a1709073ea200b007ad86f91d39so10302255ejc.10 for ; Wed, 02 Nov 2022 10:06:26 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=MzSlArbLjLwuYh4coYhcF492GFrAwrpr5F1CiSw7i+g=; b=VrYnzbfiMAYd77U0qSUwXB/P1pTTGHzBaj4KLISCjQeacOoN7yRouDI15miE4nuwlb SFxaERLLp7C4wO9fmzOr2FLe4u3+Y3n47PjUCRkz3LPLMycMr6NzLE69EAWgdW0oFXRz 794otNk/zqn6BVlehGz29F5y5m5woggjKJbPyL99g7+mTrepzYi9giLwXVXjnkIL81gE 8EeRAY8Hpm5nCHaWqSPew9LCJmnjLYHMg2eqd0/OW9vQgQLsA2+8vDOCe/DsKyZIgxDt wNbWvLCWGMuCyTIwJm+WmZwoQYbgDRnMttm0kU9SvV95I8Oj/9PZeDver6VO1PRrxIq5 VzLw== X-Gm-Message-State: ACrzQf1kzW2V3pWzCrVrBUjxpbdEtZPE74L04l3ArzHFaf8Ax4rsV89T xW2BR4m8Rp/ShX/F1J5znTBXA0Q+P7ZhRwXw8uxwbMPiY6pkzfX0R2bAbei7ztuLIVHB+Mjoe8X ZbDUGz6WpEFs= X-Received: by 2002:aa7:c1d9:0:b0:463:aeaf:3383 with SMTP id d25-20020aa7c1d9000000b00463aeaf3383mr10397494edp.253.1667408785486; Wed, 02 Nov 2022 10:06:25 -0700 (PDT) X-Google-Smtp-Source: AMsMyM4a5aiauK1J6VQYUF9mjlkxz4BZlsbuGTOro+zFT5daW27YWQJ+DquzsEIfrHyUKJnR8l1zDg== X-Received: by 2002:aa7:c1d9:0:b0:463:aeaf:3383 with SMTP id d25-20020aa7c1d9000000b00463aeaf3383mr10397444edp.253.1667408785114; Wed, 02 Nov 2022 10:06:25 -0700 (PDT) Received: from ?IPV6:2001:b07:add:ec09:c399:bc87:7b6c:fb2a? ([2001:b07:add:ec09:c399:bc87:7b6c:fb2a]) by smtp.googlemail.com with ESMTPSA id g11-20020a170906394b00b007abafe43c3bsm5575689eje.86.2022.11.02.10.06.21 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 02 Nov 2022 10:06:24 -0700 (PDT) Message-ID: Date: Wed, 2 Nov 2022 18:06:20 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.4.0 Subject: Re: [PATCH v4 1/4] mm/gup: Add FOLL_INTERRUPTIBLE To: Peter Xu , kvm@vger.kernel.org, linux-kernel@vger.kernel.org Cc: Sean Christopherson , John Hubbard , David Matlack , Andrew Morton , Andrea Arcangeli , "Dr . David Alan Gilbert" , David Hildenbrand , Linux MM Mailing List , Mike Kravetz References: <20221011195809.557016-1-peterx@redhat.com> <20221011195809.557016-2-peterx@redhat.com> From: Paolo Bonzini In-Reply-To: <20221011195809.557016-2-peterx@redhat.com> X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit ARC-Authentication-Results: i=1; imf24.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=X8JFzNxT; spf=pass (imf24.hostedemail.com: domain of pbonzini@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=pbonzini@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1667408790; a=rsa-sha256; cv=none; b=FDGleH1TsDlyAvbv4soLNAN0+vLC7agPeKXO5YTdgVa2DafWx/FoRgLlax5gTDtu7EFUHW MQ4xIDLDSjMY3y8aQLhoAxfVoXv7J8t2dKnvSR2elz0mZ7XFN8helxk0+NjQxa2AdxutcA CgWyy887v73VlOXiDKkogiXCDTWaMHI= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1667408790; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=MzSlArbLjLwuYh4coYhcF492GFrAwrpr5F1CiSw7i+g=; b=UnMomE7wc/ucxgrYJ92xE4OA0Yipu/qFXf7lDkZSRe5sKqeS4na2ct3AuUlcJlWgjgZNTN q80UIwU/LethAmvv2Ej3KTkVLfx5aMI+qolHaIwy5UBPGtpwdJtwPCTU3zzapSBGQkm/I9 VcltVkXlIipsbDsJBwkP4Fb/zTt0DoI= X-Stat-Signature: qpqm41jnp3djaxduzt8x51udhbkkexoq X-Rspamd-Queue-Id: B2060180003 Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=X8JFzNxT; spf=pass (imf24.hostedemail.com: domain of pbonzini@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=pbonzini@redhat.com; dmarc=pass (policy=none) header.from=redhat.com X-Rspam-User: X-Rspamd-Server: rspam12 X-HE-Tag: 1667408790-43946 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 10/11/22 21:58, Peter Xu wrote: > We have had FAULT_FLAG_INTERRUPTIBLE but it was never applied to GUPs. One > issue with it is that not all GUP paths are able to handle signal delivers > besides SIGKILL. > > That's not ideal for the GUP users who are actually able to handle these > cases, like KVM. > > KVM uses GUP extensively on faulting guest pages, during which we've got > existing infrastructures to retry a page fault at a later time. Allowing > the GUP to be interrupted by generic signals can make KVM related threads > to be more responsive. For examples: > > (1) SIGUSR1: which QEMU/KVM uses to deliver an inter-process IPI, > e.g. when the admin issues a vm_stop QMP command, SIGUSR1 can be > generated to kick the vcpus out of kernel context immediately, > > (2) SIGINT: which can be used with interactive hypervisor users to stop a > virtual machine with Ctrl-C without any delays/hangs, > > (3) SIGTRAP: which grants GDB capability even during page faults that are > stuck for a long time. > > Normally hypervisor will be able to receive these signals properly, but not > if we're stuck in a GUP for a long time for whatever reason. It happens > easily with a stucked postcopy migration when e.g. a network temp failure > happens, then some vcpu threads can hang death waiting for the pages. With > the new FOLL_INTERRUPTIBLE, we can allow GUP users like KVM to selectively > enable the ability to trap these signals. > > Reviewed-by: John Hubbard > Reviewed-by: David Hildenbrand > Signed-off-by: Peter Xu If no one shouts I will queue the series for 6.2, but it would be nice to get an ACK from the mm folks. > --- > include/linux/mm.h | 1 + > mm/gup.c | 33 +++++++++++++++++++++++++++++---- > mm/hugetlb.c | 5 ++++- > 3 files changed, 34 insertions(+), 5 deletions(-) > > diff --git a/include/linux/mm.h b/include/linux/mm.h > index 21f8b27bd9fd..488a9f4cce07 100644 > --- a/include/linux/mm.h > +++ b/include/linux/mm.h > @@ -2897,6 +2897,7 @@ struct page *follow_page(struct vm_area_struct *vma, unsigned long address, > #define FOLL_SPLIT_PMD 0x20000 /* split huge pmd before returning */ > #define FOLL_PIN 0x40000 /* pages must be released via unpin_user_page */ > #define FOLL_FAST_ONLY 0x80000 /* gup_fast: prevent fall-back to slow gup */ > +#define FOLL_INTERRUPTIBLE 0x100000 /* allow interrupts from generic signals */ > > /* > * FOLL_PIN and FOLL_LONGTERM may be used in various combinations with each > diff --git a/mm/gup.c b/mm/gup.c > index 5abdaf487460..d51e7ccaef32 100644 > --- a/mm/gup.c > +++ b/mm/gup.c > @@ -970,8 +970,17 @@ static int faultin_page(struct vm_area_struct *vma, > fault_flags |= FAULT_FLAG_WRITE; > if (*flags & FOLL_REMOTE) > fault_flags |= FAULT_FLAG_REMOTE; > - if (locked) > + if (locked) { > fault_flags |= FAULT_FLAG_ALLOW_RETRY | FAULT_FLAG_KILLABLE; > + /* > + * FAULT_FLAG_INTERRUPTIBLE is opt-in. GUP callers must set > + * FOLL_INTERRUPTIBLE to enable FAULT_FLAG_INTERRUPTIBLE. > + * That's because some callers may not be prepared to > + * handle early exits caused by non-fatal signals. > + */ > + if (*flags & FOLL_INTERRUPTIBLE) > + fault_flags |= FAULT_FLAG_INTERRUPTIBLE; > + } > if (*flags & FOLL_NOWAIT) > fault_flags |= FAULT_FLAG_ALLOW_RETRY | FAULT_FLAG_RETRY_NOWAIT; > if (*flags & FOLL_TRIED) { > @@ -1380,6 +1389,22 @@ int fixup_user_fault(struct mm_struct *mm, > } > EXPORT_SYMBOL_GPL(fixup_user_fault); > > +/* > + * GUP always responds to fatal signals. When FOLL_INTERRUPTIBLE is > + * specified, it'll also respond to generic signals. The caller of GUP > + * that has FOLL_INTERRUPTIBLE should take care of the GUP interruption. > + */ > +static bool gup_signal_pending(unsigned int flags) > +{ > + if (fatal_signal_pending(current)) > + return true; > + > + if (!(flags & FOLL_INTERRUPTIBLE)) > + return false; > + > + return signal_pending(current); > +} > + > /* > * Please note that this function, unlike __get_user_pages will not > * return 0 for nr_pages > 0 without FOLL_NOWAIT > @@ -1461,11 +1486,11 @@ static __always_inline long __get_user_pages_locked(struct mm_struct *mm, > * Repeat on the address that fired VM_FAULT_RETRY > * with both FAULT_FLAG_ALLOW_RETRY and > * FAULT_FLAG_TRIED. Note that GUP can be interrupted > - * by fatal signals, so we need to check it before we > + * by fatal signals of even common signals, depending on > + * the caller's request. So we need to check it before we > * start trying again otherwise it can loop forever. > */ > - > - if (fatal_signal_pending(current)) { > + if (gup_signal_pending(flags)) { > if (!pages_done) > pages_done = -EINTR; > break; > diff --git a/mm/hugetlb.c b/mm/hugetlb.c > index e070b8593b37..202f3ad7f35c 100644 > --- a/mm/hugetlb.c > +++ b/mm/hugetlb.c > @@ -6206,9 +6206,12 @@ long follow_hugetlb_page(struct mm_struct *mm, struct vm_area_struct *vma, > fault_flags |= FAULT_FLAG_WRITE; > else if (unshare) > fault_flags |= FAULT_FLAG_UNSHARE; > - if (locked) > + if (locked) { > fault_flags |= FAULT_FLAG_ALLOW_RETRY | > FAULT_FLAG_KILLABLE; > + if (flags & FOLL_INTERRUPTIBLE) > + fault_flags |= FAULT_FLAG_INTERRUPTIBLE; > + } > if (flags & FOLL_NOWAIT) > fault_flags |= FAULT_FLAG_ALLOW_RETRY | > FAULT_FLAG_RETRY_NOWAIT;