From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 416C6C00A5A for ; Tue, 17 Jan 2023 23:42:56 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 827E06B0071; Tue, 17 Jan 2023 18:42:55 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 7D8F26B0072; Tue, 17 Jan 2023 18:42:55 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6A04D6B0073; Tue, 17 Jan 2023 18:42:55 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 5BC136B0071 for ; Tue, 17 Jan 2023 18:42:55 -0500 (EST) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 36AA61A09A7 for ; Tue, 17 Jan 2023 23:42:55 +0000 (UTC) X-FDA: 80365918710.11.AAF8AC8 Received: from ams.source.kernel.org (ams.source.kernel.org [145.40.68.75]) by imf27.hostedemail.com (Postfix) with ESMTP id 8A87C40014 for ; Tue, 17 Jan 2023 23:42:53 +0000 (UTC) Authentication-Results: imf27.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b="r/1d4gQ7"; spf=pass (imf27.hostedemail.com: domain of jarkko@kernel.org designates 145.40.68.75 as permitted sender) smtp.mailfrom=jarkko@kernel.org; dmarc=pass (policy=none) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1673998973; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=fmPb+Kzllfp8bx7t/u9A1SZjD24zaBPXpc/qYQn1r6A=; b=IvVvyCyr2pYROirXZb8Y1iCsiO7OI44DcNoz32iY6ixrYDs0+ynKtWAWcQmDKqcaJjtxve 6Y4j6g/x17+9xPzwFi1MJJ+Hz5l/Ymz/Rbu/CHJfW7wOB/UYIYfXE5qr8m5FQ7lzFCuoYg avVc3+9cP9g00s99q9uCC0QN0ytnUWc= ARC-Authentication-Results: i=1; imf27.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b="r/1d4gQ7"; spf=pass (imf27.hostedemail.com: domain of jarkko@kernel.org designates 145.40.68.75 as permitted sender) smtp.mailfrom=jarkko@kernel.org; dmarc=pass (policy=none) header.from=kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1673998973; a=rsa-sha256; cv=none; b=0Ad6QnqCWGTXSZr2EqnupD9mWg26Dhh1j1h2cQVzFHF4h+wu5RIzZgee9guyydqmX0/iFT eV+JXRUw88VNayfGcAnqnWK+YycsTZKlQn7cvlyTt47aVAnSnHsq/K8KZIeWOJwVbQsLNI MA7ORbHhWMw3iub/hBqIXy2FuqsiF4I= Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ams.source.kernel.org (Postfix) with ESMTPS id DA543B81912; Tue, 17 Jan 2023 23:42:51 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 88D95C433EF; Tue, 17 Jan 2023 23:42:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1673998970; bh=2ikdQhWN8QnY8MY7pt8CC+l4LYugedIuQZfZ7a0yhEU=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=r/1d4gQ7cape7g9hFv8XNl0XZBEZ0EVwPauBC4bqmnCoGOF+Xy+qUbw2jwW6F9vvZ pVmYoRCzPA7YHryO/T0MH8YnOJXt0x4w2NzJ1ACiA5g/5vPjW519asy8n+GAnyMimK sb06Z4wbntGBSR9tr8RZD6PYKrmIg1jc4sHeTiLeVELEsNxDwUkoohhtbCJEaQ7HRF yI74gK0GdlqeWP0T8Y3RVRLOobjIJcMWIfHibmefBamQhUMzKiAdSE/SoUuntNsHbc DNg0yxLMPeXtXszECrO3bClqp8i39Vug7emnDggHcfVbbg3/E6KmSMn+0e1TATY4XX iowUzbxk9j9ag== Date: Wed, 18 Jan 2023 01:42:45 +0200 From: Jarkko Sakkinen To: Michael Roth Cc: kvm@vger.kernel.org, linux-coco@lists.linux.dev, linux-mm@kvack.org, linux-crypto@vger.kernel.org, x86@kernel.org, linux-kernel@vger.kernel.org, tglx@linutronix.de, mingo@redhat.com, jroedel@suse.de, thomas.lendacky@amd.com, hpa@zytor.com, ardb@kernel.org, pbonzini@redhat.com, seanjc@google.com, vkuznets@redhat.com, wanpengli@tencent.com, jmattson@google.com, luto@kernel.org, dave.hansen@linux.intel.com, slp@redhat.com, pgonda@google.com, peterz@infradead.org, srinivas.pandruvada@linux.intel.com, rientjes@google.com, dovmurik@linux.ibm.com, tobin@ibm.com, bp@alien8.de, vbabka@suse.cz, kirill@shutemov.name, ak@linux.intel.com, tony.luck@intel.com, marcorr@google.com, sathyanarayanan.kuppuswamy@linux.intel.com, alpergun@google.com, dgilbert@redhat.com, ashish.kalra@amd.com, harald@profian.com, Vishal Annapurve Subject: Re: [PATCH RFC v7 10/64] KVM: SEV: Populate private memory fd during LAUNCH_UPDATE_DATA Message-ID: References: <20221214194056.161492-1-michael.roth@amd.com> <20221214194056.161492-11-michael.roth@amd.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20221214194056.161492-11-michael.roth@amd.com> X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 8A87C40014 X-Stat-Signature: 6emtf59ny6ufoy51dp5kg6msytm7hygb X-HE-Tag: 1673998973-713130 X-HE-Meta: U2FsdGVkX1/jsZiT7c7kcEaMZdTOGdNzqKmp61qnIuklOZM7ItLrcUydBRepOVWPjac0iVu3iyh9ql0GgLEXXuT1Vml3iiSRdEFQaAUf1hMJN41azikwKAvSlN/lj/GpnW5Qlwm/nM0yqX074l8bL1KM70J6Q6jf3XzO9JMkdYYsB+bx1EL4PnoIRt4cTuVDN/1nX9IAvPD6rlh9gQbt/4CqJBN+X4zWAe80ZUt5ForZEA9rjjVzuKbETGp70jrSmIONx1xwHjYMVbDYi+okd25y2QudTATPWUts3tcYy72kmsuAoE75OqzTYsPTTswyJJF+D2i9paKhO7TYhiRL4hUrHd5Q9JzSgK6HMiueIfv7QovOeawm1AMHoj62Mm82BwQFubmAQjyTG80ytbfWV7feSU9uC9yM6YEMo/8fQ2ydKjXecORpwf6RbSEnBkkBys54O/F1VBYBVQzeAN/Cc1+/Dw1kJg7DbxqhQVCLlc/1BLUHON8DROR7g/ZPkmldQn6Ov34b81vW91NI0SNBhPnBdg7kiRuXktFlzZJ8ktOGZFw9skdTwbjtUWEuUZxxV931gdHqMtwx6LPVaWVDTw0snLoKrwr/WDrL6p4Zkzwv8hp/x34Kqk/Rr+TxhizjMFIm6NGtNCctMEzuaWq1yk+f9cPBFkIHMXPXJ+O7HGQqppy+wwibOF57DgqPeVJ7rC4vgdGzU9zW+7M3aAn1ButTrnkGyfvCPJeGdVk9PRvlJNWsG8U9FV+uHgWnwYSivTK9vLg7+nm4OXHk9SjsikF4AWkM3e7y5yENpzYYoaqCYKXOUfPCvezy/4RUKCQUArD7DtdBE05VnDoo7WPxBSaNF+NCe+En0YfcBv+27PPATvbyl9HD/IXRgyLqvP8NOHkSIPAU2T2fc0Pyh1Wa1bhMbxax7iDjmavnfHyJMd4BUnd0qNwEBX258I4COfFedhQjPvgHcbnYTq97ml/ 9CSGbJU1 KCO4LMLoLnY7ZgPIzJi/lqPcvDzgOw2TVAuWnjYCG9bNJxKZajxGdBGDTrAnQ+p5S2PkSTf8Db0MW3SM37lm3EIqAXw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed, Dec 14, 2022 at 01:40:02PM -0600, Michael Roth wrote: > From: Vishal Annapurve > > This change adds handling of HVA ranges to copy contents > to private memory while doing sev launch update data. > > mem_attr array is updated during LAUNCH_UPDATE_DATA to ensure > that encrypted memory is marked as private. > > Signed-off-by: Vishal Annapurve > [mdr: use gfn_to_hva_memslot_prot() for shared GFN handler to deal with > read-only slots for ROMs] > Signed-off-by: Michael Roth > --- > arch/x86/kvm/svm/sev.c | 99 ++++++++++++++++++++++++++++++++++++---- > include/linux/kvm_host.h | 1 + > virt/kvm/kvm_main.c | 27 ++++++++--- > 3 files changed, 111 insertions(+), 16 deletions(-) > > diff --git a/arch/x86/kvm/svm/sev.c b/arch/x86/kvm/svm/sev.c > index 69dbf17f0d6a..a7e4e3005786 100644 > --- a/arch/x86/kvm/svm/sev.c > +++ b/arch/x86/kvm/svm/sev.c > @@ -493,23 +493,26 @@ static unsigned long get_num_contig_pages(unsigned long idx, > return pages; > } > > -static int sev_launch_update_data(struct kvm *kvm, struct kvm_sev_cmd *argp) > +static int sev_launch_update_shared_gfn_handler(struct kvm *kvm, > + struct kvm_gfn_range *range, > + struct kvm_sev_cmd *argp) > { > unsigned long vaddr, vaddr_end, next_vaddr, npages, pages, size, i; > struct kvm_sev_info *sev = &to_kvm_svm(kvm)->sev_info; > - struct kvm_sev_launch_update_data params; > struct sev_data_launch_update_data data; > struct page **inpages; > int ret; > > - if (!sev_guest(kvm)) > - return -ENOTTY; > - > - if (copy_from_user(¶ms, (void __user *)(uintptr_t)argp->data, sizeof(params))) > - return -EFAULT; > + vaddr = gfn_to_hva_memslot_prot(range->slot, range->start, NULL); > + pr_debug("%s: shared GFN: %llx, slot.id: %d, slot.base_gfn: %llx, slot.userspace_addr: %lx, slot.flags: %x, vaddr: %lx\n", > + __func__, range->start, range->slot->id, range->slot->base_gfn, > + range->slot->userspace_addr, range->slot->flags, vaddr); > + if (kvm_is_error_hva(vaddr)) { > + pr_err("vaddr is erroneous 0x%lx\n", vaddr); > + return -EINVAL; > + } > > - vaddr = params.uaddr; > - size = params.len; > + size = (range->end - range->start) << PAGE_SHIFT; > vaddr_end = vaddr + size; > > /* Lock the user memory. */ > @@ -561,6 +564,84 @@ static int sev_launch_update_data(struct kvm *kvm, struct kvm_sev_cmd *argp) > return ret; > } > > +static int sev_launch_update_priv_gfn_handler(struct kvm *kvm, > + struct kvm_gfn_range *range, > + struct kvm_sev_cmd *argp) > +{ > + struct sev_data_launch_update_data data; > + struct kvm_sev_info *sev = &to_kvm_svm(kvm)->sev_info; > + gfn_t gfn; > + kvm_pfn_t pfn; > + struct kvm_memory_slot *memslot = range->slot; > + int ret = 0; > + > + data.reserved = 0; > + data.handle = sev->handle; > + > + for (gfn = range->start; gfn < range->end; gfn++) { > + int order; > + void *kvaddr; > + > + ret = kvm_restricted_mem_get_pfn(memslot, gfn, &pfn, &order); > + if (ret) > + return ret; > + > + kvaddr = pfn_to_kaddr(pfn); > + if (!virt_addr_valid(kvaddr)) { > + pr_err("Invalid kvaddr 0x%llx\n", (uint64_t)kvaddr); > + ret = -EINVAL; > + goto e_ret; > + } > + > + ret = kvm_read_guest_page(kvm, gfn, kvaddr, 0, PAGE_SIZE); > + if (ret) { > + pr_err("guest read failed 0x%x\n", ret); > + goto e_ret; > + } > + > + if (!this_cpu_has(X86_FEATURE_SME_COHERENT)) > + clflush_cache_range(kvaddr, PAGE_SIZE); > + > + data.len = PAGE_SIZE; > + data.address = __sme_set(pfn << PAGE_SHIFT); > + ret = sev_issue_cmd(kvm, SEV_CMD_LAUNCH_UPDATE_DATA, &data, &argp->error); > + if (ret) > + goto e_ret; > + kvm_release_pfn_clean(pfn); > + } > + kvm_vm_set_region_attr(kvm, range->start, range->end, > + true /* priv_attr */); > + > +e_ret: > + return ret; > +} > + > +static int sev_launch_update_gfn_handler(struct kvm *kvm, struct kvm_gfn_range *range, > + void *data) > +{ > + struct kvm_sev_cmd *argp = (struct kvm_sev_cmd *)data; > + > + if (kvm_slot_can_be_private(range->slot)) > + return sev_launch_update_priv_gfn_handler(kvm, range, argp); > + > + return sev_launch_update_shared_gfn_handler(kvm, range, argp); > +} > + > +static int sev_launch_update_data(struct kvm *kvm, > + struct kvm_sev_cmd *argp) > +{ > + struct kvm_sev_launch_update_data params; > + > + if (!sev_guest(kvm)) > + return -ENOTTY; > + > + if (copy_from_user(¶ms, (void __user *)(uintptr_t)argp->data, sizeof(params))) > + return -EFAULT; > + > + return kvm_vm_do_hva_range_op(kvm, params.uaddr, params.uaddr + params.len, > + sev_launch_update_gfn_handler, argp); > +} > + > static int sev_es_sync_vmsa(struct vcpu_svm *svm) > { > struct sev_es_save_area *save = svm->sev_es.vmsa; > diff --git a/include/linux/kvm_host.h b/include/linux/kvm_host.h > index 21a539ab17f6..33fa0b1435d3 100644 > --- a/include/linux/kvm_host.h > +++ b/include/linux/kvm_host.h > @@ -973,6 +973,7 @@ int kvm_init(void *opaque, unsigned vcpu_size, unsigned vcpu_align, > void kvm_exit(void); > > void kvm_get_kvm(struct kvm *kvm); > +int kvm_vm_set_region_attr(struct kvm *kvm, gfn_t start, gfn_t end, u64 attributes); > bool kvm_get_kvm_safe(struct kvm *kvm); > void kvm_put_kvm(struct kvm *kvm); > bool file_is_kvm(struct file *file); > diff --git a/virt/kvm/kvm_main.c b/virt/kvm/kvm_main.c > index 4ff7adaf6c56..1343070657d1 100644 > --- a/virt/kvm/kvm_main.c > +++ b/virt/kvm/kvm_main.c > @@ -747,6 +747,7 @@ int kvm_vm_do_hva_range_op(struct kvm *kvm, unsigned long hva_start, > > return ret; > } > +EXPORT_SYMBOL_GPL(kvm_vm_do_hva_range_op); > > static __always_inline int kvm_handle_hva_range(struct mmu_notifier *mn, > unsigned long start, > @@ -2595,12 +2596,28 @@ static void kvm_unmap_mem_range(struct kvm *kvm, gfn_t start, gfn_t end, > kvm_flush_remote_tlbs(kvm); > } > > +int kvm_vm_set_region_attr(struct kvm *kvm, gfn_t start, gfn_t end, > + u64 attributes) > +{ > + gfn_t index; > + void *entry; > + > + entry = attributes ? xa_mk_value(attributes) : NULL; > + > + for (index = start; index < end; index++) > + if (xa_err(xa_store(&kvm->mem_attr_array, index, entry, > + GFP_KERNEL_ACCOUNT))) > + break; > + > + return index; > +} > +EXPORT_SYMBOL_GPL(kvm_vm_set_region_attr); > + > static int kvm_vm_ioctl_set_mem_attributes(struct kvm *kvm, > struct kvm_memory_attributes *attrs) > { > gfn_t start, end; > unsigned long i; > - void *entry; > int idx; > u64 supported_attrs = kvm_supported_mem_attributes(kvm); > > @@ -2617,8 +2634,6 @@ static int kvm_vm_ioctl_set_mem_attributes(struct kvm *kvm, > start = attrs->address >> PAGE_SHIFT; > end = (attrs->address + attrs->size - 1 + PAGE_SIZE) >> PAGE_SHIFT; > > - entry = attrs->attributes ? xa_mk_value(attrs->attributes) : NULL; > - > if (kvm_arch_has_private_mem(kvm)) { > KVM_MMU_LOCK(kvm); > kvm_mmu_invalidate_begin(kvm); > @@ -2627,10 +2642,7 @@ static int kvm_vm_ioctl_set_mem_attributes(struct kvm *kvm, > } > > mutex_lock(&kvm->lock); > - for (i = start; i < end; i++) > - if (xa_err(xa_store(&kvm->mem_attr_array, i, entry, > - GFP_KERNEL_ACCOUNT))) > - break; > + i = kvm_vm_set_region_attr(kvm, start, end, attrs->attributes); > mutex_unlock(&kvm->lock); > > if (kvm_arch_has_private_mem(kvm)) { > @@ -2793,6 +2805,7 @@ unsigned long gfn_to_hva_memslot_prot(struct kvm_memory_slot *slot, > > return hva; > } > +EXPORT_SYMBOL_GPL(gfn_to_hva_memslot_prot); > > unsigned long gfn_to_hva_prot(struct kvm *kvm, gfn_t gfn, bool *writable) > { > -- > 2.25.1 > Hmm.. but user space is still allowed to call KVM_SET_MEMORY_ATTRIBUTES with KVM_MEMORY_ATTRIBUTE_PRIVATE set? How do these behaviours complement each other? SEV specific changes and kvm_vm_set_region_attr() definition should really be separate patches. BR, Jarkko