From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id CB4CDC07E97 for ; Sat, 3 Jul 2021 16:33:16 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 5E4B16157F for ; Sat, 3 Jul 2021 16:33:16 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5E4B16157F Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:43012 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lziZv-0006Ch-ER for qemu-devel@archiver.kernel.org; Sat, 03 Jul 2021 12:33:15 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:55408) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lziYS-0004bG-3i for qemu-devel@nongnu.org; Sat, 03 Jul 2021 12:31:44 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:25056) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lziYO-0002KI-Gx for qemu-devel@nongnu.org; Sat, 03 Jul 2021 12:31:43 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1625329898; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=aslCUlFMZs5lt4Gh9ItxHs0sfysX0g8iXM6xPa9MnrA=; b=ikeCbaZOYhy5ZoUkGzGQZLC8fpErAu7X/1+ajKxDQpfPkV4MuNDN0+PZT6rTLlyJDdvGXd xwayq+suDEjCcUp1VCjC5jB4mSP0MHFEAPNP5GjtWJAtG7hPDyRDbpZcJSJ1IVGS9aS6hA 7hwv9R4L/SL0moqwr/T7oxiOqg7gQAA= Received: from mail-ed1-f70.google.com (mail-ed1-f70.google.com [209.85.208.70]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-383-7XTre7vyPXqaalWY_hXmLg-1; Sat, 03 Jul 2021 12:31:37 -0400 X-MC-Unique: 7XTre7vyPXqaalWY_hXmLg-1 Received: by mail-ed1-f70.google.com with SMTP id y17-20020a0564023591b02903951740fab5so6776100edc.23 for ; Sat, 03 Jul 2021 09:31:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=aslCUlFMZs5lt4Gh9ItxHs0sfysX0g8iXM6xPa9MnrA=; b=hp4LCUFVqI0Sp0E2ZO/+HM4oh/O0Lx3TsQ1toRdKrwmedqQDGNk5i4NaSp2xnI7Ft5 pSr4LEk3YHQgr7l1oa/bA53fIP0Rpl4fguzBFAkrPGuExHFUBbxqKrscxOIifyaBgBZu Z1XrUXDEQq4SFVdspmriw9zfXGFWUMeZyJi6kx8U9uWU8bJsR1PpmaLYJqUJdusAk66d Mz3RL5p6aQAajv66w4SRAeCPzI94DvWRyqgYDFDuM5adbYbQD/huRhAi1M6irdALLYRl 45O/ZAdWGPHexhZ6gKsrHvoFaD3RU5OWYEia6zQ2NEvHsFM7SxI1gHd0YrfofWTA0Dbb LOSA== X-Gm-Message-State: AOAM532Id0vBdnnmmRfuDxge16L4d+GEWRBq6SYEU2IBxcPBV87es78l RZ46hMhZFbtJuem/Yqa5evuDxxP6SkPFJBgWwk0xkovHW2JgIjoH0NcQ0GoLDzeN+EmJ8TvDvX6 x69tPhxsrNQbqH9I= X-Received: by 2002:a50:f0ce:: with SMTP id a14mr5389709edm.176.1625329895951; Sat, 03 Jul 2021 09:31:35 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwqJuR3kynSnMSSm/IWQnm187dATYLvp89SmLte6kMngW9M4cu+aAlxK16KAkFlkoN/x3pIog== X-Received: by 2002:a50:f0ce:: with SMTP id a14mr5389686edm.176.1625329895571; Sat, 03 Jul 2021 09:31:35 -0700 (PDT) Received: from redhat.com ([77.126.110.253]) by smtp.gmail.com with ESMTPSA id b15sm2275530eja.82.2021.07.03.09.31.32 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 03 Jul 2021 09:31:34 -0700 (PDT) Date: Sat, 3 Jul 2021 12:31:31 -0400 From: "Michael S. Tsirkin" To: Eric Auger Subject: Re: [PATCH v7 2/5] virtio-iommu: Implement RESV_MEM probe request Message-ID: <20210703123113-mutt-send-email-mst@kernel.org> References: <20200629070404.10969-1-eric.auger@redhat.com> <20200629070404.10969-3-eric.auger@redhat.com> MIME-Version: 1.0 In-Reply-To: <20200629070404.10969-3-eric.auger@redhat.com> Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=mst@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Received-SPF: pass client-ip=216.205.24.124; envelope-from=mst@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -31 X-Spam_score: -3.2 X-Spam_bar: --- X-Spam_report: (-3.2 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.377, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: peter.maydell@linaro.org, jean-philippe@linaro.org, qemu-devel@nongnu.org, peterx@redhat.com, armbru@redhat.com, qemu-arm@nongnu.org, pbonzini@redhat.com, bbhushan2@marvell.com, eric.auger.pro@gmail.com Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On Mon, Jun 29, 2020 at 09:04:01AM +0200, Eric Auger wrote: > This patch implements the PROBE request. At the moment, > only THE RESV_MEM property is handled. The first goal is > to report iommu wide reserved regions such as the MSI regions > set by the machine code. On x86 this will be the IOAPIC MSI > region, [0xFEE00000 - 0xFEEFFFFF], on ARM this may be the ITS > doorbell. > > In the future we may introduce per device reserved regions. > This will be useful when protecting host assigned devices > which may expose their own reserved regions > > Signed-off-by: Eric Auger > Reviewed-by: Jean-Philippe Brucker > > --- > > v6 -> v7: > - put the assert again to make it clear there is no risk > of truncation > > v5 -> v6: > - removed validation of s->reserved_regions[i].type in the > probe request as it should rather happen in the realize() > > v4 -> v5: > - assert if reserved region type is different from RESERVED or > MSI > > v3 -> v4: > - removed any reference to the NONE property that does not > exist anymore. > > v2 -> v3: > - on probe, do not fill the reminder of the buffer with zeroes > as the buffer was already zero initialized (Bharat) > > v1 -> v2: > - move the unlock back to the same place > - remove the push label and factorize the code after the out label > - fix a bunch of cpu_to_leX according to the latest spec revision > - do not remove sizeof(last) from free space > - check the ep exists > --- > include/hw/virtio/virtio-iommu.h | 2 + > hw/virtio/virtio-iommu.c | 94 ++++++++++++++++++++++++++++++-- > hw/virtio/trace-events | 1 + > 3 files changed, 93 insertions(+), 4 deletions(-) > > diff --git a/include/hw/virtio/virtio-iommu.h b/include/hw/virtio/virtio-iommu.h > index e653004d7c..49eb105cd8 100644 > --- a/include/hw/virtio/virtio-iommu.h > +++ b/include/hw/virtio/virtio-iommu.h > @@ -53,6 +53,8 @@ typedef struct VirtIOIOMMU { > GHashTable *as_by_busptr; > IOMMUPciBus *iommu_pcibus_by_bus_num[PCI_BUS_MAX]; > PCIBus *primary_bus; > + ReservedRegion *reserved_regions; > + uint32_t nb_reserved_regions; > GTree *domains; > QemuMutex mutex; > GTree *endpoints; > diff --git a/hw/virtio/virtio-iommu.c b/hw/virtio/virtio-iommu.c > index 483883ec1d..2cdaa1969b 100644 > --- a/hw/virtio/virtio-iommu.c > +++ b/hw/virtio/virtio-iommu.c > @@ -38,6 +38,7 @@ > > /* Max size */ > #define VIOMMU_DEFAULT_QUEUE_SIZE 256 > +#define VIOMMU_PROBE_SIZE 512 > > typedef struct VirtIOIOMMUDomain { > uint32_t id; > @@ -378,6 +379,65 @@ static int virtio_iommu_unmap(VirtIOIOMMU *s, > return ret; > } > > +static ssize_t virtio_iommu_fill_resv_mem_prop(VirtIOIOMMU *s, uint32_t ep, > + uint8_t *buf, size_t free) > +{ > + struct virtio_iommu_probe_resv_mem prop = {}; > + size_t size = sizeof(prop), length = size - sizeof(prop.head), total; > + int i; > + > + total = size * s->nb_reserved_regions; > + > + if (total > free) { > + return -ENOSPC; > + } > + > + for (i = 0; i < s->nb_reserved_regions; i++) { > + unsigned subtype = s->reserved_regions[i].type; > + > + assert(subtype == VIRTIO_IOMMU_RESV_MEM_T_RESERVED || > + subtype == VIRTIO_IOMMU_RESV_MEM_T_MSI); > + prop.head.type = cpu_to_le16(VIRTIO_IOMMU_PROBE_T_RESV_MEM); > + prop.head.length = cpu_to_le16(length); > + prop.subtype = subtype; > + prop.start = cpu_to_le64(s->reserved_regions[i].low); > + prop.end = cpu_to_le64(s->reserved_regions[i].high); > + > + memcpy(buf, &prop, size); > + > + trace_virtio_iommu_fill_resv_property(ep, prop.subtype, > + prop.start, prop.end); > + buf += size; > + } > + return total; > +} > + > +/** > + * virtio_iommu_probe - Fill the probe request buffer with > + * the properties the device is able to return > + */ > +static int virtio_iommu_probe(VirtIOIOMMU *s, > + struct virtio_iommu_req_probe *req, > + uint8_t *buf) > +{ > + uint32_t ep_id = le32_to_cpu(req->endpoint); > + size_t free = VIOMMU_PROBE_SIZE; > + ssize_t count; > + > + if (!virtio_iommu_mr(s, ep_id)) { > + return VIRTIO_IOMMU_S_NOENT; > + } > + > + count = virtio_iommu_fill_resv_mem_prop(s, ep_id, buf, free); > + if (count < 0) { > + return VIRTIO_IOMMU_S_INVAL; > + } > + buf += count; > + free -= count; > + > + return VIRTIO_IOMMU_S_OK; > +} > + > static int virtio_iommu_iov_to_req(struct iovec *iov, > unsigned int iov_cnt, > void *req, size_t req_sz) > @@ -407,15 +467,27 @@ virtio_iommu_handle_req(detach) > virtio_iommu_handle_req(map) > virtio_iommu_handle_req(unmap) > > +static int virtio_iommu_handle_probe(VirtIOIOMMU *s, > + struct iovec *iov, > + unsigned int iov_cnt, > + uint8_t *buf) > +{ > + struct virtio_iommu_req_probe req; > + int ret = virtio_iommu_iov_to_req(iov, iov_cnt, &req, sizeof(req)); > + > + return ret ? ret : virtio_iommu_probe(s, &req, buf); > +} > + > static void virtio_iommu_handle_command(VirtIODevice *vdev, VirtQueue *vq) > { > VirtIOIOMMU *s = VIRTIO_IOMMU(vdev); > struct virtio_iommu_req_head head; > struct virtio_iommu_req_tail tail = {}; > + size_t output_size = sizeof(tail), sz; > VirtQueueElement *elem; > unsigned int iov_cnt; > struct iovec *iov; > - size_t sz; > + void *buf = NULL; > > for (;;) { > elem = virtqueue_pop(vq, sizeof(VirtQueueElement)); > @@ -452,6 +524,17 @@ static void virtio_iommu_handle_command(VirtIODevice *vdev, VirtQueue *vq) > case VIRTIO_IOMMU_T_UNMAP: > tail.status = virtio_iommu_handle_unmap(s, iov, iov_cnt); > break; > + case VIRTIO_IOMMU_T_PROBE: > + { > + struct virtio_iommu_req_tail *ptail; > + > + output_size = s->config.probe_size + sizeof(tail); > + buf = g_malloc0(output_size); > + > + ptail = (struct virtio_iommu_req_tail *) > + (buf + s->config.probe_size); > + ptail->status = virtio_iommu_handle_probe(s, iov, iov_cnt, buf); > + } > default: > tail.status = VIRTIO_IOMMU_S_UNSUPP; > } > @@ -459,12 +542,13 @@ static void virtio_iommu_handle_command(VirtIODevice *vdev, VirtQueue *vq) > > out: > sz = iov_from_buf(elem->in_sg, elem->in_num, 0, > - &tail, sizeof(tail)); > - assert(sz == sizeof(tail)); > + buf ? buf : &tail, output_size); > + assert(sz == output_size); > > - virtqueue_push(vq, elem, sizeof(tail)); > + virtqueue_push(vq, elem, sz); > virtio_notify(vdev, vq); > g_free(elem); > + g_free(buf); > } > } > > @@ -667,6 +751,7 @@ static void virtio_iommu_device_realize(DeviceState *dev, Error **errp) > s->config.page_size_mask = TARGET_PAGE_MASK; > s->config.input_range.end = -1UL; > s->config.domain_range.end = 32; > + s->config.probe_size = VIOMMU_PROBE_SIZE; > > virtio_add_feature(&s->features, VIRTIO_RING_F_EVENT_IDX); > virtio_add_feature(&s->features, VIRTIO_RING_F_INDIRECT_DESC); > @@ -676,6 +761,7 @@ static void virtio_iommu_device_realize(DeviceState *dev, Error **errp) > virtio_add_feature(&s->features, VIRTIO_IOMMU_F_MAP_UNMAP); > virtio_add_feature(&s->features, VIRTIO_IOMMU_F_BYPASS); > virtio_add_feature(&s->features, VIRTIO_IOMMU_F_MMIO); > + virtio_add_feature(&s->features, VIRTIO_IOMMU_F_PROBE); > Don't we need to disable this for existing machine types? > qemu_mutex_init(&s->mutex); > > diff --git a/hw/virtio/trace-events b/hw/virtio/trace-events > index 6427a0047d..23109f69bb 100644 > --- a/hw/virtio/trace-events > +++ b/hw/virtio/trace-events > @@ -74,3 +74,4 @@ virtio_iommu_get_domain(uint32_t domain_id) "Alloc domain=%d" > virtio_iommu_put_domain(uint32_t domain_id) "Free domain=%d" > virtio_iommu_translate_out(uint64_t virt_addr, uint64_t phys_addr, uint32_t sid) "0x%"PRIx64" -> 0x%"PRIx64 " for sid=%d" > virtio_iommu_report_fault(uint8_t reason, uint32_t flags, uint32_t endpoint, uint64_t addr) "FAULT reason=%d flags=%d endpoint=%d address =0x%"PRIx64 > +virtio_iommu_fill_resv_property(uint32_t devid, uint8_t subtype, uint64_t start, uint64_t end) "dev= %d, type=%d start=0x%"PRIx64" end=0x%"PRIx64 > -- > 2.20.1