From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 36711C10F16 for ; Tue, 30 Apr 2024 18:27:33 +0000 (UTC) Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 9C331112E17; Tue, 30 Apr 2024 18:27:32 +0000 (UTC) Authentication-Results: gabe.freedesktop.org; dkim=pass (2048-bit key; unprotected) header.d=intel.com header.i=@intel.com header.b="Q1wz9azk"; dkim-atps=neutral Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.14]) by gabe.freedesktop.org (Postfix) with ESMTPS id 03549112E0F for ; Tue, 30 Apr 2024 18:27:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1714501650; x=1746037650; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=zAvg9MgATtNbvAATjjDWJndKkIqV+rn/rVlsVG6lpX8=; b=Q1wz9azk/DO6f1WnxduvGOf4Uk/jMoFNJ5WbY+vdU0F3Re7UJoeChsYf wHswy3+UgVvfeVxzlgWAIzbzQ82BXboWQJAYTnR/tCbKIl4W1x594s5LC r/UjXE0pxV1igYdvolP2S4rFA7y7oUeeiXerZRQYgvqjtxavqsjG6I/Ca 7KghWHPjIfoe9uAWxXbnfFV+KiXClI3pBUxocx65Xf4SxKLzRRnIMPHcU CqFxLyQJ4ahG7xBouvQsqexEOv5X9BxhLVwqasW5NFtMvhAoy0VjKyBXq pq8jtCli67/ZCryIzaNY+BOXoWLBdhedsaR/vttn7PjMIDiEP/bsi6IOI g==; X-CSE-ConnectionGUID: 63YrXGCkRV2OIaxjon26gg== X-CSE-MsgGUID: TmmfvhZKQ12qws+GRpIs/g== X-IronPort-AV: E=McAfee;i="6600,9927,11060"; a="14052098" X-IronPort-AV: E=Sophos;i="6.07,242,1708416000"; d="scan'208";a="14052098" Received: from fmviesa001.fm.intel.com ([10.60.135.141]) by orvoesa106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 30 Apr 2024 11:27:30 -0700 X-CSE-ConnectionGUID: Usa/cTUqTMqZTkmFEXanaQ== X-CSE-MsgGUID: z/0+3MA7QLSBHWRK3og3AQ== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.07,242,1708416000"; d="scan'208";a="57726925" Received: from bommu-optiplex-5060.iind.intel.com ([10.145.169.63]) by fmviesa001.fm.intel.com with ESMTP; 30 Apr 2024 11:27:28 -0700 From: Bommu Krishnaiah To: igt-dev@lists.freedesktop.org Cc: Bommu Krishnaiah , Oak Zeng , Himal Prasad Ghimiray Subject: [PATCH RFC i-g-t 1/2] lib/xe/xe_util: helper function Date: Tue, 30 Apr 2024 23:57:46 +0530 Message-Id: <20240430182747.589234-2-krishnaiah.bommu@intel.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20240430182747.589234-1-krishnaiah.bommu@intel.com> References: <20240430182747.589234-1-krishnaiah.bommu@intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: igt-dev@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development mailing list for IGT GPU Tools List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: igt-dev-bounces@lists.freedesktop.org Sender: "igt-dev" Introduce helper functions for object creation, binding, submission, and destruction, applicable for SVM and other tests. Signed-off-by: Bommu Krishnaiah Cc: Oak Zeng Cc: Himal Prasad Ghimiray --- lib/xe/xe_util.c | 113 +++++++++++++++++++++++++++++++++++++++++++++++ lib/xe/xe_util.h | 32 ++++++++++++++ 2 files changed, 145 insertions(+) diff --git a/lib/xe/xe_util.c b/lib/xe/xe_util.c index 050162b5e..3f1e8c052 100644 --- a/lib/xe/xe_util.c +++ b/lib/xe/xe_util.c @@ -10,6 +10,119 @@ #include "xe/xe_ioctl.h" #include "xe/xe_query.h" #include "xe/xe_util.h" +#include "lib/svga/vm_basic_types.h" + +/*submit a command +* wait for cmmand to cmplete from gpu +* verify ufence value*/ +void xe_submit_cmd(struct xe_buffer *cmdbuf) +{ + struct drm_xe_sync sync[1] = { + { .type = DRM_XE_SYNC_TYPE_USER_FENCE, + .flags = DRM_XE_SYNC_FLAG_SIGNAL, + .timeline_value = USER_FENCE_VALUE, + .addr = xe_cmdbuf_exec_ufence_gpuva(cmdbuf),}, + }; + struct drm_xe_exec exec = { + .num_batch_buffer = 1, + .num_syncs = 1, + .syncs = to_user_pointer(&sync), + .exec_queue_id = cmdbuf->exec_queue, + .address = (uint64_t)cmdbuf->gpu_addr, + }; + + xe_exec(cmdbuf->fd, &exec); + xe_wait_ufence(cmdbuf->fd, xe_cmdbuf_exec_ufence_cpuva(cmdbuf), USER_FENCE_VALUE, + cmdbuf->exec_queue, ONE_SEC); +} + +/*create a buffer, map it to cpu and gpu */ +void xe_create_buffer(struct xe_buffer *buffer) +{ +#define ONE_SEC MS_TO_NS(1000) + struct drm_xe_sync sync[1] = { + { .type = DRM_XE_SYNC_TYPE_USER_FENCE, .flags = DRM_XE_SYNC_FLAG_SIGNAL, + .timeline_value = USER_FENCE_VALUE }, + }; + + buffer->bind_queue = xe_bind_exec_queue_create(buffer->fd, buffer->vm, 0); + buffer->bind_ufence = aligned_alloc(xe_get_default_alignment(buffer->fd), buffer->size); + sync->addr = buffer->bind_ufence; + + if (!buffer->is_userptr) { + buffer->bo = xe_bo_create(buffer->fd, 0, buffer->size, buffer->placement, buffer->flag); + buffer->cpu_addr = xe_bo_map(buffer->fd, buffer->bo, buffer->size); + } else { + buffer->bo = aligned_alloc(xe_get_default_alignment(buffer->fd), buffer->size); + } + + xe_vm_bind_async(buffer->fd, buffer->vm, buffer->bind_queue, buffer->bo, 0, (uint64_t)buffer->gpu_addr, buffer->size, sync, 1); + + xe_wait_ufence(buffer->fd, buffer->bind_ufence, USER_FENCE_VALUE, buffer->bind_queue, ONE_SEC); +} + +void xe_destroy_buffer(struct xe_buffer *buffer) +{ + struct drm_xe_sync sync[1] = { + { .type = DRM_XE_SYNC_TYPE_USER_FENCE, .flags = DRM_XE_SYNC_FLAG_SIGNAL, + .timeline_value = USER_FENCE_VALUE }, + }; + sync->addr = buffer->bind_ufence; + + xe_vm_unbind_async(buffer->fd, buffer->vm, buffer->bind_queue, 0, (uint64_t)buffer->gpu_addr, buffer->size, sync, 1); + xe_wait_ufence(buffer->fd, buffer->bind_ufence, USER_FENCE_VALUE, buffer->bind_queue, ONE_SEC); + + munmap(buffer->cpu_addr, buffer->size); + if (!buffer->is_userptr) + gem_close(buffer->fd, buffer->bo); + else + free(buffer->bo); + + free(buffer->bind_ufence); + xe_exec_queue_destroy(buffer->fd, buffer->bind_queue); +} + +/* +a command buffer is a buffer in GT0's vram, filled with gpu commands, +plus some memory for a ufence used to sync command submission +*/ +void insert_store(uint32_t *batch, uint64_t dst_va, uint32_t val) +{ + int i = 0; + + batch[i] = MI_STORE_DWORD_IMM_GEN4; + batch[++i] = dst_va; + batch[++i] = dst_va >> 32; + batch[++i] = val; + batch[++i] = MI_BATCH_BUFFER_END; +} + +void xe_create_cmdbuf(struct xe_buffer *cmd_buf, cmdbuf_fill_func_t fill_func, uint64_t dst_va, uint32_t val, struct drm_xe_engine_class_instance *eci) +{ + //make some room for a exec_ufence, which will be used to sync the + //submission of this command.... + + cmd_buf->size = xe_bb_size(cmd_buf->fd, cmd_buf->size + PAGE_ALIGN_UFENCE); + xe_create_buffer(cmd_buf); + cmd_buf->exec_queue = xe_exec_queue_create(cmd_buf->fd, cmd_buf->vm, eci, 0); + fill_func(cmd_buf->cpu_addr, dst_va, val); +} + +void xe_destroy_cmdbuf(struct xe_buffer *cmd_buf) +{ + xe_exec_queue_destroy(cmd_buf->fd, cmd_buf->exec_queue); + xe_destroy_buffer(cmd_buf); +} + +uint64_t xe_cmdbuf_exec_ufence_gpuva(struct xe_buffer *cmd_buf) +{ + return (uint64_t)cmd_buf->gpu_addr + cmd_buf->size - 8; +} + +uint64_t *xe_cmdbuf_exec_ufence_cpuva(struct xe_buffer *cmd_buf) +{ + return cmd_buf->cpu_addr + cmd_buf->size - 8; +} static bool __region_belongs_to_regions_type(struct drm_xe_mem_region *region, uint32_t *mem_regions_type, diff --git a/lib/xe/xe_util.h b/lib/xe/xe_util.h index 6480ea01a..35f59cb6b 100644 --- a/lib/xe/xe_util.h +++ b/lib/xe/xe_util.h @@ -12,6 +12,38 @@ #include #include +#define USER_FENCE_VALUE 0xdeadbeefdeadbeefull +#define ONE_SEC MS_TO_NS(1000) +#define PAGE_ALIGN_UFENCE 4096 + +struct xe_buffer { + void *cpu_addr; + void *gpu_addr; + /*the user fence used to vm bind this buffer*/ + uint64_t bind_ufence; + uint64_t size; + uint32_t flag; + uint32_t vm; + uint32_t bo; + uint32_t placement; + uint32_t bind_queue; + /*only a cmd buffer has a exec queue*/ + uint32_t exec_queue; + int fd; + bool is_userptr; +}; + +typedef void (*cmdbuf_fill_func_t) (uint32_t *batch, uint64_t dst_gpu_va, uint32_t val); +void xe_create_buffer(struct xe_buffer *buffer); +void xe_create_cmdbuf(struct xe_buffer *cmd_buf, cmdbuf_fill_func_t fill_func, + uint64_t dst_va, uint32_t val, struct drm_xe_engine_class_instance *eci); +uint64_t xe_cmdbuf_exec_ufence_gpuva(struct xe_buffer *cmd_buf); +uint64_t *xe_cmdbuf_exec_ufence_cpuva(struct xe_buffer *cmd_buf); +void insert_store(uint32_t *batch, uint64_t dst_va, uint32_t val); +void xe_submit_cmd(struct xe_buffer *cmdbuf); +void xe_destroy_buffer(struct xe_buffer *buffer); +void xe_destroy_cmdbuf(struct xe_buffer *cmd_buf); + #define XE_IS_SYSMEM_MEMORY_REGION(fd, region) \ (xe_region_class(fd, region) == DRM_XE_MEM_REGION_CLASS_SYSMEM) #define XE_IS_VRAM_MEMORY_REGION(fd, region) \ -- 2.25.1