From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7B8342E62C8 for ; Thu, 4 Sep 2025 09:13:23 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=198.137.202.133 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1756977205; cv=none; b=BOFc+4c6gY18EqGlQk4QMc0S2OC1kyUPabCfj1PgLM4Vlx3voGwVYWYeyu5PpA6B1fcFtOjeoATmiMvPYt4mp3ZN3vCAQFXRAQkWL1u2l1/ZXWyH6b2/aSdcUOE7qDLOG3BRPhfalaaVemyysqAnhtMmOvti3unkbDTDJ6VQa64= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1756977205; c=relaxed/simple; bh=g8a92xOHzpURUHbzWHQRygNcHS1E3preYKapde7TVx8=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=S8oPT50n28Xds95kkWgeok05oanagobvDYLvS5Fn8cconXnV2OErhXytKnfyZrVh23nH/pBAhn3Q1rX51jQWZLrsuN+4RJySLiJS3ZQdoxNlfc1IJxnRi3Wpw8kMAuS7SXgXM+BcOIQLKhU9z0bSe7gZXJuvpKWgW3ulUX9YM/E= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=kernel.org; spf=none smtp.mailfrom=infradead.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b=hzUpZPqu; arc=none smtp.client-ip=198.137.202.133 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=kernel.org Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=infradead.org Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="hzUpZPqu" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Sender:Content-Transfer-Encoding: MIME-Version:References:In-Reply-To:Message-ID:Date:Subject:Cc:To:From: Reply-To:Content-Type:Content-ID:Content-Description; bh=dWyZn/DmNqDX/bBgXy6EliRU/MDTntei4HZtvZSmqNU=; b=hzUpZPqueXAcbsbrzKWKHlluED KpWg7pCHiMVU7Kn2RDGgQCONIFXtVNJSAG9alVwmwoI8y/YAGD2/C3nbSp5Q+0EFYRo/sZhFNBWi5 HrZi6LanD8B+kszSQ9Zfn3RiXDyUJLNz/3dlxTMiaYLPOXmcR5M6/e3L1EQLCOkZas/AK9q5BB2nL o4Yd4/+b2QulS479rcfDgXb/pssfKGFpKxkXRPwBs6tgf3UclAoM8hWt5JKO3+CMB0Oly2IA+HwVT pS/2rXrTEQREOY6vJ/QhGGaV5eFL5crXFW441dyUjxLjOUIE0IY3rD3b9NGqQo22RnQoqFcQsgvBa mMqwf/Gg==; Received: from mcgrof by bombadil.infradead.org with local (Exim 4.98.2 #2 (Red Hat Linux)) id 1uu61z-0000000AU8t-01gO; Thu, 04 Sep 2025 09:13:23 +0000 From: Luis Chamberlain To: Chuck Lever , Daniel Gomez , kdevops@lists.linux.dev Cc: Luis Chamberlain Subject: [PATCH 4/5] ai milvus: add monitoring support Date: Thu, 4 Sep 2025 02:13:20 -0700 Message-ID: <20250904091322.2499058-5-mcgrof@kernel.org> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250904091322.2499058-1-mcgrof@kernel.org> References: <20250904091322.2499058-1-mcgrof@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Sender: Luis Chamberlain Add monitoring framework integration to the AI Milvus workflow to track performance during vector database benchmarks. Generated-by: Claude AI Signed-off-by: Luis Chamberlain --- playbooks/ai_benchmark.yml | 14 ++++++++++++++ playbooks/roles/milvus/tasks/install_docker.yml | 2 ++ .../roles/monitoring/tasks/monitor_collect.yml | 2 ++ workflows/ai/Makefile | 5 +++++ 4 files changed, 23 insertions(+) diff --git a/playbooks/ai_benchmark.yml b/playbooks/ai_benchmark.yml index 85fc117c8ba7..7e681328e2bc 100644 --- a/playbooks/ai_benchmark.yml +++ b/playbooks/ai_benchmark.yml @@ -3,6 +3,20 @@ hosts: ai vars: ai_vector_db_milvus_benchmark_enable: true + tasks: + # Start monitoring services before running benchmarks + - ansible.builtin.import_tasks: roles/monitoring/tasks/monitor_run.yml + when: + - enable_monitoring|default(false)|bool + tags: ["monitoring", "monitor_run"] + roles: - role: milvus tags: ['ai', 'vector_db', 'milvus', 'benchmark'] + + post_tasks: + # Collect monitoring data after benchmarks complete + - ansible.builtin.import_tasks: roles/monitoring/tasks/monitor_collect.yml + when: + - enable_monitoring|default(false)|bool + tags: ["monitoring", "monitor_collect"] diff --git a/playbooks/roles/milvus/tasks/install_docker.yml b/playbooks/roles/milvus/tasks/install_docker.yml index e1e1d911aee0..8c3a80430cd7 100644 --- a/playbooks/roles/milvus/tasks/install_docker.yml +++ b/playbooks/roles/milvus/tasks/install_docker.yml @@ -14,6 +14,7 @@ - python3-pip - python3-setuptools - python3-packaging + - python3-bpfcc state: present become: true when: @@ -35,6 +36,7 @@ - docker-compose - python3-pip - python3-setuptools + - python3-bcc state: present become: true when: diff --git a/playbooks/roles/monitoring/tasks/monitor_collect.yml b/playbooks/roles/monitoring/tasks/monitor_collect.yml index 9662f827301f..83193ed459b6 100644 --- a/playbooks/roles/monitoring/tasks/monitor_collect.yml +++ b/playbooks/roles/monitoring/tasks/monitor_collect.yml @@ -119,6 +119,8 @@ {{ topdir_path }}/workflows/mmtests/results/monitoring {%- elif kdevops_workflow_enable_sysbench|default(false)|bool -%} {{ topdir_path }}/workflows/sysbench/results/monitoring + {%- elif kdevops_workflow_enable_ai|default(false)|bool -%} + {{ topdir_path }}/workflows/ai/results/monitoring {%- else -%} {{ topdir_path }}/results/monitoring {%- endif -%} diff --git a/workflows/ai/Makefile b/workflows/ai/Makefile index 7e9b8af236b7..2ffa64c727fa 100644 --- a/workflows/ai/Makefile +++ b/workflows/ai/Makefile @@ -101,6 +101,11 @@ ai-results-baseline: ai-results-dev: $(Q)$(MAKE) ai-results HOSTS="dev" +monitor-results: $(KDEVOPS_EXTRA_VARS) + $(Q)ansible-playbook $(ANSIBLE_VERBOSE) \ + playbooks/monitor-results.yml \ + --extra-vars=@./extra_vars.yaml + ai-setup: $(Q)ansible-playbook $(ANSIBLE_VERBOSE) \ -i hosts \ -- 2.45.2