From: siddhartha@kenip.in
To: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org, mgorman@suse.de
Subject: Re: [PATCH] mm: limit THP alignment – performance gain observed in AI inference workloads
Date: Fri, 27 Jun 2025 16:15:36 +0530 [thread overview]
Message-ID: <d391b2ddcb4e69251c3044d7e2f36f87@kenip.in> (raw)
In-Reply-To: <28338f055b3c9afa8b69ff6f05ea20ed@kenip.in>
> Hi all,
>
> I wanted to share validation data from a Hugging Face-based AI
> inferencing workload,
> which was significantly impacted by the THP alignment logic introduced
> in commit efa7df3e3bb5.
>
> Using transformer models with dynamic input lengths on Intel Xeon
> (Cooper Lake),
> we observed up to a 3200% throughput improvement after applying the
> patch from Oct 2024:
>
> mm: limit THP alignment of anonymous mappings to PMD-aligned sizes
>
> Metrics:
> - Model: BERT-base
> - Inference engine: Transformers + ONNX Runtime
> - Kernel: 6.6 vs patched 6.6.8
> - Batch size: 8-32, input length: 64-512 tokens
> - Metric: inference throughput (samples/sec)
>
> Thanks for the fix -- this change had real impact on a
> production-relevant workload.
>
> Best Regards,
> Siddhartha Sharma
> ISV @ Kenip
> Solution Link:
> https://www.intel.com/content/www/us/en/partner/showcase/offering/a5bHo00000045YUIAY/deadlock-clearance.html
parent reply other threads:[~2025-06-27 10:45 UTC|newest]
Thread overview: expand[flat|nested] mbox.gz Atom feed
[parent not found: <28338f055b3c9afa8b69ff6f05ea20ed@kenip.in>]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=d391b2ddcb4e69251c3044d7e2f36f87@kenip.in \
--to=siddhartha@kenip.in \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mgorman@suse.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox