From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.6 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 03F5CC43603 for ; Tue, 10 Dec 2019 08:06:46 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id CD09220836 for ; Tue, 10 Dec 2019 08:06:45 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="nWtyrFvD" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726975AbfLJIGp (ORCPT ); Tue, 10 Dec 2019 03:06:45 -0500 Received: from mail-wr1-f68.google.com ([209.85.221.68]:32769 "EHLO mail-wr1-f68.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726847AbfLJIGo (ORCPT ); Tue, 10 Dec 2019 03:06:44 -0500 Received: by mail-wr1-f68.google.com with SMTP id b6so18919605wrq.0; Tue, 10 Dec 2019 00:06:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id; bh=TrPkwEXfKMcmBJRMNstq7uxjKx3WNx+bbydVyI6MWHE=; b=nWtyrFvDAYkYyZJFWyDb04U2iRVuCXLIWSsQVgMM5vtBaveIFSiKAZTL6II3BjWL/9 Uuhx1xzzjRAmkyflJ9d5X1fHwm6+s+DnJqvbNCWUFhjLVOYjica5dgr2OHwnQHJuneIT 9JpF05dCR+CcHLB1XhsCcYIITeIZWH2vSgx0KeUxqcOSg24KVR5nVx+ZZnFP3aLm9lkB dCdKYSznWWUsHPwyT7P6FRTyJ7sh7Ob+v7m+z0kh4s8feYBndiWNz6QvofqcfnI6LCnT LO4cZYp9ZGbyGVmxEy21FYfBEdDxSs197KtaSInF/iHLC2qPnc5hu2krrTf2Tz4w9Udk CSMA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id; bh=TrPkwEXfKMcmBJRMNstq7uxjKx3WNx+bbydVyI6MWHE=; b=lVqcy9EkBgdpcIdO7lpM3lJVN3+1UPbjnQtuYoZ16SGsy7olW92m/i5S32eSwLweJ8 bQV43n5Qp0sORwyHTIAqTNiXaBH0cJ4v1h7/sU/0AeQP/1lTgkcASg32ONSkJemrqsae +5IsfDiEjL1cDu1XE8iGkzqLXyt1xjE40/GkliumN580TPeNWIyI+VH6f+Rjrp2UuxLE EtfHLaJpsA3uYokDkc+6Ta1PX2euAAdFmKlUZPoqcxmI2FSFj/5N/aKx6IQ4XA76tHqS WvOQZifPUSGFAwZHiIr/PQ+eEhwr5OdAIL9n8jy8YwqSzFKC/z4FyPuTEEmXP2OoBeDG 9D8Q== X-Gm-Message-State: APjAAAUnNU308O9xnlKK4eX2gZzLHcEMGUxvtv+dx2wNL4NB2aMLQQwQ 7ZRsBa5hlUyb2zWc7MHQYUg= X-Google-Smtp-Source: APXvYqwvF9vb1Pg/03dTB9bQnN2IbN1gpJnIMJTJQB2WBT2IvDLxvGQ+qQaE01Fk2ySzFRrDqJNniQ== X-Received: by 2002:adf:ef92:: with SMTP id d18mr1570233wro.234.1575965202797; Tue, 10 Dec 2019 00:06:42 -0800 (PST) Received: from localhost.localdomain (x2f7fae7.dyn.telefonica.de. [2.247.250.231]) by smtp.gmail.com with ESMTPSA id a16sm2342587wrt.37.2019.12.10.00.06.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 10 Dec 2019 00:06:42 -0800 (PST) From: SeongJae Park X-Google-Original-From: SeongJae Park To: sjpark@amazon.com Cc: axboe@kernel.dk, konrad.wilk@oracle.com, linux-block@vger.kernel.org, linux-kernel@vger.kernel.org, pdurrant@amazon.com, roger.pau@citrix.com, sj38.park@gmail.com, xen-devel@lists.xenproject.org, SeongJae Park Subject: [PATCH v5 0/2] xenbus/backend: Add a memory pressure handler callback Date: Tue, 10 Dec 2019 08:06:26 +0000 Message-Id: <20191210080628.5264-1-sjpark@amazon.de> X-Mailer: git-send-email 2.17.1 Sender: linux-block-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-block@vger.kernel.org Granting pages consumes backend system memory. In systems configured with insufficient spare memory for those pages, it can cause a memory pressure situation. However, finding the optimal amount of the spare memory is challenging for large systems having dynamic resource utilization patterns. Also, such a static configuration might lack a flexibility. To mitigate such problems, this patchset adds a memory reclaim callback to 'xenbus_driver' (patch 1) and use it to mitigate the problem in 'xen-blkback' (patch 2). Base Version ------------ This patch is based on v5.4. A complete tree is also available at my public git repo: https://github.com/sjp38/linux/tree/blkback_squeezing_v5 Patch History ------------- Changes from v4 (https://lore.kernel.org/xen-devel/20191209194305.20828-1-sjpark@amazon.com/) - Remove domain id parameter from the callback (suggested by Jergen Gross) Changes from v3 (https://lore.kernel.org/xen-devel/20191209085839.21215-1-sjpark@amazon.com/) - Add general callback in xen_driver and use it (suggested by Juergen Gross) Changes from v2 (https://lore.kernel.org/linux-block/af195033-23d5-38ed-b73b-f6e2e3b34541@amazon.com) - Rename the module parameter and variables for brevity (aggressive shrinking -> squeezing) Changes from v1 (https://lore.kernel.org/xen-devel/20191204113419.2298-1-sjpark@amazon.com/) - Adjust the description to not use the term, `arbitrarily` (suggested by Paul Durrant) - Specify time unit of the duration in the parameter description, (suggested by Maximilian Heyne) - Change default aggressive shrinking duration from 1ms to 10ms - Merge two patches into one single patch SeongJae Park (2): xenbus/backend: Add memory pressure handler callback xen/blkback: Squeeze page pools if a memory pressure is detected drivers/block/xen-blkback/blkback.c | 23 +++++++++++++++-- drivers/block/xen-blkback/common.h | 1 + drivers/block/xen-blkback/xenbus.c | 3 ++- drivers/xen/xenbus/xenbus_probe_backend.c | 31 +++++++++++++++++++++++ include/xen/xenbus.h | 1 + 5 files changed, 56 insertions(+), 3 deletions(-) -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.3 required=3.0 tests=DKIM_ADSP_CUSTOM_MED, DKIM_INVALID,DKIM_SIGNED,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id EBA05C3F68F for ; Tue, 10 Dec 2019 08:06:54 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id BF534208C3 for ; Tue, 10 Dec 2019 08:06:54 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="nWtyrFvD" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org BF534208C3 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1ieaXd-0002Ph-6f; Tue, 10 Dec 2019 08:06:45 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1ieaXc-0002Pa-EX for xen-devel@lists.xenproject.org; Tue, 10 Dec 2019 08:06:44 +0000 X-Inumbo-ID: 00b75f68-1b24-11ea-a914-bc764e2007e4 Received: from mail-wr1-x442.google.com (unknown [2a00:1450:4864:20::442]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 00b75f68-1b24-11ea-a914-bc764e2007e4; Tue, 10 Dec 2019 08:06:43 +0000 (UTC) Received: by mail-wr1-x442.google.com with SMTP id c9so18888494wrw.8 for ; Tue, 10 Dec 2019 00:06:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id; bh=TrPkwEXfKMcmBJRMNstq7uxjKx3WNx+bbydVyI6MWHE=; b=nWtyrFvDAYkYyZJFWyDb04U2iRVuCXLIWSsQVgMM5vtBaveIFSiKAZTL6II3BjWL/9 Uuhx1xzzjRAmkyflJ9d5X1fHwm6+s+DnJqvbNCWUFhjLVOYjica5dgr2OHwnQHJuneIT 9JpF05dCR+CcHLB1XhsCcYIITeIZWH2vSgx0KeUxqcOSg24KVR5nVx+ZZnFP3aLm9lkB dCdKYSznWWUsHPwyT7P6FRTyJ7sh7Ob+v7m+z0kh4s8feYBndiWNz6QvofqcfnI6LCnT LO4cZYp9ZGbyGVmxEy21FYfBEdDxSs197KtaSInF/iHLC2qPnc5hu2krrTf2Tz4w9Udk CSMA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id; bh=TrPkwEXfKMcmBJRMNstq7uxjKx3WNx+bbydVyI6MWHE=; b=o24kHuNzj89KCkU8hlVmsaqerCxLOLA80yXcVXMdF9onJFIKK0RJQCBRKPdYPhClJy 5klCBUWb+s93iOAXd5lHxf54PhUPyHxD6eD2toA0bIJLfe9KjXnmUVKevtlTZASu37UN tFahXgijOrZbFNMy38FPw9WbH9AIXiIPhigdZy2apo8X5T3VvfxYShATep3WxxOeLq0t 2nCSWpCAISmHMFxtcVx61wethx1hRTLRdPt1otE96C9i9ZjuLYHJmvW6XLFN856ZHqel zuXEOAh30SQGpdtxoZqfLfWzQqI+XdrVekqa6RvYsCpvdnEhkUqHVXa5LziKscStUqFO iTnw== X-Gm-Message-State: APjAAAVWtRug8vOOXk0DwmKagqt/9uvmzm7YH9cWWbBtQWbcnXC0e2Zt WEstiOws+caOrEG/XOoiQXs= X-Google-Smtp-Source: APXvYqwvF9vb1Pg/03dTB9bQnN2IbN1gpJnIMJTJQB2WBT2IvDLxvGQ+qQaE01Fk2ySzFRrDqJNniQ== X-Received: by 2002:adf:ef92:: with SMTP id d18mr1570233wro.234.1575965202797; Tue, 10 Dec 2019 00:06:42 -0800 (PST) Received: from localhost.localdomain (x2f7fae7.dyn.telefonica.de. [2.247.250.231]) by smtp.gmail.com with ESMTPSA id a16sm2342587wrt.37.2019.12.10.00.06.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 10 Dec 2019 00:06:42 -0800 (PST) From: SeongJae Park X-Google-Original-From: SeongJae Park To: sjpark@amazon.com Date: Tue, 10 Dec 2019 08:06:26 +0000 Message-Id: <20191210080628.5264-1-sjpark@amazon.de> X-Mailer: git-send-email 2.17.1 Subject: [Xen-devel] [PATCH v5 0/2] xenbus/backend: Add a memory pressure handler callback X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: axboe@kernel.dk, sj38.park@gmail.com, konrad.wilk@oracle.com, pdurrant@amazon.com, SeongJae Park , linux-kernel@vger.kernel.org, linux-block@vger.kernel.org, xen-devel@lists.xenproject.org, roger.pau@citrix.com MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" R3JhbnRpbmcgcGFnZXMgY29uc3VtZXMgYmFja2VuZCBzeXN0ZW0gbWVtb3J5LiAgSW4gc3lzdGVt cyBjb25maWd1cmVkCndpdGggaW5zdWZmaWNpZW50IHNwYXJlIG1lbW9yeSBmb3IgdGhvc2UgcGFn ZXMsIGl0IGNhbiBjYXVzZSBhIG1lbW9yeQpwcmVzc3VyZSBzaXR1YXRpb24uICBIb3dldmVyLCBm aW5kaW5nIHRoZSBvcHRpbWFsIGFtb3VudCBvZiB0aGUgc3BhcmUKbWVtb3J5IGlzIGNoYWxsZW5n aW5nIGZvciBsYXJnZSBzeXN0ZW1zIGhhdmluZyBkeW5hbWljIHJlc291cmNlCnV0aWxpemF0aW9u IHBhdHRlcm5zLiAgQWxzbywgc3VjaCBhIHN0YXRpYyBjb25maWd1cmF0aW9uIG1pZ2h0IGxhY2sg YQpmbGV4aWJpbGl0eS4KClRvIG1pdGlnYXRlIHN1Y2ggcHJvYmxlbXMsIHRoaXMgcGF0Y2hzZXQg YWRkcyBhIG1lbW9yeSByZWNsYWltIGNhbGxiYWNrCnRvICd4ZW5idXNfZHJpdmVyJyAocGF0Y2gg MSkgYW5kIHVzZSBpdCB0byBtaXRpZ2F0ZSB0aGUgcHJvYmxlbSBpbgoneGVuLWJsa2JhY2snIChw YXRjaCAyKS4KCkJhc2UgVmVyc2lvbgotLS0tLS0tLS0tLS0KClRoaXMgcGF0Y2ggaXMgYmFzZWQg b24gdjUuNC4gIEEgY29tcGxldGUgdHJlZSBpcyBhbHNvIGF2YWlsYWJsZSBhdCBteQpwdWJsaWMg Z2l0IHJlcG86Cmh0dHBzOi8vZ2l0aHViLmNvbS9zanAzOC9saW51eC90cmVlL2Jsa2JhY2tfc3F1 ZWV6aW5nX3Y1CgoKUGF0Y2ggSGlzdG9yeQotLS0tLS0tLS0tLS0tCgpDaGFuZ2VzIGZyb20gdjQK KGh0dHBzOi8vbG9yZS5rZXJuZWwub3JnL3hlbi1kZXZlbC8yMDE5MTIwOTE5NDMwNS4yMDgyOC0x LXNqcGFya0BhbWF6b24uY29tLykKIC0gUmVtb3ZlIGRvbWFpbiBpZCBwYXJhbWV0ZXIgZnJvbSB0 aGUgY2FsbGJhY2sgKHN1Z2dlc3RlZCBieSBKZXJnZW4gR3Jvc3MpCgpDaGFuZ2VzIGZyb20gdjMK KGh0dHBzOi8vbG9yZS5rZXJuZWwub3JnL3hlbi1kZXZlbC8yMDE5MTIwOTA4NTgzOS4yMTIxNS0x LXNqcGFya0BhbWF6b24uY29tLykKIC0gQWRkIGdlbmVyYWwgY2FsbGJhY2sgaW4geGVuX2RyaXZl ciBhbmQgdXNlIGl0IChzdWdnZXN0ZWQgYnkgSnVlcmdlbgogICBHcm9zcykKCkNoYW5nZXMgZnJv bSB2MgooaHR0cHM6Ly9sb3JlLmtlcm5lbC5vcmcvbGludXgtYmxvY2svYWYxOTUwMzMtMjNkNS0z OGVkLWI3M2ItZjZlMmUzYjM0NTQxQGFtYXpvbi5jb20pCiAtIFJlbmFtZSB0aGUgbW9kdWxlIHBh cmFtZXRlciBhbmQgdmFyaWFibGVzIGZvciBicmV2aXR5IChhZ2dyZXNzaXZlCiAgIHNocmlua2lu ZyAtPiBzcXVlZXppbmcpCgpDaGFuZ2VzIGZyb20gdjEKKGh0dHBzOi8vbG9yZS5rZXJuZWwub3Jn L3hlbi1kZXZlbC8yMDE5MTIwNDExMzQxOS4yMjk4LTEtc2pwYXJrQGFtYXpvbi5jb20vKQogLSBB ZGp1c3QgdGhlIGRlc2NyaXB0aW9uIHRvIG5vdCB1c2UgdGhlIHRlcm0sIGBhcmJpdHJhcmlseWAg KHN1Z2dlc3RlZAogICBieSBQYXVsIER1cnJhbnQpCiAtIFNwZWNpZnkgdGltZSB1bml0IG9mIHRo ZSBkdXJhdGlvbiBpbiB0aGUgcGFyYW1ldGVyIGRlc2NyaXB0aW9uLAogICAoc3VnZ2VzdGVkIGJ5 IE1heGltaWxpYW4gSGV5bmUpCiAtIENoYW5nZSBkZWZhdWx0IGFnZ3Jlc3NpdmUgc2hyaW5raW5n IGR1cmF0aW9uIGZyb20gMW1zIHRvIDEwbXMKIC0gTWVyZ2UgdHdvIHBhdGNoZXMgaW50byBvbmUg c2luZ2xlIHBhdGNoCgpTZW9uZ0phZSBQYXJrICgyKToKICB4ZW5idXMvYmFja2VuZDogQWRkIG1l bW9yeSBwcmVzc3VyZSBoYW5kbGVyIGNhbGxiYWNrCiAgeGVuL2Jsa2JhY2s6IFNxdWVlemUgcGFn ZSBwb29scyBpZiBhIG1lbW9yeSBwcmVzc3VyZSBpcyBkZXRlY3RlZAoKIGRyaXZlcnMvYmxvY2sv eGVuLWJsa2JhY2svYmxrYmFjay5jICAgICAgIHwgMjMgKysrKysrKysrKysrKysrLS0KIGRyaXZl cnMvYmxvY2sveGVuLWJsa2JhY2svY29tbW9uLmggICAgICAgIHwgIDEgKwogZHJpdmVycy9ibG9j ay94ZW4tYmxrYmFjay94ZW5idXMuYyAgICAgICAgfCAgMyArKy0KIGRyaXZlcnMveGVuL3hlbmJ1 cy94ZW5idXNfcHJvYmVfYmFja2VuZC5jIHwgMzEgKysrKysrKysrKysrKysrKysrKysrKysKIGlu Y2x1ZGUveGVuL3hlbmJ1cy5oICAgICAgICAgICAgICAgICAgICAgIHwgIDEgKwogNSBmaWxlcyBj aGFuZ2VkLCA1NiBpbnNlcnRpb25zKCspLCAzIGRlbGV0aW9ucygtKQoKLS0gCjIuMTcuMQoKCl9f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fClhlbi1kZXZlbCBt YWlsaW5nIGxpc3QKWGVuLWRldmVsQGxpc3RzLnhlbnByb2plY3Qub3JnCmh0dHBzOi8vbGlzdHMu eGVucHJvamVjdC5vcmcvbWFpbG1hbi9saXN0aW5mby94ZW4tZGV2ZWw=