From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-14.8 required=3.0 tests=BAYES_00, DATE_IN_FUTURE_06_12,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 61B59C433E6 for ; Wed, 23 Dec 2020 07:01:36 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 1F0F6207F7 for ; Wed, 23 Dec 2020 07:01:36 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727030AbgLWHBW (ORCPT ); Wed, 23 Dec 2020 02:01:22 -0500 Received: from mga18.intel.com ([134.134.136.126]:58038 "EHLO mga18.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727160AbgLWHBW (ORCPT ); Wed, 23 Dec 2020 02:01:22 -0500 IronPort-SDR: RzE17I2WsTaUWR+5zKLNi1seS7TI5uKIvTr3o2Re95jvwYXAhPbYZWlfGbxsKqrAxoXR8gjM2s nFKR0/M2NFQw== X-IronPort-AV: E=McAfee;i="6000,8403,9843"; a="163695100" X-IronPort-AV: E=Sophos;i="5.78,441,1599548400"; d="scan'208";a="163695100" Received: from fmsmga008.fm.intel.com ([10.253.24.58]) by orsmga106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 22 Dec 2020 23:00:16 -0800 IronPort-SDR: ymICdjjlH8ItuEy0E3aLD1AQF6EY8oc3N3rhOXZAg0tq6BLYH14eh3oCi0T3e/gPZJ/VxKnFxV ZgbqTdcK+3TA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.78,441,1599548400"; d="scan'208";a="344924287" Received: from ceph.sh.intel.com ([10.239.241.176]) by fmsmga008.fm.intel.com with ESMTP; 22 Dec 2020 23:00:15 -0800 From: Qiaowei Ren To: Coly Li Cc: Qiaowei Ren , Jianpeng Ma , linux-bcache@vger.kernel.org Subject: [PATCH 7/8] bcache: persist owner info when alloc/free pages. Date: Wed, 23 Dec 2020 09:41:35 -0500 Message-Id: <20201223144136.24966-8-qiaowei.ren@intel.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201223144136.24966-1-qiaowei.ren@intel.com> References: <20201223144136.24966-1-qiaowei.ren@intel.com> Precedence: bulk List-ID: X-Mailing-List: linux-bcache@vger.kernel.org This patch implement persist owner info on nvdimm device when alloc/free pages. Signed-off-by: Jianpeng Ma Signed-off-by: Qiaowei Ren --- drivers/md/bcache/nvm-pages.c | 86 +++++++++++++++++++++++++++++++++++ 1 file changed, 86 insertions(+) diff --git a/drivers/md/bcache/nvm-pages.c b/drivers/md/bcache/nvm-pages.c index e8765b0b3398..ba1ff0582b20 100644 --- a/drivers/md/bcache/nvm-pages.c +++ b/drivers/md/bcache/nvm-pages.c @@ -197,6 +197,17 @@ static struct nvm_namespace *find_nvm_by_addr(void *addr, int order) return NULL; } +static void init_pgalloc_recs(struct nvm_pgalloc_recs *recs, const char *owner_uuid) +{ + memset(recs, 0, sizeof(struct nvm_pgalloc_recs)); + memcpy(recs->owner_uuid, owner_uuid, 16); +} + +static pgoff_t vaddr_to_nvm_pgoff(struct nvm_namespace *ns, void *kaddr) +{ + return (kaddr - ns->kaddr - ns->pages_offset) / PAGE_SIZE; +} + static int remove_extent(struct nvm_alloced_recs *alloced_recs, void *addr, int order) { struct list_head *list = alloced_recs->extent_head.next; @@ -275,6 +286,77 @@ static void __free_space(struct nvm_namespace *ns, void *addr, int order) ns->free += add_pages; } +#define RECS_LEN (sizeof(struct nvm_pgalloc_recs)) + +static void write_owner_info(void) +{ + struct owner_list *owner_list; + struct nvm_pages_owner_head *owner_head; + struct nvm_pgalloc_recs *recs; + struct extent *extent; + struct nvm_namespace *ns = only_set->nss[0]; + struct owner_list_head *owner_list_head; + bool update_owner = false; + u64 recs_pos = NVM_PAGES_SYS_RECS_HEAD_OFFSET; + struct list_head *list; + int i, j; + + owner_list_head = kzalloc(sizeof(struct owner_list_head), GFP_KERNEL); + recs = kmalloc(RECS_LEN, GFP_KERNEL); + + // in-memory owner maybe not contain alloced-pages. + for (i = 0; i < only_set->owner_list_size; i++) { + owner_head = &owner_list_head->heads[owner_list_head->size]; + owner_list = only_set->owner_lists[i]; + + for (j = 0; j < only_set->total_namespaces_nr; j++) { + struct nvm_alloced_recs *extents = owner_list->alloced_recs[j]; + + if (!extents || !extents->size) + continue; + + init_pgalloc_recs(recs, owner_list->owner_uuid); + + BUG_ON(recs_pos >= NVM_PAGES_OFFSET); + owner_head->recs[j] = (struct nvm_pgalloc_recs *)recs_pos; + + for (list = extents->extent_head.next; + list != &extents->extent_head; + list = list->next) { + extent = container_of(list, struct extent, list); + + if (recs->size == MAX_RECORD) { + BUG_ON(recs_pos >= NVM_PAGES_OFFSET); + recs->next = + (struct nvm_pgalloc_recs *)(recs_pos + RECS_LEN); + memcpy_flushcache(ns->kaddr + recs_pos, recs, RECS_LEN); + init_pgalloc_recs(recs, owner_list->owner_uuid); + recs_pos += RECS_LEN; + } + + recs->recs[recs->size].pgoff = + vaddr_to_nvm_pgoff(only_set->nss[j], extent->kaddr); + recs->recs[recs->size].nr = extent->nr; + recs->size++; + } + + update_owner = true; + memcpy_flushcache(ns->kaddr + recs_pos, recs, RECS_LEN); + recs_pos += sizeof(struct nvm_pgalloc_recs); + } + + if (update_owner) { + memcpy(owner_head->uuid, owner_list->owner_uuid, 16); + owner_list_head->size++; + update_owner = false; + } + } + + memcpy_flushcache(ns->kaddr + NVM_PAGES_OWNER_LIST_HEAD_OFFSET, + (void *)owner_list_head, sizeof(struct owner_list_head)); + kfree(owner_list_head); +} + void nvm_free_pages(void *addr, int order, const char *owner_uuid) { struct nvm_namespace *ns; @@ -309,6 +391,7 @@ void nvm_free_pages(void *addr, int order, const char *owner_uuid) } __free_space(ns, addr, order); + write_owner_info(); unlock: mutex_unlock(&only_set->lock); @@ -368,7 +451,10 @@ void *nvm_alloc_pages(int order, const char *owner_uuid) } } + if (kaddr) + write_owner_info(); mutex_unlock(&only_set->lock); + return kaddr; } EXPORT_SYMBOL_GPL(nvm_alloc_pages); -- 2.17.1