From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jason Gunthorpe Subject: Re: [PATCH v3 hmm 04/12] mm/hmm: Simplify hmm_get_or_create and make it reliable Date: Tue, 18 Jun 2019 15:55:55 -0300 Message-ID: <20190618185555.GO6961@ziepe.ca> References: <20190614004450.20252-1-jgg@ziepe.ca> <20190614004450.20252-5-jgg@ziepe.ca> <20190615141211.GD17724@infradead.org> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: Content-Disposition: inline In-Reply-To: <20190615141211.GD17724@infradead.org> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" To: Christoph Hellwig Cc: Andrea Arcangeli , Philip Yang , Ralph Campbell , linux-rdma@vger.kernel.org, John Hubbard , Felix.Kuehling@amd.com, dri-devel@lists.freedesktop.org, linux-mm@kvack.org, Jerome Glisse , amd-gfx@lists.freedesktop.org, Ira Weiny , Ben Skeggs List-Id: amd-gfx.lists.freedesktop.org T24gU2F0LCBKdW4gMTUsIDIwMTkgYXQgMDc6MTI6MTFBTSAtMDcwMCwgQ2hyaXN0b3BoIEhlbGx3 aWcgd3JvdGU6Cj4gPiArCXNwaW5fbG9jaygmbW0tPnBhZ2VfdGFibGVfbG9jayk7Cj4gPiArCWlm IChtbS0+aG1tKSB7Cj4gPiArCQlpZiAoa3JlZl9nZXRfdW5sZXNzX3plcm8oJm1tLT5obW0tPmty ZWYpKSB7Cj4gPiArCQkJc3Bpbl91bmxvY2soJm1tLT5wYWdlX3RhYmxlX2xvY2spOwo+ID4gKwkJ CXJldHVybiBtbS0+aG1tOwo+ID4gKwkJfQo+ID4gKwl9Cj4gPiArCXNwaW5fdW5sb2NrKCZtbS0+ cGFnZV90YWJsZV9sb2NrKTsKPiAKPiBUaGlzIGNvdWxkIGJlY29tZToKPiAKPiAJc3Bpbl9sb2Nr KCZtbS0+cGFnZV90YWJsZV9sb2NrKTsKPiAJaG1tID0gbW0tPmhtbQo+IAlpZiAoaG1tICYmIGty ZWZfZ2V0X3VubGVzc196ZXJvKCZobW0tPmtyZWYpKQo+IAkJZ290byBvdXRfdW5sb2NrOwo+IAlz cGluX3VubG9jaygmbW0tPnBhZ2VfdGFibGVfbG9jayk7Cj4gCj4gYXMgdGhlIGxhc3QgdHdvIGxp bmVzIG9mIHRoZSBmdW5jdGlvbiBhbHJlYWR5IGRyb3AgdGhlIHBhZ2VfdGFibGVfbG9jawo+IGFu ZCB0aGVuIHJldHVybiBobW0uICBPciBkcm9wIHRoZSAiaG1tID0gbW0tPmhtbSIgYXNpZ25tZW50 IGFib3ZlIGFuZAo+IHJldHVybiBtbS0+aG1tIGFzIHRoYXQgc2hvdWxkIGJlIGFsd2F5cyBpZGVu dGljYWwgdG8gaG1tIGF0IHRoZSBlbmQKPiB0byBzYXZlIGFub3RoZXIgbGluZS4KPiAKPiA+ICsJ LyoKPiA+ICsJICogVGhlIG1tLT5obW0gcG9pbnRlciBpcyBrZXB0IHZhbGlkIHdoaWxlIG5vdGlm aWVyIG9wcyBjYW4gYmUgcnVubmluZwo+ID4gKwkgKiBzbyB0aGV5IGRvbid0IGhhdmUgdG8gZGVh bCB3aXRoIGEgTlVMTCBtbS0+aG1tIHZhbHVlCj4gPiArCSAqLwo+IAo+IFRoZSBjb21tZW50IGNv bmZ1c2VzIG1lLiAgSG93IGRvZXMgdGhlIHBhZ2VfdGFibGVfbG9jayByZWxhdGUgdG8KPiBwb3Nz aWJseSBydW5uaW5nIG5vdGlmaWVycywgYXMgSSBjYW4ndCBmaW5kIHRoYXQgd2UgdGFrZQo+IHBh Z2VfdGFibGVfbG9jaz8gIE9yIGlzIGl0IGp1c3QgYWJvdXQgdGhlIGZhY3QgdGhhdCB3ZSBvbmx5 IGNsZWFyCj4gbW0tPmhtbSBpbiB0aGUgZnJlZSBjYWxsYmFjaywgYW5kIG5vdCBpbiBobW1fZnJl ZT8KClJldmlzZWQgd2l0aDoKCkZyb20gYmRjMDJhMWQ1MDJkYjA4NDU3ODIzZTZiMmI5ODM4NjFh MzU3NGE3NiBNb24gU2VwIDE3IDAwOjAwOjAwIDIwMDEKRnJvbTogSmFzb24gR3VudGhvcnBlIDxq Z2dAbWVsbGFub3guY29tPgpEYXRlOiBUaHUsIDIzIE1heSAyMDE5IDEwOjI0OjEzIC0wMzAwClN1 YmplY3Q6IFtQQVRDSF0gbW0vaG1tOiBTaW1wbGlmeSBobW1fZ2V0X29yX2NyZWF0ZSBhbmQgbWFr ZSBpdCByZWxpYWJsZQoKQXMgY29kZWQgdGhpcyBmdW5jdGlvbiBjYW4gZmFsc2UtZmFpbCBpbiB2 YXJpb3VzIHJhY3kgc2l0dWF0aW9ucy4gTWFrZSBpdApyZWxpYWJsZSBhbmQgc2ltcGxlciBieSBy dW5uaW5nIHVuZGVyIHRoZSB3cml0ZSBzaWRlIG9mIHRoZSBtbWFwX3NlbSBhbmQKYXZvaWRpbmcg dGhlIGZhbHNlLWZhaWxpbmcgY29tcGFyZS9leGNoYW5nZSBwYXR0ZXJuLiBEdWUgdG8gdGhlIG1t YXBfc2VtCnRoaXMgbm8gbG9uZ2VyIGhhcyB0byBhdm9pZCByYWNpbmcgd2l0aCBhIDJuZCBwYXJh bGxlbApobW1fZ2V0X29yX2NyZWF0ZSgpLgoKVW5mb3J0dW5hdGVseSB0aGlzIHN0aWxsIGhhcyB0 byB1c2UgdGhlIHBhZ2VfdGFibGVfbG9jayBhcyB0aGUKbm9uLXNsZWVwaW5nIGxvY2sgcHJvdGVj dGluZyBtbS0+aG1tLCBzaW5jZSB0aGUgY29udGV4dHMgd2hlcmUgd2UgZnJlZSB0aGUKaG1tIGFy ZSBpbmNvbXBhdGlibGUgd2l0aCBtbWFwX3NlbS4KClNpZ25lZC1vZmYtYnk6IEphc29uIEd1bnRo b3JwZSA8amdnQG1lbGxhbm94LmNvbT4KUmV2aWV3ZWQtYnk6IEpvaG4gSHViYmFyZCA8amh1YmJh cmRAbnZpZGlhLmNvbT4KUmV2aWV3ZWQtYnk6IFJhbHBoIENhbXBiZWxsIDxyY2FtcGJlbGxAbnZp ZGlhLmNvbT4KUmV2aWV3ZWQtYnk6IElyYSBXZWlueSA8aXJhLndlaW55QGludGVsLmNvbT4KVGVz dGVkLWJ5OiBQaGlsaXAgWWFuZyA8UGhpbGlwLllhbmdAYW1kLmNvbT4KLS0tCnYyOgotIEZpeCBl cnJvciB1bndpbmQgb2YgbW1ncmFiIChKZXJvbWUpCi0gVXNlIGhtbSBsb2NhbCBpbnN0ZWFkIG9m IDJuZCBjb250YWluZXJfb2YgKEplcm9tZSkKdjM6Ci0gQ2FuJ3QgdXNlIG1tYXBfc2VtIGluIHRo ZSBTUkNVIGNhbGxiYWNrLCBrZWVwIHVzaW5nIHRoZQogIHBhZ2VfdGFibGVfbG9jayAoUGhpbGlw KQp2NDoKLSBQdXQgdGhlIG1tLT5obW0gPSBOVUxMIGluIHRoZSBrcmVmIHJlbGVhc2UsIHJlZHVj ZSBMT0MKICBpbiBobW1fZ2V0X29yX2NyZWF0ZSgpIChDaHJpc3RvcGgpCi0tLQogbW0vaG1tLmMg fCA3NyArKysrKysrKysrKysrKysrKysrKysrLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLQogMSBmaWxlIGNoYW5nZWQsIDMwIGluc2VydGlvbnMoKyksIDQ3IGRlbGV0aW9ucygtKQoK ZGlmZiAtLWdpdCBhL21tL2htbS5jIGIvbW0vaG1tLmMKaW5kZXggMDgwYjE3YTJlODdlMmQuLjA0 MjNmNGNhM2E3ZTA5IDEwMDY0NAotLS0gYS9tbS9obW0uYworKysgYi9tbS9obW0uYwpAQCAtMzEs MTYgKzMxLDYgQEAKICNpZiBJU19FTkFCTEVEKENPTkZJR19ITU1fTUlSUk9SKQogc3RhdGljIGNv bnN0IHN0cnVjdCBtbXVfbm90aWZpZXJfb3BzIGhtbV9tbXVfbm90aWZpZXJfb3BzOwogCi1zdGF0 aWMgaW5saW5lIHN0cnVjdCBobW0gKm1tX2dldF9obW0oc3RydWN0IG1tX3N0cnVjdCAqbW0pCi17 Ci0Jc3RydWN0IGhtbSAqaG1tID0gUkVBRF9PTkNFKG1tLT5obW0pOwotCi0JaWYgKGhtbSAmJiBr cmVmX2dldF91bmxlc3NfemVybygmaG1tLT5rcmVmKSkKLQkJcmV0dXJuIGhtbTsKLQotCXJldHVy biBOVUxMOwotfQotCiAvKioKICAqIGhtbV9nZXRfb3JfY3JlYXRlIC0gcmVnaXN0ZXIgSE1NIGFn YWluc3QgYW4gbW0gKEhNTSBpbnRlcm5hbCkKICAqCkBAIC01NSwxMSArNDUsMTYgQEAgc3RhdGlj IGlubGluZSBzdHJ1Y3QgaG1tICptbV9nZXRfaG1tKHN0cnVjdCBtbV9zdHJ1Y3QgKm1tKQogICov CiBzdGF0aWMgc3RydWN0IGhtbSAqaG1tX2dldF9vcl9jcmVhdGUoc3RydWN0IG1tX3N0cnVjdCAq bW0pCiB7Ci0Jc3RydWN0IGhtbSAqaG1tID0gbW1fZ2V0X2htbShtbSk7Ci0JYm9vbCBjbGVhbnVw ID0gZmFsc2U7CisJc3RydWN0IGhtbSAqaG1tOworCisJbG9ja2RlcF9hc3NlcnRfaGVsZF9leGNs dXNpdmUoJm1tLT5tbWFwX3NlbSk7CiAKLQlpZiAoaG1tKQotCQlyZXR1cm4gaG1tOworCS8qIEFi dXNlIHRoZSBwYWdlX3RhYmxlX2xvY2sgdG8gYWxzbyBwcm90ZWN0IG1tLT5obW0uICovCisJc3Bp bl9sb2NrKCZtbS0+cGFnZV90YWJsZV9sb2NrKTsKKwlobW0gPSBtbS0+aG1tOworCWlmIChtbS0+ aG1tICYmIGtyZWZfZ2V0X3VubGVzc196ZXJvKCZtbS0+aG1tLT5rcmVmKSkKKwkJZ290byBvdXRf dW5sb2NrOworCXNwaW5fdW5sb2NrKCZtbS0+cGFnZV90YWJsZV9sb2NrKTsKIAogCWhtbSA9IGtt YWxsb2Moc2l6ZW9mKCpobW0pLCBHRlBfS0VSTkVMKTsKIAlpZiAoIWhtbSkKQEAgLTc0LDU3ICs2 OSw0NSBAQCBzdGF0aWMgc3RydWN0IGhtbSAqaG1tX2dldF9vcl9jcmVhdGUoc3RydWN0IG1tX3N0 cnVjdCAqbW0pCiAJaG1tLT5ub3RpZmllcnMgPSAwOwogCWhtbS0+ZGVhZCA9IGZhbHNlOwogCWht bS0+bW0gPSBtbTsKLQltbWdyYWIoaG1tLT5tbSk7CiAKLQlzcGluX2xvY2soJm1tLT5wYWdlX3Rh YmxlX2xvY2spOwotCWlmICghbW0tPmhtbSkKLQkJbW0tPmhtbSA9IGhtbTsKLQllbHNlCi0JCWNs ZWFudXAgPSB0cnVlOwotCXNwaW5fdW5sb2NrKCZtbS0+cGFnZV90YWJsZV9sb2NrKTsKKwlobW0t Pm1tdV9ub3RpZmllci5vcHMgPSAmaG1tX21tdV9ub3RpZmllcl9vcHM7CisJaWYgKF9fbW11X25v dGlmaWVyX3JlZ2lzdGVyKCZobW0tPm1tdV9ub3RpZmllciwgbW0pKSB7CisJCWtmcmVlKGhtbSk7 CisJCXJldHVybiBOVUxMOworCX0KIAotCWlmIChjbGVhbnVwKQotCQlnb3RvIGVycm9yOworCW1t Z3JhYihobW0tPm1tKTsKIAogCS8qCi0JICogV2Ugc2hvdWxkIG9ubHkgZ2V0IGhlcmUgaWYgaG9s ZCB0aGUgbW1hcF9zZW0gaW4gd3JpdGUgbW9kZSBpZSBvbgotCSAqIHJlZ2lzdHJhdGlvbiBvZiBm aXJzdCBtaXJyb3IgdGhyb3VnaCBobW1fbWlycm9yX3JlZ2lzdGVyKCkKKwkgKiBXZSBob2xkIHRo ZSBleGNsdXNpdmUgbW1hcF9zZW0gaGVyZSBzbyB3ZSBrbm93IHRoYXQgbW0tPmhtbSBpcworCSAq IHN0aWxsIE5VTEwgb3IgMCBrcmVmLCBhbmQgaXMgc2FmZSB0byB1cGRhdGUuCiAJICovCi0JaG1t LT5tbXVfbm90aWZpZXIub3BzID0gJmhtbV9tbXVfbm90aWZpZXJfb3BzOwotCWlmIChfX21tdV9u b3RpZmllcl9yZWdpc3RlcigmaG1tLT5tbXVfbm90aWZpZXIsIG1tKSkKLQkJZ290byBlcnJvcl9t bTsKLQotCXJldHVybiBobW07Ci0KLWVycm9yX21tOgogCXNwaW5fbG9jaygmbW0tPnBhZ2VfdGFi bGVfbG9jayk7Ci0JaWYgKG1tLT5obW0gPT0gaG1tKQotCQltbS0+aG1tID0gTlVMTDsKKwltbS0+ aG1tID0gaG1tOworCitvdXRfdW5sb2NrOgogCXNwaW5fdW5sb2NrKCZtbS0+cGFnZV90YWJsZV9s b2NrKTsKLWVycm9yOgotCW1tZHJvcChobW0tPm1tKTsKLQlrZnJlZShobW0pOwotCXJldHVybiBO VUxMOworCXJldHVybiBobW07CiB9CiAKIHN0YXRpYyB2b2lkIGhtbV9mcmVlX3JjdShzdHJ1Y3Qg cmN1X2hlYWQgKnJjdSkKIHsKLQlrZnJlZShjb250YWluZXJfb2YocmN1LCBzdHJ1Y3QgaG1tLCBy Y3UpKTsKKwlzdHJ1Y3QgaG1tICpobW0gPSBjb250YWluZXJfb2YocmN1LCBzdHJ1Y3QgaG1tLCBy Y3UpOworCisJbW1kcm9wKGhtbS0+bW0pOworCWtmcmVlKGhtbSk7CiB9CiAKIHN0YXRpYyB2b2lk IGhtbV9mcmVlKHN0cnVjdCBrcmVmICprcmVmKQogewogCXN0cnVjdCBobW0gKmhtbSA9IGNvbnRh aW5lcl9vZihrcmVmLCBzdHJ1Y3QgaG1tLCBrcmVmKTsKLQlzdHJ1Y3QgbW1fc3RydWN0ICptbSA9 IGhtbS0+bW07CiAKLQltbXVfbm90aWZpZXJfdW5yZWdpc3Rlcl9ub19yZWxlYXNlKCZobW0tPm1t dV9ub3RpZmllciwgbW0pOworCXNwaW5fbG9jaygmaG1tLT5tbS0+cGFnZV90YWJsZV9sb2NrKTsK KwlpZiAoaG1tLT5tbS0+aG1tID09IGhtbSkKKwkJaG1tLT5tbS0+aG1tID0gTlVMTDsKKwlzcGlu X3VubG9jaygmaG1tLT5tbS0+cGFnZV90YWJsZV9sb2NrKTsKIAotCXNwaW5fbG9jaygmbW0tPnBh Z2VfdGFibGVfbG9jayk7Ci0JaWYgKG1tLT5obW0gPT0gaG1tKQotCQltbS0+aG1tID0gTlVMTDsK LQlzcGluX3VubG9jaygmbW0tPnBhZ2VfdGFibGVfbG9jayk7Ci0KLQltbWRyb3AoaG1tLT5tbSk7 CisJbW11X25vdGlmaWVyX3VucmVnaXN0ZXJfbm9fcmVsZWFzZSgmaG1tLT5tbXVfbm90aWZpZXIs IGhtbS0+bW0pOwogCW1tdV9ub3RpZmllcl9jYWxsX3NyY3UoJmhtbS0+cmN1LCBobW1fZnJlZV9y Y3UpOwogfQogCi0tIAoyLjIxLjAKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fCmRyaS1kZXZlbCBtYWlsaW5nIGxpc3QKZHJpLWRldmVsQGxpc3RzLmZyZWVk ZXNrdG9wLm9yZwpodHRwczovL2xpc3RzLmZyZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZv L2RyaS1kZXZlbA== From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.4 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI, SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,USER_AGENT_MUTT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4FA60C31E5D for ; Tue, 18 Jun 2019 18:55:59 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id DE61D206BA for ; Tue, 18 Jun 2019 18:55:58 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=ziepe.ca header.i=@ziepe.ca header.b="PCSfTOPJ" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org DE61D206BA Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=ziepe.ca Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 4BF5C6B0003; Tue, 18 Jun 2019 14:55:58 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 46FBA8E0002; Tue, 18 Jun 2019 14:55:58 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3371E8E0001; Tue, 18 Jun 2019 14:55:58 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from mail-qt1-f197.google.com (mail-qt1-f197.google.com [209.85.160.197]) by kanga.kvack.org (Postfix) with ESMTP id 11CDA6B0003 for ; Tue, 18 Jun 2019 14:55:58 -0400 (EDT) Received: by mail-qt1-f197.google.com with SMTP id g30so13303168qtm.17 for ; Tue, 18 Jun 2019 11:55:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:dkim-signature:date:from:to:cc:subject :message-id:references:mime-version:content-disposition:in-reply-to :user-agent; bh=hXnlrwSMDb2KXQ2kUpfowsfYiMjlQHuh1AdwWvUKWgU=; b=LfhGNUeVxZZVeIAGwreDx4y2lAmeB99OquBjw5rn3m2Cb1OMATdWJHneFIGk5kMmXS x+SFv3aP7uMhYEPCSZhuS7UCV39VvNHA+GP9DDlvPC2OT3t4saRTzT3EUOc9S+aeJs/N zjpthVsVMtnLGpfRDV9p7t3mjxWwd6MU5pgp5023yJKj65LCgloIuvr6hLN71GDT983g Q/YhdjI+XV2Qdlt2JbKGS5vMHm2RIM7mXoIKn0Yn30PQlqcPdhNrXJYobiRx4i8m1/tV 4ekancS2jAYizmnPcBRhyFdZcnsGdH++THAR9qXI+shLmXRcSO9+rWfrCkPRa1SiU0Nl avmQ== X-Gm-Message-State: APjAAAWFS6a81nlsZMFGmpMKQ4CGEnesJOtFtIsUDmG1yiZwOYSHIN0Q x83iuXEI8oYBF/vX4e5VsZVTP/gSYC9rstlWexhEOhtOic5L9ExxW2OtA3kijf2lridBgAqYmZw XPc/Mnm9cA5XPV6ZlVZTXa6qXbWVOl3vSAPqJGxZeuDsmEgM5jHfGgb3xTItfiDKA1A== X-Received: by 2002:a37:6b87:: with SMTP id g129mr86304165qkc.305.1560884157786; Tue, 18 Jun 2019 11:55:57 -0700 (PDT) X-Received: by 2002:a37:6b87:: with SMTP id g129mr86304128qkc.305.1560884157030; Tue, 18 Jun 2019 11:55:57 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1560884157; cv=none; d=google.com; s=arc-20160816; b=o8naFPiY51pYePVzpcZvGNEfajup2216K+r+ER26/ui+Zi6bo2zHLFRVDKXSHtvPEU UlMHXvtWnOm7UeUjHNnebHt3BdhQ0dXNpUemyry0tikVaOpo33gQ/J0ug9gZldZs7Czg uzF9il9SczqvjOR9X9frs3/lRMw8ZifGYnL+18nY1YiNypQM1RwrlMKgHILpW34/I6gK x6x0tPYXZNxG2RD16HAubI2WRJ0FA8LTZZQXXd1BJN46iTc5v/Us6aLymc+6NDwM9U8o 3v4uLcZH3Cd/a93fd8xoFDFgRK+etvbEMic/GuRkwjWtRV+e26mSQ/ON7GsODPj1m0LU IkTg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=user-agent:in-reply-to:content-disposition:mime-version:references :message-id:subject:cc:to:from:date:dkim-signature; bh=hXnlrwSMDb2KXQ2kUpfowsfYiMjlQHuh1AdwWvUKWgU=; b=yFSilUUSXsr1fgARcnFlOE0VvkyLyJbolbDHc9e3XpA24c8UDEaTXS6xBMZkxjdxWF 65bdM5DgMo+yY5jdVGZP0pw2T+WPNLKG3e+9ir1TldpGqDBGV6GHllhFULgt9CTNJ/VX DHl7IABWZ00WSbL0vS2lzl6s4D2O44fDDdrL1A4Vp4YSthCVupBhokUBGJuZ/gkXoUHB WhlIipAbb/ogqVXz1WdwB5WqRKXTgEHINUlqQMpycn9R2ayf4n74LfNipgg72jxbwqel wenLp84qK3FpeV0X/DYXMwXlccrN++IXeVBUsXfSNxAYBLpve2M9Cda3vdOKhmbekMj+ ow8A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ziepe.ca header.s=google header.b=PCSfTOPJ; spf=pass (google.com: domain of jgg@ziepe.ca designates 209.85.220.65 as permitted sender) smtp.mailfrom=jgg@ziepe.ca Received: from mail-sor-f65.google.com (mail-sor-f65.google.com. [209.85.220.65]) by mx.google.com with SMTPS id k12sor9611198qkg.11.2019.06.18.11.55.56 for (Google Transport Security); Tue, 18 Jun 2019 11:55:57 -0700 (PDT) Received-SPF: pass (google.com: domain of jgg@ziepe.ca designates 209.85.220.65 as permitted sender) client-ip=209.85.220.65; Authentication-Results: mx.google.com; dkim=pass header.i=@ziepe.ca header.s=google header.b=PCSfTOPJ; spf=pass (google.com: domain of jgg@ziepe.ca designates 209.85.220.65 as permitted sender) smtp.mailfrom=jgg@ziepe.ca DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ziepe.ca; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=hXnlrwSMDb2KXQ2kUpfowsfYiMjlQHuh1AdwWvUKWgU=; b=PCSfTOPJhKvREdZ5xmkF2xPmb8AA5MtPK22PwiRyTbCbI9n4CnJdW/qq3WiSMdiUy4 6Z/IIW8iNAiO52TupOZYX1bP0ZYvZA2VvIVMD7rhz9DB6xzcL8VhPuHnFJVM+LqaVDy4 eoh4ivskUQESpEUflxImNhbiMcEzVAwMLSOzW1JZcP/LFSLq2bKsmf5Xe1tMeaMO9a8j 1awvPochrqqHFzLHQiREBjty59bhtgqM1Hx8EpZVefBLXue+iue6tkPzV3aLPoAa9K/4 eAlHpkRxnJvQyiQsJsHvbnZ1QoFRrPmfZsAnJSukHSDtbHZzYFbrauhu8anr3n5RV2Tu ajGw== X-Google-Smtp-Source: APXvYqyd+i6cTg2Tugb4a/2Cz8C0TtEUZL3kmahVSIFwk8sIJzOkIjm/6TLS4YnWGmfBfWmeHHI2Cw== X-Received: by 2002:a37:680e:: with SMTP id d14mr853394qkc.287.1560884156517; Tue, 18 Jun 2019 11:55:56 -0700 (PDT) Received: from ziepe.ca (hlfxns017vw-156-34-55-100.dhcp-dynamic.fibreop.ns.bellaliant.net. [156.34.55.100]) by smtp.gmail.com with ESMTPSA id 6sm7888729qkk.69.2019.06.18.11.55.56 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Tue, 18 Jun 2019 11:55:56 -0700 (PDT) Received: from jgg by mlx.ziepe.ca with local (Exim 4.90_1) (envelope-from ) id 1hdJGt-000090-Km; Tue, 18 Jun 2019 15:55:55 -0300 Date: Tue, 18 Jun 2019 15:55:55 -0300 From: Jason Gunthorpe To: Christoph Hellwig Cc: Jerome Glisse , Ralph Campbell , John Hubbard , Felix.Kuehling@amd.com, linux-rdma@vger.kernel.org, linux-mm@kvack.org, Andrea Arcangeli , dri-devel@lists.freedesktop.org, amd-gfx@lists.freedesktop.org, Ben Skeggs , Ira Weiny , Philip Yang Subject: Re: [PATCH v3 hmm 04/12] mm/hmm: Simplify hmm_get_or_create and make it reliable Message-ID: <20190618185555.GO6961@ziepe.ca> References: <20190614004450.20252-1-jgg@ziepe.ca> <20190614004450.20252-5-jgg@ziepe.ca> <20190615141211.GD17724@infradead.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190615141211.GD17724@infradead.org> User-Agent: Mutt/1.9.4 (2018-02-28) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Sat, Jun 15, 2019 at 07:12:11AM -0700, Christoph Hellwig wrote: > > + spin_lock(&mm->page_table_lock); > > + if (mm->hmm) { > > + if (kref_get_unless_zero(&mm->hmm->kref)) { > > + spin_unlock(&mm->page_table_lock); > > + return mm->hmm; > > + } > > + } > > + spin_unlock(&mm->page_table_lock); > > This could become: > > spin_lock(&mm->page_table_lock); > hmm = mm->hmm > if (hmm && kref_get_unless_zero(&hmm->kref)) > goto out_unlock; > spin_unlock(&mm->page_table_lock); > > as the last two lines of the function already drop the page_table_lock > and then return hmm. Or drop the "hmm = mm->hmm" asignment above and > return mm->hmm as that should be always identical to hmm at the end > to save another line. > > > + /* > > + * The mm->hmm pointer is kept valid while notifier ops can be running > > + * so they don't have to deal with a NULL mm->hmm value > > + */ > > The comment confuses me. How does the page_table_lock relate to > possibly running notifiers, as I can't find that we take > page_table_lock? Or is it just about the fact that we only clear > mm->hmm in the free callback, and not in hmm_free? Revised with: >From bdc02a1d502db08457823e6b2b983861a3574a76 Mon Sep 17 00:00:00 2001 From: Jason Gunthorpe Date: Thu, 23 May 2019 10:24:13 -0300 Subject: [PATCH] mm/hmm: Simplify hmm_get_or_create and make it reliable As coded this function can false-fail in various racy situations. Make it reliable and simpler by running under the write side of the mmap_sem and avoiding the false-failing compare/exchange pattern. Due to the mmap_sem this no longer has to avoid racing with a 2nd parallel hmm_get_or_create(). Unfortunately this still has to use the page_table_lock as the non-sleeping lock protecting mm->hmm, since the contexts where we free the hmm are incompatible with mmap_sem. Signed-off-by: Jason Gunthorpe Reviewed-by: John Hubbard Reviewed-by: Ralph Campbell Reviewed-by: Ira Weiny Tested-by: Philip Yang --- v2: - Fix error unwind of mmgrab (Jerome) - Use hmm local instead of 2nd container_of (Jerome) v3: - Can't use mmap_sem in the SRCU callback, keep using the page_table_lock (Philip) v4: - Put the mm->hmm = NULL in the kref release, reduce LOC in hmm_get_or_create() (Christoph) --- mm/hmm.c | 77 ++++++++++++++++++++++---------------------------------- 1 file changed, 30 insertions(+), 47 deletions(-) diff --git a/mm/hmm.c b/mm/hmm.c index 080b17a2e87e2d..0423f4ca3a7e09 100644 --- a/mm/hmm.c +++ b/mm/hmm.c @@ -31,16 +31,6 @@ #if IS_ENABLED(CONFIG_HMM_MIRROR) static const struct mmu_notifier_ops hmm_mmu_notifier_ops; -static inline struct hmm *mm_get_hmm(struct mm_struct *mm) -{ - struct hmm *hmm = READ_ONCE(mm->hmm); - - if (hmm && kref_get_unless_zero(&hmm->kref)) - return hmm; - - return NULL; -} - /** * hmm_get_or_create - register HMM against an mm (HMM internal) * @@ -55,11 +45,16 @@ static inline struct hmm *mm_get_hmm(struct mm_struct *mm) */ static struct hmm *hmm_get_or_create(struct mm_struct *mm) { - struct hmm *hmm = mm_get_hmm(mm); - bool cleanup = false; + struct hmm *hmm; + + lockdep_assert_held_exclusive(&mm->mmap_sem); - if (hmm) - return hmm; + /* Abuse the page_table_lock to also protect mm->hmm. */ + spin_lock(&mm->page_table_lock); + hmm = mm->hmm; + if (mm->hmm && kref_get_unless_zero(&mm->hmm->kref)) + goto out_unlock; + spin_unlock(&mm->page_table_lock); hmm = kmalloc(sizeof(*hmm), GFP_KERNEL); if (!hmm) @@ -74,57 +69,45 @@ static struct hmm *hmm_get_or_create(struct mm_struct *mm) hmm->notifiers = 0; hmm->dead = false; hmm->mm = mm; - mmgrab(hmm->mm); - spin_lock(&mm->page_table_lock); - if (!mm->hmm) - mm->hmm = hmm; - else - cleanup = true; - spin_unlock(&mm->page_table_lock); + hmm->mmu_notifier.ops = &hmm_mmu_notifier_ops; + if (__mmu_notifier_register(&hmm->mmu_notifier, mm)) { + kfree(hmm); + return NULL; + } - if (cleanup) - goto error; + mmgrab(hmm->mm); /* - * We should only get here if hold the mmap_sem in write mode ie on - * registration of first mirror through hmm_mirror_register() + * We hold the exclusive mmap_sem here so we know that mm->hmm is + * still NULL or 0 kref, and is safe to update. */ - hmm->mmu_notifier.ops = &hmm_mmu_notifier_ops; - if (__mmu_notifier_register(&hmm->mmu_notifier, mm)) - goto error_mm; - - return hmm; - -error_mm: spin_lock(&mm->page_table_lock); - if (mm->hmm == hmm) - mm->hmm = NULL; + mm->hmm = hmm; + +out_unlock: spin_unlock(&mm->page_table_lock); -error: - mmdrop(hmm->mm); - kfree(hmm); - return NULL; + return hmm; } static void hmm_free_rcu(struct rcu_head *rcu) { - kfree(container_of(rcu, struct hmm, rcu)); + struct hmm *hmm = container_of(rcu, struct hmm, rcu); + + mmdrop(hmm->mm); + kfree(hmm); } static void hmm_free(struct kref *kref) { struct hmm *hmm = container_of(kref, struct hmm, kref); - struct mm_struct *mm = hmm->mm; - mmu_notifier_unregister_no_release(&hmm->mmu_notifier, mm); + spin_lock(&hmm->mm->page_table_lock); + if (hmm->mm->hmm == hmm) + hmm->mm->hmm = NULL; + spin_unlock(&hmm->mm->page_table_lock); - spin_lock(&mm->page_table_lock); - if (mm->hmm == hmm) - mm->hmm = NULL; - spin_unlock(&mm->page_table_lock); - - mmdrop(hmm->mm); + mmu_notifier_unregister_no_release(&hmm->mmu_notifier, hmm->mm); mmu_notifier_call_srcu(&hmm->rcu, hmm_free_rcu); } -- 2.21.0