From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id A6502D1813A for ; Mon, 14 Oct 2024 18:43:53 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3DACC6B007B; Mon, 14 Oct 2024 14:43:53 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 363916B0083; Mon, 14 Oct 2024 14:43:53 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 18FC36B0088; Mon, 14 Oct 2024 14:43:53 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id EA28C6B007B for ; Mon, 14 Oct 2024 14:43:52 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id C656F811DE for ; Mon, 14 Oct 2024 18:43:45 +0000 (UTC) X-FDA: 82673081652.19.C4E1907 Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) by imf26.hostedemail.com (Postfix) with ESMTP id 79397140011 for ; Mon, 14 Oct 2024 18:43:45 +0000 (UTC) Authentication-Results: imf26.hostedemail.com; dkim=pass header.d=ibm.com header.s=pp1 header.b=BNEVfo2k; dmarc=pass (policy=none) header.from=ibm.com; spf=pass (imf26.hostedemail.com: domain of hca@linux.ibm.com designates 148.163.156.1 as permitted sender) smtp.mailfrom=hca@linux.ibm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1728931325; a=rsa-sha256; cv=none; b=xR5GNW1QFW5HRJSISvQ7j6LK1Slj9ezPxgnjqaiDUb8LV3ewyD2u+O3kT94/fzFTqIX1n8 jx/l+vW6DAGCmgL9waWln6yhzydMvpeYchu/kLksH7lZJVp1DN7IOgAugnJ/aVyGK+adFA eRFcQ3H3IB2pStS+esg0fBX7VEqxNxU= ARC-Authentication-Results: i=1; imf26.hostedemail.com; dkim=pass header.d=ibm.com header.s=pp1 header.b=BNEVfo2k; dmarc=pass (policy=none) header.from=ibm.com; spf=pass (imf26.hostedemail.com: domain of hca@linux.ibm.com designates 148.163.156.1 as permitted sender) smtp.mailfrom=hca@linux.ibm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1728931325; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=nuOiVE6YX5KLsvxa6zabqNtcQLT+k4suKXrkdqwky0Q=; b=E30qZcRkWvnNHIep9wFu+AERNQYGxOcoVWMaQWBHvsuokengGw3Xtt6QVBsTrtLb3Oln5Q 0XhZOPx4KjTfpp/n8o8MLmH9uQ0YgUTu0rNyiMZS++U2oK1/wUWEdZ/dZ9F6ULP9LofTt0 +SjAPAMwO/vjN4vrH8llJaEnHuw1l1M= Received: from pps.filterd (m0360083.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 49EIT8I5008837; Mon, 14 Oct 2024 18:43:49 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=date :from:to:cc:subject:message-id:references:mime-version :content-type:in-reply-to; s=pp1; bh=nuOiVE6YX5KLsvxa6zabqNtcQLT +k4suKXrkdqwky0Q=; b=BNEVfo2kvZctYwMwaWKTDgkcY8TPiXnU8sRf6l21EjH gQTnkx6pjY2qEIRnLgk/Pf04E5JqDWaloCkE1oAqB326tawgmvwaj4P+o7pDh4O6 HymVXidHsweh/q9sznByDTIoywD1CbE81wmC7zhuKTWkHlQzHXhjB3pq/GCYRo3+ eaPdz81Oe1HOWtJrxdijEG6f0Pkwr2D8mVVhFClXc0To9gPwcXFd4hA6EhKdXt+c 9gATC7aoVmIywLCOnL+57C5crSrJE09DpPXe4oIVNWlo/HSAZEXN47st8Qup0Edu 6yxB3qYuuMe4kQVvilrRCEFzudmoUlXfTquZHoguMLQ== Received: from pps.reinject (localhost [127.0.0.1]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 4298m7r281-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 14 Oct 2024 18:43:48 +0000 (GMT) Received: from m0360083.ppops.net (m0360083.ppops.net [127.0.0.1]) by pps.reinject (8.18.0.8/8.18.0.8) with ESMTP id 49EIhmQc007686; Mon, 14 Oct 2024 18:43:48 GMT Received: from ppma23.wdc07v.mail.ibm.com (5d.69.3da9.ip4.static.sl-reverse.com [169.61.105.93]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 4298m7r27u-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 14 Oct 2024 18:43:47 +0000 (GMT) Received: from pps.filterd (ppma23.wdc07v.mail.ibm.com [127.0.0.1]) by ppma23.wdc07v.mail.ibm.com (8.18.1.2/8.18.1.2) with ESMTP id 49EIb2cG007025; Mon, 14 Oct 2024 18:43:46 GMT Received: from smtprelay03.fra02v.mail.ibm.com ([9.218.2.224]) by ppma23.wdc07v.mail.ibm.com (PPS) with ESMTPS id 4284xjyxfp-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 14 Oct 2024 18:43:46 +0000 Received: from smtpav01.fra02v.mail.ibm.com (smtpav01.fra02v.mail.ibm.com [10.20.54.100]) by smtprelay03.fra02v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 49EIhg0R41288078 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 14 Oct 2024 18:43:42 GMT Received: from smtpav01.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 9719F2004D; Mon, 14 Oct 2024 18:43:42 +0000 (GMT) Received: from smtpav01.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 694AF20040; Mon, 14 Oct 2024 18:43:41 +0000 (GMT) Received: from osiris (unknown [9.171.66.174]) by smtpav01.fra02v.mail.ibm.com (Postfix) with ESMTPS; Mon, 14 Oct 2024 18:43:41 +0000 (GMT) Date: Mon, 14 Oct 2024 20:43:39 +0200 From: Heiko Carstens To: David Hildenbrand Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-s390@vger.kernel.org, virtualization@lists.linux.dev, linux-doc@vger.kernel.org, kvm@vger.kernel.org, Vasily Gorbik , Alexander Gordeev , Christian Borntraeger , Sven Schnelle , Thomas Huth , Cornelia Huck , Janosch Frank , Claudio Imbrenda , "Michael S. Tsirkin" , Jason Wang , Xuan Zhuo , Eugenio =?iso-8859-1?Q?P=E9rez?= , Andrew Morton , Jonathan Corbet , Mario Casquero Subject: Re: [PATCH v2 4/7] s390/physmem_info: query diag500(STORAGE LIMIT) to support QEMU/KVM memory devices Message-ID: <20241014184339.10447-E-hca@linux.ibm.com> References: <20241014144622.876731-1-david@redhat.com> <20241014144622.876731-5-david@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20241014144622.876731-5-david@redhat.com> X-TM-AS-GCONF: 00 X-Proofpoint-ORIG-GUID: bdm0jANgH3licBgVzWntyxR77QM8XgPw X-Proofpoint-GUID: mxM05b8kFTSUrO4aochPmncpoIkXsq_A X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1051,Hydra:6.0.680,FMLib:17.12.62.30 definitions=2024-10-14_12,2024-10-11_01,2024-09-30_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 clxscore=1015 mlxscore=0 spamscore=0 suspectscore=0 phishscore=0 priorityscore=1501 impostorscore=0 lowpriorityscore=0 adultscore=0 mlxlogscore=495 malwarescore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2409260000 definitions=main-2410140131 X-Rspamd-Queue-Id: 79397140011 X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: dt5g4n3nn5e5fjynxo4wreiqd4o6anzj X-HE-Tag: 1728931425-808189 X-HE-Meta: U2FsdGVkX183C8XO5BN6KFa4eqs6RlnemlxLDRHgTysZFc/6EQbJiGTTltkjLpBSeQdJglnGjuIGMMaP77Tkeqe66KftDM4hEN4b70GQtBjrAYbgT+K3dP69+eSwp77zvdWLDOT69+f4IthzdgywY7klMEk3PmGwa5LD5S5PfMHRNA9PM2JDNjFrgLBHomO/ICvJaRstE79j26cqAqjlQVcrwjvHVsfGeiRKp95PQzrxOBZhL8hnCLVLKKBfXkYEOsfGjlmBsX7s/xLTlqdOXfoAz5q/9ZiuC9h3NGcDJ6Ln7KSG6gqRNj2eEKPvqJTxls/TLJ2XR5X6CKP5VCroLfwQ1CXxCyzVRCEyDyjcB/+xVRJ6s2W3vY/hw9hl6T6GISWziNWJnIF7dv59FGr83TsjX6swvucUkKrfaT3ISd+YB+JKgMMvzVnwpcLnxNXgzOpGb9iGtqDCZFkckJTIbD4iTOmhzXTVgferzoG/PNqGZ5HRvqGktZcYcb+rTMMOEKjcEwzvfg+ESIMkxz7h4eWL9msllke5YjH3dt2C8cvEAHXXl5VHIckGDddIYGmtj3pzYT7cEJ9D9FZzs9+yuIYiHnOmxlpE/Km32fHePYVGfYRHUKhnAf89ksL7ijWFlVKtB83kgxZ4YbUDlCHlxGxWTTMmy1rwOY4Bp/C9wIxfAo+pfguik5wvem7AoYKtaB0jf1NL43bBjvfYzXkoV2AHc3pwP7jOS6BxX5UbaOQEbDQno8nbBiuiMB4u1+Swq/t/zPjy1BhwVP2a0WlbK9KfJudm68KfGrQ1Oe2as6UWSNmXOX6JlpJETc5J0EsmIGzj6gnwq7myYhHP8NxYCUlH/U928aNpOoGox0RXBWm4MVNc8+0Ebo7fvuNWeCAzsqomaaAzos7q6wsDEHg9XGMTo+0uU4ykGqNaRvbC7ThNQrNcfHfi83Zx7exyFrbxK5T9cMK6UiYH3mpmhQe uUrVptaA MDL9G+g+jufO9UfP2/Yn/wyg8/fTrpc+jxK/lDwI6lC9Fp5quCwc6Cgau2P1iVxDJyRPjC6HXyhD7o6Pcps7otiI1yJH06jAaA41ci5apJ89RzN6krm/wlFWntEJOfPGr67QWwC8MqYrlyohCVVcnBJ3T5IogcVYb+R7PGqsYvCH6WDfDlmtCZVXBJjWM48nAFDhSz1gSuPzTOlZShlPPF6fRVCPsaXQzh7i+rUML4kBG8Tng7PfbyISqvwmNypFE6MhJ9+OaYaHg5dIcdXukR4JmxDs3kmswt1juvxyPLATyOgitcwbPrXF8HKLnfkCSljfubpCrdPG0px8= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Mon, Oct 14, 2024 at 04:46:16PM +0200, David Hildenbrand wrote: > To support memory devices under QEMU/KVM, such as virtio-mem, > we have to prepare our kernel virtual address space accordingly and > have to know the highest possible physical memory address we might see > later: the storage limit. The good old SCLP interface is not suitable for > this use case. > > In particular, memory owned by memory devices has no relationship to > storage increments, it is always detected using the device driver, and > unaware OSes (no driver) must never try making use of that memory. > Consequently this memory is located outside of the "maximum storage > increment"-indicated memory range. > > Let's use our new diag500 STORAGE_LIMIT subcode to query this storage > limit that can exceed the "maximum storage increment", and use the > existing interfaces (i.e., SCLP) to obtain information about the initial > memory that is not owned+managed by memory devices. > > If a hypervisor does not support such memory devices, the address exposed > through diag500 STORAGE_LIMIT will correspond to the maximum storage > increment exposed through SCLP. > > To teach kdump on s390 to include memory owned by memory devices, there > will be ways to query the relevant memory ranges from the device via a > driver running in special kdump mode (like virtio-mem already implements > to filter /proc/vmcore access so we don't end up reading from unplugged > device blocks). > > Tested-by: Mario Casquero > Signed-off-by: David Hildenbrand > --- > arch/s390/boot/physmem_info.c | 46 ++++++++++++++++++++++++++-- > arch/s390/include/asm/physmem_info.h | 3 ++ > 2 files changed, 46 insertions(+), 3 deletions(-) ... > +static int diag500_storage_limit(unsigned long *max_physmem_end) > +{ > + register unsigned long __nr asm("1") = 0x4; > + register unsigned long __storage_limit asm("2") = 0; > + unsigned long reg1, reg2; > + psw_t old; In general we do not allow register asm usage anymore in s390 code, except for a very few defined places. This is due to all the problems that we've seen with code instrumentation and register corruption. The patch below changes your code accordingly, but it is untested. Please verify that your code still works. > @@ -157,7 +189,9 @@ unsigned long detect_max_physmem_end(void) > { > unsigned long max_physmem_end = 0; > > - if (!sclp_early_get_memsize(&max_physmem_end)) { > + if (!diag500_storage_limit(&max_physmem_end)) { > + physmem_info.info_source = MEM_DETECT_DIAG500_STOR_LIMIT; > + } else if (!sclp_early_get_memsize(&max_physmem_end)) { > physmem_info.info_source = MEM_DETECT_SCLP_READ_INFO; > } else { > max_physmem_end = search_mem_end(); > @@ -170,11 +204,17 @@ void detect_physmem_online_ranges(unsigned long max_physmem_end) > { > if (!sclp_early_read_storage_info()) { > physmem_info.info_source = MEM_DETECT_SCLP_STOR_INFO; > + return; > } else if (!diag260()) { > physmem_info.info_source = MEM_DETECT_DIAG260; > - } else if (max_physmem_end) { > - add_physmem_online_range(0, max_physmem_end); > + return; > + } else if (physmem_info.info_source == MEM_DETECT_DIAG500_STOR_LIMIT) { > + max_physmem_end = 0; > + if (!sclp_early_get_memsize(&max_physmem_end)) > + physmem_info.info_source = MEM_DETECT_SCLP_READ_INFO; > } > + if (max_physmem_end) > + add_physmem_online_range(0, max_physmem_end); > } In general looks good to me, but I'd like to see that Vasily or Alexander give an Ack to this patch. diff --git a/arch/s390/boot/physmem_info.c b/arch/s390/boot/physmem_info.c index fb4e66e80fd8..975fc478e0e3 100644 --- a/arch/s390/boot/physmem_info.c +++ b/arch/s390/boot/physmem_info.c @@ -109,10 +109,11 @@ static int diag260(void) return 0; } +#define DIAG500_SC_STOR_LIMIT 4 + static int diag500_storage_limit(unsigned long *max_physmem_end) { - register unsigned long __nr asm("1") = 0x4; - register unsigned long __storage_limit asm("2") = 0; + unsigned long storage_limit; unsigned long reg1, reg2; psw_t old; @@ -123,21 +124,24 @@ static int diag500_storage_limit(unsigned long *max_physmem_end) " st %[reg2],4(%[psw_pgm])\n" " larl %[reg1],1f\n" " stg %[reg1],8(%[psw_pgm])\n" + " lghi 1,%[subcode]\n" + " lghi 2,0\n" " diag 2,4,0x500\n" "1: mvc 0(16,%[psw_pgm]),0(%[psw_old])\n" + " lgr %[slimit],2\n" : [reg1] "=&d" (reg1), [reg2] "=&a" (reg2), - "+&d" (__storage_limit), + [slimit] "=d" (storage_limit), "=Q" (get_lowcore()->program_new_psw), "=Q" (old) : [psw_old] "a" (&old), [psw_pgm] "a" (&get_lowcore()->program_new_psw), - "d" (__nr) - : "memory"); - if (!__storage_limit) - return -EINVAL; - /* convert inclusive end to exclusive end. */ - *max_physmem_end = __storage_limit + 1; + [subcode] "i" (DIAG500_SC_STOR_LIMIT) + : "memory", "1", "2"); + if (!storage_limit) + return -EINVAL; + /* Convert inclusive end to exclusive end */ + *max_physmem_end = storage_limit + 1; return 0; }