From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.2 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS, USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 834A0C3F2D1 for ; Wed, 4 Mar 2020 15:40:47 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 30EBA24658 for ; Wed, 4 Mar 2020 15:40:47 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 30EBA24658 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.ibm.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id B56D46B0003; Wed, 4 Mar 2020 10:40:46 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id B08126B0005; Wed, 4 Mar 2020 10:40:46 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 9F6866B0006; Wed, 4 Mar 2020 10:40:46 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0028.hostedemail.com [216.40.44.28]) by kanga.kvack.org (Postfix) with ESMTP id 88A6A6B0003 for ; Wed, 4 Mar 2020 10:40:46 -0500 (EST) Received: from smtpin29.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id 2D3A0180AD801 for ; Wed, 4 Mar 2020 15:40:46 +0000 (UTC) X-FDA: 76558092492.29.lock97_40dd6f4be2d23 X-HE-Tag: lock97_40dd6f4be2d23 X-Filterd-Recvd-Size: 11406 Received: from mx0a-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by imf37.hostedemail.com (Postfix) with ESMTP for ; Wed, 4 Mar 2020 15:40:45 +0000 (UTC) Received: from pps.filterd (m0098421.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 024Fa424077404 for ; Wed, 4 Mar 2020 10:40:45 -0500 Received: from e06smtp02.uk.ibm.com (e06smtp02.uk.ibm.com [195.75.94.98]) by mx0a-001b2d01.pphosted.com with ESMTP id 2yj6njc0bv-1 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 04 Mar 2020 10:40:44 -0500 Received: from localhost by e06smtp02.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Wed, 4 Mar 2020 15:40:42 -0000 Received: from b06cxnps4074.portsmouth.uk.ibm.com (9.149.109.196) by e06smtp02.uk.ibm.com (192.168.101.132) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 bits=256/256) Wed, 4 Mar 2020 15:40:34 -0000 Received: from d06av26.portsmouth.uk.ibm.com (d06av26.portsmouth.uk.ibm.com [9.149.105.62]) by b06cxnps4074.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 024FeWKl48758790 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 4 Mar 2020 15:40:32 GMT Received: from d06av26.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id B7001AE05A; Wed, 4 Mar 2020 15:40:32 +0000 (GMT) Received: from d06av26.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id A9640AE045; Wed, 4 Mar 2020 15:40:31 +0000 (GMT) Received: from pic2.home (unknown [9.145.145.27]) by d06av26.portsmouth.uk.ibm.com (Postfix) with ESMTP; Wed, 4 Mar 2020 15:40:31 +0000 (GMT) Subject: Re: [PATCH v3 24/27] powerpc/powernv/pmem: Expose SMART data via ndctl To: "Alastair D'Silva" , alastair@d-silva.org Cc: "Aneesh Kumar K . V" , "Oliver O'Halloran" , Benjamin Herrenschmidt , Paul Mackerras , Michael Ellerman , Andrew Donnellan , Arnd Bergmann , Greg Kroah-Hartman , Dan Williams , Vishal Verma , Dave Jiang , Ira Weiny , Andrew Morton , Mauro Carvalho Chehab , "David S. Miller" , Rob Herring , Anton Blanchard , Krzysztof Kozlowski , Mahesh Salgaonkar , Madhavan Srinivasan , =?UTF-8?Q?C=c3=a9dric_Le_Goater?= , Anju T Sudhakar , Hari Bathini , Thomas Gleixner , Greg Kurz , Nicholas Piggin , Masahiro Yamada , Alexey Kardashevskiy , linux-kernel@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-nvdimm@lists.01.org, linux-mm@kvack.org References: <20200221032720.33893-1-alastair@au1.ibm.com> <20200221032720.33893-25-alastair@au1.ibm.com> From: Frederic Barrat Date: Wed, 4 Mar 2020 16:40:31 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.4.1 MIME-Version: 1.0 In-Reply-To: <20200221032720.33893-25-alastair@au1.ibm.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US X-TM-AS-GCONF: 00 x-cbid: 20030415-0008-0000-0000-0000035951B1 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 20030415-0009-0000-0000-00004A7A85DB Message-Id: <7d461119-12e6-7813-50d5-42e2d7774b54@linux.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.138,18.0.572 definitions=2020-03-04_05:2020-03-04,2020-03-04 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 malwarescore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxlogscore=999 suspectscore=0 impostorscore=0 priorityscore=1501 bulkscore=0 phishscore=0 mlxscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2001150001 definitions=main-2003040114 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Le 21/02/2020 =C3=A0 04:27, Alastair D'Silva a =C3=A9crit=C2=A0: > From: Alastair D'Silva >=20 > This patch retrieves proprietary formatted SMART data and makes it > available via ndctl. A later contribution will be made to ndctl to > parse this data. >=20 > Signed-off-by: Alastair D'Silva > --- Nothing new to add compared to previous patches with similarities. Fred > arch/powerpc/platforms/powernv/pmem/ocxl.c | 128 +++++++++++++++++= + > .../platforms/powernv/pmem/ocxl_internal.h | 18 +++ > include/uapi/linux/ndctl.h | 1 + > 3 files changed, 147 insertions(+) >=20 > diff --git a/arch/powerpc/platforms/powernv/pmem/ocxl.c b/arch/powerpc/= platforms/powernv/pmem/ocxl.c > index d4ce5e9e0521..5cd1b6d78dd6 100644 > --- a/arch/powerpc/platforms/powernv/pmem/ocxl.c > +++ b/arch/powerpc/platforms/powernv/pmem/ocxl.c > @@ -81,6 +81,129 @@ static int ndctl_config_size(struct nd_cmd_get_conf= ig_size *command) > return 0; > } > =20 > +/** > + * smart_header_parse() - Parse the first 64 bits of the SMART admin c= ommand response > + * @ocxlpmem: the device metadata > + * @length: out, returns the number of bytes in the response (excludin= g the 64 bit header) > + */ > +static int smart_header_parse(struct ocxlpmem *ocxlpmem, u32 *length) > +{ > + int rc; > + u64 val; > + > + u16 data_identifier; > + u32 data_length; > + > + rc =3D ocxl_global_mmio_read64(ocxlpmem->ocxl_afu, > + ocxlpmem->admin_command.data_offset, > + OCXL_LITTLE_ENDIAN, &val); > + if (rc) > + return rc; > + > + data_identifier =3D val >> 48; > + data_length =3D val & 0xFFFFFFFF; > + > + if (data_identifier !=3D 0x534D) { // 'SM' > + dev_err(&ocxlpmem->dev, > + "Bad data identifier for smart data, expected 'SM', got '%-.*s'\n", > + 2, (char *)&data_identifier); > + return -EINVAL; > + } > + > + *length =3D data_length; > + return 0; > +} > + > +static int ndctl_smart(struct ocxlpmem *ocxlpmem, struct nd_cmd_pkg *p= kg) > +{ > + u32 length, i; > + struct nd_ocxl_smart *out; > + int rc; > + > + mutex_lock(&ocxlpmem->admin_command.lock); > + > + rc =3D admin_command_request(ocxlpmem, ADMIN_COMMAND_SMART); > + if (rc) > + goto out; > + > + rc =3D admin_command_execute(ocxlpmem); > + if (rc) > + goto out; > + > + rc =3D admin_command_complete_timeout(ocxlpmem, ADMIN_COMMAND_SMART); > + if (rc < 0) { > + dev_err(&ocxlpmem->dev, "SMART timeout\n"); > + goto out; > + } > + > + rc =3D admin_response(ocxlpmem); > + if (rc < 0) > + goto out; > + if (rc !=3D STATUS_SUCCESS) { > + warn_status(ocxlpmem, "Unexpected status from SMART", rc); > + goto out; > + } > + > + rc =3D smart_header_parse(ocxlpmem, &length); > + if (rc) > + goto out; > + > + pkg->nd_fw_size =3D length; > + > + length =3D min(length, pkg->nd_size_out); // bytes > + out =3D (struct nd_ocxl_smart *)pkg->nd_payload; > + // Each SMART attribute is 2 * 64 bits > + out->count =3D length / (2 * sizeof(u64)); // attributes > + > + for (i =3D 0; i < length; i +=3D sizeof(u64)) { > + rc =3D ocxl_global_mmio_read64(ocxlpmem->ocxl_afu, > + ocxlpmem->admin_command.data_offset + sizeof(u64) + i, > + OCXL_LITTLE_ENDIAN, > + &out->attribs[i/sizeof(u64)]); > + if (rc) > + goto out; > + } > + > + rc =3D admin_response_handled(ocxlpmem); > + if (rc) > + goto out; > + > + rc =3D 0; > + goto out; > + > +out: > + mutex_unlock(&ocxlpmem->admin_command.lock); > + return rc; > +} > + > +static int ndctl_call(struct ocxlpmem *ocxlpmem, void *buf, unsigned i= nt buf_len) > +{ > + struct nd_cmd_pkg *pkg =3D buf; > + > + if (buf_len < sizeof(struct nd_cmd_pkg)) { > + dev_err(&ocxlpmem->dev, "Invalid ND_CALL size=3D%u\n", buf_len); > + return -EINVAL; > + } > + > + if (pkg->nd_family !=3D NVDIMM_FAMILY_OCXL) { > + dev_err(&ocxlpmem->dev, "Invalid ND_CALL family=3D0x%llx\n", pkg->nd= _family); > + return -EINVAL; > + } > + > + switch (pkg->nd_command) { > + case ND_CMD_OCXL_SMART: > + ndctl_smart(ocxlpmem, pkg); > + break; > + > + default: > + dev_err(&ocxlpmem->dev, "Invalid ND_CALL command=3D0x%llx\n", pkg->n= d_command); > + return -EINVAL; > + } > + > + > + return 0; > +} > + > static int ndctl(struct nvdimm_bus_descriptor *nd_desc, > struct nvdimm *nvdimm, > unsigned int cmd, void *buf, unsigned int buf_len, int *cmd_rc) > @@ -88,6 +211,10 @@ static int ndctl(struct nvdimm_bus_descriptor *nd_d= esc, > struct ocxlpmem *ocxlpmem =3D container_of(nd_desc, struct ocxlpmem,= bus_desc); > =20 > switch (cmd) { > + case ND_CMD_CALL: > + *cmd_rc =3D ndctl_call(ocxlpmem, buf, buf_len); > + return 0; > + > case ND_CMD_GET_CONFIG_SIZE: > *cmd_rc =3D ndctl_config_size(buf); > return 0; > @@ -171,6 +298,7 @@ static int register_lpc_mem(struct ocxlpmem *ocxlpm= em) > set_bit(ND_CMD_GET_CONFIG_SIZE, &nvdimm_cmd_mask); > set_bit(ND_CMD_GET_CONFIG_DATA, &nvdimm_cmd_mask); > set_bit(ND_CMD_SET_CONFIG_DATA, &nvdimm_cmd_mask); > + set_bit(ND_CMD_CALL, &nvdimm_cmd_mask); > =20 > set_bit(NDD_ALIASING, &nvdimm_flags); > =20 > diff --git a/arch/powerpc/platforms/powernv/pmem/ocxl_internal.h b/arch= /powerpc/platforms/powernv/pmem/ocxl_internal.h > index 927690f4888f..0eb7a35d24ae 100644 > --- a/arch/powerpc/platforms/powernv/pmem/ocxl_internal.h > +++ b/arch/powerpc/platforms/powernv/pmem/ocxl_internal.h > @@ -7,6 +7,7 @@ > #include > #include > #include > +#include > =20 > #define LABEL_AREA_SIZE (1UL << PA_SECTION_SHIFT) > #define DEFAULT_TIMEOUT 100 > @@ -98,6 +99,23 @@ struct ocxlpmem_function0 { > struct ocxl_fn *ocxl_fn; > }; > =20 > +struct nd_ocxl_smart { > + __u8 count; > + __u8 reserved[7]; > + __u64 attribs[0]; > +} __packed; > + > +struct nd_pkg_ocxl { > + struct nd_cmd_pkg gen; > + union { > + struct nd_ocxl_smart smart; > + }; > +}; > + > +enum nd_cmd_ocxl { > + ND_CMD_OCXL_SMART =3D 1, > +}; > + > struct ocxlpmem { > struct device dev; > struct pci_dev *pdev; > diff --git a/include/uapi/linux/ndctl.h b/include/uapi/linux/ndctl.h > index de5d90212409..2885052e7f40 100644 > --- a/include/uapi/linux/ndctl.h > +++ b/include/uapi/linux/ndctl.h > @@ -244,6 +244,7 @@ struct nd_cmd_pkg { > #define NVDIMM_FAMILY_HPE2 2 > #define NVDIMM_FAMILY_MSFT 3 > #define NVDIMM_FAMILY_HYPERV 4 > +#define NVDIMM_FAMILY_OCXL 6 > =20 > #define ND_IOCTL_CALL _IOWR(ND_IOCTL, ND_CMD_CALL,\ > struct nd_cmd_pkg) >=20