From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.3 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D2450C352AA for ; Mon, 7 Oct 2019 11:52:02 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 5E4A4206C2 for ; Mon, 7 Oct 2019 11:52:02 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="d3NWUSeI" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5E4A4206C2 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=arm.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+infradead-linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20170209; h=Sender:Content-Type: Content-Transfer-Encoding:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:Date:Message-ID:From: References:To:Subject:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=Ve0jP+Xx6X4mtzIVafp5jXcpJ3kFsG/XtkMEu4Vvt9A=; b=d3NWUSeIm59fDCGDw85usP6Sv ZgtXIFnlUB117NTmGBZIipz2Hp26vhLFvl3WFjUrLRVyJHdVs8D0ZVWXIp/E0Bfpv6GQHzGg0cEkt +L9kS/kj3JvKEIKf8C5n3I2YCdfaUW7HDqVf34csS0rh0tJb+NDm2Nn9fKN1DZ9OtsOim8oTKVegq FLnVuquBSs6xBtk7Ayw0jyFpnJcgsaJRIu8dF21y5HArq6k4dl7b2dR2srSKQfefGhZiUIWC4zy+u PRQycHQszU/I9Jn0+opguLCPIG1Q6oTE1l6r0RYckVFTeifA5YChiqPBZV771mt6kvjlHmIFSVWMq W+rVfrOYA==; Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.92.2 #3 (Red Hat Linux)) id 1iHRYG-00069F-LL; Mon, 07 Oct 2019 11:51:44 +0000 Received: from foss.arm.com ([217.140.110.172]) by bombadil.infradead.org with esmtp (Exim 4.92.2 #3 (Red Hat Linux)) id 1iHRYC-00068O-VJ; Mon, 07 Oct 2019 11:51:42 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 067201570; Mon, 7 Oct 2019 04:51:40 -0700 (PDT) Received: from [10.1.197.57] (e110467-lin.cambridge.arm.com [10.1.197.57]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 006B93F706; Mon, 7 Oct 2019 04:51:38 -0700 (PDT) Subject: Re: aarch64 Kernel Panic Asynchronous SError Interrupt on large file IO To: Heiko Stuebner References: <20190819104313.fekk5cxxznoctvz5@willie-the-truck> <006d3ee0-2711-1b4e-d8cf-6a226fcad0e4@arm.com> <1596764.niU1GBd6P2@phil> From: Robin Murphy Message-ID: <7f659a93-81e1-65f3-8239-537307f34f42@arm.com> Date: Mon, 7 Oct 2019 12:51:37 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <1596764.niU1GBd6P2@phil> Content-Language: en-GB X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20191007_045141_097011_85DD5575 X-CRM114-Status: GOOD ( 26.46 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Catalin Marinas , vicencb@gmail.com, linux-rockchip@lists.infradead.org, andre.przywara@arm.com, Philipp Richter , Will Deacon , linux-arm-kernel@lists.infradead.org Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+infradead-linux-arm-kernel=archiver.kernel.org@lists.infradead.org On 06/10/2019 14:13, Heiko Stuebner wrote: > Am Sonntag, 6. Oktober 2019, 01:45:23 CEST schrieb Robin Murphy: >> On 2019-08-19 11:43 am, Will Deacon wrote: >>> On Mon, Aug 19, 2019 at 11:07:14AM +0100, Catalin Marinas wrote: >>>> On Sat, Aug 17, 2019 at 03:12:41PM +0200, Philipp Richter wrote: >>>>> I added "memtest=4" to the kernel cmdline and I'm getting very quicky >>>>> a "Internal error: synchronous external abort" panic. >>>> [...] >>>>> [ 0.000000] early_memtest: # of tests: 4 >>>>> [ 0.000000] 0x0000000000200000 - 0x0000000002080000 pattern aaaaaaaaaaaaaaaa >>>>> [ 0.000000] 0x0000000003a95000 - 0x00000000f8400000 pattern aaaaaaaaaaaaaaaa >>>>> [ 0.000000] Internal error: synchronous external abort: 96000210 [#1] SMP >>>> >>>> At least it's a synchronous error ;). >>>> >>>>> [ 0.000000] pc : early_memtest+0x16c/0x23c >>>> [...] >>>>> [ 0.000000] Code: d2800002 d2800001 eb0400bf 54000309 (f9400080) >>>> >>>> decodecode says: >>>> >>>> 0: d2800002 mov x2, #0x0 // #0 >>>> 4: d2800001 mov x1, #0x0 // #0 >>>> 8: eb0400bf cmp x5, x4 >>>> c: 54000309 b.ls 0x6c // b.plast >>>> 10:* f9400080 ldr x0, [x4] <-- trapping instruction >>>> >>>> I guess that's the read of *p in memtest(). Writing *p probably >>>> generates asynchronous errors it you haven't seen it yet. >>>> >>>>> Is my board completely broken ? :( >>>> >>>> One possibility is that you don't have any memory where you think there >>>> is, so the mapping just doesn't translate to any valid physical >>>> location. >>>> >>>> Can you add some printk(addr) in do_sea() to see if it always faults on >>>> the same address? >>> >>> Alternatively, just run it a few more times and see if the register dump >>> changes. Currently we've got: >>> >>> [ 0.000000] x5 : ffff8000f8400000 x4 : ffff800008400000 >>> [ 0.000000] x3 : 0000000008400000 x2 : 0000000000000000 >>> [ 0.000000] x1 : 0000000000000000 x0 : aaaaaaaaaaaaaaaa >>> >>> so I'd guess that x3 is the faulting pa. The faulting (linear) VAs in the >>> originl report were 0xffff800009c74aa8 and 0xffff800009c08390, which is >>> still a way way off from this one :/ >>> >>> Looking at the TRM for the rk3328, there's 4gb of ram starting at pa 0x0, >>> so maybe some of it has been configured as secure or the memory controller >>> hasn't been properly initialised? >> >> FWIW I've noticed my RK3399 board doing this too, now that I've started >> using it in anger. I'm using a hacky firmware comprising upstream U-Boot >> munged with the Rockchip miniloader and downstream Trusted Firmware >> binaries, > > any reason for that combination? For example the rockpro64 got ddr4 support > in upstream uboot recently. Not really; it's just the "works well enough" setup that made distro boot usable before the SPL support went upstream, and (other than hacking in the CPU PLL initialisation which otherwise gets lost in that combination) I haven't touched it since. [ for now I've just hacked a reserved-memory node into my DT... one day I'll get round to firmware tinkering ;) ] >> and it looks like that mismatch is the root of this problem. >> Booting a different image based on the BSP U-boot shows that that's >> passing a memory node with the range 0x8400000-0x9600000 entirely carved >> out, so this is presumably claimed by the secure firmware/TEE and set to >> abort Non-Secure accesses. > > As TEE on PX30 is also one of my current projects, I've stumbled over that > memory issue. At least OP-TEE can get passed a location for a dtb during > startup which it then would modify to add a reserved section for its memory. > > But that dtb generally is not the one, the kernel will actually use, but > instead only the one used by uboot. extlinux, tftp or whatever will normally > load and use a new dtb for the kernel which will likely not get that memory > reservation automatically? > > I'm not yet sure how this is supposed to work in an all-upstream > configuration - I'm running upstream u-boot + upstream TF-A + upstream > OP-Tee in my project environment right now. As far as I understand, U-Boot is still responsible for generating the memory node in whatever DTB it loads and passes to the kernel, so it should still be able to adjust that accordingly. Presumably U-Boot needs to discover any firmware/TEE reservations early on to avoid touching any Secure memory itself, so it should just need to keep track of them until finalising the kernel DTB. Robin. _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel