From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jarkko Sakkinen Subject: Re: RFC: userspace exception fixups Date: Mon, 19 Nov 2018 16:05:43 +0200 Message-ID: <20181119140543.GF8755@linux.intel.com> References: <20181118071548.GA4795@linux.intel.com> <20181118130203.GA18934@linux.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Content-Disposition: inline In-Reply-To: Sender: linux-kernel-owner@vger.kernel.org To: Jethro Beekman Cc: Andy Lutomirski , Dave Hansen , "Christopherson, Sean J" , Florian Weimer , Linux API , Jann Horn , Linus Torvalds , X86 ML , linux-arch , LKML , Peter Zijlstra , Rich Felker , "nhorman@redhat.com" , "npmccallum@redhat.com" , "Ayoun, Serge" , "shay.katz-zamir@intel.com" , "linux-sgx@vger.kernel.org" , Andy Shevchenko List-Id: linux-arch.vger.kernel.org On Mon, Nov 19, 2018 at 05:17:26AM +0000, Jethro Beekman wrote: > On 2018-11-18 18:32, Jarkko Sakkinen wrote: > > On Sun, Nov 18, 2018 at 09:15:48AM +0200, Jarkko Sakkinen wrote: > > > On Thu, Nov 01, 2018 at 10:53:40AM -0700, Andy Lutomirski wrote: > > > > Hi all- > > > > > > > > The people working on SGX enablement are grappling with a somewhat > > > > annoying issue: the x86 EENTER instruction is used from user code and > > > > can, as part of its normal-ish operation, raise an exception. It is > > > > also highly likely to be used from a library, and signal handling in > > > > libraries is unpleasant at best. > > > > > > > > There's been some discussion of adding a vDSO entry point to wrap > > > > EENTER and do something sensible with the exceptions, but I'm > > > > wondering if a more general mechanism would be helpful. > > > > > > I haven't really followed all of this discussion because I've been busy > > > working on the patch set but for me all of these approaches look awfully > > > complicated. > > > > > > I'll throw my own suggestion and apologize if this has been already > > > suggested and discarded: return-to-AEP. > > > > > > My idea is to do just a small extension to SGX AEX handling. At the > > > moment hardware will RAX, RBX and RCX with ERESUME parameters. We can > > > fill extend this by filling other three spare registers with exception > > > information. > > > > > > AEP handler can then do whatever it wants to do with this information > > > or just do ERESUME. > > > > A correction here. In practice this will add a requirement to have a bit > > more complicated AEP code (check the regs for exceptions) than before > > and not just bytes for ENCLU. > > > > e.g. AEP handler should be along the lines > > > > 1. #PF (or #UD or) happens. Kernel fills the registers when it cannot > > handle the exception and returns back to user space i.e. to the > > AEP handler. > > 2. Check the registers containing exception information. If they have > > been filled, take whatever actions user space wants to take. > > 3. Otherwise, just ERESUME. > > > > From my point of view this is making the AEP parameter useful. Its > > standard use is just weird (always point to a place just containing > > ENCLU bytes, why the heck it even exists). > > I like this solution. Keeps things simple. One question: when an exception > occurs, how does the kernel know whether to set special registers or send a > signal? Yes, and AFAIK people do in many cases people want to do something else than just direct ERESUME in AEP handler so would neither be a major bummer for user space. If I remember correctly you have such? You can check the cases that we have for SIGSEGV (namely EPCM conflict) from Sean's patch 08/23. I'm open for expanding the scope. It is the easy part after there is consensus for the handling mechanism :-) /Jarkko From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga17.intel.com ([192.55.52.151]:15864 "EHLO mga17.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729331AbeKTA3e (ORCPT ); Mon, 19 Nov 2018 19:29:34 -0500 Date: Mon, 19 Nov 2018 16:05:43 +0200 From: Jarkko Sakkinen Subject: Re: RFC: userspace exception fixups Message-ID: <20181119140543.GF8755@linux.intel.com> References: <20181118071548.GA4795@linux.intel.com> <20181118130203.GA18934@linux.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Sender: linux-arch-owner@vger.kernel.org List-ID: To: Jethro Beekman Cc: Andy Lutomirski , Dave Hansen , "Christopherson, Sean J" , Florian Weimer , Linux API , Jann Horn , Linus Torvalds , X86 ML , linux-arch , LKML , Peter Zijlstra , Rich Felker , "nhorman@redhat.com" , "npmccallum@redhat.com" , "Ayoun, Serge" , "shay.katz-zamir@intel.com" , "linux-sgx@vger.kernel.org" , Andy Shevchenko , Thomas Gleixner , Ingo Molnar , Borislav Petkov Message-ID: <20181119140543.0hWCzfFJrgLRAT1oGiIRdWs4A_sT6nny-eADvXp2sis@z> On Mon, Nov 19, 2018 at 05:17:26AM +0000, Jethro Beekman wrote: > On 2018-11-18 18:32, Jarkko Sakkinen wrote: > > On Sun, Nov 18, 2018 at 09:15:48AM +0200, Jarkko Sakkinen wrote: > > > On Thu, Nov 01, 2018 at 10:53:40AM -0700, Andy Lutomirski wrote: > > > > Hi all- > > > > > > > > The people working on SGX enablement are grappling with a somewhat > > > > annoying issue: the x86 EENTER instruction is used from user code and > > > > can, as part of its normal-ish operation, raise an exception. It is > > > > also highly likely to be used from a library, and signal handling in > > > > libraries is unpleasant at best. > > > > > > > > There's been some discussion of adding a vDSO entry point to wrap > > > > EENTER and do something sensible with the exceptions, but I'm > > > > wondering if a more general mechanism would be helpful. > > > > > > I haven't really followed all of this discussion because I've been busy > > > working on the patch set but for me all of these approaches look awfully > > > complicated. > > > > > > I'll throw my own suggestion and apologize if this has been already > > > suggested and discarded: return-to-AEP. > > > > > > My idea is to do just a small extension to SGX AEX handling. At the > > > moment hardware will RAX, RBX and RCX with ERESUME parameters. We can > > > fill extend this by filling other three spare registers with exception > > > information. > > > > > > AEP handler can then do whatever it wants to do with this information > > > or just do ERESUME. > > > > A correction here. In practice this will add a requirement to have a bit > > more complicated AEP code (check the regs for exceptions) than before > > and not just bytes for ENCLU. > > > > e.g. AEP handler should be along the lines > > > > 1. #PF (or #UD or) happens. Kernel fills the registers when it cannot > > handle the exception and returns back to user space i.e. to the > > AEP handler. > > 2. Check the registers containing exception information. If they have > > been filled, take whatever actions user space wants to take. > > 3. Otherwise, just ERESUME. > > > > From my point of view this is making the AEP parameter useful. Its > > standard use is just weird (always point to a place just containing > > ENCLU bytes, why the heck it even exists). > > I like this solution. Keeps things simple. One question: when an exception > occurs, how does the kernel know whether to set special registers or send a > signal? Yes, and AFAIK people do in many cases people want to do something else than just direct ERESUME in AEP handler so would neither be a major bummer for user space. If I remember correctly you have such? You can check the cases that we have for SIGSEGV (namely EPCM conflict) from Sean's patch 08/23. I'm open for expanding the scope. It is the easy part after there is consensus for the handling mechanism :-) /Jarkko