From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mike Christie Subject: Re: SOCK_MEMALLOC vs loopback Date: Wed, 04 Mar 2015 22:03:51 -0600 Message-ID: <54F7D5A7.1060404@redhat.com> References: <20150304200427.GQ3087@suse.de> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Transfer-Encoding: 7bit Cc: ceph-devel@vger.kernel.org, Eric Dumazet , Sage Weil , NeilBrown , netdev@vger.kernel.org To: Mel Gorman , Ilya Dryomov Return-path: Received: from mx1.redhat.com ([209.132.183.28]:40770 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750998AbbCEEEC (ORCPT ); Wed, 4 Mar 2015 23:04:02 -0500 In-Reply-To: <20150304200427.GQ3087@suse.de> Sender: netdev-owner@vger.kernel.org List-ID: On 03/04/2015 02:04 PM, Mel Gorman wrote: > On Wed, Mar 04, 2015 at 09:38:48PM +0300, Ilya Dryomov wrote: >> Hello, >> >> A short while ago Mike added a patch to libceph to set SOCK_MEMALLOC on >> libceph sockets and PF_MEMALLOC around send/receive paths (commit >> 89baaa570ab0, "libceph: use memalloc flags for net IO"). rbd is much >> like nbd and is succeptible to all the same memory allocation >> deadlocks, so it seemed like a step in the right direction. >> > > The contract for SOCK_MEMALLOC is that it would only be used for temporary > allocations that were necessary for the system to make forward progress. In > the case of swap-over-NFS, it would only be used for transmitting > buffers that were necessary to write data to swap when there were no Are upper layers like NFS/iSCSI/NBD/RBD supposed to know or track when there are no other options (for example if a GFP_ATOMIC allocation fails, then set the flags and retry the operation), or are they supposed to be able to set the flags, send IO and let the network layer handle it? > other options. If that contract is not met then using it can deadlock the > system. It's the same for PF_MEMALLOC -- activating that is a recipe for > deadlock due to memory exhaustion. For rbd and iscsi's SOCK_MEMALLOC/PF_MEMALLOC use, I copied what you did for nbd in commit 7f338fe4540b1d0600b02314c7d885fd358e9eca which always sets those flags and seems to rely on the network layer to do the right thing. Are they all incorrect?