From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-qk1-f175.google.com (mail-qk1-f175.google.com [209.85.222.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 13699188012 for ; Fri, 7 Feb 2025 19:01:54 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.222.175 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1738954916; cv=none; b=svg1IdhEczehLCmHL8fkXss/9Z9Lhr7GI8afchvHcGYux6XgwqFgg1ST4SR4OAte4gmRdeyJFJc/DO88l0WyCMseLiF6e6/XZKCkJ1OpGkeVdNKj1Zf+Kt1UJPkLH2TTVNpxtAI2RkNvNMcfoyUzZxOUEivRiupydiYc2HS+XJM= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1738954916; c=relaxed/simple; bh=YPSaecsiFXwDzTGHAFZ+jSzAX3eweeruBqLKgpgEvCY=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=qdoRwWdw3w1473YD9Kj0lJmmeoGShhkhz13yvIrnvi0fpxtlkUoq5RuvLRj4mNEXJxF80o1tdzcnNPbp4yBe/u4eMAwCnxyXryA/wiU+kdEjg5u7vtRG1hqrKR5Cyb0vuj4c0R3pe8Dt8hFOB3QPAZF09f2z6ROvXQ3KmhQ2n/0= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=ziepe.ca; spf=pass smtp.mailfrom=ziepe.ca; dkim=pass (2048-bit key) header.d=ziepe.ca header.i=@ziepe.ca header.b=W9a48pDC; arc=none smtp.client-ip=209.85.222.175 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=ziepe.ca Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=ziepe.ca Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=ziepe.ca header.i=@ziepe.ca header.b="W9a48pDC" Received: by mail-qk1-f175.google.com with SMTP id af79cd13be357-7b6f53c12adso193997085a.1 for ; Fri, 07 Feb 2025 11:01:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ziepe.ca; s=google; t=1738954914; x=1739559714; darn=vger.kernel.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=jhHb/Iyzu9wCbvQ3EuxPsy9WEDtQ71gsxOEbCbrMAfg=; b=W9a48pDCS4gt7FtBNlj7uKmO9Pm2RKBBxA9qICSurXf0AhrGc5f1hhwZGIeuFnT/Eh QRcWjyALaxu8QteGT5B6VQVJ8ZXe5fLZMEBVDZk/rkDdtqRlF8HcrJjbCwN0QzQy78Ee YLMOnUH7IylejaoHt3HLJRFJIc1zc9DZE8gSUYAnn0Rz7nNhc2JStbwQbbBl2/ZUmuXm 8CTNOlV1/pkv6WWuCp2aVNHycS9d9j9I0v4T6ZxqBCf4dyQ/QVJNNOkRZNvd5/v+tSMO gaMmADwnAcZz7nWJziV7K77t6BnFs6Tap9R1Zwr+7tmnhHKX633UTaMlmk/MhKi/Q/Hi ZdRQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1738954914; x=1739559714; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=jhHb/Iyzu9wCbvQ3EuxPsy9WEDtQ71gsxOEbCbrMAfg=; b=WxUTTnFMZIIjlkdGEOgOH5ipAo/K6xKm+uM96d7ffXVdYfeka6vCICT7DUng1wlLDS 8zd6pV1zGhSIGn6tiAAJmHkRfVsU0V2DC0I4GhLv2oZyQ8/EPnd3rB/mQ4nU79z34RVY obVkuKzgzP/2sO6AtOhTb2yoKryEcw478Bs2kpvdFjG/Gbmky5K1yQuOkEGAYDcocxr5 ykmeBwVTIu5TlqtTfKMG5FrGVAYLPlPZpbwVmAZzcCYLQlsqWhVmwM8z5vplPRBHpDfF LCDa/GGI3GDHurUqZm2wa4yQyvWmemFkVwn/UW6T9JTSKuB5mlhWqYhXEftNPGmRX1TW bikg== X-Forwarded-Encrypted: i=1; AJvYcCUuZ+uiBl9/WJl/7MLr/wZ+5t7oG5z9+K6hW1w8fMYE4ErpiUaVb/To0z0wJUVh6MLRTVCBvspVzPV3@vger.kernel.org X-Gm-Message-State: AOJu0YzP0Rk6qiconNkaDtN6tGIbcjHAf7A0QSIIFoEZ3wGzrmufVPRC Ue4IhluEUKl8moq1j7Kyoy0tKYXxV6IWrIkS3sqmN1VHSdnxVypD2jr7qKNHoYA= X-Gm-Gg: ASbGncu4nmWHPCcX9TCyreczZZJIcN60Ezj23seBY76fYVKSg87rYWuOEzg3IyoYjb2 ZFEmEuO87mO1D5eCV4wdHphXrPWbjaHRM/r1mrtVVSoXvx6LmqtUDckuEcbdhDjAuUYwPCPYDfl fICgS/r8fPBvCHNtNIahZg09SjLZV3aMP9P2n7+bKDE5vbA+67XvJHuAexI4A3DY1Z2wfOn2fuW ypB0PRjrCFITbBud/8ou2tR74eTAuQTU8wXanYFB0LjOxtwdYWITd5gNKumbLdBfHnm4yE9zYaC RMHm9aSDpQB3pnODbZDUJaCE3rewFtU4zchhIgk5Dd0V0x7jAgp1ZTZeT9n8tVbe X-Google-Smtp-Source: AGHT+IGI7NvAKLU4JsJOvorfEjiFHTyYvApddGJTHotUW76EJE4gTICxKMW+ZU1MxMaOyB1msPjlAw== X-Received: by 2002:a05:620a:2b99:b0:7b7:106a:1991 with SMTP id af79cd13be357-7c047bba9demr630217685a.16.1738954913493; Fri, 07 Feb 2025 11:01:53 -0800 (PST) Received: from ziepe.ca (hlfxns017vw-142-68-128-5.dhcp-dynamic.fibreop.ns.bellaliant.net. [142.68.128.5]) by smtp.gmail.com with ESMTPSA id d75a77b69052e-47153bc75aesm19533301cf.64.2025.02.07.11.01.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 07 Feb 2025 11:01:53 -0800 (PST) Received: from jgg by wakko with local (Exim 4.97) (envelope-from ) id 1tgTbs-0000000FUFC-1jHG; Fri, 07 Feb 2025 15:01:52 -0400 Date: Fri, 7 Feb 2025 15:01:52 -0400 From: Jason Gunthorpe To: Mitchell Augustin Cc: saeedm@nvidia.com, leon@kernel.org, tariqt@nvidia.com, andrew+netdev@lunn.ch, "David S. Miller" , Eric Dumazet , Jakub Kicinski , Paolo Abeni , netdev@vger.kernel.org, linux-rdma@vger.kernel.org, linux-kernel@vger.kernel.org, Talat Batheesh , Feras Daoud Subject: Re: modprobe mlx5_core on OCI bare-metal instance causes unrecoverable hang and I/O error Message-ID: <20250207190152.GA3665794@ziepe.ca> References: <20250207155456.GA3665725@ziepe.ca> Precedence: bulk X-Mailing-List: linux-rdma@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: On Fri, Feb 07, 2025 at 10:02:46AM -0600, Mitchell Augustin wrote: > > Is it using iscsi/srp/nfs/etc for any filesystems? > > Yes, dev sda is using iSCSI: If you remove the driver that is providing transport for your filesystem the system will hang like you showed. It can be done, but the process sequencing the load/unload has to be entirely contained to a tmpfs so it doesn't become blocked on IO that cannot complete. Jason