From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-wr1-f41.google.com (mail-wr1-f41.google.com [209.85.221.41]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 2E938314A6A for ; Thu, 13 Nov 2025 21:21:57 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.221.41 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763068920; cv=none; b=MqKaxFCcMKSd81/73/W5RjasvFSWPxutH7aAFEAXXqXfulHwiVlv+pdUY3mMGyDa71RuGa2a/u29FXgm8zqlSogLwhpf3zkf3/VNF/aBeDn4puYXbw4CNFTl8K36rHJBMyf5GlmbaljEBLUoMkftqnTI34TPmXhUGPtduYVVx3Q= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763068920; c=relaxed/simple; bh=TjDU/af5FiAhFROINzGit2UUjQ3aPYBQkK+NOxk+7eg=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=WZC6Pls6sqKzCKl7ArNTuV0H1CIH7MwuyZxlOYNwcio6z73aLCd6b603ZSfdmSzv6pnRGp87BfqpXm3Oq/urHiq48fI4zZOuxw41uhN6TwAq9+IswmqRO5+RxgdSU519HJm/RFQdarZmxY91AKehkuKOXP1C+4x08RDJ184yHD0= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=debian.org; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=Rd4hb4Z7; arc=none smtp.client-ip=209.85.221.41 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=debian.org Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="Rd4hb4Z7" Received: by mail-wr1-f41.google.com with SMTP id ffacd0b85a97d-42b566859ecso833745f8f.2 for ; Thu, 13 Nov 2025 13:21:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1763068916; x=1763673716; darn=vger.kernel.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=VoHlN1Uh/L/WCMIqqxrIQUNXoefV1yby25Jl36zSEDw=; b=Rd4hb4Z7vYqhidTfUJC4XKaWaA/Koi6CAWMKcKHRgzVe43rV4BD9vSk82ci9yqzF/1 wMXCV068w1G5pn6ps0l60ECdvsdzEIoCs/dmUNFDq9QW5xmmM7NqfrOyUDS4dVKCOyPL jbbmQKVsBxOb6wQl2YiYJ0COmEeOq9UJrm/laZEZ9xU5BggVMpzpP/7AQOLFn/Zn6QJQ fiW/UO8CR4rD+si+ExJnh8G2FBz3yBXgkdV5VPjGEhHcCQkizAxdGkDEOqnkIuDYGl/4 EGY59QExRzq+Vy678kgpbmeBzOMC8cCcZosGLD/IvkOgc4BHGNFtS13+vLCWlEi/0Sz+ DdhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1763068916; x=1763673716; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=VoHlN1Uh/L/WCMIqqxrIQUNXoefV1yby25Jl36zSEDw=; b=vzSl30TZExHWgX0/6xevYq0uZGuu2kXCTVPYUEJ5qf4ukzsm/fwuP5XGPmlrRD4QeZ fcc/lsm1fjihlwIXA5xJznE1EKwpiieDNjCudQfhiY6KD4u1cf6KUkxh66G4JGtFSW+Y raKcSD8OX+xt/v1l9UEi/NbA4Rp7eOPajvrvcrYlGPYTxXkBBdskXCGypHYwoFOEqa6Z lCnoWgrM+x/iX8ujwdQKfj+t8Gvw5bacPZm+YIPcvBhLMwjD9iA0CVsIJsukGExridOx /wisrq/ro0y4gNbtfusxpk9pV48SiU0gOsGXH+XxllP2AukRal/st+pkyDwIB41cHHjU a3mg== X-Forwarded-Encrypted: i=1; AJvYcCWL7SjQ6R1972W51kDJRF03yJ588IG7FPX45EkxrhU1q8afm1xfMPCs8vHlwq6CNKb2+gmTnmV/+7OkXvs=@vger.kernel.org X-Gm-Message-State: AOJu0YxVZBry28307A6QxsQY2uMC45d05UygI+G+rpapcsG8byEjU2+6 mtNjG4AeLV4a8c89HYHTNISiLQo9BIrocVFDJOLW+82+7UUfjJIkCJ1M X-Gm-Gg: ASbGncvDurRhPYL1gIg03IEFIqb/mVTtZW+3+7gx7tH/87fX1INBcvZR0KeUHxiys2J b6+xCOsdwEJsop+J7jQCTmRA65KCv5LzGZ1EKJNiakKt/Q/aQGbed7OHXr3wPJqUZVUZwWvedip joGRlHqVGplcNgjktS/VPANLJXsV0ZWb90vbvA8CCE/yPGstWIpinooJSTQWil7PKDeUNm0dxwM IWycp7fsZVgEG2z0o9eduiGQVv1x+WwMcFBe0XNjJJf5gox6IZA4LrrvsI+PM+C6D3c5L0iQhoQ D6ib0Kc63T6NLwftf/nL0/mBe6G+oOP89hehNi/zIPty0y4EBGEL9PyuV+A0Pk3fQLNK54N/6p7 IghuO97d+ba8kmPCu3kBI/VgfNAWMRC9g1uhfcYT6AZKd55IuQ/90XqU4Jvd41qZNq+PzzZ2UVV u8MlDEQKLx2f3u6zlNIjTEUMcragui81r+/w== X-Google-Smtp-Source: AGHT+IGgdlQfJ5OD5HJ3tyT6iHcoRgEsMixVoGakZcW9KLWIBx8U/Y3z4mMK6LTxbeNZ0lbK+OCTag== X-Received: by 2002:a05:6000:1447:b0:42b:3a84:1ee6 with SMTP id ffacd0b85a97d-42b5934e2d7mr692084f8f.24.1763068916210; Thu, 13 Nov 2025 13:21:56 -0800 (PST) Received: from eldamar.lan (c-82-192-244-13.customer.ggaweb.ch. [82.192.244.13]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-42b53f0b513sm5950645f8f.30.2025.11.13.13.21.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 13 Nov 2025 13:21:54 -0800 (PST) Sender: Salvatore Bonaccorso Received: by eldamar.lan (Postfix, from userid 1000) id 0BDE7BE2EE7; Thu, 13 Nov 2025 22:21:54 +0100 (CET) Date: Thu, 13 Nov 2025 22:21:54 +0100 From: Salvatore Bonaccorso To: Chuck Lever Cc: "Tyler W. Ross" , "1120598@bugs.debian.org" <1120598@bugs.debian.org>, Jeff Layton , NeilBrown , Scott Mayhew , Steve Dickson , Salvatore Bonaccorso , Olga Kornievskaia , Dai Ngo , Tom Talpey , Trond Myklebust , Anna Schumaker , linux-nfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: ls input/output error ("NFS: readdir(/) returns -5") on krb5 NFSv4 client using SHA2 Message-ID: References: <176298368872.955.14091113173156448257.reportbug@nfsclient-sid.ipa.twrlab.net> <8d873978-2df6-4b79-891d-f0fd78485551@oracle.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Hi Chuck, On Thu, Nov 13, 2025 at 12:47:23PM -0500, Chuck Lever wrote: > On 11/13/25 12:16 PM, Tyler W. Ross wrote: > > Thanks, Chunk. > > > > Suggested trace-cmd report from the client follows. Last 3 lines appear salient, but I've included the full report just in case. > > > > -0 [001] ..s2. 270.327040: xs_data_ready: peer=[10.108.2.102]:2049 > > kworker/u16:0-12 [001] ...1. 270.327048: xprt_lookup_rqst: peer=[10.108.2.102]:2049 xid=0x7b569c7a status=0 > > kworker/u16:0-12 [001] ...2. 270.327050: rpc_task_wakeup: task:00000008@00000005 flags=MOVEABLE|DYNAMIC|SENT|NORTO|CRED_NOREF runstate=0x6 status=0 timeout=15000 queue=xprt_pending > > kworker/u16:0-12 [001] ..... 270.327054: xs_stream_read_request: peer=[10.108.2.102]:2049 xid=0x7b569c7a copied=988 reclen=988 offset=988 > > kworker/u16:0-12 [001] ..... 270.327055: xs_stream_read_data: peer=[10.108.2.102]:2049 err=-11 total=992 > > ls-969 [003] ..... 270.327062: rpc_task_sync_wake: task:00000008@00000005 flags=MOVEABLE|DYNAMIC|SENT|NORTO|CRED_NOREF runstate=RUNNING|0x4 status=0 action=call_status > > ls-969 [003] ..... 270.327062: rpc_task_run_action: task:00000008@00000005 flags=MOVEABLE|DYNAMIC|SENT|NORTO|CRED_NOREF runstate=RUNNING|0x4 status=0 action=xprt_timer > > ls-969 [003] ..... 270.327063: rpc_task_run_action: task:00000008@00000005 flags=MOVEABLE|DYNAMIC|SENT|NORTO|CRED_NOREF runstate=RUNNING|0x4 status=0 action=call_status > > ls-969 [003] ..... 270.327063: rpc_task_run_action: task:00000008@00000005 flags=MOVEABLE|DYNAMIC|SENT|NORTO|CRED_NOREF runstate=RUNNING|0x4 status=0 action=call_decode > > ls-969 [003] ..... 270.327063: rpc_xdr_recvfrom: task:00000008@00000005 head=[0xffff8895c29fef64,140] page=4008(88) tail=[0xffff8895c29feff0,36] len=988 > > ls-969 [003] ..... 270.327067: rpc_xdr_overflow: task:00000008@00000005 nfsv4 READDIR requested=8 p=0xffff8895c29fefec end=0xffff8895c29feff0 xdr=[0xffff8895c29fef64,140]/4008/[0xffff8895c29feff0,36]/988 > > Here's the problem. This is a sign of an XDR decoding issue. If you > capture the traffic with Wireshark, does Wireshark indicate where the > XDR is malformed? > > If it doesn't, then there is some problem with the client code. Since > Fedora 43 is working as expected, I would guess there's a misapplied > patch on Debian 13's kernel...? if it is helpful: Debian follows the stable upstream releases (6.12.y for trixie/Debian 13, right now 6.17.y for Debian unstable) and we try to keep the patches limited which we apply on top. So far I see none which touches net/sunrpc/. The patches applied: https://salsa.debian.org/kernel-team/linux/-/tree/debian/6.17/forky/debian/patches?ref_type=heads (in case this could help narrowing down more the issue). But we could try here additionally, if Tylor has the possibility to do so, to try directly the 6.17.7 upstream version without Debian patches applied. Regards, Salvatore