From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from smtp4.osuosl.org (smtp4.osuosl.org [140.211.166.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 1258CC47258 for ; Wed, 31 Jan 2024 16:39:11 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp4.osuosl.org (Postfix) with ESMTP id B4CF541E33; Wed, 31 Jan 2024 16:39:10 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.11.0 smtp4.osuosl.org B4CF541E33 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=osuosl.org; s=default; t=1706719150; bh=1tE1rAWiZcCR1+0L0YG2jJBJ+FtyI/6x4WDfXxA1OZE=; h=Date:From:To:References:In-Reply-To:Subject:List-Id: List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe: Cc:From; b=ICcBKO1nkHNqXLAWPCFJxeB4GPyVoYHl3QSwKghRDxOFmQGo5GjerSnDiKBVYM91l AKPN4PAwZJQ+kCwGN2sTT5Ox08J9e8gvjAJb3azPf1hJke5zDZIO4PLyoRBAm6UT49 EDGD5HCHqqQnI15WFUqSvCmZ/jo/hP5vuThwMyDbE3WEU5MTcOsG1WAicJ/E+C58XO WSojHm7TcPBWoAD2Q+yR/oj906iwT/SoHGLSWdgKq7sBmrAPCSQQA1SlTeORK8MNCI NvM7DxHZPtjRk7/u3pLaoZ2o67yR3t5ZWDNH5PQW7lyEE65kivAUuPv+dcJir8mU/L 3zjqD91oCfv/w== X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp4.osuosl.org ([127.0.0.1]) by localhost (smtp4.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9mBtF_HuWfRo; Wed, 31 Jan 2024 16:39:09 +0000 (UTC) Received: from ash.osuosl.org (ash.osuosl.org [140.211.166.34]) by smtp4.osuosl.org (Postfix) with ESMTP id 9028841BE9; Wed, 31 Jan 2024 16:39:09 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.11.0 smtp4.osuosl.org 9028841BE9 Received: from smtp1.osuosl.org (smtp1.osuosl.org [140.211.166.138]) by ash.osuosl.org (Postfix) with ESMTP id 058211BF5A8 for ; Wed, 31 Jan 2024 16:39:05 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp1.osuosl.org (Postfix) with ESMTP id DCAE983C11 for ; Wed, 31 Jan 2024 16:39:04 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.11.0 smtp1.osuosl.org DCAE983C11 X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp1.osuosl.org ([127.0.0.1]) by localhost (smtp1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5Myxx6iMQUhX for ; Wed, 31 Jan 2024 16:39:04 +0000 (UTC) Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.14]) by smtp1.osuosl.org (Postfix) with ESMTPS id F2A2380E2A for ; Wed, 31 Jan 2024 16:39:03 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.11.0 smtp1.osuosl.org F2A2380E2A X-IronPort-AV: E=McAfee;i="6600,9927,10969"; a="3518200" X-IronPort-AV: E=Sophos;i="6.05,231,1701158400"; d="scan'208";a="3518200" Received: from orsmga001.jf.intel.com ([10.7.209.18]) by orvoesa106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 31 Jan 2024 08:39:03 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10969"; a="822617151" X-IronPort-AV: E=Sophos;i="6.05,231,1701158400"; d="scan'208";a="822617151" Received: from fmsmsx603.amr.corp.intel.com ([10.18.126.83]) by orsmga001.jf.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 31 Jan 2024 08:39:02 -0800 Received: from fmsmsx612.amr.corp.intel.com (10.18.126.92) by fmsmsx603.amr.corp.intel.com (10.18.126.83) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Wed, 31 Jan 2024 08:39:02 -0800 Received: from fmsmsx610.amr.corp.intel.com (10.18.126.90) by fmsmsx612.amr.corp.intel.com (10.18.126.92) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Wed, 31 Jan 2024 08:39:01 -0800 Received: from fmsedg601.ED.cps.intel.com (10.1.192.135) by fmsmsx610.amr.corp.intel.com (10.18.126.90) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35 via Frontend Transport; Wed, 31 Jan 2024 08:39:01 -0800 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (104.47.70.100) by edgegateway.intel.com (192.55.55.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.35; Wed, 31 Jan 2024 08:39:00 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=IV+YKAGhzjUGYekWvb00D9QzH/chmQb/fcHSre0Ltv+hdYh/aVt593YfUhNj4SHPEdU2iH1AK9gpP2tB7rL8xyu64n+vPe9kWi4VJdS6AKz/nuEFxHIJqgOTkrk+mkOLDZBhU5H+cpunGJV3Ng1NwuDAtkZMEtouSBO5Fe+1+LQ+vrq6LbTnfIwyGIEdITg80LVV0kFiWYVeUPWF/lPRX1543tHGDLUD1DU3UxL6xh1zSvDMwjG67Q7KdT+HVhJXBbxDiO3MSCTGa1oro+d1N+BAChrLv3GGUNf5h+uj64meMy71i2hMjVAZmEdzhchgoUq9kYdbzEmlL5l70SKfbA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=1tE1rAWiZcCR1+0L0YG2jJBJ+FtyI/6x4WDfXxA1OZE=; b=TCYS7RNMS9L0dBk5lbU7vIlPwOgFU6kWvuxx83gnEWCPsTU75UcIu6Jrqe7ZLogh97k+FHlgxPIPtW0IpWwsZqL2/z08MhwtfZDWWxru9yNNWS14fNAPmVnTUmYngOUAYO/ayiiv4kpZ6CgufDhESg22VTmK4rOncYLWP4uo0r83REew5biV/7pJExiEQysAH3CpB5DOBxiAWuVFX2oRL88BK3EagjI0m93f1osbd3xUGLYugjoKBq35jM6KyYL+LDIN3yIq4pO7YyaXIBhPr0XJUiSnb9umvU1hRC/oxbRvfdDmYzE3hazngNXGFxeU5ONaMmy7f7YshOUZp7cf2A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from DM4PR11MB6117.namprd11.prod.outlook.com (2603:10b6:8:b3::19) by BL1PR11MB5478.namprd11.prod.outlook.com (2603:10b6:208:31d::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7249.24; Wed, 31 Jan 2024 16:38:57 +0000 Received: from DM4PR11MB6117.namprd11.prod.outlook.com ([fe80::ccab:b5f4:e200:ee47]) by DM4PR11MB6117.namprd11.prod.outlook.com ([fe80::ccab:b5f4:e200:ee47%6]) with mapi id 15.20.7249.023; Wed, 31 Jan 2024 16:38:57 +0000 Date: Wed, 31 Jan 2024 17:38:53 +0100 From: Maciej Fijalkowski To: Seth Forshee Message-ID: References: <47eea378-6b76-46a7-b70e-52bc61f5e9f0@molgen.mpg.de> Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-ClientProxiedBy: FR2P281CA0170.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:99::19) To DM4PR11MB6117.namprd11.prod.outlook.com (2603:10b6:8:b3::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM4PR11MB6117:EE_|BL1PR11MB5478:EE_ X-MS-Office365-Filtering-Correlation-Id: 978725a6-3207-4779-a28a-08dc227b1f00 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: KsFHcJsUdayxNeKifBgFoq/gTGrfHslg1JmxCmS3JkYKon4q5cgSWP5oxmQEFjfLJNDQCMUe5AhH1ni/OuOclWSUyC8XAr2eVrUJzxRPXrm5x7eie/nSkBecTxy6Q3Io3v2VNCQijhkYVjxZYkp3sXA6USFXJkRJiM3TccHplTTwo7ge8+pybDBnV3oL0Z/OC9NhDfBdDPjtZhWfwvjyHuOnYTMb3GKTv02lZiE+2ebaskHFL3Iz7h4Lfr8+vFgym1eDastEJ1dGZwftCB+T8EcSyInzRrcsdfWcPWJK0MAq+/GNyhXo1eGQEAUs7S2/2orlImozRYPLbPesafnYYpHyPJrCSvBa0iW2NjIq7or1mfWwDMnaHnXkRaTOp0Z+j90mQ5yKsrlbDhnsSYDdwScbIk3VwS8GFNiUEDdQla/wF0IxqDF/2CFvM/HtTm/FkipZlSqy5DwX2YazFknJXP7e74GJbjvgwCJjWIKsijRTeorr08EurBe4ADYGE9cSpRNdZZ36apPFQ7IuhPt+MLSZ+v5HkZqJ3gkuv7nTBWU3ZXCPT4EzZkg/KhrZaIyW X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM4PR11MB6117.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(7916004)(376002)(136003)(346002)(396003)(39860400002)(366004)(230922051799003)(64100799003)(451199024)(1800799012)(186009)(26005)(107886003)(83380400001)(478600001)(6486002)(41300700001)(6506007)(6666004)(33716001)(8676002)(6512007)(9686003)(4326008)(8936002)(82960400001)(44832011)(316002)(66476007)(66556008)(6916009)(66946007)(54906003)(2906002)(5660300002)(38100700002)(86362001); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?aW00VWJHWEErZGd4TWs4K29LMHQrblBDM2lWVHBYWUQ5NjhPeHgzL0pPY1Yr?= =?utf-8?B?RzYvRUYvMlVqNTJONEZGelZWb2wvaWxwWkFVUDJWUWlrMW5WbEZOc1A3TVRi?= =?utf-8?B?T0pnenNIeCtWOUZoRGlad1hsQzdmRHUvaWFnT3lYZDNxcnZXcDFIQ1A2T3hD?= =?utf-8?B?bjBQSFZjVzBsdGJpVkpZQmQvR3dqaEo2SG5vTmgraktmd00rVlQ2NFArUnR1?= =?utf-8?B?aWtSMWRPbklXUExTUHRHTEl0VmJkQmZPSmlicEhWV0VYdXlIUUpCRzYyZnFH?= =?utf-8?B?YXNnWEN0eXNmK2V2WXRTUDY4YlhQNmx4Nk85eE5JQitKQXl4ZUlsYVdqVmlH?= =?utf-8?B?alB4M3hlVFhBcjYybUZtVG5rZEpsZ21ud2ZIdi90Y2hWMTVjOFZBdHp2Z0c1?= =?utf-8?B?QzZMbHBFbkRKRENvTG5iL2p0NmhNc0V5MUNPTldmSmlxMTdJS3VrbjdDOU1R?= =?utf-8?B?L1VMMHpPeElDQ3hJWXRpbUpQeFhFWlRyTUpKa0twM3JJdkdoU1MwMUF6SHNh?= =?utf-8?B?VU5VVE1EeVdxWFFVK3E1dysybnlOckVjNHdveWlHYXBSbGdPQ3lzTFEyZVFG?= =?utf-8?B?OEc3Vno0dndIZGtDUGtpQnhEempid1dvaFIrUGFqd2Q0VURQZWs4Ykd4Vmp3?= =?utf-8?B?eCtaZnFLR3JuWnNZK3JTeWduYVVMcWE1K3VTSTRwSjBNZzl5V251ZDBqQTdm?= =?utf-8?B?b01IOWlBV2FhYVE3TjRvc0k5dG5QcE1pa0hHUm9WcjNrTUt5dDlibmtwQjlU?= =?utf-8?B?Nk5LSHFYSlJqd3pybmVkQ3RBamJTR004ZEJkYWU3a2lvLzRMVm9kVkdGWGQr?= =?utf-8?B?TzhCMHZnK3IzMHR4aU8xR2dSRkJUbXorMTg5dlFIQVZrSStETmxET2ZQbTNi?= =?utf-8?B?THdtbCs2ejd3WUJKWnBNeEYvZDJrdEt4ektlc3RaRTdaN1RRYVRuUlBXL01Y?= =?utf-8?B?Y3IreTZydWFwT1V4VmNTN3dmWTFaNzFYekk2STd0ci83WkpXczFnalpuVWhu?= =?utf-8?B?WjJOTjIvRXBtdTVUR2twNWJ0dHIrcEFQNWJGSXFKdjh0VlFiaTNwSmJvcy9i?= =?utf-8?B?YzJ6MDcwVm1zNGpmbVdPb1FaUXFVOHpoTHRoZWswWHdUd1ZuZnhqWVNVeDJK?= =?utf-8?B?U0hVWW1aajlDK0tMNnNZQ20wRDFKSVdyYnU3U3AxbUU3SFRUTVJLYU5lM1Iw?= =?utf-8?B?SVdTekE0MXVxSWlicmtUdDF5ZlQyZkF5Y0JCRzFyWG96WlNlNy9ydWYwaEov?= =?utf-8?B?SktyR3VJNFhIcE92cCtNbUI4R2ozWUUzdFdYM2Z6UVBNYnVHTEliZnRuMDdK?= =?utf-8?B?d0tWbjh4UkpubzVjRSt3Uk5TSlE2ekJXUkc3WlJWaDdVNXN1Uzd2T29sa1Za?= =?utf-8?B?THhCbFpJcFM4QnlOa2VZS0M0Z3dIMDdMVVEwb0JpdUhEV0dVaUI2TWwybWVq?= =?utf-8?B?NTlLclgxQ2tkdlEyMUlJZXpYVGtBcUZnRkNhU0lUbUtadE4xR3V2VEdSeEJn?= =?utf-8?B?dlA3ZE5kdVprRDRCQXh0Y0kvZGkweFhpYzRIQzEyV2Y5OXRyOTBBZjN4MkhV?= =?utf-8?B?NnFlWVArODBGdHFlbXdjbGp4MTI0MDJrS2QrZlVlTTN4L3BJdFlHbVhsUm9Y?= =?utf-8?B?QzJ6Nkowb3NZdmdlMzl5MzRSMjBLV2FTQmpZNjE2bVJ4QWd3SEJjN3RBTHNW?= =?utf-8?B?cTRoWHFqTS8xVDFXUTRaak9WQTlxMUlmZ2dyWXdUc1lPNVlJZVRlR3lkZzh6?= =?utf-8?B?dVF6Um1PZVcwODF5bFI5OWRpN0Y5bWdWVTNhVTM1NGFwUWxKYzJVRFBFVE95?= =?utf-8?B?eGFxWFVjQTgvT054T2NZMzFGbGVvNHFlQ2dXYzUzYXFZdGRoRk04dUs2dENz?= =?utf-8?B?OUplZzhheFY0U1doeWpCUDFQSzQxNXBOZzc5amJLSmx1STdZU1JQVCs3eWxR?= =?utf-8?B?czdEQVJhNTJhMjh6Y1ExMXBDSW5ZTFVONHNTOGJiaS9ZR0VMLy8xWUVBalNS?= =?utf-8?B?cTRINmhYT2dTRytnSlJmZ05kZFRINWt5cTRNcE5NZDljOGwrVDd3Um9KRlVx?= =?utf-8?B?U2lubGJNOCtRZ1hybnJHZm4vR050aFpqQXQ1cVpmVTZBY083QU1POWZ5NFNQ?= =?utf-8?B?ZFdrS1BLZzV1eGhPREs5cmw0UURNVm9vU05sWmZBRXR4cTNFU0k0eExFWGZo?= =?utf-8?B?a3c9PQ==?= X-MS-Exchange-CrossTenant-Network-Message-Id: 978725a6-3207-4779-a28a-08dc227b1f00 X-MS-Exchange-CrossTenant-AuthSource: DM4PR11MB6117.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Jan 2024 16:38:57.7284 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: ynFHdUUgwHsBlKqY0pLAusl3/M20QIccDmN93DCLR1yMqrMPuK8WOs2UvkmjUQlUA644V7w59W/cVZJupYEQ/lmiW6CenFFCizCctUNkiM4= X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL1PR11MB5478 X-OriginatorOrg: intel.com X-Mailman-Original-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1706719144; x=1738255144; h=date:from:to:cc:subject:message-id:references: content-transfer-encoding:in-reply-to:mime-version; bh=kMNAiWJpvmRx/wwWojjV0G8FTTHaGA5RiB1bU2yLFwU=; b=QiAMQKvK7Uy5LXYwLJW/pyyRoysVYNgY6Paa06USNIy4au4AtV3CVUDo r0YWchMiJKxzNB/jPk152Wb3uZJNgBVSeAZoxgAltST0eLSdqoQcHEA3P KncEja3u6AL/dG1NUvhkcZYCfiNFPYFEpGWTNDlhAAR4cv5/BYr1Vxi+r yd+9qqL3uupXxNAEVcBfNDjJcul56c6FmAmXreX8k/GUZdwbDnd1ortQ/ PV4xGvuP4xqE2ie6k2CbGSo+/3UIbFxqXNsPH58Nx1Qknki/fWiGMlzi2 XRQfvedsajnNfFIpMpKdtxtxjfFICn4eOp8LRZvnylcAP8qhcULKkAGTn Q==; X-Mailman-Original-Authentication-Results: smtp1.osuosl.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.a=rsa-sha256 header.s=Intel header.b=QiAMQKvK X-Mailman-Original-Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Subject: Re: [Intel-wired-lan] i40e XDP program stops transmitting after link down/up X-BeenThere: intel-wired-lan@osuosl.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Intel Wired Ethernet Linux Kernel Driver Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Paul Menzel , netdev@vger.kernel.org, Jesse Brandeburg , intel-wired-lan@lists.osuosl.org, Tony Nguyen , magnus.karlsson@intel.com Errors-To: intel-wired-lan-bounces@osuosl.org Sender: "Intel-wired-lan" On Wed, Jan 31, 2024 at 10:26:07AM -0600, Seth Forshee wrote: > On Tue, Jan 30, 2024 at 11:06:07PM +0100, Maciej Fijalkowski wrote: > > On Tue, Jan 30, 2024 at 08:28:24PM +0100, Maciej Fijalkowski wrote: > > > On Tue, Jan 30, 2024 at 10:59:13AM -0600, Seth Forshee wrote: > > > > On Tue, Jan 30, 2024 at 05:14:23PM +0100, Paul Menzel wrote: > > > > > Dear Seth, > > > > > > > > > > > > > > > Thank you for bring this up. > > > > > > > > > > Am 30.01.24 um 15:17 schrieb Seth Forshee: > > > > > > I got a inquiry from a colleague about a behavior he's seeing with i40e > > > > > > but not with other NICs. The interfaces are bonded with a XDP > > > > > > load-balancer program attached to them. After 'ip link set ethX down; ip > > > > > > link set ethX up' on one of the interfaces the XDP program on that > > > > > > interface is no longer transmitting packets. He found that tx starts > > > > > > again after running 'sudo ethtool -t ethX'. > > > > > > > > > > > > There's a 'i40e 0000:d8:00.1: VSI seid 391 XDP Tx ring 0 disable > > > > > > timeout' message in dmesg when disabling the interface. I've included > > > > > > the relevant portions from dmesg below. > > > > > > > > > > > > This was first observed with a 6.1 kernel, but we've confirmed that the > > > > > > behavior is the same in 6.7. I realize the firmware is pretty old, so > > > > > > far our attempts to update the NVM have failed. > > > > > > > > > > Does that mean, the problem didn’t happen before Linux 6.1? If so, if you > > > > > have the reproducer and the time, bisecting the issue is normally the > > > > > fastest way to solve the issue. > > > > > > > > No, sorry, I should have worded that better. I meant that they were > > > > using 6.1 when they noticed the issue, not that kernels before 6.1 did > > > > not have that issue. We've also tried a 5.15 kernel build now and still > > > > see the issue there, we haven't tested anything older than that. > > > > > > Hey Seth, > > > > > > I am observing same thing on my side with xdpsock in txonly mode, so I'll > > > take a look at this and will keep you updated. > > > > Can you try this diff on your side? > > That fixes the problem! Awesome. I'll send a proper fix then and will keep you in loop. > > Thanks, > Seth