From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1C3E3C6FA8F for ; Tue, 29 Aug 2023 14:54:41 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237110AbjH2OyP (ORCPT ); Tue, 29 Aug 2023 10:54:15 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:43396 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S237196AbjH2OyE (ORCPT ); Tue, 29 Aug 2023 10:54:04 -0400 Received: from mail-yb1-xb4a.google.com (mail-yb1-xb4a.google.com [IPv6:2607:f8b0:4864:20::b4a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7E382CCF for ; Tue, 29 Aug 2023 07:53:48 -0700 (PDT) Received: by mail-yb1-xb4a.google.com with SMTP id 3f1490d57ef6-d7b957fd276so98809276.0 for ; Tue, 29 Aug 2023 07:53:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20221208; t=1693320827; x=1693925627; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:from:to:cc:subject:date:message-id:reply-to; bh=Ky3d8D5ymMbIfBXVq+qxATqRkOwyZi9DsKmup3PNcMU=; b=Ua0W/oI31W8kUh/mHh4BdS2E2RdrGmHy0OtqHOz3gXV1Lahp9Dxfake9juOgfTiG0j 2ylXmDJDrNLcCvXlhi0Ke44vP9K4tguMaJIzzR9FChgoEgrtVtxElPY/VOauMk7LQaKQ smLj8bZ67HFSY23UOiZ1KPNqEfchppKoat9VY6sZu7zpGwxwzEBpwfHkIAwWfAOPLqQh 2osGf4wqHydez1ufUZx+diQuoyuGYIq2Cimkx9JlNLAsfA5XEBhoOfOha0cdyKbFmXDu RWK8ALjcrH2QRu3Vm9+n3DqK8+ws1LNaRPr2y6qF6dZUaKckPD1Bb8kgQ21n40LSyu9q A+NA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693320827; x=1693925627; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Ky3d8D5ymMbIfBXVq+qxATqRkOwyZi9DsKmup3PNcMU=; b=UZXszsQgsfboM3H4wOHBmMtTT//z5CkcwbDTXIxujRJUegcnKkE7+GLuceiyItlCYe zCRXdjOYpzupOjTzwsgynfM9459Fv/5xB/kE0bZXl5SYHqY4oa2aYY4NY16cFX5VNGll Nt/3iByKV5K3Y9kFx1rFLP47g7KM1CIziJf5/sOSB1o0hHeVm50X4yj3a3kWEQhdbpzh 2oBSz5SgiJAr57OX/ebQRz+gh1mC2W0BsAzT8N6H1uYuLMppuU3uG9q+oI0zc/zVAZVN Vjv1PJWfWlavEVhByc/HgEb8NdOPSZei90BFQvPbIlDF4USUzQ33E6oQ8FJSTu1625W3 0zyA== X-Gm-Message-State: AOJu0YwhmewnhKz8I+ZIGN7x9VWOVb4xjoldRuzUXDkTCbu6OkOdOqnX 0fKUF4PUeth+TsQ+Dx5GTc0Dz2J9GOA= X-Google-Smtp-Source: AGHT+IFUIM4+6E0xyUCXjdjIabWpHNkXAnpnYs2UsN4bcqdefeenkaN9AY+O7fjrvHm1zce80Y3CwZ5v41w= X-Received: from zagreus.c.googlers.com ([fda3:e722:ac3:cc00:7f:e700:c0a8:5c37]) (user=seanjc job=sendgmr) by 2002:a5b:991:0:b0:d07:9d79:881c with SMTP id c17-20020a5b0991000000b00d079d79881cmr979102ybq.11.1693320827774; Tue, 29 Aug 2023 07:53:47 -0700 (PDT) Date: Tue, 29 Aug 2023 07:53:45 -0700 In-Reply-To: Mime-Version: 1.0 References: Message-ID: Subject: Re: Linux 6.5 speed regression, boot VERY slow with anything systemd related From: Sean Christopherson To: Marc Haber Cc: Bagas Sanjaya , linux-kernel@vger.kernel.org, Linux Regressions , Linux KVM , Paolo Bonzini , Tony Lindgren Content-Type: text/plain; charset="us-ascii" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Aug 29, 2023, Marc Haber wrote: > [Please keep me on Cc, I am only subscribed to linux-kernel] > > Hi Bagas, > > thanks for your quick answer. > > On Tue, Aug 29, 2023 at 03:17:15PM +0700, Bagas Sanjaya wrote: > > In any case, bisecting kernel is highly appreciated in order to pin down > > the culprit. > > Without having read the docs (that came too late, need to read up on > that again), my bisect came out at > 84a9582fd203063cd4d301204971ff2cd8327f1a being the first bad commit. > This is a rather big one, that does not easily back out of the 6.5 > release. Sadly, just transplanting drivers/tty/serial from a 6.4.12 tree > doesn't even build. I'm adding Tony Lindgren, the author of the commit, > to the Cc list. > > But, since the commit is related to serial port, I began fiddling around > with the serial port setting on the misbehaving VM and found out that > running the VM without the serial console that I am using (thus removing > "console=ttyS0,57600n8" from the kernel command line) makes the machine > boot up just fine with the 6.5 kernel that I built yesterday. It is not > even necessary to remove the virtual serial port. > > The issue is still somehow connected to the host the machine is running > on, since my VMs all have a serial console and the test VMs running on > different hosts are running fine with 6.5. What is different between the bad host(s) and the good host(s)? E.g. kernel, QEMU, etc.