From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6CFBDC48260 for ; Sat, 10 Feb 2024 15:16:12 +0000 (UTC) Received: from mail-wm1-f44.google.com (mail-wm1-f44.google.com [209.85.128.44]) by mx.groups.io with SMTP id smtpd.web11.15392.1707578169519360015 for ; Sat, 10 Feb 2024 07:16:10 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=UIl7k8LO; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.44, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f44.google.com with SMTP id 5b1f17b1804b1-41097f9a9a4so2716005e9.2 for ; Sat, 10 Feb 2024 07:16:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1707578168; x=1708182968; darn=lists.openembedded.org; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:cc:to:from:subject:message-id:from:to :cc:subject:date:message-id:reply-to; bh=KQNRmwugIgVCELXucx+ORy8dvZBf6UNimmq/kLqFS2I=; b=UIl7k8LORiRggWp4/flxtk5/Utli4Z0KbqZSwOrPDq3qrRnG1P7m74FIFVIrNoKJRs vF2btW3uZt1ypb41K4v0gRJp22WM5w6rSzWvVJZwULpHnCo3zZX/AiDxVdJ9speGe37p iIa7lhOI/sjjJa4cVrD3WB5YC7Ybme7ha85Cc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707578168; x=1708182968; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:cc:to:from:subject:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=KQNRmwugIgVCELXucx+ORy8dvZBf6UNimmq/kLqFS2I=; b=SPh/5YJf5A5a4i1zHk1g61N/5lu5jFjopWd9k27hFwJpefDqftQ7bqZV16EMcIAvj7 MLp2enf3xvM1U5BxxiAlgalEr8N1aJh0d0FUy53NrEvnbfOMBfZogyNZhrs10/TYkiab 0KG52QnN6oNxDM4S+93tmg3l1R0nfMrcyKsMC5cMQeSHDVTGOCpPBOb8Xw073gtW/vgv N4g6VSeSyG0KwNtMkRC41k8KeF9+yCOj0Ulh7lOd41odAechZbt39ABK2knmp+3UUszI vUfdWzUMPO5edVnDi0ifxuBHIvXUpgZf3JWVPS8EpGgrVbcX7D9ch0JqzGqY5Iq91lwv tYqw== X-Gm-Message-State: AOJu0YzpBdGYQo2hfXatliz3qttwlE+C/wjzIuxwGbpbhG7ARrUpHvZq wF7jOko7Bi9bqLIQAPNhXD74/LsRY00WQ0UP1aEznv8XfXy+FJ3XepJU9DY0cTs= X-Google-Smtp-Source: AGHT+IFjODDakezpN7wgjlNE6U7DyoTeMoCDzJ0+p4ca+W1SJ/k/5DhdS3fiUxU9gma3jxdgI8XG+A== X-Received: by 2002:a05:600c:45d1:b0:410:7bfe:c605 with SMTP id s17-20020a05600c45d100b004107bfec605mr2151712wmo.20.1707578167733; Sat, 10 Feb 2024 07:16:07 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCUkHMN1NPiG3HcFLuQVkACEb/vKU7jkAEjH6PE2Ke47D7T1LH8aZY62SNBeRJrWQ9PRWaDp4Ut8eqxnuR/j5/zDY/e3xPs/qfcMs4s8PifRcH2ayUc= Received: from ?IPv6:2001:8b0:aba:5f3c:c350:b3c8:3bca:cef1? ([2001:8b0:aba:5f3c:c350:b3c8:3bca:cef1]) by smtp.gmail.com with ESMTPSA id bt9-20020a056000080900b0033b75d0993esm571917wrb.74.2024.02.10.07.16.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 10 Feb 2024 07:16:07 -0800 (PST) Message-ID: Subject: Re: [bitbake-devel] regression of 'world' performance? From: Richard Purdie To: Alexander Kanavin Cc: Khem Raj , bitbake-devel Date: Sat, 10 Feb 2024 15:16:06 +0000 In-Reply-To: <17B257441406400D.588@lists.openembedded.org> References: <0186f166a0ded0d97d5e19f64a3dd8e5ad44a92f.camel@linuxfoundation.org> <947006112712dcca07c607eb6b49b7e4e475c3d9.camel@linuxfoundation.org> <829c8fff2e6735297f036fdb878f4d244cf08f91.camel@linuxfoundation.org> <17B24084174823DE.15017@lists.openembedded.org> <17B255DB2CE33879.588@lists.openembedded.org> <17B257441406400D.588@lists.openembedded.org> Autocrypt: addr=richard.purdie@linuxfoundation.org; prefer-encrypt=mutual; keydata=mQINBGN1PzgBEADqZynxX+ivalgYtZ+AoHoGynCiJw0lR+H9rC83sj9z38nlKHBCuh8r8KOqelDUf1B73E9oCLjZQVwqKLmao6ZDQYt7utG+h6qGLEgyDfeochYkLwElvRtjhTp0Ks5WPIHUgE4lwfqmsLrHbkEfRYui9eSd+zJpPKTRgQ7WhTGfRaXPEVYn24fWEo637biLyoEop1qaZMoY/mPsflDYDISWgAeunFx63oL9zNAhOWbLIy2uicKq2GyS56CooPzQkpUv7ssQBOqXp/FSuGJ49RV7Npj/eXyEepAh3BtMliJF08rAj07Hpywp3skXku8YcwUAD7TqOnJ4Wr6G8vpJlQKSITIGMBqtq3f8+SwImWEMRVXxDzrmznihOC7qEUWH4tN/AEkz2BJQbGYnp3iQjZqsoqKblyC83/5MCCUHHpDg20HooEWVNTUxUa8dGWaJehKC5fX1276Sm4WLaoqbQwSGCmwS1e+LjO9lFT80WHIELw07iDhQxshNqVLIxCt3pZfWRlf9fHCtxStiQIRrQLAKN7ze+//YjExjkDOt1ZFIsgMmKIQmJ6b8kRAAmQUraTcn4E/hy0mArFLmROyPSc1nD8hQMeELDcjyjEmo7j3qQCsU464v4tcvJVXyqPc4TU1GDQdZBaKP0/jR68aR3ZOvzx99jdocPdHNW4Kpbv6PnQARAQABtDNSaWNoYXJkIFB1cmRpZSA8cmljaGFyZC5wdXJkaWVAbGludXhmb3VuZGF0aW9uLm9yZz6JAlcEEwEKAEECGwEFCQPCZwAFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AWIQQRclb3b/q6zLA9Fn+aUMY1GLyygAUCY3VBgQIZAQAKCRCaUMY1GLyygAtOEADglyjAhkCSGGetbs40FJ4 xdHKck7aaB1FgbpGn9e9/WAeAPC722eJsxhujxgKaS9b7mHcTcWeMP7KFut4yKTDHovt4VbQOd PGqwyUmi8z0yd2ORlT9E3RjEEllpj/Z2Wfzs3H4qR5wz3Rij1BCirDH8LD5yAO8PpIW2N1Y4VbzFDTPX2KtLGQYIraOHZQQe8XjAJnXflVQbzSIbNw14IlVWnF94UwkamxRhhCVAdA4139ebU+R0inaVsG0Bb7GP3KiED4C1I/tj171G4bOsyz3zYkpuV64yuq5pVevLBuCJv1Z/yiBdbB02B+FkosKLWRvoZFa2gqK2xpZT8RvDdkBQTmZTs/hP59mh1QSt4d2p1KsBu7cx2fjRBuf9XVG+uR/XnbD5T1BQRVV641ZNzPTjtE3rEZzR1nsUv+vcFYv0V/FPcLg5f3Ui+4cuYj/xDykMKZlrBIVGExBOJr7Anbzwq8o4nYUsrbFE3Fu88l8/mWrQCkAIZqc2NRyuXplZrDanB9Abi2XmZO0B3Q9wKvzmH0yJyLfswmzrejf3oVOJNEKJP5acPnXfQqAr5F7gdeLvdHbOAtg1iU8GujkOvRA7ad5ahT/1mDzKlkjaf36p4jodsGzPydOks2/jbVZxbZsR1il3BuDXb0agChNXJH4IpcnrjAliBtTKwnEYuLQeLQsUmljaGFyZCBQdXJkaWUgPHJwdXJkaWVAbGludXhmb3VuZGF0aW9uLm9yZz6JAlQEEwEKAD4WIQQRclb3b/q6zLA9Fn+aUMY1GLyygAUCY3VBEAIbAQUJA8JnAAULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRCaUMY1GLyygA0tD/4l5GVZ1OTKoCsHzQuSUVnyzmSwYmJD7W7E1VeVVvVk5bfFf/w6p3dXfGjhZ8zFackE+RmT3//8kQ+Zs68csd0wjX8klyFXgA5PWP3DxNkejnHCq7wiLouOGC/E9RSUULn1DYb68yPzvdGQBooqPQZORtXzNgM NuWDKH+9uvhGbdvURJHCRPTpgcdCo64d+IMzA+XmZUg0P722IyVmB+I2TgjaIRr/NsbsGP4x3u8 TVfJPXmE1IS9nrKEm023ntuy1AH9JlACLZ4LGvpxf8x7ZVKaXXqWOQ1aQ5BCQoOc41AiVUyeiq2wdLRQaNOxbb8+ED34BYLyMjZdII9eovZMbMt7kLSjkbOs/k3s7wtQ2eY7QnSggf8/MWUSUaJzLKHnOBRcqGjdFdlZ0BKXL+v9NrpjcUBsG1TY5XORIahk6Pt1+cPyIsKdycKU4RHtNfwX5fidE8AhU97U04z3tIYs121J4M/EG3bEfOtwDaH7BRTZHK5B05Mks/kX608CwLSJSbX2dSENInh5+dSVQ0egbFbXQGcHFmCCMjYH09hcNUSEyI4OUQHVu8HHQIfvutPqIsZEtJ1K/s3ZD3Zyq35UUiwnCu5hYohX9B0o0TwgDaI85dS2edHy2bnM3a9yuTPiwNYpfR6dp6cg8BM+9qqkJvwp5LiMcZcJC8S5xR3U0FtbQiUmljaGFyZCBQdXJkaWUgPHJwdXJkaWVAcnBzeXMubmV0PokCVAQTAQoAPhYhBBFyVvdv+rrMsD0Wf5pQxjUYvLKABQJjdUEhAhsBBQkDwmcABQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAAAoJEJpQxjUYvLKA/iUQAJJkVW2yDzxrH/5szOuG0ZDDH6X6Yrdp+m+F4hHHJQkTYgdRPeoHYKyXNOettdVKrZyEDkztBWkB7Sd7zuVHR3Q4PVTsEh09ZzkqBgN8OevMA7RPHZOa2PYJ8pAx7eTah1whM2eOf+VZGKrW1R9ouTluV7/c4o5loaKuh+t61W2nH6E+lQt3/gKnwj4QmUb5V957ZSHO1cnjtHrd4FFmkYQOCbolEfC25lT9vh4ldY+dILQPcq4at/LEABp4xEgS6R7K4E3cDnjWogrZTiniAUrR7P0SNYv7WCpAbvk4Z9DGCHXpKod KjTi3em7xDpqA1Rxd/rV4z9VQJrbpL/oiPCnTW/iCx+eMH70dRk+gHxSU8FWVf+CucFZprvO9UMi tGHLvfpBxfnGDT2EOqOoFOYgYHq7MfSDZT+zM/gBWfHXbyz6W9RYqycwWCIhG5jhMhT2sEWr4FlwmXfogvSqxvKondwPfXsgNT1MdBqa0Hhm0pIJYs4ovKWnvymTraziqSWI2C9X5lPmf6ugNiuzJt5BqlilNHxsej9OC53HfBbkgDONdcJbduW9nrJlIl9OLanB4/fvuqG1ZIS/eFFAkb2YnBBuS2TNz3aPd7vFkOoMU7VegDic/sH23eZPGQm3XWcTYwIY2djBU8Jzyy4mRIOQZMGXb/ygrGXAuIxL2R2O1uFYEY3VB1RIIKoZIzj0DAQcCAwQzkAYGjbS/m2SeumSYfDZKeazIkOpwUxpTQ7kPxz0ijiquKSsEZzlPMFzhA+iBJh2jdCyabi5K+8+v3VZZglbWAwEIB4kCNgQYAQoAIBYhBBFyVvdv+rrMsD0Wf5pQxjUYvLKABQJjdUHVAhsMAAoJEJpQxjUYvLKAr6UQAMyaDatvvCkxvOyFgO6jxLLzbkwl40hTNB/TsG5RdwL6FXnBMzkIa5lEfgV1u2zwu0p7SKWH9J3DSNqYKjUCAfwDEv6aDKrFYqGQZMuke1ZAfKqmWTIYOKYG4vRgvvF1u0aCOrRJiipjEPnrw1LC6eaqpnI3WGJyy8Wgr8aO0RBUO93ax/+Mpw3QG+jQqZjuomBWGvUwsjRtzE9j2QUcGxjyTrocVsR2qjK0boE4jLGJWNreSIgs5Nllww++3l0pabmXhyXqDdoYE1U0WkI/yemsc8ydDtjpeG4uzv9rfd5VUqHoZpuYZ1sc4DTGFrEAoght/9FXWsOFOtX8vZprLFFi7iFNSDChIFEsyuizHOW5wl/PYkGCCMZvwPK61IvCARKwevdnSrle9omYEqjnU/HjVZ/kvtKxn1VN15j1NNF 0zgmm+/RfbZFHbeuea/lVInXpNBMDj+pl3VyygUae65DMFWgYVSLtXPTRLVMb2mIxiNpk3T2UcuVW 1XC9LWup6h8jHEJ0zBCPjPyd1tFQ9hHVOJnwRthV+VG3zuBf8sri1TPnz5XjNpu3Q3r/6turvh+Khal2itb980tITH5fDbLUewPiA2jCAgZCkVMQcvYTS4rZCC+hpHSMte4m1n7AcmF9ohhw6tt41AEhwbMh+nRkyjDkY+k/vivg0obC2JpruDMEY3VCGBYJKwYBBAHaRw8BAQdArl5/9Fe2aA9JEc+HRm2rnCl6NMb7DZJLnM0xmQg1ouyJAq0EGAEKACAWIQQRclb3b/q6zLA9Fn+aUMY1GLyygAUCY3VCGAIbAgCBCRCaUMY1GLyygHYgBBkWCAAdFiEEHKt8QO5c0zRDdmiGodJewzbIKeYFAmN1QhgACgkQodJewzbIKeawUgEAzEwjSYf8lXVNcZVYL/4SLX9FEop83Q8+WmwT2rGhA+MBAKga5Fl8afYVHuPlPOxB/M7aQdP8vfYEx/cWmHmQEUICQxQQAJd85C4//BU0FOUPlEQ1vofZGNC1wTzVA7cQtYlIRrgQOmjR4tOFTxEzusA8QvXxOYkMkDlaa/Ai4/nicMqadnWPQ37BmTAW3/O5PVA22mWaC/ZVeG6DGBGVWb/OAwZe9KMxOR6say+bEIM6B6iDgc3V/HNsLWYYPHaj5HebHOKAJ7dqGGUlFV02OrVW5yAaOUEI61cKw0QuwoN1fZgih94EvFicNaLnDVDV64cbOnNyxGlJhbv4WMErtU4RVD3tT1soESmDB4jS2v49reBpsVVXg2G/M1xFO3sUcczHeo5LRaKtXpkXNh4WO3HDT/eb/IWP8Me2YKpwa5dzlrUz0AYi2s+h+LGclOP0Mls0tgS8sQSVdTj/feLk1FSSQGhSKdHMMGTlSsqj7XjToTAnIheq+5sdaY8UCEYu4s6jDiKu6G02HlF WpERQ9FmtGo2PVqnMaZy2w9lkNNn8ccyMWpP2EwGuCxONQrc22a7WnCYLTpOukLUSD7ApH7M2Jk8on kPGvi48NFq7PWaTkvG3vuSm+eApSToeyz7AVtFt8QOUnHTiNHbuiNpQsDd3y5bLLhU9mIJTbsWNP/72oXV7Tcz7w8zVh2qmuZqhu5qz9rcox3D9unGQ49N3i+CO9c7SqxcLckEjd9o62HsDDpqYv3cdtFNajNsHD8bFU9bb+swCuDMEY3VCRhYJKwYBBAHaRw8BAQdAjoQBsbbnpigttLSFJOFohHY6BGWmjCi520kt0UBBgG+JAjYEGAEKACAWIQQRclb3b/q6zLA9Fn+aUMY1GLyygAUCY3VCRgIbIAAKCRCaUMY1GLyygAQbD/0WyvGz8jA3CTAMTa8yoAlcX73+7aHQaP+DT1PaVU6W85Mm/Bv5JXJ+RWyCCa1jllAWTOhqkOXZ1lXqgislBGtpY22LdwlXW4NGETWwZb79ypR+nayuIPnjOrxkxPOFpcH+wCk9wX0qYi4/8xFTeIZtoty6ayP2bZUZL8aQ91kyUn7nrLmAymPhDq1AAjg+Dkz6DDyzkzXDsY6OY9SpKcWxLkcOm8oXn5B5K5Pl3FaRfYrmX2pAZ6DliQsvPMtXlA01qJ6W4nvRN5ROfjXefNGdyRK8LfJ8BkfDqtZ9/5UrMrW1b7CPA9/7dC5P2jfImtU6R90fz/S4ua2jzeVY2gt7olSDsBqJDOMBPwqEETDROu1+oCIXvdrrZszBu0pTCLV8r+rQqqjICZtK17CEXH3jmDeD/Q6MmAQqeyIhi3uQpGOaveP81WMiC8DDLRXmSuMYOIH/KebzgNnaCQzlQl3a+8tD2qQ48RqzR6JLcKu6h0A6KWItZScfshopNRVsm7FIWM1XUGm1nG6lmPtpVYsXF75hx+YxpAogbzm6fOnUJWFiP1/NVRgtWiii2HG8YCIrEeR3LCUQd/5aYS0CI0cy8WATg/1qkLbcr0lVaCRLT2KZd5WH7tz/4IBanSdCAj6vEfovE5ilWNThQHwg8aPQI6COaHFcTcervMD4Sy YNvg== Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.50.0-1 MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Sat, 10 Feb 2024 15:16:12 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/bitbake-devel/message/15872 On Fri, 2024-02-09 at 23:59 +0000, Richard Purdie via lists.openembedded.org wrote: > On Fri, 2024-02-09 at 23:33 +0000, Richard Purdie via > lists.openembedded.org wrote: > > On Fri, 2024-02-09 at 21:44 +0100, Alexander Kanavin wrote: > > > On Fri, 9 Feb 2024 at 18:02, Alexander Kanavin via > > > lists.openembedded.org > > > wrote: > > > > I worked around it by running 'bitbake world' without -P so it coul= d > > > > parse recipes successfully, then re-running with -P against pre-par= sed > > > > data. So profiles are being collected now. > > >=20 > > > Here it is: https://drive.google.com/file/d/1bM1MGJWU5uWRf6kE6AaENQLQ= KIbopnGW/view?usp=3Dsharing > > >=20 > > > I pressed ctrl-c after some 20 minutes - I took a look into it then > > > but somehow couldn't find anything related to execute(). The two > > > collected profiles seemingly are just waiting on select(). > >=20 > > This didn't make much sense to me so I ended up going digging. > >=20 > > The traceback you showed is reproducible if you trigger parsing while > > using -P so a bug needs fixing there. You can avoid it with something > > like: > >=20 > > bitbake -p > > bitbake world -nP > >=20 > > However what I've then realised is that when we added the second thread > > to cooker, we only dump the performance data for one of the threads, > > not the other. > >=20 > > So I suspect we need to fix the profiling to dump the stats on the > > second thread, then we'll see what the real issue is. > >=20 > > I can confirm that bitbake world -nP is running much slower than it > > should, even just for oe-core. >=20 > I've sent a patch to add the profiling for the other thread. With that > applied and a simple "bitbake bash -nP", profile-mainloop.log.processed > contains: >=20 > Ordered by: cumulative time >=20 > ncalls tottime percall cumtime percall filename:lineno(function) > 1 0.240 0.240 104.476 104.476 /media/build/poky/bitbake/l= ib/bb/server/process.py:421(idle_thread_internal) > 12663 75.679 0.006 75.679 0.006 {built-in method select.sel= ect} > 13842 0.036 0.000 26.361 0.002 /media/build/poky/bitbake/l= ib/bb/cooker.py:1474(buildTargetsIdle) > 13842 0.017 0.000 26.324 0.002 /media/build/poky/bitbake/l= ib/bb/runqueue.py:1624(execute_runqueue) > 13842 0.214 0.000 26.306 0.002 /media/build/poky/bitbake/l= ib/bb/runqueue.py:1523(_execute_runqueue) > 13842 0.274 0.000 23.590 0.002 /media/build/poky/bitbake/l= ib/bb/runqueue.py:2147(execute) > 1621 6.623 0.004 15.030 0.009 /media/build/poky/bitbake/l= ib/bb/runqueue.py:2418(build_taskdepdata) > 1338979 3.250 0.000 5.513 0.000 /media/build/poky/bitbake/l= ib/bb/runqueue.py:2407(filtermcdeps) > 211156 0.633 0.000 3.877 0.000 /media/build/poky/bitbake/l= ib/bb/runqueue.py:3217(read) > 25898 0.058 0.000 3.213 0.000 /media/build/poky/bitbake/l= ib/bb/runqueue.py:1419(read_workers) > 37063 0.252 0.000 2.876 0.000 /media/build/poky/bitbake/l= ib/bb/event.py:190(fire_ui_handlers) > 1686 0.029 0.000 2.870 0.002 /media/build/poky/bitbake/l= ib/bb/runqueue.py:1328(send_pickled_data) > 1411556 1.677 0.000 2.704 0.000 /media/build/poky/bitbake/l= ib/bb/runqueue.py:56(split_tid_mcfn) > 8982/8940 0.016 0.000 1.936 0.000 /media/build/poky/bitbake/l= ib/bb/event.py:217(fire) > 2284982 1.234 0.000 1.924 0.000 /media/build/poky/bitbake/l= ib/bb/runqueue.py:41(mc_from_tid) > 979 0.002 0.000 1.906 0.002 /media/build/poky/bitbake/l= ib/bb/command.py:110(runAsyncCommand) > 1686 1.852 0.001 1.852 0.001 {method 'write' of '_io.Buf= feredWriter' objects} >=20 >=20 > which even without a world build, says some interesting things about > the 1.3 million calls to filtermcdeps and the time spend in > build_taskdepdata. I was curious about the time spent in build_taskdepdata() since we can fix that. I'll send a patch out shortly but with it applied, the above becomes: ncalls tottime percall cumtime percall filename:lineno(function) 1 0.268 0.268 93.061 93.061 /media/build/poky/bitbake/lib= /bb/server/process.py:426(idle_thread_internal) 16033 78.812 0.005 78.812 0.005 {built-in method select.selec= t} 16876 0.038 0.000 11.875 0.001 /media/build/poky/bitbake/lib= /bb/cooker.py:1474(buildTargetsIdle) 16876 0.019 0.000 11.835 0.001 /media/build/poky/bitbake/lib= /bb/runqueue.py:1624(execute_runqueue) 16876 0.084 0.000 11.816 0.001 /media/build/poky/bitbake/lib= /bb/runqueue.py:1523(_execute_runqueue) 16876 0.274 0.000 9.231 0.001 /media/build/poky/bitbake/lib= /bb/runqueue.py:2149(execute) 201858 0.615 0.000 3.589 0.000 /media/build/poky/bitbake/lib= /bb/runqueue.py:3227(read) 32302 0.062 0.000 2.924 0.000 /media/build/poky/bitbake/lib= /bb/runqueue.py:1419(read_workers) 37041 0.217 0.000 2.616 0.000 /media/build/poky/bitbake/lib= /bb/event.py:190(fire_ui_handlers) 1686 0.021 0.000 2.606 0.002 /media/build/poky/bitbake/lib= /bb/runqueue.py:1328(send_pickled_data) 1686 1.837 0.001 1.837 0.001 {method 'write' of '_io.Buffe= redWriter' objects} 979 0.002 0.000 1.827 0.002 /media/build/poky/bitbake/lib= /bb/command.py:110(runAsyncCommand) 8960/8929 0.015 0.000 1.798 0.000 /media/build/poky/bitbake/lib= /bb/event.py:217(fire) 1621 1.355 0.001 1.491 0.001 /media/build/poky/bitbake/lib= /bb/runqueue.py:2436(build_taskdepdata) 17943 0.144 0.000 1.451 0.000 /media/build/poky/bitbake/lib= /bb/cooker.py:113(send) 28081 0.022 0.000 1.354 0.000 /media/build/poky/bitbake/lib= /bb/event.py:237(fire_from_worker) [...] 3657 0.078 0.000 0.085 0.000 /media/build/poky/bitbake/lib= /bb/runqueue.py:2409(filtermcdeps) i.e. 1.3 million function calls to filtermcdeps becomes 3657, so probably a valid speedup. There is probably something different Alex is running into in his build so I'll wait for the data for that case. I'd note that whilst the performance logging patch does work, it can mean the cooker is slow to shut down so if the mainloop file isn't there, wait for the cooker to exit. Cheers, Richard