From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 017F8EE644B for ; Thu, 12 Sep 2024 05:45:36 +0000 (UTC) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1socY1-0007eF-1u; Thu, 12 Sep 2024 01:39:19 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1socXc-0006kJ-Kg for qemu-devel@nongnu.org; Thu, 12 Sep 2024 01:38:52 -0400 Received: from us-smtp-delivery-124.mimecast.com ([170.10.129.124]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1socXY-0003jc-FA for qemu-devel@nongnu.org; Thu, 12 Sep 2024 01:38:50 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1726119526; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding:autocrypt:autocrypt; bh=Z7kYflwMZRa47LKuqq+fSNneBw952RbVdOoXPHzeY3Q=; b=HkCfQOSQO52kI29vt1ShEb+QV3chkoeSbk1NlB1ERc6/W5WJsLuCrU5h1XEDu4JMXhKtTA VIJt844GfWAdvG/sbUVExRa8u+mIcqMIgJ7EuDbUIXnworIyh8b7ZyUaD8KXBruncD9AMm AzAG2jZ856FJSea1AoRwSsKdoroZn5o= Received: from mail-wm1-f72.google.com (mail-wm1-f72.google.com [209.85.128.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-607-iVM7PhxaNryCW13qRsxOMw-1; Thu, 12 Sep 2024 01:38:41 -0400 X-MC-Unique: iVM7PhxaNryCW13qRsxOMw-1 Received: by mail-wm1-f72.google.com with SMTP id 5b1f17b1804b1-42cb830ea86so3626965e9.3 for ; Wed, 11 Sep 2024 22:38:41 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726119520; x=1726724320; h=content-transfer-encoding:autocrypt:subject:cc:to:from :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Z7kYflwMZRa47LKuqq+fSNneBw952RbVdOoXPHzeY3Q=; b=eDfcc/0KEvUR12P2twrBfskoVhqYSlYgMNF+PiJzOFXr4Z/VYS34AJGophdlaaTsEC 678fbN5uOKSCihdA2FER0/qPMfbd88VvR8QXQdXL9sKCowz62Amg1P9CO5IIxEPJLdxX ALA9BWs8gMFqEvBwA9e+Wz5wBI8pgXYAKJWZiWUtoZ0EWXL9yAcNOjTYnXa4jp8unO/8 raGIXT0DAoz0MkBtZMms/qbhfey3zKObTJAIXdfqS8XdUHWIqD00Ee6NcdjA03Ca7bvM 6L1SnShTdVy0tHDSyvRwPYc8I8uRSXVqsf2tNdjRNRlqdK6i6fb0sUHQZu1piVTCv47X 9b2w== X-Forwarded-Encrypted: i=1; AJvYcCXTQSNrQ0qpW47cxvOj5hHMjP2bZgkKWppPU+RtoyZoOUWw4B1fceqix5CisP7hFrcd3wsDg5jcLvMr@nongnu.org X-Gm-Message-State: AOJu0Yxl1PlJatN+yOFWho2H+WVbUqFOPqgIK4TTVeobEedLlLAk7WSo ybnSuoirQm9MBmbZej4RL+LR1lVR2TmmYQWG5K/nJDpuvNgByzv5+U6O5KvJduviIK3GM+LGG/K 1Ro7WR4dzX42i6PtFig2S+S0GZ5DG7T7BfhkVoJ1uMTgEFGp1PMYD X-Received: by 2002:a05:600c:4ecb:b0:42c:b8c9:16cb with SMTP id 5b1f17b1804b1-42cdb4e6aecmr11006935e9.5.1726119520226; Wed, 11 Sep 2024 22:38:40 -0700 (PDT) X-Google-Smtp-Source: AGHT+IHYJhsKj0sDfA3BHiigkoVTxOM49PYhaiC9WNKl1cmxqcNBNBl/ZRz19gwqrRLmYz7LiIx8rg== X-Received: by 2002:a05:600c:4ecb:b0:42c:b8c9:16cb with SMTP id 5b1f17b1804b1-42cdb4e6aecmr11006825e9.5.1726119519701; Wed, 11 Sep 2024 22:38:39 -0700 (PDT) Received: from [192.168.0.6] (ip-109-43-178-122.web.vodafone.de. [109.43.178.122]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-42cb77afd5asm121284785e9.17.2024.09.11.22.38.38 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 11 Sep 2024 22:38:39 -0700 (PDT) Message-ID: Date: Thu, 12 Sep 2024 07:38:37 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US From: Thomas Huth To: Paolo Bonzini , QEMU Developers Cc: Peter Maydell , Stefan Hajnoczi , "Daniel P. Berrange" , Richard Henderson Subject: Gitlab CI caching is not working Autocrypt: addr=thuth@redhat.com; keydata= xsFNBFH7eUwBEACzyOXKU+5Pcs6wNpKzrlJwzRl3VGZt95VCdb+FgoU9g11m7FWcOafrVRwU yYkTm9+7zBUc0sW5AuPGR/dp3pSLX/yFWsA/UB4nJsHqgDvDU7BImSeiTrnpMOTXb7Arw2a2 4CflIyFqjCpfDM4MuTmzTjXq4Uov1giGE9X6viNo1pxyEpd7PanlKNnf4PqEQp06X4IgUacW tSGj6Gcns1bCuHV8OPWLkf4hkRnu8hdL6i60Yxz4E6TqlrpxsfYwLXgEeswPHOA6Mn4Cso9O 0lewVYfFfsmokfAVMKWzOl1Sr0KGI5T9CpmRfAiSHpthhHWnECcJFwl72NTi6kUcUzG4se81 O6n9d/kTj7pzTmBdfwuOZ0YUSqcqs0W+l1NcASSYZQaDoD3/SLk+nqVeCBB4OnYOGhgmIHNW 0CwMRO/GK+20alxzk//V9GmIM2ACElbfF8+Uug3pqiHkVnKqM7W9/S1NH2qmxB6zMiJUHlTH gnVeZX0dgH27mzstcF786uPcdEqS0KJuxh2kk5IvUSL3Qn3ZgmgdxBMyCPciD/1cb7/Ahazr 3ThHQXSHXkH/aDXdfLsKVuwDzHLVSkdSnZdt5HHh75/NFHxwaTlydgfHmFFwodK8y/TjyiGZ zg2Kje38xnz8zKn9iesFBCcONXS7txENTzX0z80WKBhK+XSFJwARAQABzR5UaG9tYXMgSHV0 aCA8dGh1dGhAcmVkaGF0LmNvbT7CwXgEEwECACIFAlVgX6oCGwMGCwkIBwMCBhUIAgkKCwQW AgMBAh4BAheAAAoJEC7Z13T+cC21EbIP/ii9cvT2HHGbFRl8HqGT6+7Wkb+XLMqJBMAIGiQK QIP3xk1HPTsLfVG0ao4hy/oYkGNOP8+ubLnZen6Yq3zAFiMhQ44lvgigDYJo3Ve59gfe99KX EbtB+X95ODARkq0McR6OAsPNJ7gpEUzfkQUUJTXRDQXfG/FX303Gvk+YU0spm2tsIKPl6AmV 1CegDljzjycyfJbk418MQmMu2T82kjrkEofUO2a24ed3VGC0/Uz//XCR2ZTo+vBoBUQl41BD eFFtoCSrzo3yPFS+w5fkH9NT8ChdpSlbNS32NhYQhJtr9zjWyFRf0Zk+T/1P7ECn6gTEkp5k ofFIA4MFBc/fXbaDRtBmPB0N9pqTFApIUI4vuFPPO0JDrII9dLwZ6lO9EKiwuVlvr1wwzsgq zJTPBU3qHaUO4d/8G+gD7AL/6T4zi8Jo/GmjBsnYaTzbm94lf0CjXjsOX3seMhaE6WAZOQQG tZHAO1kAPWpaxne+wtgMKthyPLNwelLf+xzGvrIKvLX6QuLoWMnWldu22z2ICVnLQChlR9d6 WW8QFEpo/FK7omuS8KvvopFcOOdlbFMM8Y/8vBgVMSsK6fsYUhruny/PahprPbYGiNIhKqz7 UvgyZVl4pBFjTaz/SbimTk210vIlkDyy1WuS8Zsn0htv4+jQPgo9rqFE4mipJjy/iboDzsFN BFH7eUwBEAC2nzfUeeI8dv0C4qrfCPze6NkryUflEut9WwHhfXCLjtvCjnoGqFelH/PE9NF4 4VPSCdvD1SSmFVzu6T9qWdcwMSaC+e7G/z0/AhBfqTeosAF5XvKQlAb9ZPkdDr7YN0a1XDfa +NgA+JZB4ROyBZFFAwNHT+HCnyzy0v9Sh3BgJJwfpXHH2l3LfncvV8rgFv0bvdr70U+On2XH 5bApOyW1WpIG5KPJlDdzcQTyptOJ1dnEHfwnABEfzI3dNf63rlxsGouX/NFRRRNqkdClQR3K gCwciaXfZ7ir7fF0u1N2UuLsWA8Ei1JrNypk+MRxhbvdQC4tyZCZ8mVDk+QOK6pyK2f4rMf/ WmqxNTtAVmNuZIwnJdjRMMSs4W4w6N/bRvpqtykSqx7VXcgqtv6eqoDZrNuhGbekQA0sAnCJ VPArerAZGArm63o39me/bRUQeQVSxEBmg66yshF9HkcUPGVeC4B0TPwz+HFcVhheo6hoJjLq knFOPLRj+0h+ZL+D0GenyqD3CyuyeTT5dGcNU9qT74bdSr20k/CklvI7S9yoQje8BeQAHtdV cvO8XCLrpGuw9SgOS7OP5oI26a0548M4KldAY+kqX6XVphEw3/6U1KTf7WxW5zYLTtadjISB X9xsRWSU+Yqs3C7oN5TIPSoj9tXMoxZkCIHWvnqGwZ7JhwARAQABwsFfBBgBAgAJBQJR+3lM AhsMAAoJEC7Z13T+cC21hPAQAIsBL9MdGpdEpvXs9CYrBkd6tS9mbaSWj6XBDfA1AEdQkBOn ZH1Qt7HJesk+qNSnLv6+jP4VwqK5AFMrKJ6IjE7jqgzGxtcZnvSjeDGPF1h2CKZQPpTw890k fy18AvgFHkVk2Oylyexw3aOBsXg6ukN44vIFqPoc+YSU0+0QIdYJp/XFsgWxnFIMYwDpxSHS 5fdDxUjsk3UBHZx+IhFjs2siVZi5wnHIqM7eK9abr2cK2weInTBwXwqVWjsXZ4tq5+jQrwDK cvxIcwXdUTLGxc4/Z/VRH1PZSvfQxdxMGmNTGaXVNfdFZjm4fz0mz+OUi6AHC4CZpwnsliGV ODqwX8Y1zic9viSTbKS01ZNp175POyWViUk9qisPZB7ypfSIVSEULrL347qY/hm9ahhqmn17 Ng255syASv3ehvX7iwWDfzXbA0/TVaqwa1YIkec+/8miicV0zMP9siRcYQkyTqSzaTFBBmqD oiT+z+/E59qj/EKfyce3sbC9XLjXv3mHMrq1tKX4G7IJGnS989E/fg6crv6NHae9Ckm7+lSs IQu4bBP2GxiRQ+NV3iV/KU3ebMRzqIC//DCOxzQNFNJAKldPe/bKZMCxEqtVoRkuJtNdp/5a yXFZ6TfE1hGKrDBYAm4vrnZ4CXFSBDllL59cFFOJCkn4Xboj/aVxxJxF30bn Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Received-SPF: pass client-ip=170.10.129.124; envelope-from=thuth@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -21 X-Spam_score: -2.2 X-Spam_bar: -- X-Spam_report: (-2.2 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.144, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Hi! While looking at some recent CI jobs, I noticed that the caching of the Gitlab-CI jobs is not working at all anymore. In the build jobs, the ccache saving is not working and causing a complete cache miss of each compile: https://gitlab.com/qemu-project/qemu/-/jobs/7802183187#L5328 And, maybe more important, in the avocado/functional jobs we don't cache the assets anymore, causing a re-download of multiple gigabytes each time: https://gitlab.com/qemu-project/qemu/-/jobs/7802183251#L29 (the du -chs in line 35 is not executed, thus the cache is nonexistent) The problem is not new, it's been there for some weeks already, e.g. here's a run from the last freeze period (when the job was only running avocado tests): https://gitlab.com/qemu-project/qemu/-/jobs/7753544153#L86 There is a suspicious message at the beginning of the logs: "No URL provided, cache will not be downloaded from shared cache server. Instead a local version of cache will be extracted." ... but since we use throw-away containers for building, I guess there is no local version of the cache? Anyway, the problem only exists for the k8s runners, in my private clone of the repository that uses shared runners from gitlab, the caching is working right. Could somebody please have a look into this? Fixing the caching might speed up our build time quite a bit, I think. Thomas