From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from smtp4.osuosl.org (smtp4.osuosl.org [140.211.166.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id A606ED743EF for ; Wed, 20 Nov 2024 23:27:50 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp4.osuosl.org (Postfix) with ESMTP id 3DF7040821; Wed, 20 Nov 2024 23:27:50 +0000 (UTC) X-Virus-Scanned: amavis at osuosl.org Received: from smtp4.osuosl.org ([127.0.0.1]) by localhost (smtp4.osuosl.org [127.0.0.1]) (amavis, port 10024) with ESMTP id lVZsLkTQEwQ1; Wed, 20 Nov 2024 23:27:49 +0000 (UTC) X-Comment: SPF check N/A for local connections - client-ip=140.211.166.142; helo=lists1.osuosl.org; envelope-from=buildroot-bounces@buildroot.org; receiver= DKIM-Filter: OpenDKIM Filter v2.11.0 smtp4.osuosl.org 2DD1E4083A Received: from lists1.osuosl.org (lists1.osuosl.org [140.211.166.142]) by smtp4.osuosl.org (Postfix) with ESMTP id 2DD1E4083A; Wed, 20 Nov 2024 23:27:49 +0000 (UTC) Received: from smtp1.osuosl.org (smtp1.osuosl.org [IPv6:2605:bc80:3010::138]) by lists1.osuosl.org (Postfix) with ESMTP id 70FC427DE for ; Wed, 20 Nov 2024 23:27:47 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp1.osuosl.org (Postfix) with ESMTP id 4CBE681214 for ; Wed, 20 Nov 2024 23:27:47 +0000 (UTC) X-Virus-Scanned: amavis at osuosl.org Received: from smtp1.osuosl.org ([127.0.0.1]) by localhost (smtp1.osuosl.org [127.0.0.1]) (amavis, port 10024) with ESMTP id Gn30JvkwZoVk for ; Wed, 20 Nov 2024 23:27:46 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=116.202.254.214; helo=ciao.gmane.io; envelope-from=glbb-buildroot@m.gmane-mx.org; receiver= DMARC-Filter: OpenDMARC Filter v1.4.2 smtp1.osuosl.org 9D97A8120F DKIM-Filter: OpenDKIM Filter v2.11.0 smtp1.osuosl.org 9D97A8120F Received: from ciao.gmane.io (ciao.gmane.io [116.202.254.214]) by smtp1.osuosl.org (Postfix) with ESMTPS id 9D97A8120F for ; Wed, 20 Nov 2024 23:27:46 +0000 (UTC) Received: from list by ciao.gmane.io with local (Exim 4.92) (envelope-from ) id 1tDu6p-0007qU-Lv for buildroot@busybox.net; Thu, 21 Nov 2024 00:27:43 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: buildroot@busybox.net From: Grant Edwards Date: Wed, 20 Nov 2024 23:27:39 -0000 (UTC) Message-ID: References: User-Agent: slrn/1.0.3 (Linux) Cc: buildroot@uclibc.org X-Mailman-Original-Authentication-Results: smtp1.osuosl.org; dmarc=fail (p=none dis=none) header.from=gmail.com Subject: Re: [Buildroot] Large number of duplicate files in sdk X-BeenThere: buildroot@buildroot.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Discussion and development of buildroot List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: buildroot-bounces@buildroot.org Sender: "buildroot" On 2024-11-20, Grant Edwards wrote: > When I do a "make sdk" (using 2024.02.6), the resulting tarball > contains tons of duplicate files. I'm using an external Linaro ARM > toolchain. With a fairly bare-bones package selection, the sdk tarball > generated by buildroot appears to be about 40% duplicate files by > size (about 20% by count). It's actually a bit worse than that. My app wasn't finding files that were duplicated more than once. Running a simple de-dupe utility on output/host reduced disk space from 928MB to 556MB. That app is pretty conservative: it only links files that have the same name, the same parent directory name, and differing top directory names. _______________________________________________ buildroot mailing list buildroot@buildroot.org https://lists.buildroot.org/mailman/listinfo/buildroot