From mboxrd@z Thu Jan 1 00:00:00 1970 From: Yann E. MORIN Date: Thu, 19 Nov 2020 22:23:47 +0100 Subject: [Buildroot] [PATCH 0/7] support/download: reproducible archives whatever tar version (branch yem/dl-git-tar-pax) Message-ID: List-Id: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit To: buildroot@busybox.net Hello All! This series fixes our download backends, git and svn, to generate reproducible archives whatever the tar version, thus removing the requirement for a maximum tar version. This however changes the actual format of the generated archives, and they are different from the existing ones. So we also change the compression to avoid collision with existign archives on s.b.o, that need to be read by older Buildroot versions. A huge thank to Vincent for digging up the adequate set of options that allows generating reproducible archives. Thanks! :-) Note that this series contains commits marked "WIP": they are separate commits for ease of review, but they should ultimately be squashed together or the series would not be bisectable. Regards, Yann E. MORIN. ---------------------------------------------------------------- Yann E. MORIN (7): core/pkg-infra: prepare for alternate default source archives WIP: support/download: change format of archives generated from git WIP: boot+packages: update hash to new git-tarballs format WIP: support/testing: update git-hash checks with new archive format support/download: change format of archives generated from svn support/dependencies: drop check for maximal tar version package/tar: drop specific version for host variant boot/vexpress-firmware/vexpress-firmware.hash | 2 +- package/aer-inject/aer-inject.hash | 2 +- package/am33x-cm3/am33x-cm3.hash | 2 +- package/armbian-firmware/armbian-firmware.hash | 2 +- package/at/at.hash | 6 +- package/bayer2rgb-neon/bayer2rgb-neon.hash | 4 +- package/brickd/brickd.hash | 4 +- package/c-capnproto/c-capnproto.hash | 2 +- package/dbus-triggerd/dbus-triggerd.hash | 2 +- package/dt-utils/dt-utils.hash | 4 +- package/dtv-scan-tables/dtv-scan-tables.hash | 6 +- package/flashbench/flashbench.hash | 2 +- .../imx-alsa-plugins/imx-alsa-plugins.hash | 2 +- package/freescale-imx/imx-lib/imx-lib.hash | 2 +- package/google-breakpad/google-breakpad.hash | 2 +- .../gstreamer1/gst1-interpipe/gst1-interpipe.hash | 2 +- package/gstreamer1/gst1-shark/gst1-shark.hash | 4 +- package/imx-mkimage/imx-mkimage.hash | 4 +- package/kvm-unit-tests/kvm-unit-tests.hash | 2 +- package/kvmtool/kvmtool.hash | 2 +- package/libbroadvoice/libbroadvoice.hash | 4 +- package/libclc/libclc.hash | 4 +- package/libg7221/libg7221.hash | 4 +- package/libilbc/libilbc.hash | 4 +- package/libsilk/libsilk.hash | 4 +- package/libsvgtiny/libsvgtiny.hash | 4 +- package/libuci/libuci.hash | 2 +- package/libyuv/libyuv.hash | 4 +- package/linux-firmware/linux-firmware.hash | 68 +++++++++++----------- .../linux-syscall-support.hash | 2 +- package/minicom/minicom.hash | 4 +- package/mmc-utils/mmc-utils.hash | 4 +- package/net-tools/net-tools.hash | 2 +- package/netcat-openbsd/netcat-openbsd.hash | 4 +- .../netsurf-buildsystem/netsurf-buildsystem.hash | 2 +- package/odhcp6c/odhcp6c.hash | 2 +- package/opkg-utils/opkg-utils.hash | 2 +- package/piglit/piglit.hash | 2 +- package/pkg-generic.mk | 9 ++- package/prelink-cross/prelink-cross.hash | 2 +- package/psplash/psplash.hash | 4 +- package/qt-webkit-kiosk/qt-webkit-kiosk.hash | 2 +- package/rcw/rcw.hash | 4 +- package/rtc-tools/rtc-tools.hash | 4 +- package/rtmpdump/rtmpdump.hash | 4 +- package/speexdsp/speexdsp.hash | 4 +- package/stm32flash/stm32flash.hash | 4 +- package/tar/tar.mk | 8 +-- package/ti-sgx-demos/ti-sgx-demos.hash | 4 +- package/ti-sgx-km/ti-sgx-km.hash | 4 +- package/ti-sgx-libgbm/ti-sgx-libgbm.hash | 4 +- package/ti-sgx-um/ti-sgx-um.hash | 4 +- package/trace-cmd/trace-cmd.hash | 6 +- package/tremor/tremor.hash | 4 +- package/ubus/ubus.hash | 2 +- package/uemacs/uemacs.hash | 4 +- package/uhttpd/uhttpd.hash | 2 +- package/ustream-ssl/ustream-ssl.hash | 4 +- package/vboot-utils/vboot-utils.hash | 2 +- package/wilink-bt-firmware/wilink-bt-firmware.hash | 4 +- .../xdriver_xf86-video-imx-viv.hash | 2 +- .../xdriver_xf86-video-intel.hash | 1 + support/dependencies/check-host-tar.sh | 14 +---- support/download/git | 20 +++++-- support/download/svn | 12 ++-- .../br2-external/git-hash/package/bad/bad.hash | 2 +- .../br2-external/git-hash/package/good/good.hash | 2 +- .../git-partial-sha1-branch-head.hash | 2 +- .../git-partial-sha1-reachable-by-branch.hash | 2 +- .../git-partial-sha1-reachable-by-tag.hash | 2 +- .../git-partial-sha1-tag-itself.hash | 2 +- .../git-partial-sha1-tag-points-to.hash | 2 +- .../git-sha1-branch-head/git-sha1-branch-head.hash | 2 +- .../git-sha1-reachable-by-branch.hash | 2 +- .../git-sha1-reachable-by-tag.hash | 2 +- .../git-sha1-tag-itself/git-sha1-tag-itself.hash | 2 +- .../git-sha1-tag-points-to.hash | 2 +- .../git-submodule-disabled.hash | 2 +- .../git-submodule-enabled.hash | 2 +- .../git-refs/package/git-tag/git-tag.hash | 2 +- .../git-wrong-content/git-wrong-content.hash | 2 +- 81 files changed, 177 insertions(+), 173 deletions(-) -- .-----------------.--------------------.------------------.--------------------. | Yann E. MORIN | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: | | +33 662 376 056 | Software Designer | \ / CAMPAIGN | ___ | | +33 561 099 427 `------------.-------: X AGAINST | \e/ There is no | | http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL | v conspiracy. | '------------------------------^-------^------------------^--------------------'