[ANNOUNCE] mtd-utils-2.3.0 is released

[ANNOUNCE] mtd-utils-2.3.0 is released

[David Oberhollenzer]

[-- Attachment #1.1.1.1: Type: text/plain, Size: 10009 bytes --]

Hi,

mtd-utils-2.3.0 is released.

Tarball:               ftp://ftp.infradead.org/pub/mtd-utils/mtd-utils-2.3.0.tar.bz2
Tarball gpg signature: ftp://ftp.infradead.org/pub/mtd-utils/mtd-utils-2.3.0.tar.bz2.asc
Signed git tag:        git://git.infradead.org/mtd-utils.git v2.3.0


Alternatively also mirrored here:

Tarball:               https://infraroot.at/pub/mtd/mtd-utils-2.3.0.tar.bz2
Tarball gpg signature: https://infraroot.at/pub/mtd/mtd-utils-2.3.0.tar.bz2.asc
Signed git tag:        https://git.infraroot.at/mtd-utils.git v2.3.0


Besides the usual odd fixes, this release re-syncs headers with upstream kernel
versions, as well as the vendored, third party libiniparser with its respective,
upstream release.

Special thanks go out to Cheng Zhihao, who refactored mkfs.ubifs and contributed
an fsck.ubifs utility. This is also the main, big new feature in this release,
prompting the minor version bump.


Changes from 2.2.1 to 2.3.0:

Features:
  - fsck.ubifs: Add fsck utility for ubifs
  - ubifs-utils: Support Address-Sanitizier debug
  - nand-utils: nanddump: Add support for testing continuous reads
  - mtd-tests: nandbiterrs: Add support for testing continuous reads
  - mtd-tests: flash_speed: Benchmark continuous reads

Fixes:
  - Various integer handling errors (potential overflows, divide by zero)
  - mkfs.jffs2: fix segfault when parsing dev table
  - nand-utils: nanddump: Explicitely use the page size when relevant
  - misc-utils: add missing error handling for 'bam' allocation in ftl_check.c
  - mtdinfo: type mis-match in printf format string
  - nanddump: const cast warning
  - flashcp: uninitialized variable
  - jffs2reader: potential null pointer dereference
  - tests: checkfs: Add previous prototype for do_pwr_dn()

Changes:
  - mkfs.ubifs: re-sync with the kernel code
  - mkfs.ubifs: move most of the code into a libubifs library
  - Import a more recent version of libiniparser
  - mtd-tests: flash_speed: cleanup/refactor


Raw short log since the 2.2.1 release:

Anton Moryakov (7):
       ubi-utils: ubirsvol: Fix integer overflow in ubirsvol.c
       misc-utils: flash_erase: FIX integer overflow in flash_erase.c
       nand-utils: Fix integer overflow in nandflipbits.c
       ubi-utils: Fix integer overflow in mtdinfo.c
       misc-utils: add missing error handling for 'bam' allocation in ftl_check.c
       jffsX-utils: fix integer overflow in jffs2dump.c
       ubi-utils: FIX DIVISION BY ZERO in ubinize.c

David Oberhollenzer (4):
       Import a more recent version of libiniparser
       Update CHANGELOG.md
       Update CHANGELOG.md
       Release mtd-utils-2.3.0

Huang Xiaojia (1):
       fsck.ubifs: Check and create the lost+found

Miquel Raynal (10):
       nand-utils: nanddump: Use a specific variable for the buffer size
       nand-utils: nanddump: Explicitely use the page size when relevant
       nand-utils: nanddump: Add support for testing continuous reads
       mtd-tests: nandbiterrs: Store the chunks size in an intermediate variable
       mtd-tests: nandbiterrs: Add support for testing continuous reads
       mtd-tests: flash_speed: Drop an apparently useless block
       mtd-tests: flash_speed: Clarify the number of pages in each set while measuring
       mtd-tests: flash_speed: Generalize read_eraseblock_by_2pages()
       mtd-tests: flash_speed: Drop read_eraseblock_by_page()
       mtd-tests: flash_speed: Benchmark continuous reads

Rosen Penev (1):
       mkfs.jffs2: fix segfault when parsing dev table

Xiang Yang (1):
       fsck.ubifs: Check and correct files' information

Zhihao Cheng (107):
       ubifs-utils: Split common source files from mkfs.ubifs
       ubifs-utils: Decouple mkfs.ubifs.h out of other modules
       ubifs-utils: Define PROGRAM_NAME as variable
       ubifs-utils: Clean up error message printing functions
       ubifs-utils: Move 'debug_level' into ubifs_info structure
       ubifs-utils: Add 'dev_name' into 'ubifs_info' structure
       ubifs-utils: Add 'dev_fd' and 'libubi' into 'ubifs_info' structure
       ubifs-utils: Extract UBI opening/closing/volume_check_empty functions into a new source file
       ubifs-utils: Import UBIFS libs from linux kernel
       ubifs-utils: Add compiler attributes implementations
       ubifs-utils: Add linux type definitions
       ubifs-utils: Add linux kernel error conversion definitions
       ubifs-utils: Add linux kernel memory allocation implementations
       ubifs-utils: Add atomic implementations
       ubifs-utils: Add bit operations implementations
       ubifs-utils: Add spinlock implementations
       ubifs-utils: Add mutexlock implementations
       ubifs-utils: Add rwsem implementations
       ubifs-utils: Add sorting implementations
       ubifs-utils: Add implementations for linux kernel printing functions
       ubifs-utils: Add linux hexdump implementations lib
       libubi: Add new interface ubi_leb_map()
       ubifs-utils: Add common definitions in linux kernel
       ubifs-utils: Add descriptions for new lib files in common/README
       ubifs-utils: Adapt ubifs header file in libubifs
       ubifs-utils: Adapt super.c in libubifs
       ubifs-utils: Adapt io.c in libubifs
       ubifs-utils: Adapt lpt subsystem in libubifs
       ubifs-utils: Adapt tnc subsystem in libubifs
       ubifs-utils: Adapt log.c in libubifs
       ubifs-utils: Adapt recovery subsystem in libubifs
       ubifs-utils: Adapt sb.c in libubifs
       ubifs-utils: Adapt auth.c in libubifs
       ubifs-utils: Adapt dir.c in libubifs
       ubifs-utils: Adapt journal.c in libubifs
       ubifs-utils: Adapt budget.c in libubifs
       ubifs-utils: Adapt commit.c in libubifs
       ubifs-utils: Adapt debug subsystem in libubifs
       ubifs-utils: Adapt key.h in libubifs
       ubifs-utils: Adapt master.c in libubifs
       ubifs-utils: Adapt misc.h in libubifs
       ubifs-utils: Adapt orphan.c in libubifs
       ubifs-utils: Adapt gc subsystem in libubifs
       ubifs-utils: Move ubifs-media.h in libubifs
       ubifs-utils: Add descriptions for new lib files in libubifs/README
       ubifs-utils: Replace ubifs related source code with linux kernel implementation
       ubifs-utils: open_ubi: Set errno if the target is not char device
       fsck.ubifs: Add fsck support
       fsck.ubifs: Add inconsistent problem handling asking function
       fsck.ubifs: Distinguish reasons when certain failures happen
       fsck.ubifs: Load filesystem information from UBI volume
       fsck.ubifs: Add node parsing functions
       fsck.ubifs: Add file organization realization
       fsck.ubifs: Add rebuilding filesystem support
       fsck.ubifs: rebuild_fs: Remove deleted nodes from valid node tree
       fsck.ubifs: rebuild_fs: Add valid nodes into file
       fsck.ubifs: rebuild_fs: Filter invalid files
       fsck.ubifs: rebuild_fs: Extract reachable directory entries tree
       fsck.ubifs: rebuild_fs: Check and correct files' information
       fsck.ubifs: rebuild_fs: Record used LEBs
       fsck.ubifs: rebuild_fs: Re-write data
       fsck.ubifs: rebuild_fs: Create new root dir if there are no scanned files
       fsck.ubifs: rebuild_fs: Build TNC
       fsck.ubifs: rebuild_fs: Build LPT
       fsck.ubifs: rebuild_fs: Clean up log and orphan area
       fsck.ubifs: rebuild_fs: Write master node
       fsck.ubifs: Read master node & init lpt
       fsck.ubifs: Replay journal
       fsck.ubifs: Handle orphan nodes
       fsck.ubifs: Consolidate log
       fsck.ubifs: Recover isize
       fsck.ubifs: Move common functions and data structures into fsck.ubifs.c
       fsck.ubifs: Traverse TNC and construct files
       fsck.ubifs: Ensure that TNC LEB can be scanned successful
       fsck.ubifs: Update files' size for check mode
       fsck.ubifs: Check and handle invalid files
       fsck.ubifs: Check and handle unreachable files
       fsck.ubifs: Check whether the TNC is empty
       fsck.ubifs: Move common functions and data structures into check_space.c
       fsck.ubifs: check and correct the space statistics
       fsck.ubifs: Commit problem fixing modifications to disk
       fsck.ubifs: Check and correct the index size
       ubifs-utils: libubifs: Support some file operations
       fsck.ubifs: Check and create the root dir
       fsck.ubifs: Handle disconnected files
       fsck.ubifs: Do final committing
       fsck.ubifs: Add README to describe fsck
       tests: Add common libs for testing fsck.ubifs/mkfs.ubifs
       tests: ubifs_tools: fsck_tests: Add authentication refusing test
       tests: ubifs_tools: fsck_tests: Add cycle mount+fsck test
       tests: ubifs_tools: fsck_tests: Add powercut+fsck+mount test
       tests: ubifs_tools: fsck_tests: Add corrupt+fsck+fault_inject test
       tests: ubifs_tools: fsck_tests: Add cycle_powercut+fsck test
       tests: ubifs_tools: fsck_tests: Add random_corrupt+fsck test
       tests: ubifs_tools: fsck_tests: Add corrupted images
       tests: ubifs_tools: fsck_tests: Add bad images fixing test
       tests: ubifs_tools: mkfs_tests: Add fs content check test
       tests: ubifs_tools: Add run_all script
       tests: ubifs_tools: Add README
       ubifs-utils: Support Address-Sanitizier debug
       ubi-utils: mtdinfo: Fix type truncation compiling warning for 'start' variable
       nand-utils: nanddump: Fix unexpected type compiling warning for argument 'dumpfile'
       misc-utils: flashcp: Fix uninitialized variable ‘wrlast_buf’ compiling warning
       jffsX-utils: jffs2reader: Fix potential null pointer dereference compiling warning for 'path'
       tests: checkfs: Add previous prototype for do_pwr_dn()
       ubifs-utils: common: Add descritpions for linux kernel resource files
       ubifs-utils: libubifs: Update source files from linux kernel 6.13-rc7


Regards,

David

[-- Attachment #1.1.1.2: OpenPGP public key --]
[-- Type: application/pgp-keys, Size: 1743 bytes --]

[-- Attachment #1.2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 495 bytes --]

[-- Attachment #2: Type: text/plain, Size: 144 bytes --]

______________________________________________________
Linux MTD discussion mailing list
http://lists.infradead.org/mailman/listinfo/linux-mtd/

Re: [ANNOUNCE] mtd-utils-2.3.0 is released

[Miquel Raynal]

Hello David,

+Zhihao

On 15/02/2025 at 17:05:53 +01, David Oberhollenzer <david.oberhollenzer@sigma-star.at> wrote:

> Hi,
>
> mtd-utils-2.3.0 is released.

Thanks a lot for this new release! I wanted to bump the package version
in Buildroot but I got issues, perhaps you can help.

A regular `./configure --host=<arm> && make` works well when cloning the
Git repository, however Buildroot used to download the tarball, which in
practice does not contain all the .gz files:
https://git.infraroot.at/mtd-utils.git/tree/tests/ubifs_tools-tests/images

This of course leads to a build failure:
make[1]: *** No rule to make target 'tests/ubifs_tools-tests/images/good.gz', needed by 'all-am'.  Stop.

The commits from Zhihao actually list these .gz files in the .am files,
and they also appear in the Makefile.in as

    @BUILD_TESTS_TRUE@am__append_22

yet they are not part of the final distributed tarball. Any idea how to
fix that properly?

Thanks!
Miquèl

______________________________________________________
Linux MTD discussion mailing list
http://lists.infradead.org/mailman/listinfo/linux-mtd/

Re: [ANNOUNCE] mtd-utils-2.3.0 is released

[Zhihao Cheng]

在 2025/2/20 21:58, Miquel Raynal 写道:
> Hello David,
> 
> +Zhihao
> 
> On 15/02/2025 at 17:05:53 +01, David Oberhollenzer <david.oberhollenzer@sigma-star.at> wrote:
> 
>> Hi,
>>
>> mtd-utils-2.3.0 is released.
> 
> Thanks a lot for this new release! I wanted to bump the package version
> in Buildroot but I got issues, perhaps you can help.
> 
> A regular `./configure --host=<arm> && make` works well when cloning the
> Git repository, however Buildroot used to download the tarball, which in
> practice does not contain all the .gz files:
> https://git.infraroot.at/mtd-utils.git/tree/tests/ubifs_tools-tests/images
> 
> This of course leads to a build failure:
> make[1]: *** No rule to make target 'tests/ubifs_tools-tests/images/good.gz', needed by 'all-am'.  Stop.
> 
> The commits from Zhihao actually list these .gz files in the .am files,
> and they also appear in the Makefile.in as
> 
>      @BUILD_TESTS_TRUE@am__append_22
> 
> yet they are not part of the final distributed tarball. Any idea how to
> fix that properly?

Hi Miquel, sorry for introducing the problem. It could be fixed by this 
patch:

https://patchwork.ozlabs.org/project/linux-mtd/patch/20250220112554.2150046-1-m.olbrich@pengutronix.de/
> 
> Thanks!
> Miquèl
> .
> 


______________________________________________________
Linux MTD discussion mailing list
http://lists.infradead.org/mailman/listinfo/linux-mtd/

Re: [ANNOUNCE] mtd-utils-2.3.0 is released

[Miquel Raynal]

Hello Zhihao,

>> The commits from Zhihao actually list these .gz files in the .am
>> files,
>> and they also appear in the Makefile.in as
>>      @BUILD_TESTS_TRUE@am__append_22
>> yet they are not part of the final distributed tarball. Any idea how
>> to
>> fix that properly?
>
> Hi Miquel, sorry for introducing the problem. It could be fixed by this
> patch:
>
> https://patchwork.ozlabs.org/project/linux-mtd/patch/20250220112554.2150046-1-m.olbrich@pengutronix.de/

Excellent! Happy to know there is a fix already. Unfortunately it feels
like there is not much we can do directly in BR, so I'll wait for the
fix to land in a .1 minor release.

Thanks,
Miquèl

______________________________________________________
Linux MTD discussion mailing list
http://lists.infradead.org/mailman/listinfo/linux-mtd/