[BUG] ut lib lib_rsa_verify_valid crashes on qemu_arm if RSA_VERIFY_WITH_PKEY=y

AKASHI Takahiro
2020-06-09T01:42:14Z

Heinrich,

On Mon, Jun 08, 2020 at 11:08:53PM +0200, Heinrich Schuchardt wrote:
> Hello Takahiro,
>
> when trying to execute command
>
> ut lib lib_rsa_verify_valid
>
> on qemu_arm_defconfig with CONFIG_UNIT_TEST=y and
> CONFIG_RSA_VERIFY_WITH_PKEY=y it crashes in
>
> free((void *)prop->modulus) called from
> rsa_free_key_prop() called from
> rsa_verify_key() called from
> rsa_verify_with_pkey().
>
> Without CONFIG_RSA_VERIFY_WITH_PKEY=y the problem does not occur.
> On qemu_arm64_defconfig the problem does not occur.

I can't reproduce your problem on v2020.07-rc4 exactly with
qemu_arm64_defconfig + PKEY=y:

U-Boot 2020.07-rc4-dirty (Jun 09 2020 - 10:33:30 +0900)

...

=> ut lib
Running 11 lib tests
Test: lib_asn1_pkcs7
Test: lib_asn1_pkey
Test: lib_asn1_x509
Test: lib_memcpy
Test: lib_memmove
Test: lib_memset
Test: lib_rsa_verify_invalid
Test: lib_rsa_verify_valid
Test: lib_test_bin2hex
Test: lib_test_hex2bin
Test: lib_test_hex_to_bin
Failures: 0

-Takahiro Akashi

> Could you, please, have a look.
>
> Best regards
>
> Heinrich