From: "kernelci.org bot" <bot@kernelci.org>
To: stable@vger.kernel.org, kernel-build-reports@lists.linaro.org,
kernelci-results@groups.io
Subject: stable-rc/queue/4.19 baseline: 160 runs, 29 regressions (v4.19.269-521-g305d312d039a)
Date: Tue, 17 Jan 2023 02:17:20 -0800 (PST) [thread overview]
Message-ID: <63c675b0.170a0220.f65ab.12b7@mx.google.com> (raw)
stable-rc/queue/4.19 baseline: 160 runs, 29 regressions (v4.19.269-521-g305d312d039a)
Regressions Summary
-------------------
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
at91sam9g20ek | arm | lab-broonie | gcc-10 | multi_v5_defconfig | 1
cubietruck | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1
qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
sun50i-h6-pine-h64 | arm64 | lab-baylibre | gcc-10 | defconfig | 1
sun50i-h6-pine-h64 | arm64 | lab-clabbe | gcc-10 | defconfig | 1
sun50i-h6-pine-h64 | arm64 | lab-collabora | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/job/stable-rc/branch/queue%2F4.19/kernel/v4.19.269-521-g305d312d039a/plan/baseline/
Test: baseline
Tree: stable-rc
Branch: queue/4.19
Describe: v4.19.269-521-g305d312d039a
URL: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git
SHA: 305d312d039a3784cb0cb6db21f6d562ed66988a
Test Regressions
----------------
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
at91sam9g20ek | arm | lab-broonie | gcc-10 | multi_v5_defconfig | 1
Details: https://kernelci.org/test/plan/id/63c641c5f30edc8347915ec7
Results: 5 PASS, 1 FAIL, 1 SKIP
Full config: multi_v5_defconfig
Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm/multi_v5_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm/multi_v5_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/armel/rootfs.cpio.gz
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63c641c5f30edc8347915ecc
new failure (last pass: v4.19.269-425-g6a5912d9a0538)
2023-01-17T06:35:30.819411 + set +x
2023-01-17T06:35:30.824640 <8><LAVA_SIGNAL_ENDRUN 0_dmesg 122941_1.5.2.4.1>
2023-01-17T06:35:30.938360 / # #
2023-01-17T06:35:31.041312 export SHELL=/bin/sh
2023-01-17T06:35:31.042094 #
2023-01-17T06:35:31.144041 / # export SHELL=/bin/sh. /lava-122941/environment
2023-01-17T06:35:31.144828
2023-01-17T06:35:31.247364 / # . /lava-122941/environment/lava-122941/bin/lava-test-runner /lava-122941/1
2023-01-17T06:35:31.248669
2023-01-17T06:35:31.255174 / # /lava-122941/bin/lava-test-runner /lava-122941/1
... (12 line(s) more)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
cubietruck | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/63c64406a8ef39b5e0915f21
Results: 5 PASS, 1 FAIL, 1 SKIP
Full config: multi_v7_defconfig
Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/armel/rootfs.cpio.gz
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63c64406a8ef39b5e0915f26
new failure (last pass: v4.19.269-9-gce7b59ec9d48)
2023-01-17T06:45:05.880133 + set +x<8>[ 7.408540] <LAVA_SIGNAL_ENDRUN 0_dmesg 3142159_1.5.2.4.1>
2023-01-17T06:45:05.880868
2023-01-17T06:45:05.991705 / # #
2023-01-17T06:45:06.096020 export SHELL=/bin/sh
2023-01-17T06:45:06.097218 #
2023-01-17T06:45:06.199509 / # export SHELL=/bin/sh. /lava-3142159/environment
2023-01-17T06:45:06.200016
2023-01-17T06:45:06.301731 / # . /lava-3142159/environment/lava-3142159/bin/lava-test-runner /lava-3142159/1
2023-01-17T06:45:06.303659
2023-01-17T06:45:06.308609 / # /lava-3142159/bin/lava-test-runner /lava-3142159/1
... (12 line(s) more)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c644b37adb19f98d915ec8
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c644b37adb19f98d915ec9
failing since 273 days (last pass: v4.19.238-22-gb215381f8cf05, first fail: v4.19.238-32-g4d86c9395c31a)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c644cf8e482f7de3915eba
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c644cf8e482f7de3915ebb
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c646248315c48932915ef7
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c646248315c48932915ef8
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c6451074b1bd99b4915ee7
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c6451074b1bd99b4915ee8
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c6468c6cbdb04d88915ed2
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c6468c6cbdb04d88915ed3
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c6448251c2f1086b915ec3
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c6448251c2f1086b915ec4
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c645bec0696a44af915ecd
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c645bec0696a44af915ece
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c644ca916126a245915eb9
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c644ca916126a245915eba
failing since 251 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c64610ba47563237915eb9
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c64610ba47563237915eba
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c644e828179478cb915ebb
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c644e828179478cb915ebc
failing since 251 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c647b8a7359766e0915edd
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c647b8a7359766e0915ede
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c645bf19eaa5b348915eb9
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c645bf19eaa5b348915eba
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c644ce916126a245915ebf
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c644ce916126a245915ec0
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c6460ef4525345ef915ee7
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c6460ef4525345ef915ee8
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c644ea74b1bd99b4915ed1
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c644ea74b1bd99b4915ed2
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c646a0e0c5053298915ee6
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c646a0e0c5053298915ee7
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c6448151c2f1086b915ec0
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c6448151c2f1086b915ec1
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c645c119eaa5b348915ebc
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c645c119eaa5b348915ebd
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c644ccb9fea0c57f915ee0
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c644ccb9fea0c57f915ee1
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c64627ba47563237915ed1
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c64627ba47563237915ed2
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c644e98e482f7de3915f3a
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c644e98e482f7de3915f3b
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c647e0f8a047db6e915eef
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c647e0f8a047db6e915ef0
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c6447e2ffdacc5c9915ecd
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c6447e2ffdacc5c9915ece
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/63c645d32ccbf43db2915ec7
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: defconfig+arm64-chromebook
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.login: https://kernelci.org/test/case/id/63c645d32ccbf43db2915ec8
failing since 175 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
sun50i-h6-pine-h64 | arm64 | lab-baylibre | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c6438a775c7cab55915edd
Results: 5 PASS, 1 FAIL, 1 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63c6438a775c7cab55915ee2
new failure (last pass: v4.19.266-171-g3ff1cc101ea8)
2023-01-17T06:42:57.627281 / # #
2023-01-17T06:42:57.729162 export SHELL=/bin/sh
2023-01-17T06:42:57.729738 #
2023-01-17T06:42:57.831090 / # export SHELL=/bin/sh. /lava-3142197/environment
2023-01-17T06:42:57.831442
2023-01-17T06:42:57.932796 / # . /lava-3142197/environment/lava-3142197/bin/lava-test-runner /lava-3142197/1
2023-01-17T06:42:57.933418
2023-01-17T06:42:57.938323 / # /lava-3142197/bin/lava-test-runner /lava-3142197/1
2023-01-17T06:42:58.008101 + export 'TESTRUN_ID=1_bootrr'
2023-01-17T06:42:58.008584 + cd /lava-3142197<8>[ 15.627067] <LAVA_SIGNAL_STARTRUN 1_bootrr 3142197_1.5.2.4.5>
... (11 line(s) more)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
sun50i-h6-pine-h64 | arm64 | lab-clabbe | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c643791460d84762915eeb
Results: 5 PASS, 1 FAIL, 1 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-clabbe/baseline-sun50i-h6-pine-h64.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-clabbe/baseline-sun50i-h6-pine-h64.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63c643791460d84762915eee
new failure (last pass: v4.19.266-171-g3ff1cc101ea8)
2023-01-17T06:42:50.061221 <8>[ 15.157765] <LAVA_SIGNAL_ENDRUN 0_dmesg 380319_1.5.2.4.1>
2023-01-17T06:42:50.167852 / # #
2023-01-17T06:42:50.270104 export SHELL=/bin/sh
2023-01-17T06:42:50.270713 #
2023-01-17T06:42:50.372358 / # export SHELL=/bin/sh. /lava-380319/environment
2023-01-17T06:42:50.372936
2023-01-17T06:42:50.474588 / # . /lava-380319/environment/lava-380319/bin/lava-test-runner /lava-380319/1
2023-01-17T06:42:50.475602
2023-01-17T06:42:50.492295 / # /lava-380319/bin/lava-test-runner /lava-380319/1
2023-01-17T06:42:50.508299 + export 'TESTRUN_ID=1_bootrr'
... (13 line(s) more)
platform | arch | lab | compiler | defconfig | regressions
-----------------------------+-------+---------------+----------+----------------------------+------------
sun50i-h6-pine-h64 | arm64 | lab-collabora | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/63c6438f775c7cab55915f22
Results: 5 PASS, 1 FAIL, 1 SKIP
Full config: defconfig
Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.txt
HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.269-521-g305d312d039a/arm64/defconfig/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63c6438f775c7cab55915f27
new failure (last pass: v4.19.266-171-g3ff1cc101ea8)
2023-01-17T06:43:20.552662 / # #
2023-01-17T06:43:20.655319 export SHELL=/bin/sh
2023-01-17T06:43:20.656058 #
2023-01-17T06:43:20.757542 / # export SHELL=/bin/sh. /lava-8745722/environment
2023-01-17T06:43:20.758330
2023-01-17T06:43:20.860268 / # . /lava-8745722/environment/lava-8745722/bin/lava-test-runner /lava-8745722/1
2023-01-17T06:43:20.861603
2023-01-17T06:43:20.874118 / # /lava-8745722/bin/lava-test-runner /lava-8745722/1
2023-01-17T06:43:20.932770 + export 'TESTRUN_ID=1_bootrr'
2023-01-17T06:43:20.933153 + cd /lava-8745722<8>[ 15.636155] <LAVA_SIGNAL_STARTRUN 1_bootrr 8745722_1.5.2.4.5>
... (11 line(s) more)
reply other threads:[~2023-01-17 10:18 UTC|newest]
Thread overview: [no followups] expand[flat|nested] mbox.gz Atom feed
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=63c675b0.170a0220.f65ab.12b7@mx.google.com \
--to=bot@kernelci.org \
--cc=kernel-build-reports@lists.linaro.org \
--cc=kernelci-results@groups.io \
--cc=stable@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.