All of lore.kernel.org
 help / color / mirror / Atom feed
From: "kernelci.org bot" <bot@kernelci.org>
To: stable@vger.kernel.org, kernel-build-reports@lists.linaro.org,
	kernelci-results@groups.io
Subject: stable-rc/queue/4.19 baseline: 124 runs, 29 regressions (v4.19.300-63-gf79cd1783ec9)
Date: Tue, 05 Dec 2023 22:13:55 -0800 (PST)	[thread overview]
Message-ID: <65701123.170a0220.2c753.fc04@mx.google.com> (raw)

stable-rc/queue/4.19 baseline: 124 runs, 29 regressions (v4.19.300-63-gf79cd1783ec9)

Regressions Summary
-------------------

platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
at91sam9g20ek              | arm   | lab-broonie   | gcc-10   | multi_v5_defconfig         | 1          
meson-gxl-s905d-p230       | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          
meson-gxm-khadas-vim2      | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv2      | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv2      | arm64 | lab-baylibre  | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv2      | arm64 | lab-broonie   | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv2      | arm64 | lab-broonie   | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv2      | arm64 | lab-collabora | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv2      | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre  | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie   | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie   | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv3      | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv3      | arm64 | lab-baylibre  | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv3      | arm64 | lab-broonie   | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv3      | arm64 | lab-broonie   | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv3      | arm64 | lab-collabora | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv3      | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre  | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie   | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie   | gcc-10   | defconfig+arm64-chromebook | 1          
qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10   | defconfig                  | 1          
qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 1          
rk3399-gru-kevin           | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 2          

  Details:  https://kernelci.org/test/job/stable-rc/branch/queue%2F4.19/kernel/v4.19.300-63-gf79cd1783ec9/plan/baseline/

  Test:     baseline
  Tree:     stable-rc
  Branch:   queue/4.19
  Describe: v4.19.300-63-gf79cd1783ec9
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git
  SHA:      f79cd1783ec9cc35a3cbaf721251b580bce330df 


Test Regressions
---------------- 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
at91sam9g20ek              | arm   | lab-broonie   | gcc-10   | multi_v5_defconfig         | 1          

  Details:     https://kernelci.org/test/plan/id/656fdeb8463c196c50e13480

  Results:     42 PASS, 9 FAIL, 1 SKIP
  Full config: multi_v5_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm/multi_v5_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm/multi_v5_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 


  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/656fdeb8463c196c50e134af
        failing since 13 days (last pass: v4.19.284-5-gd33af5806015, first fail: v4.19.299-50-gaa3fbf0e1c59)

    2023-12-06T02:38:08.513179  + set +x
    2023-12-06T02:38:08.513706  <8><LAVA_SIGNAL_ENDRUN 0_dmesg 312593_1.5.2.4.1>
    2023-12-06T02:38:08.625991  / # #
    2023-12-06T02:38:08.729085  export SHELL=/bin/sh
    2023-12-06T02:38:08.729884  #
    2023-12-06T02:38:08.831944  / # export SHELL=/bin/sh. /lava-312593/environment
    2023-12-06T02:38:08.832754  
    2023-12-06T02:38:08.934851  / # . /lava-312593/environment/lava-312593/bin/lava-test-runner /lava-312593/1
    2023-12-06T02:38:08.936174  
    2023-12-06T02:38:08.939735  / # /lava-312593/bin/lava-test-runner /lava-312593/1 
    ... (12 line(s) more)  
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
meson-gxl-s905d-p230       | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe022233b0b999ce134c1

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/656fe022233b0b999ce134ca
        new failure (last pass: v4.19.283-112-g053be4f4cfe1)
        3 lines

    2023-12-06T02:44:05.578250  kern  :emerg : Disabling IRQ #19
    2023-12-06T02:44:05.583883  kern  :emerg : Disabling IRQ #20
    2023-12-06T02:44:05.594772  kern  :emerg : Disabling IRQ <8>[   52.691877] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=3>
    2023-12-06T02:44:05.595083  #18   
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
meson-gxm-khadas-vim2      | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fdfe921f1ffad39e13493

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/656fdfe921f1ffad39e1349a
        failing since 13 days (last pass: v4.19.284-5-gd33af5806015, first fail: v4.19.299-50-gaa3fbf0e1c59)
        2 lines

    2023-12-06T02:43:34.168143  kern  :emerg : Disabling IRQ #24
    2023-12-06T02:43:34.168349  kern  :emerg : Disabling IRQ #22
    2023-12-06T02:43:34.168745  <8>[   48.363613] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2023-12-06T02:43:34.168941  + set +x
    2023-12-06T02:43:34.169128  <8>[   48.368004] <LAVA_SIGNAL_ENDRUN 0_dmesg 3862494_1.5.2.4.1>   
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2      | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe0d9f136f20a2be13487

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe0d9f136f20a2be13488
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2      | arm64 | lab-baylibre  | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe1dcb4e3e8f9afe1348d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe1dcb4e3e8f9afe1348e
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2      | arm64 | lab-broonie   | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe1c48367553e54e134d4

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe1c48367553e54e134d5
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2      | arm64 | lab-broonie   | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe50d72010bc2d9e1349d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe50d72010bc2d9e1349e
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2      | arm64 | lab-collabora | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe12273aae27311e13476

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe12273aae27311e13477
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2      | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe3a695a9591227e13477

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe3a795a9591227e13478
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe0dcf136f20a2be1348d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe0dcf136f20a2be1348e
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre  | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe24141443f78afe13504

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe24141443f78afe13505
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie   | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe2504ffcd7b463e1347d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe2504ffcd7b463e1347e
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie   | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe54922887345fde135df

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe54922887345fde135e0
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe1764a83aa0b6ae13475

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe1764a83aa0b6ae13476
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe45b843a85dd38e13494

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe45b843a85dd38e13495
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3      | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe0dbf136f20a2be1348a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe0dbf136f20a2be1348b
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3      | arm64 | lab-baylibre  | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe1f002410244d3e1348a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe1f002410244d3e1348b
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3      | arm64 | lab-broonie   | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe20ce1b8fbdbfee134b9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe20ce1b8fbdbfee134ba
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3      | arm64 | lab-broonie   | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe50e41a8a40874e134a5

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe50e41a8a40874e134a6
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3      | arm64 | lab-collabora | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe16004c998042fe134cf

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe16004c998042fe134d0
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3      | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe443a3e4d9306ae134b9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe443a3e4d9306ae134ba
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre  | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe0da00d77344a2e134a0

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe0da00d77344a2e134a1
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre  | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe24041443f78afe13501

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe24041443f78afe13502
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie   | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe200e1b8fbdbfee134a3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe200e1b8fbdbfee134a4
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie   | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe52cf4e8a22cbae13528

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe52cf4e8a22cbae13529
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10   | defconfig                  | 1          

  Details:     https://kernelci.org/test/plan/id/656fe123dce5c26c9ee134ae

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe123dce5c26c9ee134af
        failing since 574 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/656fe40bcf40a19733e13475

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/656fe40bcf40a19733e13476
        failing since 574 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) 
 


platform                   | arch  | lab           | compiler | defconfig                  | regressions
---------------------------+-------+---------------+----------+----------------------------+------------
rk3399-gru-kevin           | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook | 2          

  Details:     https://kernelci.org/test/plan/id/656fe06c9538a41b72e1348f

  Results:     77 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.300-63-gf79cd1783ec9/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 


  * baseline.bootrr.rockchip-usb2phy1-probed: https://kernelci.org/test/case/id/656fe06c9538a41b72e13495
        failing since 266 days (last pass: v4.19.275-252-gcb3c41fc75db9, first fail: v4.19.276-34-ge787294ce440f)

    2023-12-06T02:48:15.637626  /lava-12193487/1/../bin/lava-test-case
   

  * baseline.bootrr.rockchip-usb2phy0-probed: https://kernelci.org/test/case/id/656fe06c9538a41b72e13496
        failing since 266 days (last pass: v4.19.275-252-gcb3c41fc75db9, first fail: v4.19.276-34-ge787294ce440f)

    2023-12-06T02:48:14.624511  /lava-12193487/1/../bin/lava-test-case<8>[   36.401925] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-usb2phy0-probed RESULT=fail>

    2023-12-06T02:48:14.624647  
   
  

                 reply	other threads:[~2023-12-06  6:13 UTC|newest]

Thread overview: [no followups] expand[flat|nested]  mbox.gz  Atom feed

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=65701123.170a0220.2c753.fc04@mx.google.com \
    --to=bot@kernelci.org \
    --cc=kernel-build-reports@lists.linaro.org \
    --cc=kernelci-results@groups.io \
    --cc=stable@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.