All of lore.kernel.org
 help / color / mirror / Atom feed
From: "kernelci.org bot" <bot@kernelci.org>
To: stable@vger.kernel.org, kernel-build-reports@lists.linaro.org,
	kernelci-results@groups.io
Subject: stable-rc/queue/6.1 baseline: 138 runs, 10 regressions (v6.1.27-610-gc6b46250d53e)
Date: Wed, 10 May 2023 21:38:30 -0700 (PDT)	[thread overview]
Message-ID: <645c7146.170a0220.f5849.9ce2@mx.google.com> (raw)

stable-rc/queue/6.1 baseline: 138 runs, 10 regressions (v6.1.27-610-gc6b46250d53e)

Regressions Summary
-------------------

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          
asus-cx9400-volteer          | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-14-G1-sona           | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 2          
qemu_mips-malta              | mips   | lab-collabora | gcc-10   | malta_defconfig              | 1          

  Details:  https://kernelci.org/test/job/stable-rc/branch/queue%2F6.1/kernel/v6.1.27-610-gc6b46250d53e/plan/baseline/

  Test:     baseline
  Tree:     stable-rc
  Branch:   queue/6.1
  Describe: v6.1.27-610-gc6b46250d53e
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git
  SHA:      c6b46250d53e859cf018d2ba8b8d2abe3fb86906 


Test Regressions
---------------- 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/645c3a36ca5f92de512e8652

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/x86/rootfs.cpio.gz 


  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/645c3a36ca5f92de512e8657
        failing since 43 days (last pass: v6.1.21-104-gd5eb32be5b26, first fail: v6.1.21-224-g1abeb39fad59)

    2023-05-11T00:43:16.886324  + set +x

    2023-05-11T00:43:16.892766  <8>[   10.450531] <LAVA_SIGNAL_ENDRUN 0_dmesg 10273266_1.4.2.3.1>

    2023-05-11T00:43:17.001585  / # #

    2023-05-11T00:43:17.104086  export SHELL=/bin/sh

    2023-05-11T00:43:17.104885  #

    2023-05-11T00:43:17.206682  / # export SHELL=/bin/sh. /lava-10273266/environment

    2023-05-11T00:43:17.207486  

    2023-05-11T00:43:17.309250  / # . /lava-10273266/environment/lava-10273266/bin/lava-test-runner /lava-10273266/1

    2023-05-11T00:43:17.310545  

    2023-05-11T00:43:17.316025  / # /lava-10273266/bin/lava-test-runner /lava-10273266/1
 
    ... (12 line(s) more)  
 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/645c39af3ea9844e642e85e6

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/x86/rootfs.cpio.gz 


  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/645c39af3ea9844e642e85eb
        failing since 43 days (last pass: v6.1.21-104-gd5eb32be5b26, first fail: v6.1.21-224-g1abeb39fad59)

    2023-05-11T00:41:10.581401  + set<8>[   11.440966] <LAVA_SIGNAL_ENDRUN 0_dmesg 10273272_1.4.2.3.1>

    2023-05-11T00:41:10.581529   +x

    2023-05-11T00:41:10.686139  / # #

    2023-05-11T00:41:10.786809  export SHELL=/bin/sh

    2023-05-11T00:41:10.787007  #

    2023-05-11T00:41:10.887519  / # export SHELL=/bin/sh. /lava-10273272/environment

    2023-05-11T00:41:10.887687  

    2023-05-11T00:41:10.988246  / # . /lava-10273272/environment/lava-10273272/bin/lava-test-runner /lava-10273272/1

    2023-05-11T00:41:10.988557  

    2023-05-11T00:41:10.993232  / # /lava-10273272/bin/lava-test-runner /lava-10273272/1
 
    ... (12 line(s) more)  
 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
asus-cx9400-volteer          | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/645c39b5559e3397762e86dc

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/x86/rootfs.cpio.gz 


  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/645c39b5559e3397762e86e1
        failing since 43 days (last pass: v6.1.21-104-gd5eb32be5b26, first fail: v6.1.21-224-g1abeb39fad59)

    2023-05-11T00:41:18.988237  <8>[   11.075837] <LAVA_SIGNAL_ENDRUN 0_dmesg 10273281_1.4.2.3.1>

    2023-05-11T00:41:18.991393  + set +x

    2023-05-11T00:41:19.093587  

    2023-05-11T00:41:19.194252  / # #export SHELL=/bin/sh

    2023-05-11T00:41:19.194562  

    2023-05-11T00:41:19.295223  / # export SHELL=/bin/sh. /lava-10273281/environment

    2023-05-11T00:41:19.295533  

    2023-05-11T00:41:19.396214  / # . /lava-10273281/environment/lava-10273281/bin/lava-test-runner /lava-10273281/1

    2023-05-11T00:41:19.396704  

    2023-05-11T00:41:19.401490  / # /lava-10273281/bin/lava-test-runner /lava-10273281/1
 
    ... (12 line(s) more)  
 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/645c3a0a0bdd45f83e2e864e

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/x86/rootfs.cpio.gz 


  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/645c3a0a0bdd45f83e2e8653
        failing since 43 days (last pass: v6.1.21-104-gd5eb32be5b26, first fail: v6.1.21-224-g1abeb39fad59)

    2023-05-11T00:42:34.375487  + set +x

    2023-05-11T00:42:34.382106  <8>[   11.397917] <LAVA_SIGNAL_ENDRUN 0_dmesg 10273302_1.4.2.3.1>

    2023-05-11T00:42:34.486498  / # #

    2023-05-11T00:42:34.587131  export SHELL=/bin/sh

    2023-05-11T00:42:34.587334  #

    2023-05-11T00:42:34.687885  / # export SHELL=/bin/sh. /lava-10273302/environment

    2023-05-11T00:42:34.688124  

    2023-05-11T00:42:34.788680  / # . /lava-10273302/environment/lava-10273302/bin/lava-test-runner /lava-10273302/1

    2023-05-11T00:42:34.788996  

    2023-05-11T00:42:34.794213  / # /lava-10273302/bin/lava-test-runner /lava-10273302/1
 
    ... (12 line(s) more)  
 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
hp-x360-14-G1-sona           | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/645c39a26683dfbd532e85f3

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/x86/rootfs.cpio.gz 


  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/645c39a26683dfbd532e85f8
        failing since 43 days (last pass: v6.1.21-104-gd5eb32be5b26, first fail: v6.1.21-224-g1abeb39fad59)

    2023-05-11T00:40:51.029128  <8>[   10.467988] <LAVA_SIGNAL_ENDRUN 0_dmesg 10273245_1.4.2.3.1>

    2023-05-11T00:40:51.032250  + set +x

    2023-05-11T00:40:51.137157  / # #

    2023-05-11T00:40:51.237823  export SHELL=/bin/sh

    2023-05-11T00:40:51.238004  #

    2023-05-11T00:40:51.338496  / # export SHELL=/bin/sh. /lava-10273245/environment

    2023-05-11T00:40:51.338756  

    2023-05-11T00:40:51.439279  / # . /lava-10273245/environment/lava-10273245/bin/lava-test-runner /lava-10273245/1

    2023-05-11T00:40:51.439559  

    2023-05-11T00:40:51.444343  / # /lava-10273245/bin/lava-test-runner /lava-10273245/1
 
    ... (12 line(s) more)  
 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/645c39c13ea9844e642e8623

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/x86/rootfs.cpio.gz 


  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/645c39c13ea9844e642e8628
        failing since 43 days (last pass: v6.1.21-104-gd5eb32be5b26, first fail: v6.1.21-224-g1abeb39fad59)

    2023-05-11T00:41:14.926164  + set<8>[   11.761631] <LAVA_SIGNAL_ENDRUN 0_dmesg 10273307_1.4.2.3.1>

    2023-05-11T00:41:14.926268   +x

    2023-05-11T00:41:15.030660  / # #

    2023-05-11T00:41:15.131433  export SHELL=/bin/sh

    2023-05-11T00:41:15.131667  #

    2023-05-11T00:41:15.232257  / # export SHELL=/bin/sh. /lava-10273307/environment

    2023-05-11T00:41:15.232522  

    2023-05-11T00:41:15.333111  / # . /lava-10273307/environment/lava-10273307/bin/lava-test-runner /lava-10273307/1

    2023-05-11T00:41:15.333378  

    2023-05-11T00:41:15.337618  / # /lava-10273307/bin/lava-test-runner /lava-10273307/1
 
    ... (12 line(s) more)  
 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/645c39bc068e642a282e85f4

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/x86/rootfs.cpio.gz 


  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/645c39bc068e642a282e85f9
        failing since 43 days (last pass: v6.1.21-104-gd5eb32be5b26, first fail: v6.1.21-224-g1abeb39fad59)

    2023-05-11T00:41:15.851161  / # #

    2023-05-11T00:41:15.952298  export SHELL=/bin/sh

    2023-05-11T00:41:15.952603  #

    2023-05-11T00:41:16.053263  / # export SHELL=/bin/sh. /lava-10273294/environment

    2023-05-11T00:41:16.053540  

    2023-05-11T00:41:16.154231  / # . /lava-10273294/environment/lava-10273294/bin/lava-test-runner /lava-10273294/1

    2023-05-11T00:41:16.154555  

    2023-05-11T00:41:16.158819  / # /lava-10273294/bin/lava-test-runner /lava-10273294/1

    2023-05-11T00:41:16.165790  + export 'TESTRUN_ID=1_bootrr'

    2023-05-11T00:41:16.168897  + cd /lava-10273294/1/tests/1_bootrr
 
    ... (10 line(s) more)  
 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 2          

  Details:     https://kernelci.org/test/plan/id/645c3ff750f3f5faad2e8618

  Results:     166 PASS, 5 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/arm64/rootfs.cpio.gz 


  * baseline.bootrr.mt6577-auxadc-probed: https://kernelci.org/test/case/id/645c3ff750f3f5faad2e862c
        failing since 3 days (last pass: v6.1.22-704-ga3dcd1f09de2, first fail: v6.1.22-1160-g24230ce6f2e2)

    2023-05-11T01:07:41.924972  /lava-10273681/1/../bin/lava-test-case

    2023-05-11T01:07:41.931050  <8>[   22.915563] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mt6577-auxadc-probed RESULT=fail>
   

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/645c3ff750f3f5faad2e86c0
        failing since 3 days (last pass: v6.1.22-704-ga3dcd1f09de2, first fail: v6.1.22-1160-g24230ce6f2e2)

    2023-05-11T01:07:36.472527  + set +x

    2023-05-11T01:07:36.479691  <8>[   17.462623] <LAVA_SIGNAL_ENDRUN 0_dmesg 10273681_1.5.2.3.1>

    2023-05-11T01:07:36.584965  / # #

    2023-05-11T01:07:36.685750  export SHELL=/bin/sh

    2023-05-11T01:07:36.685999  #

    2023-05-11T01:07:36.786600  / # export SHELL=/bin/sh. /lava-10273681/environment

    2023-05-11T01:07:36.786841  

    2023-05-11T01:07:36.887420  / # . /lava-10273681/environment/lava-10273681/bin/lava-test-runner /lava-10273681/1

    2023-05-11T01:07:36.887790  

    2023-05-11T01:07:36.893256  / # /lava-10273681/bin/lava-test-runner /lava-10273681/1
 
    ... (13 line(s) more)  
 


platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_mips-malta              | mips   | lab-collabora | gcc-10   | malta_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/645c38a6ea1c1404052e8603

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: malta_defconfig
  Compiler:    gcc-10 (mips-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/mips/malta_defconfig/gcc-10/lab-collabora/baseline-qemu_mips-malta.txt
  HTML log:    https://storage.kernelci.org//stable-rc/queue-6.1/v6.1.27-610-gc6b46250d53e/mips/malta_defconfig/gcc-10/lab-collabora/baseline-qemu_mips-malta.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230421.0/mipsel/rootfs.cpio.gz 


  * baseline.login: https://kernelci.org/test/case/id/645c38a6ea1c1404052e8604
        failing since 3 days (last pass: v6.1.22-1159-g8729cbdc1402, first fail: v6.1.22-1196-g571a2463c150b) 
  

                 reply	other threads:[~2023-05-11  4:38 UTC|newest]

Thread overview: [no followups] expand[flat|nested]  mbox.gz  Atom feed

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=645c7146.170a0220.f5849.9ce2@mx.google.com \
    --to=bot@kernelci.org \
    --cc=kernel-build-reports@lists.linaro.org \
    --cc=kernelci-results@groups.io \
    --cc=stable@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.