All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: Nicholas Piggin <npiggin@gmail.com>
Cc: Michael Ellerman <mpe@ellerman.id.au>,
	Jonathan Cameron <Jonathan.Cameron@huawei.com>,
	dzickus@redhat.com, sfr@canb.auug.org.au, linuxarm@huawei.com,
	abdhalee@linux.vnet.ibm.com, tglx@linutronix.de,
	sparclinux@vger.kernel.org, akpm@linux-foundation.org,
	linuxppc-dev@lists.ozlabs.org, David Miller <davem@davemloft.net>,
	linux-arm-kernel@lists.infradead.org, john.stultz@linaro.org
Subject: Re: RCU lockup issues when CONFIG_SOFTLOCKUP_DETECTOR=n - any one else seeing this?
Date: Sun, 20 Aug 2017 14:14:29 -0700	[thread overview]
Message-ID: <20170820211429.GA27111@linux.vnet.ibm.com> (raw)
In-Reply-To: <20170820183514.GM11320@linux.vnet.ibm.com>

On Sun, Aug 20, 2017 at 11:35:14AM -0700, Paul E. McKenney wrote:
> On Sun, Aug 20, 2017 at 11:00:40PM +1000, Nicholas Piggin wrote:
> > On Sun, 20 Aug 2017 14:45:53 +1000
> > Nicholas Piggin <npiggin@gmail.com> wrote:
> > 
> > > On Wed, 16 Aug 2017 09:27:31 -0700
> > > "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> wrote:
> > > > On Wed, Aug 16, 2017 at 05:56:17AM -0700, Paul E. McKenney wrote:
> > > > 
> > > > Thomas, John, am I misinterpreting the timer trace event messages?  
> > > 
> > > So I did some digging, and what you find is that rcu_sched seems to do a
> > > simple scheudle_timeout(1) and just goes out to lunch for many seconds.
> > > The process_timeout timer never fires (when it finally does wake after
> > > one of these events, it usually removes the timer with del_timer_sync).
> > > 
> > > So this patch seems to fix it. Testing, comments welcome.
> > 
> > Okay this had a problem of trying to forward the timer from a timer
> > callback function.
> > 
> > This was my other approach which also fixes the RCU warnings, but it's
> > a little more complex. I reworked it a bit so the mod_timer fast path
> > hopefully doesn't have much more overhead (actually by reading jiffies
> > only when needed, it probably saves a load).
> 
> Giving this one a whirl!

No joy here, but then again there are other reasons to believe that I
am seeing a different bug than Dave and Jonathan are.

OK, not -entirely- without joy -- 10 of 14 runs were error-free, which
is a good improvement over 0 of 84 for your earlier patch.  ;-)  But
not statistically different from what I see without either patch.

But no statistical difference compared to without patch, and I still
see the "rcu_sched kthread starved" messages.  For whatever it is worth,
by the way, I also see this: "hrtimer: interrupt took 5712368 ns".
Hmmm...  I am also seeing that without any of your patches.  Might
be hypervisor preemption, I guess.

							Thanx, Paul

PS.  I will be off the grid for the next day or so.  Eclipse day here...

WARNING: multiple messages have this Message-ID (diff)
From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: linux-arm-kernel@lists.infradead.org
Subject: Re: RCU lockup issues when CONFIG_SOFTLOCKUP_DETECTOR=n - any one else seeing this?
Date: Sun, 20 Aug 2017 21:14:29 +0000	[thread overview]
Message-ID: <20170820211429.GA27111@linux.vnet.ibm.com> (raw)
In-Reply-To: <20170820183514.GM11320@linux.vnet.ibm.com>

On Sun, Aug 20, 2017 at 11:35:14AM -0700, Paul E. McKenney wrote:
> On Sun, Aug 20, 2017 at 11:00:40PM +1000, Nicholas Piggin wrote:
> > On Sun, 20 Aug 2017 14:45:53 +1000
> > Nicholas Piggin <npiggin@gmail.com> wrote:
> > 
> > > On Wed, 16 Aug 2017 09:27:31 -0700
> > > "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> wrote:
> > > > On Wed, Aug 16, 2017 at 05:56:17AM -0700, Paul E. McKenney wrote:
> > > > 
> > > > Thomas, John, am I misinterpreting the timer trace event messages?  
> > > 
> > > So I did some digging, and what you find is that rcu_sched seems to do a
> > > simple scheudle_timeout(1) and just goes out to lunch for many seconds.
> > > The process_timeout timer never fires (when it finally does wake after
> > > one of these events, it usually removes the timer with del_timer_sync).
> > > 
> > > So this patch seems to fix it. Testing, comments welcome.
> > 
> > Okay this had a problem of trying to forward the timer from a timer
> > callback function.
> > 
> > This was my other approach which also fixes the RCU warnings, but it's
> > a little more complex. I reworked it a bit so the mod_timer fast path
> > hopefully doesn't have much more overhead (actually by reading jiffies
> > only when needed, it probably saves a load).
> 
> Giving this one a whirl!

No joy here, but then again there are other reasons to believe that I
am seeing a different bug than Dave and Jonathan are.

OK, not -entirely- without joy -- 10 of 14 runs were error-free, which
is a good improvement over 0 of 84 for your earlier patch.  ;-)  But
not statistically different from what I see without either patch.

But no statistical difference compared to without patch, and I still
see the "rcu_sched kthread starved" messages.  For whatever it is worth,
by the way, I also see this: "hrtimer: interrupt took 5712368 ns".
Hmmm...  I am also seeing that without any of your patches.  Might
be hypervisor preemption, I guess.

							Thanx, Paul

PS.  I will be off the grid for the next day or so.  Eclipse day here...


WARNING: multiple messages have this Message-ID (diff)
From: paulmck@linux.vnet.ibm.com (Paul E. McKenney)
To: linux-arm-kernel@lists.infradead.org
Subject: RCU lockup issues when CONFIG_SOFTLOCKUP_DETECTOR=n - any one else seeing this?
Date: Sun, 20 Aug 2017 14:14:29 -0700	[thread overview]
Message-ID: <20170820211429.GA27111@linux.vnet.ibm.com> (raw)
In-Reply-To: <20170820183514.GM11320@linux.vnet.ibm.com>

On Sun, Aug 20, 2017 at 11:35:14AM -0700, Paul E. McKenney wrote:
> On Sun, Aug 20, 2017 at 11:00:40PM +1000, Nicholas Piggin wrote:
> > On Sun, 20 Aug 2017 14:45:53 +1000
> > Nicholas Piggin <npiggin@gmail.com> wrote:
> > 
> > > On Wed, 16 Aug 2017 09:27:31 -0700
> > > "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> wrote:
> > > > On Wed, Aug 16, 2017 at 05:56:17AM -0700, Paul E. McKenney wrote:
> > > > 
> > > > Thomas, John, am I misinterpreting the timer trace event messages?  
> > > 
> > > So I did some digging, and what you find is that rcu_sched seems to do a
> > > simple scheudle_timeout(1) and just goes out to lunch for many seconds.
> > > The process_timeout timer never fires (when it finally does wake after
> > > one of these events, it usually removes the timer with del_timer_sync).
> > > 
> > > So this patch seems to fix it. Testing, comments welcome.
> > 
> > Okay this had a problem of trying to forward the timer from a timer
> > callback function.
> > 
> > This was my other approach which also fixes the RCU warnings, but it's
> > a little more complex. I reworked it a bit so the mod_timer fast path
> > hopefully doesn't have much more overhead (actually by reading jiffies
> > only when needed, it probably saves a load).
> 
> Giving this one a whirl!

No joy here, but then again there are other reasons to believe that I
am seeing a different bug than Dave and Jonathan are.

OK, not -entirely- without joy -- 10 of 14 runs were error-free, which
is a good improvement over 0 of 84 for your earlier patch.  ;-)  But
not statistically different from what I see without either patch.

But no statistical difference compared to without patch, and I still
see the "rcu_sched kthread starved" messages.  For whatever it is worth,
by the way, I also see this: "hrtimer: interrupt took 5712368 ns".
Hmmm...  I am also seeing that without any of your patches.  Might
be hypervisor preemption, I guess.

							Thanx, Paul

PS.  I will be off the grid for the next day or so.  Eclipse day here...

  reply	other threads:[~2017-08-20 21:14 UTC|newest]

Thread overview: 241+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-07-25 11:32 RCU lockup issues when CONFIG_SOFTLOCKUP_DETECTOR=n - any one else seeing this? Jonathan Cameron
2017-07-25 12:26 ` Nicholas Piggin
2017-07-25 12:26   ` Nicholas Piggin
2017-07-25 13:46   ` Paul E. McKenney
2017-07-25 13:46     ` Paul E. McKenney
2017-07-25 13:46     ` Paul E. McKenney
2017-07-25 14:42     ` Jonathan Cameron
2017-07-25 14:42       ` Jonathan Cameron
2017-07-25 14:42       ` Jonathan Cameron
2017-07-25 15:12       ` Paul E. McKenney
2017-07-25 15:12         ` Paul E. McKenney
2017-07-25 15:12         ` Paul E. McKenney
2017-07-25 16:52         ` Jonathan Cameron
2017-07-25 16:52           ` Jonathan Cameron
2017-07-25 16:52           ` Jonathan Cameron
2017-07-25 21:10           ` David Miller
2017-07-25 21:10             ` David Miller
2017-07-25 21:10             ` David Miller
2017-07-26  3:55             ` Paul E. McKenney
2017-07-26  3:55               ` Paul E. McKenney
2017-07-26  3:55               ` Paul E. McKenney
2017-07-26  4:02               ` David Miller
2017-07-26  4:02                 ` David Miller
2017-07-26  4:02                 ` David Miller
2017-07-26  4:12                 ` Paul E. McKenney
2017-07-26  4:12                   ` Paul E. McKenney
2017-07-26  4:12                   ` Paul E. McKenney
2017-07-26  8:16                   ` Jonathan Cameron
2017-07-26  8:16                     ` Jonathan Cameron
2017-07-26  8:16                     ` Jonathan Cameron
2017-07-26  9:32                     ` Jonathan Cameron
2017-07-26  9:32                       ` Jonathan Cameron
2017-07-26  9:32                       ` Jonathan Cameron
2017-07-26 12:28                       ` Jonathan Cameron
2017-07-26 12:28                         ` Jonathan Cameron
2017-07-26 12:28                         ` Jonathan Cameron
2017-07-26 12:49                         ` Jonathan Cameron
2017-07-26 12:49                           ` Jonathan Cameron
2017-07-26 12:49                           ` Jonathan Cameron
2017-07-26 14:14                         ` Paul E. McKenney
2017-07-26 14:14                           ` Paul E. McKenney
2017-07-26 14:14                           ` Paul E. McKenney
2017-07-26 14:23                           ` Jonathan Cameron
2017-07-26 14:23                             ` Jonathan Cameron
2017-07-26 14:23                             ` Jonathan Cameron
2017-07-26 15:33                             ` Jonathan Cameron
2017-07-26 15:33                               ` Jonathan Cameron
2017-07-26 15:33                               ` Jonathan Cameron
2017-07-26 15:49                               ` Paul E. McKenney
2017-07-26 15:49                                 ` Paul E. McKenney
2017-07-26 15:49                                 ` Paul E. McKenney
2017-07-26 16:54                                 ` David Miller
2017-07-26 16:54                                   ` David Miller
2017-07-26 16:54                                   ` David Miller
2017-07-26 17:13                                   ` Jonathan Cameron
2017-07-26 17:13                                     ` Jonathan Cameron
2017-07-26 17:13                                     ` Jonathan Cameron
2017-07-27  7:41                                     ` Jonathan Cameron
2017-07-27  7:41                                       ` Jonathan Cameron
2017-07-27  7:41                                       ` Jonathan Cameron
2017-07-26 17:50                                   ` Paul E. McKenney
2017-07-26 17:50                                     ` Paul E. McKenney
2017-07-26 17:50                                     ` Paul E. McKenney
2017-07-26 22:36                                     ` Paul E. McKenney
2017-07-26 22:36                                       ` Paul E. McKenney
2017-07-26 22:36                                       ` Paul E. McKenney
2017-07-26 22:45                                       ` David Miller
2017-07-26 22:45                                         ` David Miller
2017-07-26 22:45                                         ` David Miller
2017-07-26 23:15                                         ` Paul E. McKenney
2017-07-26 23:15                                           ` Paul E. McKenney
2017-07-26 23:15                                           ` Paul E. McKenney
2017-07-26 23:22                                           ` David Miller
2017-07-26 23:22                                             ` David Miller
2017-07-26 23:22                                             ` David Miller
2017-07-27  1:42                                             ` Paul E. McKenney
2017-07-27  1:42                                               ` Paul E. McKenney
2017-07-27  1:42                                               ` Paul E. McKenney
2017-07-27  4:34                                               ` Nicholas Piggin
2017-07-27  4:34                                                 ` Nicholas Piggin
2017-07-27  4:34                                                 ` Nicholas Piggin
2017-07-27 12:49                                                 ` Paul E. McKenney
2017-07-27 12:49                                                   ` Paul E. McKenney
2017-07-27 12:49                                                   ` Paul E. McKenney
2017-07-27 13:49                                                   ` Jonathan Cameron
2017-07-27 13:49                                                     ` Jonathan Cameron
2017-07-27 13:49                                                     ` Jonathan Cameron
2017-07-27 16:39                                                     ` Jonathan Cameron
2017-07-27 16:39                                                       ` Jonathan Cameron
2017-07-27 16:39                                                       ` Jonathan Cameron
2017-07-27 16:52                                                       ` Paul E. McKenney
2017-07-27 16:52                                                         ` Paul E. McKenney
2017-07-27 16:52                                                         ` Paul E. McKenney
2017-07-28  7:44                                                         ` Jonathan Cameron
2017-07-28  7:44                                                           ` Jonathan Cameron
2017-07-28  7:44                                                           ` Jonathan Cameron
2017-07-28 12:54                                                           ` Boqun Feng
2017-07-28 12:54                                                             ` Boqun Feng
2017-07-28 12:54                                                             ` Boqun Feng
2017-07-28 13:13                                                             ` Jonathan Cameron
2017-07-28 13:13                                                               ` Jonathan Cameron
2017-07-28 13:13                                                               ` Jonathan Cameron
2017-07-28 14:55                                                             ` Paul E. McKenney
2017-07-28 14:55                                                               ` Paul E. McKenney
2017-07-28 14:55                                                               ` Paul E. McKenney
2017-07-28 18:41                                                               ` Paul E. McKenney
2017-07-28 18:41                                                                 ` Paul E. McKenney
2017-07-28 18:41                                                                 ` Paul E. McKenney
2017-07-28 19:09                                                                 ` Paul E. McKenney
2017-07-28 19:09                                                                   ` Paul E. McKenney
2017-07-28 19:09                                                                   ` Paul E. McKenney
2017-07-30 13:37                                                                   ` Boqun Feng
2017-07-30 13:37                                                                     ` Boqun Feng
2017-07-30 13:37                                                                     ` Boqun Feng
2017-07-30 16:59                                                                     ` Paul E. McKenney
2017-07-30 16:59                                                                       ` Paul E. McKenney
2017-07-30 16:59                                                                       ` Paul E. McKenney
2017-07-29  1:20                                                                 ` Boqun Feng
2017-07-29  1:20                                                                   ` Boqun Feng
2017-07-29  1:20                                                                   ` Boqun Feng
2017-07-28 18:42                                                             ` David Miller
2017-07-28 18:42                                                               ` David Miller
2017-07-28 18:42                                                               ` David Miller
2017-07-28 13:08                                                           ` Jonathan Cameron
2017-07-28 13:08                                                             ` Jonathan Cameron
2017-07-28 13:24                                                           ` Jonathan Cameron
2017-07-28 13:24                                                             ` Jonathan Cameron
2017-07-28 13:24                                                             ` Jonathan Cameron
2017-07-28 16:55                                                             ` Paul E. McKenney
2017-07-28 16:55                                                               ` Paul E. McKenney
2017-07-28 17:27                                                               ` Jonathan Cameron
2017-07-28 17:27                                                                 ` Jonathan Cameron
2017-07-28 17:27                                                                 ` Jonathan Cameron
2017-07-28 19:03                                                                 ` Paul E. McKenney
2017-07-28 19:03                                                                   ` Paul E. McKenney
2017-07-28 19:03                                                                   ` Paul E. McKenney
2017-07-31 11:08                                                                   ` Jonathan Cameron
2017-07-31 11:08                                                                     ` Jonathan Cameron
2017-07-31 11:08                                                                     ` Jonathan Cameron
2017-07-31 15:04                                                                     ` Paul E. McKenney
2017-07-31 15:04                                                                       ` Paul E. McKenney
2017-07-31 15:04                                                                       ` Paul E. McKenney
2017-07-31 15:27                                                                       ` Jonathan Cameron
2017-07-31 15:27                                                                         ` Jonathan Cameron
2017-07-31 15:27                                                                         ` Jonathan Cameron
2017-08-01 18:46                                                                         ` Paul E. McKenney
2017-08-01 18:46                                                                           ` Paul E. McKenney
2017-08-01 18:46                                                                           ` Paul E. McKenney
2017-08-02 16:25                                                                           ` Jonathan Cameron
2017-08-02 16:25                                                                             ` Jonathan Cameron
2017-08-02 16:25                                                                             ` Jonathan Cameron
2017-08-15 15:47                                                                             ` Paul E. McKenney
2017-08-15 15:47                                                                               ` Paul E. McKenney
2017-08-15 15:47                                                                               ` Paul E. McKenney
2017-08-16  1:24                                                                               ` Jonathan Cameron
2017-08-16  1:24                                                                                 ` Jonathan Cameron
2017-08-16  1:24                                                                                 ` Jonathan Cameron
2017-08-16 12:43                                                                               ` Michael Ellerman
2017-08-16 12:43                                                                                 ` Michael Ellerman
2017-08-16 12:43                                                                                 ` Michael Ellerman
2017-08-16 12:56                                                                                 ` Paul E. McKenney
2017-08-16 12:56                                                                                   ` Paul E. McKenney
2017-08-16 12:56                                                                                   ` Paul E. McKenney
2017-08-16 15:31                                                                                   ` Nicholas Piggin
2017-08-16 15:31                                                                                     ` Nicholas Piggin
2017-08-16 15:31                                                                                     ` Nicholas Piggin
2017-08-16 16:27                                                                                   ` Paul E. McKenney
2017-08-16 16:27                                                                                     ` Paul E. McKenney
2017-08-16 16:27                                                                                     ` Paul E. McKenney
2017-08-17 13:55                                                                                     ` Michael Ellerman
2017-08-17 13:55                                                                                       ` Michael Ellerman
2017-08-17 13:55                                                                                       ` Michael Ellerman
2017-08-20  4:45                                                                                     ` Nicholas Piggin
2017-08-20  4:45                                                                                       ` Nicholas Piggin
2017-08-20  4:45                                                                                       ` Nicholas Piggin
2017-08-20  5:01                                                                                       ` David Miller
2017-08-20  5:01                                                                                         ` David Miller
2017-08-20  5:01                                                                                         ` David Miller
2017-08-20  5:04                                                                                       ` Paul E. McKenney
2017-08-20  5:04                                                                                         ` Paul E. McKenney
2017-08-20  5:04                                                                                         ` Paul E. McKenney
2017-08-20 13:00                                                                                       ` Nicholas Piggin
2017-08-20 13:00                                                                                         ` Nicholas Piggin
2017-08-20 13:00                                                                                         ` Nicholas Piggin
2017-08-20 18:35                                                                                         ` Paul E. McKenney
2017-08-20 18:35                                                                                           ` Paul E. McKenney
2017-08-20 18:35                                                                                           ` Paul E. McKenney
2017-08-20 21:14                                                                                           ` Paul E. McKenney [this message]
2017-08-20 21:14                                                                                             ` Paul E. McKenney
2017-08-20 21:14                                                                                             ` Paul E. McKenney
2017-08-21  0:52                                                                                             ` Nicholas Piggin
2017-08-21  0:52                                                                                               ` Nicholas Piggin
2017-08-21  0:52                                                                                               ` Nicholas Piggin
2017-08-21  6:06                                                                                               ` Nicholas Piggin
2017-08-21  6:06                                                                                                 ` Nicholas Piggin
2017-08-21  6:06                                                                                                 ` Nicholas Piggin
2017-08-21 10:18                                                                                                 ` Jonathan Cameron
2017-08-21 10:18                                                                                                   ` Jonathan Cameron
2017-08-21 10:18                                                                                                   ` Jonathan Cameron
2017-08-21 14:19                                                                                                   ` Nicholas Piggin
2017-08-21 14:19                                                                                                     ` Nicholas Piggin
2017-08-21 14:19                                                                                                     ` Nicholas Piggin
2017-08-21 15:02                                                                                                     ` Jonathan Cameron
2017-08-21 15:02                                                                                                       ` Jonathan Cameron
2017-08-21 15:02                                                                                                       ` Jonathan Cameron
2017-08-21 20:55                                                                                                     ` David Miller
2017-08-21 20:55                                                                                                       ` David Miller
2017-08-21 20:55                                                                                                       ` David Miller
2017-08-22  7:49                                                                                                       ` Jonathan Cameron
2017-08-22  7:49                                                                                                         ` Jonathan Cameron
2017-08-22  7:49                                                                                                         ` Jonathan Cameron
2017-08-22  8:51                                                                                                         ` Abdul Haleem
2017-08-22  8:51                                                                                                           ` Abdul Haleem
2017-08-22  8:51                                                                                                           ` Abdul Haleem
2017-08-22 15:26                                                                                                           ` Paul E. McKenney
2017-08-22 15:26                                                                                                             ` Paul E. McKenney
2017-08-22 15:26                                                                                                             ` Paul E. McKenney
2017-09-06 12:28                                                                                                             ` Paul E. McKenney
2017-09-06 12:28                                                                                                               ` Paul E. McKenney
2017-09-06 12:28                                                                                                               ` Paul E. McKenney
2017-08-22  0:38                                                                                               ` Paul E. McKenney
2017-08-22  0:38                                                                                                 ` Paul E. McKenney
2017-08-22  0:38                                                                                                 ` Paul E. McKenney
2017-07-31 11:09                                           ` Jonathan Cameron
2017-07-31 11:09                                             ` Jonathan Cameron
2017-07-31 11:09                                             ` Jonathan Cameron
2017-07-31 11:55                                             ` Jonathan Cameron
2017-07-31 11:55                                               ` Jonathan Cameron
2017-07-31 11:55                                               ` Jonathan Cameron
2017-08-01 10:53                                               ` Jonathan Cameron
2017-08-01 10:53                                                 ` Jonathan Cameron
2017-08-01 10:53                                                 ` Jonathan Cameron
2017-07-26 16:48                           ` David Miller
2017-07-26 16:48                             ` David Miller
2017-07-26 16:48                             ` David Miller
2017-07-26  3:53           ` Paul E. McKenney
2017-07-26  3:53             ` Paul E. McKenney
2017-07-26  3:53             ` Paul E. McKenney
2017-07-26  7:51             ` Jonathan Cameron
2017-07-26  7:51               ` Jonathan Cameron
2017-07-26  7:51               ` Jonathan Cameron

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20170820211429.GA27111@linux.vnet.ibm.com \
    --to=paulmck@linux.vnet.ibm.com \
    --cc=Jonathan.Cameron@huawei.com \
    --cc=abdhalee@linux.vnet.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=davem@davemloft.net \
    --cc=dzickus@redhat.com \
    --cc=john.stultz@linaro.org \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linuxarm@huawei.com \
    --cc=linuxppc-dev@lists.ozlabs.org \
    --cc=mpe@ellerman.id.au \
    --cc=npiggin@gmail.com \
    --cc=sfr@canb.auug.org.au \
    --cc=sparclinux@vger.kernel.org \
    --cc=tglx@linutronix.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.