All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jason Gunthorpe <jgg@nvidia.com>
To: Alistair Popple <apopple@nvidia.com>
Cc: "Alex Sierra" <alex.sierra@amd.com>,
	"Karol Herbst" <kherbst@redhat.com>,
	"David Airlie" <airlied@linux.ie>,
	nouveau@lists.freedesktop.org, dri-devel@lists.freedesktop.org,
	linux-mm@kvack.org, amd-gfx@lists.freedesktop.org,
	"Michael Ellerman" <mpe@ellerman.id.au>,
	"Matthew Wilcox (Oracle)" <willy@infradead.org>,
	"Ben Skeggs" <bskeggs@redhat.com>,
	"Ralph Campbell" <rcampbell@nvidia.com>,
	"John Hubbard" <jhubbard@nvidia.com>,
	"Nicholas Piggin" <npiggin@gmail.com>,
	"Dan Williams" <dan.j.williams@intel.com>,
	"Felix Kuehling" <Felix.Kuehling@amd.com>,
	"Pan, Xinhui" <Xinhui.Pan@amd.com>,
	linux-kernel@vger.kernel.org, "Daniel Vetter" <daniel@ffwll.ch>,
	"Alex Deucher" <alexander.deucher@amd.com>,
	"Andrew Morton" <akpm@linux-foundation.org>,
	linuxppc-dev@lists.ozlabs.org,
	"Christian König" <christian.koenig@amd.com>
Subject: Re: [PATCH 2/7] mm: Free device private pages have zero refcount
Date: Mon, 26 Sep 2022 11:36:11 -0300	[thread overview]
Message-ID: <YzG42766BJSxro0R@nvidia.com> (raw)
In-Reply-To: <3d74bb439723c7e46cbe47d1711795308aee4ae3.1664171943.git-series.apopple@nvidia.com>

On Mon, Sep 26, 2022 at 04:03:06PM +1000, Alistair Popple wrote:
> Since 27674ef6c73f ("mm: remove the extra ZONE_DEVICE struct page
> refcount") device private pages have no longer had an extra reference
> count when the page is in use. However before handing them back to the
> owning device driver we add an extra reference count such that free
> pages have a reference count of one.
> 
> This makes it difficult to tell if a page is free or not because both
> free and in use pages will have a non-zero refcount. Instead we should
> return pages to the drivers page allocator with a zero reference count.
> Kernel code can then safely use kernel functions such as
> get_page_unless_zero().
> 
> Signed-off-by: Alistair Popple <apopple@nvidia.com>
> ---
>  arch/powerpc/kvm/book3s_hv_uvmem.c       | 1 +
>  drivers/gpu/drm/amd/amdkfd/kfd_migrate.c | 1 +
>  drivers/gpu/drm/nouveau/nouveau_dmem.c   | 1 +
>  lib/test_hmm.c                           | 1 +
>  mm/memremap.c                            | 5 -----
>  mm/page_alloc.c                          | 6 ++++++
>  6 files changed, 10 insertions(+), 5 deletions(-)

I think this is a great idea, but I'm surprised no dax stuff is
touched here?

Jason

WARNING: multiple messages have this Message-ID (diff)
From: Jason Gunthorpe <jgg@nvidia.com>
To: Alistair Popple <apopple@nvidia.com>
Cc: "Alex Sierra" <alex.sierra@amd.com>,
	"David Airlie" <airlied@linux.ie>,
	nouveau@lists.freedesktop.org, dri-devel@lists.freedesktop.org,
	linux-mm@kvack.org, amd-gfx@lists.freedesktop.org,
	"Michael Ellerman" <mpe@ellerman.id.au>,
	"Matthew Wilcox (Oracle)" <willy@infradead.org>,
	"Ben Skeggs" <bskeggs@redhat.com>,
	"Ralph Campbell" <rcampbell@nvidia.com>,
	"Nicholas Piggin" <npiggin@gmail.com>,
	"Dan Williams" <dan.j.williams@intel.com>,
	"Felix Kuehling" <Felix.Kuehling@amd.com>,
	"Pan, Xinhui" <Xinhui.Pan@amd.com>,
	linux-kernel@vger.kernel.org, "Daniel Vetter" <daniel@ffwll.ch>,
	"Alex Deucher" <alexander.deucher@amd.com>,
	"Andrew Morton" <akpm@linux-foundation.org>,
	linuxppc-dev@lists.ozlabs.org,
	"Christian König" <christian.koenig@amd.com>
Subject: Re: [Nouveau] [PATCH 2/7] mm: Free device private pages have zero refcount
Date: Mon, 26 Sep 2022 11:36:11 -0300	[thread overview]
Message-ID: <YzG42766BJSxro0R@nvidia.com> (raw)
In-Reply-To: <3d74bb439723c7e46cbe47d1711795308aee4ae3.1664171943.git-series.apopple@nvidia.com>

On Mon, Sep 26, 2022 at 04:03:06PM +1000, Alistair Popple wrote:
> Since 27674ef6c73f ("mm: remove the extra ZONE_DEVICE struct page
> refcount") device private pages have no longer had an extra reference
> count when the page is in use. However before handing them back to the
> owning device driver we add an extra reference count such that free
> pages have a reference count of one.
> 
> This makes it difficult to tell if a page is free or not because both
> free and in use pages will have a non-zero refcount. Instead we should
> return pages to the drivers page allocator with a zero reference count.
> Kernel code can then safely use kernel functions such as
> get_page_unless_zero().
> 
> Signed-off-by: Alistair Popple <apopple@nvidia.com>
> ---
>  arch/powerpc/kvm/book3s_hv_uvmem.c       | 1 +
>  drivers/gpu/drm/amd/amdkfd/kfd_migrate.c | 1 +
>  drivers/gpu/drm/nouveau/nouveau_dmem.c   | 1 +
>  lib/test_hmm.c                           | 1 +
>  mm/memremap.c                            | 5 -----
>  mm/page_alloc.c                          | 6 ++++++
>  6 files changed, 10 insertions(+), 5 deletions(-)

I think this is a great idea, but I'm surprised no dax stuff is
touched here?

Jason

WARNING: multiple messages have this Message-ID (diff)
From: Jason Gunthorpe <jgg@nvidia.com>
To: Alistair Popple <apopple@nvidia.com>
Cc: "Alex Sierra" <alex.sierra@amd.com>,
	"Karol Herbst" <kherbst@redhat.com>,
	"David Airlie" <airlied@linux.ie>,
	nouveau@lists.freedesktop.org, dri-devel@lists.freedesktop.org,
	linux-mm@kvack.org, amd-gfx@lists.freedesktop.org,
	"Matthew Wilcox (Oracle)" <willy@infradead.org>,
	"Ben Skeggs" <bskeggs@redhat.com>,
	"Ralph Campbell" <rcampbell@nvidia.com>,
	"Lyude Paul" <lyude@redhat.com>,
	"John Hubbard" <jhubbard@nvidia.com>,
	"Nicholas Piggin" <npiggin@gmail.com>,
	"Dan Williams" <dan.j.williams@intel.com>,
	"Felix Kuehling" <Felix.Kuehling@amd.com>,
	"Pan, Xinhui" <Xinhui.Pan@amd.com>,
	linux-kernel@vger.kernel.org, "Daniel Vetter" <daniel@ffwll.ch>,
	"Alex Deucher" <alexander.deucher@amd.com>,
	"Andrew Morton" <akpm@linux-foundation.org>,
	linuxppc-dev@lists.ozlabs.org,
	"Christian König" <christian.koenig@amd.com>
Subject: Re: [PATCH 2/7] mm: Free device private pages have zero refcount
Date: Mon, 26 Sep 2022 11:36:11 -0300	[thread overview]
Message-ID: <YzG42766BJSxro0R@nvidia.com> (raw)
In-Reply-To: <3d74bb439723c7e46cbe47d1711795308aee4ae3.1664171943.git-series.apopple@nvidia.com>

On Mon, Sep 26, 2022 at 04:03:06PM +1000, Alistair Popple wrote:
> Since 27674ef6c73f ("mm: remove the extra ZONE_DEVICE struct page
> refcount") device private pages have no longer had an extra reference
> count when the page is in use. However before handing them back to the
> owning device driver we add an extra reference count such that free
> pages have a reference count of one.
> 
> This makes it difficult to tell if a page is free or not because both
> free and in use pages will have a non-zero refcount. Instead we should
> return pages to the drivers page allocator with a zero reference count.
> Kernel code can then safely use kernel functions such as
> get_page_unless_zero().
> 
> Signed-off-by: Alistair Popple <apopple@nvidia.com>
> ---
>  arch/powerpc/kvm/book3s_hv_uvmem.c       | 1 +
>  drivers/gpu/drm/amd/amdkfd/kfd_migrate.c | 1 +
>  drivers/gpu/drm/nouveau/nouveau_dmem.c   | 1 +
>  lib/test_hmm.c                           | 1 +
>  mm/memremap.c                            | 5 -----
>  mm/page_alloc.c                          | 6 ++++++
>  6 files changed, 10 insertions(+), 5 deletions(-)

I think this is a great idea, but I'm surprised no dax stuff is
touched here?

Jason

WARNING: multiple messages have this Message-ID (diff)
From: Jason Gunthorpe <jgg@nvidia.com>
To: Alistair Popple <apopple@nvidia.com>
Cc: "Alex Sierra" <alex.sierra@amd.com>,
	"Karol Herbst" <kherbst@redhat.com>,
	"David Airlie" <airlied@linux.ie>,
	nouveau@lists.freedesktop.org, dri-devel@lists.freedesktop.org,
	linux-mm@kvack.org, amd-gfx@lists.freedesktop.org,
	"Michael Ellerman" <mpe@ellerman.id.au>,
	"Matthew Wilcox (Oracle)" <willy@infradead.org>,
	"Ben Skeggs" <bskeggs@redhat.com>,
	"Ralph Campbell" <rcampbell@nvidia.com>,
	"John Hubbard" <jhubbard@nvidia.com>,
	"Nicholas Piggin" <npiggin@gmail.com>,
	"Dan Williams" <dan.j.williams@intel.com>,
	"Felix Kuehling" <Felix.Kuehling@amd.com>,
	"Pan, Xinhui" <Xinhui.Pan@amd.com>,
	linux-kernel@vger.kernel.org,
	"Alex Deucher" <alexander.deucher@amd.com>,
	"Andrew Morton" <akpm@linux-foundation.org>,
	linuxppc-dev@lists.ozlabs.org,
	"Christian König" <christian.koenig@amd.com>
Subject: Re: [PATCH 2/7] mm: Free device private pages have zero refcount
Date: Mon, 26 Sep 2022 11:36:11 -0300	[thread overview]
Message-ID: <YzG42766BJSxro0R@nvidia.com> (raw)
In-Reply-To: <3d74bb439723c7e46cbe47d1711795308aee4ae3.1664171943.git-series.apopple@nvidia.com>

On Mon, Sep 26, 2022 at 04:03:06PM +1000, Alistair Popple wrote:
> Since 27674ef6c73f ("mm: remove the extra ZONE_DEVICE struct page
> refcount") device private pages have no longer had an extra reference
> count when the page is in use. However before handing them back to the
> owning device driver we add an extra reference count such that free
> pages have a reference count of one.
> 
> This makes it difficult to tell if a page is free or not because both
> free and in use pages will have a non-zero refcount. Instead we should
> return pages to the drivers page allocator with a zero reference count.
> Kernel code can then safely use kernel functions such as
> get_page_unless_zero().
> 
> Signed-off-by: Alistair Popple <apopple@nvidia.com>
> ---
>  arch/powerpc/kvm/book3s_hv_uvmem.c       | 1 +
>  drivers/gpu/drm/amd/amdkfd/kfd_migrate.c | 1 +
>  drivers/gpu/drm/nouveau/nouveau_dmem.c   | 1 +
>  lib/test_hmm.c                           | 1 +
>  mm/memremap.c                            | 5 -----
>  mm/page_alloc.c                          | 6 ++++++
>  6 files changed, 10 insertions(+), 5 deletions(-)

I think this is a great idea, but I'm surprised no dax stuff is
touched here?

Jason

WARNING: multiple messages have this Message-ID (diff)
From: Jason Gunthorpe <jgg@nvidia.com>
To: Alistair Popple <apopple@nvidia.com>
Cc: linux-mm@kvack.org, "Andrew Morton" <akpm@linux-foundation.org>,
	"Michael Ellerman" <mpe@ellerman.id.au>,
	"Nicholas Piggin" <npiggin@gmail.com>,
	"Felix Kuehling" <Felix.Kuehling@amd.com>,
	"Alex Deucher" <alexander.deucher@amd.com>,
	"Christian König" <christian.koenig@amd.com>,
	"Pan, Xinhui" <Xinhui.Pan@amd.com>,
	"David Airlie" <airlied@linux.ie>,
	"Daniel Vetter" <daniel@ffwll.ch>,
	"Ben Skeggs" <bskeggs@redhat.com>,
	"Karol Herbst" <kherbst@redhat.com>,
	"Lyude Paul" <lyude@redhat.com>,
	"Ralph Campbell" <rcampbell@nvidia.com>,
	"Matthew Wilcox (Oracle)" <willy@infradead.org>,
	"Alex Sierra" <alex.sierra@amd.com>,
	"John Hubbard" <jhubbard@nvidia.com>,
	linuxppc-dev@lists.ozlabs.org, linux-kernel@vger.kernel.org,
	amd-gfx@lists.freedesktop.org, nouveau@lists.freedesktop.org,
	dri-devel@lists.freedesktop.org,
	"Dan Williams" <dan.j.williams@intel.com>
Subject: Re: [PATCH 2/7] mm: Free device private pages have zero refcount
Date: Mon, 26 Sep 2022 11:36:11 -0300	[thread overview]
Message-ID: <YzG42766BJSxro0R@nvidia.com> (raw)
In-Reply-To: <3d74bb439723c7e46cbe47d1711795308aee4ae3.1664171943.git-series.apopple@nvidia.com>

On Mon, Sep 26, 2022 at 04:03:06PM +1000, Alistair Popple wrote:
> Since 27674ef6c73f ("mm: remove the extra ZONE_DEVICE struct page
> refcount") device private pages have no longer had an extra reference
> count when the page is in use. However before handing them back to the
> owning device driver we add an extra reference count such that free
> pages have a reference count of one.
> 
> This makes it difficult to tell if a page is free or not because both
> free and in use pages will have a non-zero refcount. Instead we should
> return pages to the drivers page allocator with a zero reference count.
> Kernel code can then safely use kernel functions such as
> get_page_unless_zero().
> 
> Signed-off-by: Alistair Popple <apopple@nvidia.com>
> ---
>  arch/powerpc/kvm/book3s_hv_uvmem.c       | 1 +
>  drivers/gpu/drm/amd/amdkfd/kfd_migrate.c | 1 +
>  drivers/gpu/drm/nouveau/nouveau_dmem.c   | 1 +
>  lib/test_hmm.c                           | 1 +
>  mm/memremap.c                            | 5 -----
>  mm/page_alloc.c                          | 6 ++++++
>  6 files changed, 10 insertions(+), 5 deletions(-)

I think this is a great idea, but I'm surprised no dax stuff is
touched here?

Jason


  reply	other threads:[~2022-09-26 15:32 UTC|newest]

Thread overview: 130+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-09-26  6:03 [PATCH 0/7] Fix several device private page reference counting issues Alistair Popple
2022-09-26  6:03 ` Alistair Popple
2022-09-26  6:03 ` Alistair Popple
2022-09-26  6:03 ` Alistair Popple
2022-09-26  6:03 ` [Nouveau] " Alistair Popple
2022-09-26  6:03 ` [PATCH 1/7] mm/memory.c: Fix race when faulting a device private page Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` [Nouveau] " Alistair Popple
2022-09-29  0:07   ` Michael Ellerman
2022-09-29  0:07     ` Michael Ellerman
2022-09-29  0:07     ` Michael Ellerman
2022-09-29  0:07     ` Michael Ellerman
2022-09-29  0:07     ` [Nouveau] " Michael Ellerman
2022-09-29  1:40     ` Alistair Popple
2022-09-29  1:40       ` Alistair Popple
2022-09-29  1:40       ` Alistair Popple
2022-09-29  1:40       ` Alistair Popple
2022-09-29  1:40       ` [Nouveau] " Alistair Popple
2022-09-29  5:07       ` Michael Ellerman
2022-09-29  5:07         ` Michael Ellerman
2022-09-29  5:07         ` Michael Ellerman
2022-09-29  5:07         ` Michael Ellerman
2022-09-29  5:07         ` [Nouveau] " Michael Ellerman
2022-09-26  6:03 ` [PATCH 2/7] mm: Free device private pages have zero refcount Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` [Nouveau] " Alistair Popple
2022-09-26 14:36   ` Jason Gunthorpe [this message]
2022-09-26 14:36     ` Jason Gunthorpe
2022-09-26 14:36     ` Jason Gunthorpe
2022-09-26 14:36     ` Jason Gunthorpe
2022-09-26 14:36     ` [Nouveau] " Jason Gunthorpe
2022-09-27  2:06     ` Alistair Popple
2022-09-27  2:06       ` Alistair Popple
2022-09-27  2:06       ` Alistair Popple
2022-09-27  2:06       ` Alistair Popple
2022-09-27  2:06       ` [Nouveau] " Alistair Popple
2022-09-29 20:18       ` Dan Williams
2022-09-29 20:18         ` Dan Williams
2022-09-29 20:18         ` Dan Williams
2022-09-29 20:18         ` Dan Williams
2022-09-29 20:18         ` [Nouveau] " Dan Williams
2022-09-30  0:45         ` Alistair Popple
2022-09-30  0:45           ` Alistair Popple
2022-09-30  0:45           ` Alistair Popple
2022-09-30  0:45           ` Alistair Popple
2022-09-30  0:45           ` [Nouveau] " Alistair Popple
2022-09-30  1:49           ` Dan Williams
2022-09-30  1:49             ` Dan Williams
2022-09-30  1:49             ` Dan Williams
2022-09-30  1:49             ` Dan Williams
2022-09-30  1:49             ` [Nouveau] " Dan Williams
2022-09-26  6:03 ` [PATCH 3/7] mm/migrate_device.c: Refactor migrate_vma and migrate_deivce_coherent_page() Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` [Nouveau] " Alistair Popple
2022-09-26  6:03 ` [PATCH 4/7] mm/migrate_device.c: Add migrate_device_range() Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` [Nouveau] " Alistair Popple
2022-09-26  6:03 ` [PATCH 5/7] nouveau/dmem: Refactor nouveau_dmem_fault_copy_one() Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` [Nouveau] " Alistair Popple
2022-09-26 21:29   ` Lyude Paul
2022-09-26 21:29     ` Lyude Paul
2022-09-26 21:29     ` Lyude Paul
2022-09-26 21:29     ` Lyude Paul
2022-09-26 21:29     ` [Nouveau] " Lyude Paul
2022-09-28 11:30     ` Alistair Popple
2022-09-28 11:30       ` Alistair Popple
2022-09-28 11:30       ` Alistair Popple
2022-09-28 11:30       ` Alistair Popple
2022-09-28 11:30       ` [Nouveau] " Alistair Popple
2022-09-26  6:03 ` [PATCH 6/7] nouveau/dmem: Evict device private memory during release Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` [Nouveau] " Alistair Popple
2022-09-26 13:28   ` kernel test robot
2022-09-26 13:28     ` kernel test robot
2022-09-26 13:28     ` kernel test robot
2022-09-26 13:28     ` kernel test robot
2022-09-26 13:28     ` [Nouveau] " kernel test robot
2022-09-26 21:35   ` Lyude Paul
2022-09-26 21:35     ` Lyude Paul
2022-09-26 21:35     ` Lyude Paul
2022-09-26 21:35     ` Lyude Paul
2022-09-26 21:35     ` [Nouveau] " Lyude Paul
2022-09-26 22:14     ` John Hubbard
2022-09-26 22:14       ` John Hubbard
2022-09-26 22:14       ` John Hubbard
2022-09-26 22:14       ` John Hubbard
2022-09-26 22:14       ` [Nouveau] " John Hubbard
2022-09-26 23:45       ` Alistair Popple
2022-09-26 23:45         ` Alistair Popple
2022-09-26 23:45         ` Alistair Popple
2022-09-26 23:45         ` Alistair Popple
2022-09-26 23:45         ` [Nouveau] " Alistair Popple
2022-09-28 21:39         ` Lyude Paul
2022-09-28 21:39           ` Lyude Paul
2022-09-28 21:39           ` Lyude Paul
2022-09-28 21:39           ` Lyude Paul
2022-09-28 21:39           ` [Nouveau] " Lyude Paul
2022-09-26 23:07     ` Felix Kuehling
2022-09-26 23:07       ` Felix Kuehling
2022-09-26 23:07       ` Felix Kuehling
2022-09-26 23:07       ` Felix Kuehling
2022-09-26 23:07       ` [Nouveau] " Felix Kuehling
2022-09-27  1:39       ` Alistair Popple
2022-09-27  1:39         ` Alistair Popple
2022-09-27  1:39         ` Alistair Popple
2022-09-27  1:39         ` Alistair Popple
2022-09-27  1:39         ` [Nouveau] " Alistair Popple
2022-09-28 21:23         ` Lyude Paul
2022-09-28 21:23           ` Lyude Paul
2022-09-28 21:23           ` Lyude Paul
2022-09-28 21:23           ` Lyude Paul
2022-09-28 21:23           ` [Nouveau] " Lyude Paul
2022-09-26  6:03 ` [PATCH 7/7] hmm-tests: Add test for migrate_device_range() Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` Alistair Popple
2022-09-26  6:03   ` [Nouveau] " Alistair Popple

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=YzG42766BJSxro0R@nvidia.com \
    --to=jgg@nvidia.com \
    --cc=Felix.Kuehling@amd.com \
    --cc=Xinhui.Pan@amd.com \
    --cc=airlied@linux.ie \
    --cc=akpm@linux-foundation.org \
    --cc=alex.sierra@amd.com \
    --cc=alexander.deucher@amd.com \
    --cc=amd-gfx@lists.freedesktop.org \
    --cc=apopple@nvidia.com \
    --cc=bskeggs@redhat.com \
    --cc=christian.koenig@amd.com \
    --cc=dan.j.williams@intel.com \
    --cc=daniel@ffwll.ch \
    --cc=dri-devel@lists.freedesktop.org \
    --cc=jhubbard@nvidia.com \
    --cc=kherbst@redhat.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linuxppc-dev@lists.ozlabs.org \
    --cc=mpe@ellerman.id.au \
    --cc=nouveau@lists.freedesktop.org \
    --cc=npiggin@gmail.com \
    --cc=rcampbell@nvidia.com \
    --cc=willy@infradead.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.