PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

[Konstantin Ryabitsev]

[-- Attachment #1: Type: text/plain, Size: 1553 bytes --]

Hello, all:

Over the past few months we've migrated all of the vger.kernel.org mailing
lists, with the exception of the Big One (linux-kernel, aka LKML). This list
alone is responsible for about 80% of all vger mailing list traffic, so we
left it for the last.

This Thursday, December 14, at 11AM Pacific (19:00 UTC), we will switch the MX
record for vger to point to the new location (subspace.kernel.org), which will
complete the mailing list migration from the legacy vger server to the new
infrastructure.

# What to expect on the migration day

This is a non-disruptive process and there should be no interruption in
message delivery. However, there will be a period of about an hour when the
archives on lore.kernel.org/linux-kernel will not be updated due to the
backend archive being moved to the new location. Any messages received during
this period will be added to the archive after the move is completed.

# Saying goodbye to majordomo

The most notable change will be the switch away from majordomo to mlmmj's
native subscription mechanism, described here:

https://subspace.kernel.org/subscribing.html

Any messages sent to majordomo@vger.kernel.org after the migration on Thursday
will generate an automatic bounce explaining what the new process is for
subscribing and unsubscribing.

# What is subspace running?

If you are curious what software is running on subspace, please see this page:

https://subspace.kernel.org/software.html

# Questions, comments?

If you have any questions or concerns, please reply to this message.

-K

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

Re: PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

[Willy Tarreau]

Hi Konstantin,

On Tue, Dec 12, 2023 at 04:36:28PM -0500, Konstantin Ryabitsev wrote:
(...)
> # Questions, comments?
> 
> If you have any questions or concerns, please reply to this message.
 
Thanks for this update. I'm having a no-delay rule on my SMTP server
for a few well-known friendly senders whom I don't want to inflict
the SMTP banner delay. Vger is on it the list. Which host will send
messages now ? subspace.kernel.org or any other ? 

Thanks,
Willy

Re: PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

[Konstantin Ryabitsev]

On Wed, Dec 13, 2023 at 06:20:55AM +0100, Willy Tarreau wrote:
> On Tue, Dec 12, 2023 at 04:36:28PM -0500, Konstantin Ryabitsev wrote:
> (...)
> > # Questions, comments?
> > 
> > If you have any questions or concerns, please reply to this message.
>  
> Thanks for this update. I'm having a no-delay rule on my SMTP server
> for a few well-known friendly senders whom I don't want to inflict
> the SMTP banner delay. Vger is on it the list. Which host will send
> messages now ? subspace.kernel.org or any other ? 

You can check the output of:

    dig -t txt _listspf.kernel.org

On our end, we use postwhite for similar purposes, which allows us to just add
domains and have it automatically generate the list of exceptions via
published spf records:

https://github.com/stevejenkins/postwhite

-K

Re: PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

[Willy Tarreau]

On Wed, Dec 13, 2023 at 10:19:19AM -0500, Konstantin Ryabitsev wrote:
> On Wed, Dec 13, 2023 at 06:20:55AM +0100, Willy Tarreau wrote:
> > On Tue, Dec 12, 2023 at 04:36:28PM -0500, Konstantin Ryabitsev wrote:
> > (...)
> > > # Questions, comments?
> > > 
> > > If you have any questions or concerns, please reply to this message.
> >  
> > Thanks for this update. I'm having a no-delay rule on my SMTP server
> > for a few well-known friendly senders whom I don't want to inflict
> > the SMTP banner delay. Vger is on it the list. Which host will send
> > messages now ? subspace.kernel.org or any other ? 
> 
> You can check the output of:
> 
>     dig -t txt _listspf.kernel.org
> 
> On our end, we use postwhite for similar purposes, which allows us to just add
> domains and have it automatically generate the list of exceptions via
> published spf records:
> 
> https://github.com/stevejenkins/postwhite

Looks like what I needed, perfect, thanks Konstantin!

Willy

Re: PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

[Konstantin Ryabitsev]

On Tue, Dec 12, 2023 at 04:36:28PM -0500, Konstantin Ryabitsev wrote:
> This Thursday, December 14, at 11AM Pacific (19:00 UTC), we will switch the MX
> record for vger to point to the new location (subspace.kernel.org), which will
> complete the mailing list migration from the legacy vger server to the new
> infrastructure.

This work is completed, but there will be a brief outage around 3PM PST (23:00
UTC) to bump the number of CPUs needed for all the increased spam scanning.

-K

Re: PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

[Konstantin Ryabitsev]

On Thu, Dec 14, 2023 at 05:08:44PM -0500, Konstantin Ryabitsev wrote:
> > This Thursday, December 14, at 11AM Pacific (19:00 UTC), we will switch the MX
> > record for vger to point to the new location (subspace.kernel.org), which will
> > complete the mailing list migration from the legacy vger server to the new
> > infrastructure.
> 
> This work is completed, but there will be a brief outage around 3PM PST (23:00
> UTC) to bump the number of CPUs needed for all the increased spam scanning.

All work is complete. If anything isn't looking or working right, please
report this to helpdesk@kernel.org.

Best regards,
-K

Re: PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

[Greg KH]

On Thu, Dec 14, 2023 at 06:05:36PM -0500, Konstantin Ryabitsev wrote:
> On Thu, Dec 14, 2023 at 05:08:44PM -0500, Konstantin Ryabitsev wrote:
> > > This Thursday, December 14, at 11AM Pacific (19:00 UTC), we will switch the MX
> > > record for vger to point to the new location (subspace.kernel.org), which will
> > > complete the mailing list migration from the legacy vger server to the new
> > > infrastructure.
> > 
> > This work is completed, but there will be a brief outage around 3PM PST (23:00
> > UTC) to bump the number of CPUs needed for all the increased spam scanning.
> 
> All work is complete. If anything isn't looking or working right, please
> report this to helpdesk@kernel.org.

Thank you so much for doing this work, I know it hasn't been easy
migrating one of the higest-volume mailing lists in the world with no
interruptions.  If nothing else, you all should get a few conference
talks about it, and free beer from all of us!

thanks,

greg k-h

Re: PSA: final vger mailing list migration: Thu, Dec 14, 11AM PST (1900 UTC)

[Konstantin Ryabitsev]

On Fri, Dec 15, 2023 at 05:32:53PM +0100, Greg KH wrote:
> Thank you so much for doing this work, I know it hasn't been easy
> migrating one of the higest-volume mailing lists in the world with no
> interruptions.  If nothing else, you all should get a few conference
> talks about it, and free beer from all of us!

Thanks, Greg! I'll take you up on the free beer, but the technical aspects
weren't actually all that exciting. :) I will probably do a write-up over on
people.k.o over the holidays, for the general interest of what is probably 5-6
people out there actually interested in the gritty details. :)

Cheers,
-K