Re: Forbidden requests for kernel.org/releases.json

[Jonathan Corbet <corbet@lwn.net>]

James Bottomley <James.Bottomley@HansenPartnership.com> writes:

> On Fri, 2025-04-11 at 11:25 -0400, Konstantin Ryabitsev wrote:
>> On Fri, Apr 11, 2025 at 10:18:00AM -0400, Theodore Ts'o wrote:
> [...]
>> > The other alternative that I've tried is to replace git.kernel.org
>> > with kernel.googlesource.com as the git mirror, is supposed to be
>> > only a few minutes behind git.kernel.org and presumably is closer
>> > to a GCE VM from a network perspective.
>> 
>> I'm fine with that as well -- just as long as you keep in mind that
>> it can go away at any time the way many Google things sometimes do.
>> I'm also considering running stable/next/mainline forks on several
>> major forges as mirror-only repos that are updated immediately after
>> each push, so people can use them as an alternative to googlesource.
>
> Just on this point, the load from AI bots is presumably mostly
> emanating from various public clouds that provide AI services.

Have a look at Bright Data - they claim 100M+ *residential* IPs for
scraping.  They seem to operate a VPN service for "free", to use it you
just have to allow them to use your connection for this kind of stuff.

jon