Re: Forbidden requests for kernel.org/releases.json

["Luck, Tony" <tony.luck@intel.com>]

On Thu, Apr 10, 2025 at 08:45:30AM -0400, Konstantin Ryabitsev wrote:
> On Thu, Apr 10, 2025 at 10:05:28AM +0200, Daniel Gomez wrote:
> > We've started encountering "HTTP Error 403: Forbidden" errors in kdevops
> > when querying https://www.kernel.org/releases.json from our CI environments/
> > deployments. We're using a Python script with the urllib library to fetch the
> > latest kernel release information [1].
> 
> Yes, I'm trying to deal with bots who don't identify themselves. We're seeing
> many requests per second from user-agents like "python-requests/x.x" or
> "Python-urllib/x.x" or "Java/x.x" etc, and it's impossible for us to tell good
> bots from bad bots if they don't identify themselves properly.
> 
> > * What is the recommended approach for automated tools to access
> > kernel.org/releases.json?
> 
> Set your user-agent to something like:
> 
>     "kdevops-ci/{version} (contact@address.here)"

Would it help things if you just delayed response to *every*
query by a couple of seconds?

While I love it that lore.kernel.org answers my queries more
or less instantly, my user experience wouldn't suffer significantly
if I had to wait for a short (to humans) but long (to bots) time.

-Tony