git caching(?) issues with http(s)

git caching(?) issues with http(s)

[Jonas Gorski]

Hi,

I noticed that git over http(s) seems to get stale data (just done a
few minutes ago):

~$ git clone http://git.linux-mips.org/pub/scm/ralf/upstream-sfr.git
Cloning into 'upstream-sfr'...
~$ cd upstream-sfr/
~/upstream-sfr$ git log -1
commit 475d5928b79bb78326a645863d46ff95c5e25e5a
Merge: c6b7b9f 1062080
Author: Ralf Baechle <ralf@linux-mips.org>
Date:   Sat Aug 2 00:07:03 2014 +0200

    Merge branch '3.16-fixes' into mips-for-linux-next

while using git:
~$git clone git://git.linux-mips.org/pub/scm/ralf/upstream-sfr.git sfr-git
Cloning into 'sfr-git'...
remote: Counting objects: 4487760, done.
remote: Compressing objects: 100% (686908/686908), done.
Receiving objects: 100% (4487760/4487760), 823.18 MiB | 47.58 MiB/s, done.
remote: Total 4487760 (delta 3795897), reused 4457674 (delta 3768509)
Resolving deltas: 100% (3795897/3795897), done.
~$ cd sfr-git
~/sfr-git$ git log -1
commit 8d3c99536e8ea7b5d0ca927982d88fa487b1bfe2
Merge: 884013a 3278c5a
Author: Ralf Baechle <ralf@linux-mips.org>
Date:   Fri Nov 21 01:13:48 2014 +0100

    Merge branch '3.18-fixes' into mips-for-linux-next


Jonas

Re: git caching(?) issues with http(s)

[Ralf Baechle]

On Fri, Nov 21, 2014 at 02:27:58PM +0100, Jonas Gorski wrote:
> Date:   Fri, 21 Nov 2014 14:27:58 +0100
> From: Jonas Gorski <jogo@openwrt.org>
> To: Ralf Baechle <ralf@linux-mips.org>
> Cc: John Crispin <john@phrozen.org>, MIPS Mailing List
>  <linux-mips@linux-mips.org>
> Subject: git caching(?) issues with http(s)
> Content-Type: text/plain; charset=UTF-8
> 
> Hi,
> 
> I noticed that git over http(s) seems to get stale data (just done a
> few minutes ago):
> 
> ~$ git clone http://git.linux-mips.org/pub/scm/ralf/upstream-sfr.git
> Cloning into 'upstream-sfr'...
> ~$ cd upstream-sfr/
> ~/upstream-sfr$ git log -1
> commit 475d5928b79bb78326a645863d46ff95c5e25e5a
> Merge: c6b7b9f 1062080
> Author: Ralf Baechle <ralf@linux-mips.org>
> Date:   Sat Aug 2 00:07:03 2014 +0200
> 
>     Merge branch '3.16-fixes' into mips-for-linux-next

Odd - but I have an idea what might be wrong.

Are you seeing this only with the upstream-sfr tree?

  Ralf

Re: git caching(?) issues with http(s)

[Jonas Gorski]

On Fri, Nov 21, 2014 at 2:41 PM, Ralf Baechle <ralf@linux-mips.org> wrote:
> On Fri, Nov 21, 2014 at 02:27:58PM +0100, Jonas Gorski wrote:
>> Date:   Fri, 21 Nov 2014 14:27:58 +0100
>> From: Jonas Gorski <jogo@openwrt.org>
>> To: Ralf Baechle <ralf@linux-mips.org>
>> Cc: John Crispin <john@phrozen.org>, MIPS Mailing List
>>  <linux-mips@linux-mips.org>
>> Subject: git caching(?) issues with http(s)
>> Content-Type: text/plain; charset=UTF-8
>>
>> Hi,
>>
>> I noticed that git over http(s) seems to get stale data (just done a
>> few minutes ago):
>>
>> ~$ git clone http://git.linux-mips.org/pub/scm/ralf/upstream-sfr.git
>> Cloning into 'upstream-sfr'...
>> ~$ cd upstream-sfr/
>> ~/upstream-sfr$ git log -1
>> commit 475d5928b79bb78326a645863d46ff95c5e25e5a
>> Merge: c6b7b9f 1062080
>> Author: Ralf Baechle <ralf@linux-mips.org>
>> Date:   Sat Aug 2 00:07:03 2014 +0200
>>
>>     Merge branch '3.16-fixes' into mips-for-linux-next
>
> Odd - but I have an idea what might be wrong.
>
> Are you seeing this only with the upstream-sfr tree?

Hadn't checked anything else, but looks like it also affects other trees:

~# git clone http://git.linux-mips.org/pub/scm/ralf/upstream-linus.git
Cloning into 'upstream-linus'...
~$ cd upstream-linus/
~/upstream-linus$ git log -1
commit 475d5928b79bb78326a645863d46ff95c5e25e5a
Merge: c6b7b9f 1062080
Author: Ralf Baechle <ralf@linux-mips.org>
Date:   Sat Aug 2 00:07:03 2014 +0200

    Merge branch '3.16-fixes' into mips-for-linux-next


(strangely the same commit)

Jonas

Re: git caching(?) issues with http(s)

[Ralf Baechle]

On Fri, Nov 21, 2014 at 03:03:08PM +0100, Jonas Gorski wrote:

> >> I noticed that git over http(s) seems to get stale data (just done a
> >> few minutes ago):
> >>
> >> ~$ git clone http://git.linux-mips.org/pub/scm/ralf/upstream-sfr.git
> >> Cloning into 'upstream-sfr'...
> >> ~$ cd upstream-sfr/
> >> ~/upstream-sfr$ git log -1
> >> commit 475d5928b79bb78326a645863d46ff95c5e25e5a
> >> Merge: c6b7b9f 1062080
> >> Author: Ralf Baechle <ralf@linux-mips.org>
> >> Date:   Sat Aug 2 00:07:03 2014 +0200
> >>
> >>     Merge branch '3.16-fixes' into mips-for-linux-next
> >
> > Odd - but I have an idea what might be wrong.
> >
> > Are you seeing this only with the upstream-sfr tree?
> 
> Hadn't checked anything else, but looks like it also affects other trees:
> 
> ~# git clone http://git.linux-mips.org/pub/scm/ralf/upstream-linus.git
> Cloning into 'upstream-linus'...
> ~$ cd upstream-linus/
> ~/upstream-linus$ git log -1
> commit 475d5928b79bb78326a645863d46ff95c5e25e5a
> Merge: c6b7b9f 1062080
> Author: Ralf Baechle <ralf@linux-mips.org>
> Date:   Sat Aug 2 00:07:03 2014 +0200
> 
>     Merge branch '3.16-fixes' into mips-for-linux-next
> 
> 
> (strangely the same commit)

The issue is a stale info/refs on the server.  This file normally gets
updated when the hook hooks/post-update is ran which in turn calls
git-update-server-info but that just didn't happen.

Can you retry?

Btw, why are you using http transport anyway?  The git protocol should
be more efficient.

  Ralf

Re: git caching(?) issues with http(s)

[Jonas Gorski]

On Fri, Nov 21, 2014 at 5:10 PM, Ralf Baechle <ralf@linux-mips.org> wrote:
> On Fri, Nov 21, 2014 at 03:03:08PM +0100, Jonas Gorski wrote:
>
>> >> I noticed that git over http(s) seems to get stale data (just done a
>> >> few minutes ago):
>> >>
>> >> ~$ git clone http://git.linux-mips.org/pub/scm/ralf/upstream-sfr.git
>> >> Cloning into 'upstream-sfr'...
>> >> ~$ cd upstream-sfr/
>> >> ~/upstream-sfr$ git log -1
>> >> commit 475d5928b79bb78326a645863d46ff95c5e25e5a
>> >> Merge: c6b7b9f 1062080
>> >> Author: Ralf Baechle <ralf@linux-mips.org>
>> >> Date:   Sat Aug 2 00:07:03 2014 +0200
>> >>
>> >>     Merge branch '3.16-fixes' into mips-for-linux-next
>> >
>> > Odd - but I have an idea what might be wrong.
>> >
>> > Are you seeing this only with the upstream-sfr tree?
>>
>> Hadn't checked anything else, but looks like it also affects other trees:
>>
>> ~# git clone http://git.linux-mips.org/pub/scm/ralf/upstream-linus.git
>> Cloning into 'upstream-linus'...
>> ~$ cd upstream-linus/
>> ~/upstream-linus$ git log -1
>> commit 475d5928b79bb78326a645863d46ff95c5e25e5a
>> Merge: c6b7b9f 1062080
>> Author: Ralf Baechle <ralf@linux-mips.org>
>> Date:   Sat Aug 2 00:07:03 2014 +0200
>>
>>     Merge branch '3.16-fixes' into mips-for-linux-next
>>
>>
>> (strangely the same commit)
>
> The issue is a stale info/refs on the server.  This file normally gets
> updated when the hook hooks/post-update is ran which in turn calls
> git-update-server-info but that just didn't happen.
>
> Can you retry?

I am now able to clone a new, current tree, but updating my older
tree is broken:

# git pull --rebase
error: Unable to find e213b27f3921a88768201638d6d358f0f0c80419 under
https://git.linux-mips.org/pub/scm/ralf/upstream-sfr.git
Cannot obtain needed blob e213b27f3921a88768201638d6d358f0f0c80419
while processing commit fd37780aa0ee04f74e4323f45492947fcef62c35.
error: Fetch failed.

But I can live with that.

> Btw, why are you using http transport anyway?  The git protocol should
> be more efficient.

General paranoia (https) as well as occasional stupid corporate
firewalls that won't allow anything except 80 or 443.


Jonas