git.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Elijah Newren <newren@gmail.com>
To: Git Mailing List <git@vger.kernel.org>
Subject: BUG: fast-import, ftruncate, and file mode
Date: Tue, 22 Feb 2022 23:47:53 -0800	[thread overview]
Message-ID: <CABPp-BERVCynOVvBq0QL49Ah+gy3W2snUVWBHfzXaVpXX3Dpyg@mail.gmail.com> (raw)

Hi,

fast-import makes use of odb_mkstemp(), which creates a secure
temporary file and opens it with mode 0444, and then uses it for its
packfile writing.  Sometimes, fast-import will call its
truncate_pack() function, which makes use of ftruncate().

According to my local manpage, "With ftruncate(), the file must be
open for writing; with truncate(), the file must be writable."

The writable requirement does not appear to be enforced by the kernel
on common filesystems like ext4 or zfs, but this is enforced on some
filesystems.  Apparently a "VxFS Veritas filesystem" got triggered by
this...and some helpful bug reporters tracked this problem down and
found a workaround (for the filter-repo usecase, they recompiled a
special copy of git using mode 0644 for odb_mkstemp, since it was just
an intermediate step anyway and won't be used elsewhere).

I'm not sure if we should (1) just stop calling truncate_pack() in
fast-import (it's merely an optimization), or (2) modify odb_mkstemp()
to allow specifying a mode and also have something like
finalize_object_file() modify the mode before renaming, or (3) if we
should do something else entirely.  Someone more familiar with the
object storage side of things probably knows.  But I'm guessing that
once someone who knows the area states what should be done, that this
might be a small micro-project suitable for the GSoC interns (or
anyone else wanting to get involved)?

Original details from here:
https://github.com/newren/git-filter-repo/issues/342#issuecomment-1047638304

             reply	other threads:[~2022-02-23  7:48 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-02-23  7:47 Elijah Newren [this message]
2022-02-23 13:59 ` BUG: fast-import, ftruncate, and file mode Phillip Wood
2022-02-23 15:33   ` Elijah Newren
2022-02-23 23:18     ` Junio C Hamano

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CABPp-BERVCynOVvBq0QL49Ah+gy3W2snUVWBHfzXaVpXX3Dpyg@mail.gmail.com \
    --to=newren@gmail.com \
    --cc=git@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).