All of lore.kernel.org
 help / color / mirror / Atom feed
From: Joel Fernandes <joel@joelfernandes.org>
To: "Enrico Weigelt, metux IT consult" <lkml@metux.net>
Cc: Olof Johansson <olof@lixom.net>,
	Alexei Starovoitov <alexei.starovoitov@gmail.com>,
	Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
	Qais Yousef <qais.yousef@arm.com>,
	Dietmar Eggemann <dietmar.eggemann@arm.com>,
	Manoj Rao <linux@manojrajarao.com>,
	Andrew Morton <akpm@linux-foundation.org>,
	Alexei Starovoitov <ast@kernel.org>,
	atish patra <atishp04@gmail.com>,
	Daniel Colascione <dancol@google.com>,
	Dan Williams <dan.j.williams@intel.com>,
	Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
	Guenter Roeck <groeck@chromium.org>,
	Jonathan Corbet <corbet@lwn.net>,
	Karim Yaghmour <karim.yaghmour@opersys.com>,
	Kees Cook <keescook@chromium.org>,
	Android Kernel Team <kernel-team@android.com>,
	"open list:DOCUMENTATION" <linux-doc@vger.kernel.org>,
	"open list:KERNEL SELFTEST FRAMEWORK" 
	<linux-kselftest@vger.kernel.org>,
	linux-trace-devel@vger.kernel.org,
	Masahiro Yamada <yamada.masahiro@socionext.com>,
	Masami Hiramatsu <mhiramat@kernel.org>,
	Randy Dunlap <rdunlap@infradead.org>,
	Steven Rostedt <rostedt@goodmis.org>,
	Shuah Khan <shuah@kernel.org>, Yonghong Song <yhs@fb.com>
Subject: Re: [PATCH v5 1/3] Provide in-kernel headers to make extending kernel easier
Date: Mon, 15 Apr 2019 09:52:49 -0400	[thread overview]
Message-ID: <20190415135249.GA205801@google.com> (raw)
In-Reply-To: <463a08cb-d1ac-b750-c699-8242c2c20fd2@metux.net>

On Mon, Apr 15, 2019 at 11:41:18AM +0200, Enrico Weigelt, metux IT consult wrote:
[snip]
> > This patch seems to have been met with a lot of responses in the tone> of "this is not an appealing solution".
> 
> Personally, having generic helpers for putting blobs into /proc files
> (like config.gz) sound appealing. But I'm not sure whether doing that
> w/ kernel headers this way is a good solution. Actually, I'm even not
> sure whether raw kernel headers are at all are a good way. (can't we
> use compiler-generated debug info ?)

We can't use compiler generated debug info for this.

As discussed previously here, eBPF tools need kernel headers, DWARF and
compiler debug information wont help:
https://lkml.org/lkml/2019/3/11/1358
https://lkml.org/lkml/2019/3/11/1363

> > Usually what we do at times like this is that we say "Yeah, this is a> problem that should be solved, but this solution doesn't seem to be>
> the right one and we would need to maintain it forever as part of the>
> ABI. Let's wait until a better solution is found." With time,> sometimes
> a better solution becomes obvious, or circumstances change> enough to
> allow for some different approach, or someone has a new idea> from a
> different perspective that solves the same problem.
> ACK. For now, this is an Android-only debug tool, just needed there
> because of it's unusual partitioning/deployment mechanisms - on usual
> GNU/Linux distros, we just have the kheaders in the file system.
> (and even on my small embedded devices, I either run the DUTs via NFS,
> 9P2k, initrd, etc or just deploy kernel and headers into the filesystem)
> 
> As Android already is in it's own universe, why can't that stuff remain
> incubated there, until we have more field experience w/ it and more time
> to rethink the whole idea very carefully ?

Well, we follow mostly an upstream first process.

> The patch is pretty small, so it's trivial cherry-pick, in case somebody
> outside Android universe wants to use it.

It could break very easily if things upstream change in some way, and adds a
lot of maintenance burden, besides I don't see a good reason it should not be
upstreamed tbh.

thanks,

 - Joel


WARNING: multiple messages have this Message-ID (diff)
From: joel at joelfernandes.org (Joel Fernandes)
Subject: [PATCH v5 1/3] Provide in-kernel headers to make extending kernel easier
Date: Mon, 15 Apr 2019 09:52:49 -0400	[thread overview]
Message-ID: <20190415135249.GA205801@google.com> (raw)
In-Reply-To: <463a08cb-d1ac-b750-c699-8242c2c20fd2@metux.net>

On Mon, Apr 15, 2019 at 11:41:18AM +0200, Enrico Weigelt, metux IT consult wrote:
[snip]
> > This patch seems to have been met with a lot of responses in the tone> of "this is not an appealing solution".
> 
> Personally, having generic helpers for putting blobs into /proc files
> (like config.gz) sound appealing. But I'm not sure whether doing that
> w/ kernel headers this way is a good solution. Actually, I'm even not
> sure whether raw kernel headers are at all are a good way. (can't we
> use compiler-generated debug info ?)

We can't use compiler generated debug info for this.

As discussed previously here, eBPF tools need kernel headers, DWARF and
compiler debug information wont help:
https://lkml.org/lkml/2019/3/11/1358
https://lkml.org/lkml/2019/3/11/1363

> > Usually what we do at times like this is that we say "Yeah, this is a> problem that should be solved, but this solution doesn't seem to be>
> the right one and we would need to maintain it forever as part of the>
> ABI. Let's wait until a better solution is found." With time,> sometimes
> a better solution becomes obvious, or circumstances change> enough to
> allow for some different approach, or someone has a new idea> from a
> different perspective that solves the same problem.
> ACK. For now, this is an Android-only debug tool, just needed there
> because of it's unusual partitioning/deployment mechanisms - on usual
> GNU/Linux distros, we just have the kheaders in the file system.
> (and even on my small embedded devices, I either run the DUTs via NFS,
> 9P2k, initrd, etc or just deploy kernel and headers into the filesystem)
> 
> As Android already is in it's own universe, why can't that stuff remain
> incubated there, until we have more field experience w/ it and more time
> to rethink the whole idea very carefully ?

Well, we follow mostly an upstream first process.

> The patch is pretty small, so it's trivial cherry-pick, in case somebody
> outside Android universe wants to use it.

It could break very easily if things upstream change in some way, and adds a
lot of maintenance burden, besides I don't see a good reason it should not be
upstreamed tbh.

thanks,

 - Joel

WARNING: multiple messages have this Message-ID (diff)
From: joel@joelfernandes.org (Joel Fernandes)
Subject: [PATCH v5 1/3] Provide in-kernel headers to make extending kernel easier
Date: Mon, 15 Apr 2019 09:52:49 -0400	[thread overview]
Message-ID: <20190415135249.GA205801@google.com> (raw)
Message-ID: <20190415135249.noMs65n0KiqylPmhHZsUY24DeLp-kpmjNo6lq0BzrZk@z> (raw)
In-Reply-To: <463a08cb-d1ac-b750-c699-8242c2c20fd2@metux.net>

On Mon, Apr 15, 2019@11:41:18AM +0200, Enrico Weigelt, metux IT consult wrote:
[snip]
> > This patch seems to have been met with a lot of responses in the tone> of "this is not an appealing solution".
> 
> Personally, having generic helpers for putting blobs into /proc files
> (like config.gz) sound appealing. But I'm not sure whether doing that
> w/ kernel headers this way is a good solution. Actually, I'm even not
> sure whether raw kernel headers are at all are a good way. (can't we
> use compiler-generated debug info ?)

We can't use compiler generated debug info for this.

As discussed previously here, eBPF tools need kernel headers, DWARF and
compiler debug information wont help:
https://lkml.org/lkml/2019/3/11/1358
https://lkml.org/lkml/2019/3/11/1363

> > Usually what we do at times like this is that we say "Yeah, this is a> problem that should be solved, but this solution doesn't seem to be>
> the right one and we would need to maintain it forever as part of the>
> ABI. Let's wait until a better solution is found." With time,> sometimes
> a better solution becomes obvious, or circumstances change> enough to
> allow for some different approach, or someone has a new idea> from a
> different perspective that solves the same problem.
> ACK. For now, this is an Android-only debug tool, just needed there
> because of it's unusual partitioning/deployment mechanisms - on usual
> GNU/Linux distros, we just have the kheaders in the file system.
> (and even on my small embedded devices, I either run the DUTs via NFS,
> 9P2k, initrd, etc or just deploy kernel and headers into the filesystem)
> 
> As Android already is in it's own universe, why can't that stuff remain
> incubated there, until we have more field experience w/ it and more time
> to rethink the whole idea very carefully ?

Well, we follow mostly an upstream first process.

> The patch is pretty small, so it's trivial cherry-pick, in case somebody
> outside Android universe wants to use it.

It could break very easily if things upstream change in some way, and adds a
lot of maintenance burden, besides I don't see a good reason it should not be
upstreamed tbh.

thanks,

 - Joel

  reply	other threads:[~2019-04-15 13:52 UTC|newest]

Thread overview: 126+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-03-20 16:31 [PATCH v5 1/3] Provide in-kernel headers to make extending kernel easier Joel Fernandes (Google)
2019-03-20 16:31 ` Joel Fernandes (Google)
2019-03-20 16:31 ` joel
2019-03-20 16:31 ` [PATCH v5 2/3] Add selftests for module build using in-kernel headers Joel Fernandes (Google)
2019-03-20 16:31   ` Joel Fernandes (Google)
2019-03-20 16:31   ` joel
2019-03-20 16:31 ` [PATCH v5 3/3] init/config: Do not select BUILD_BIN2C for IKCONFIG Joel Fernandes (Google)
2019-03-20 16:31   ` Joel Fernandes (Google)
2019-03-20 16:31   ` joel
2019-03-20 18:31 ` [PATCH v5 1/3] Provide in-kernel headers to make extending kernel easier Andrew Morton
2019-03-20 18:31   ` Andrew Morton
2019-03-20 18:31   ` akpm
2019-03-20 19:42   ` Joel Fernandes
2019-03-20 19:42     ` Joel Fernandes
2019-03-20 19:42     ` joel
2019-04-08 16:29 ` Olof Johansson
2019-04-08 16:29   ` Olof Johansson
2019-04-08 16:29   ` olof
2019-04-08 16:37   ` Daniel Colascione
2019-04-08 16:37     ` Daniel Colascione
2019-04-08 16:37     ` dancol
2019-04-08 16:53     ` Olof Johansson
2019-04-08 16:53       ` Olof Johansson
2019-04-08 16:53       ` olof
2019-04-08 20:36   ` Joel Fernandes
2019-04-08 20:36     ` Joel Fernandes
2019-04-08 20:36     ` joel
2019-04-10 15:07     ` Olof Johansson
2019-04-10 15:07       ` Olof Johansson
2019-04-10 15:07       ` olof
2019-04-10 15:50       ` Joel Fernandes
2019-04-10 15:50         ` Joel Fernandes
2019-04-10 15:50         ` joelaf
2019-04-10 16:34         ` Olof Johansson
2019-04-10 16:34           ` Olof Johansson
2019-04-10 16:34           ` olof
2019-04-10 17:33           ` Joel Fernandes
2019-04-10 17:33             ` Joel Fernandes
2019-04-10 17:33             ` joelaf
2019-04-10 17:35           ` Daniel Colascione
2019-04-10 17:35             ` Daniel Colascione
2019-04-10 17:35             ` dancol
2019-04-11  3:15           ` Alexei Starovoitov
2019-04-11  3:15             ` Alexei Starovoitov
2019-04-11  3:15             ` alexei.starovoitov
2019-04-11 16:30             ` Joel Fernandes
2019-04-11 16:30               ` Joel Fernandes
2019-04-11 16:30               ` joel
2019-04-14 19:38             ` Olof Johansson
2019-04-14 19:38               ` Olof Johansson
2019-04-14 19:38               ` olof
2019-04-15  9:41               ` Enrico Weigelt, metux IT consult
2019-04-15  9:41                 ` Enrico Weigelt, metux IT consult
2019-04-15  9:41                 ` lkml
2019-04-15 13:52                 ` Joel Fernandes [this message]
2019-04-15 13:52                   ` Joel Fernandes
2019-04-15 13:52                   ` joel
2019-04-15 14:05               ` Joel Fernandes
2019-04-15 14:05                 ` Joel Fernandes
2019-04-15 14:05                 ` joel
2019-04-15 14:41               ` Steven Rostedt
2019-04-15 14:41                 ` Steven Rostedt
2019-04-15 14:41                 ` rostedt
2019-04-16  3:50                 ` Kees Cook
2019-04-16  3:50                   ` Kees Cook
2019-04-16  3:50                   ` keescook
2019-04-16 12:33                   ` Steven Rostedt
2019-04-16 12:33                     ` Steven Rostedt
2019-04-16 12:33                     ` rostedt
2019-04-16 12:49                     ` Greg Kroah-Hartman
2019-04-16 12:49                       ` Greg Kroah-Hartman
2019-04-16 12:49                       ` gregkh
2019-04-16 13:04                       ` Joel Fernandes
2019-04-16 13:04                         ` Joel Fernandes
2019-04-16 13:04                         ` joel
2019-04-16 13:32                         ` Karim Yaghmour
2019-04-16 13:32                           ` Karim Yaghmour
2019-04-16 13:32                           ` karim.yaghmour
2019-04-16 13:45                           ` Steven Rostedt
2019-04-16 13:45                             ` Steven Rostedt
2019-04-16 13:45                             ` rostedt
2019-04-16 14:21                             ` Joel Fernandes
2019-04-16 14:21                               ` Joel Fernandes
2019-04-16 14:21                               ` joel
2019-04-16 14:22                             ` Greg Kroah-Hartman
2019-04-16 14:22                               ` Greg Kroah-Hartman
2019-04-16 14:22                               ` gregkh
2019-04-16 14:43                               ` Steven Rostedt
2019-04-16 14:43                                 ` Steven Rostedt
2019-04-16 14:43                                 ` rostedt
2019-04-16 16:42                                 ` Olof Johansson
2019-04-16 16:42                                   ` Olof Johansson
2019-04-16 16:42                                   ` olof
2019-04-16 16:46                               ` Alexei Starovoitov
2019-04-16 16:46                                 ` Alexei Starovoitov
2019-04-16 16:46                                 ` alexei.starovoitov
2019-04-16 16:57                                 ` Olof Johansson
2019-04-16 16:57                                   ` Olof Johansson
2019-04-16 16:57                                   ` olof
2019-04-16 17:22                                   ` Joel Fernandes
2019-04-16 17:22                                     ` Joel Fernandes
2019-04-16 17:22                                     ` joel
2019-04-16 17:30                                   ` Alexei Starovoitov
2019-04-16 17:30                                     ` Alexei Starovoitov
2019-04-16 17:30                                     ` alexei.starovoitov
2019-04-16 16:47                           ` Olof Johansson
2019-04-16 16:47                             ` Olof Johansson
2019-04-16 16:47                             ` olof
2019-04-10 19:19       ` Arnd Bergmann
2019-04-10 19:19         ` Arnd Bergmann
2019-04-10 19:19         ` arnd
2019-04-12 16:16         ` Enrico Weigelt, metux IT consult
2019-04-12 16:16           ` Enrico Weigelt, metux IT consult
2019-04-12 16:16           ` lkml
2019-04-12 17:25           ` Steven Rostedt
2019-04-12 17:25             ` Steven Rostedt
2019-04-12 17:25             ` rostedt
2019-04-08 20:52   ` Karim Yaghmour
2019-04-08 20:52     ` Karim Yaghmour
2019-04-08 20:52     ` karim.yaghmour
2019-04-10 15:15     ` Olof Johansson
2019-04-10 15:15       ` Olof Johansson
2019-04-10 15:15       ` olof
2019-04-10 15:44       ` Daniel Colascione
2019-04-10 15:44         ` Daniel Colascione
2019-04-10 15:44         ` dancol

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20190415135249.GA205801@google.com \
    --to=joel@joelfernandes.org \
    --cc=akpm@linux-foundation.org \
    --cc=alexei.starovoitov@gmail.com \
    --cc=ast@kernel.org \
    --cc=atishp04@gmail.com \
    --cc=corbet@lwn.net \
    --cc=dan.j.williams@intel.com \
    --cc=dancol@google.com \
    --cc=dietmar.eggemann@arm.com \
    --cc=gregkh@linuxfoundation.org \
    --cc=groeck@chromium.org \
    --cc=karim.yaghmour@opersys.com \
    --cc=keescook@chromium.org \
    --cc=kernel-team@android.com \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-kselftest@vger.kernel.org \
    --cc=linux-trace-devel@vger.kernel.org \
    --cc=linux@manojrajarao.com \
    --cc=lkml@metux.net \
    --cc=mhiramat@kernel.org \
    --cc=olof@lixom.net \
    --cc=qais.yousef@arm.com \
    --cc=rdunlap@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=shuah@kernel.org \
    --cc=yamada.masahiro@socionext.com \
    --cc=yhs@fb.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.