[Buildroot] warp7_defconfig build error

[Buildroot] warp7_defconfig build error

[Fabio Estevam]

Hi,

Getting the following build error on a warp7_defconfig build with
latest mainline:

>>>   Copying overlay board/warp7/rootfs_overlay
>>>   Generating root filesystem image rootfs.ext2
rm -f /home/fabio/buildroot/output/build/_fakeroot.fs
rm -f /home/fabio/buildroot/output/target/THIS_IS_NOT_YOUR_ROOT_FILESYSTEM
rm -f /home/fabio/buildroot/output/build/_users_table.txt
echo '#!/bin/sh' > /home/fabio/buildroot/output/build/_fakeroot.fs
echo "set -e" >> /home/fabio/buildroot/output/build/_fakeroot.fs
echo "chown -h -R 0:0 /home/fabio/buildroot/output/target" >>
/home/fabio/buildroot/output/build/_fakeroot.fs
printf '   \n' >> /home/fabio/buildroot/output/build/_users_table.txt
PATH="/home/fabio/buildroot/output/host/bin:/home/fabio/buildroot/output/host/sbin:/home/fabio/buildroot/output/host/usr/bin:/home/fabio/buildroot/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
/home/fabio/buildroot/support/scripts/mkusers
/home/fabio/buildroot/output/build/_users_table.txt
/home/fabio/buildroot/output/target >>
/home/fabio/buildroot/output/build/_fakeroot.fs
cat system/device_table.txt >
/home/fabio/buildroot/output/build/_device_table.txt
printf '   /bin/busybox                     f 4755 0  0 - - - - -\n
/dev/console c 622 0 0 5 1 - - -\n\n' >>
/home/fabio/buildroot/output/build/_device_table.txt
echo "/home/fabio/buildroot/output/host/usr/bin/makedevs -d
/home/fabio/buildroot/output/build/_device_table.txt
/home/fabio/buildroot/output/target" >>
/home/fabio/buildroot/output/build/_fakeroot.fs
printf '   PATH="/home/fabio/buildroot/output/host/bin:/home/fabio/buildroot/output/host/sbin:/home/fabio/buildroot/output/host/usr/bin:/home/fabio/buildroot/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
mke2img -d /home/fabio/buildroot/output/target -G 4 -R 1 -B 0 -I 0 -o
/home/fabio/buildroot/output/images/rootfs.ext2\n' >>
/home/fabio/buildroot/output/build/_fakeroot.fs
chmod a+x /home/fabio/buildroot/output/build/_fakeroot.fs
PATH="/home/fabio/buildroot/output/host/bin:/home/fabio/buildroot/output/host/sbin:/home/fabio/buildroot/output/host/usr/bin:/home/fabio/buildroot/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
/home/fabio/buildroot/output/host/usr/bin/pseudo --
/home/fabio/buildroot/output/build/_fakeroot.fs
Warning: PSEUDO_PREFIX unset, defaulting to
/home/fabio/buildroot/output/host/usr.
rootdir=/home/fabio/buildroot/output/target
table='/home/fabio/buildroot/output/build/_device_table.txt'
makedevs: line 23: Couldnt create node
/home/fabio/buildroot/output/target/dev/console: File exists
fs/ext2/ext2.mk:46: recipe for target
'/home/fabio/buildroot/output/images/rootfs.ext2' failed
make[1]: *** [/home/fabio/buildroot/output/images/rootfs.ext2] Error 1
Makefile:76: recipe for target '_all' failed
make: *** [_all] Error 2

Does anyone have any ideas on how to fix this error?

Thanks

[Buildroot] warp7_defconfig build error

[Fabio Estevam]

On Fri, Nov 4, 2016 at 5:52 PM, Fabio Estevam <festevam@gmail.com> wrote:
> Hi,
>
> Getting the following build error on a warp7_defconfig build with
> latest mainline:

A clarification: I meant "latest Buildroot master".

>
>>>>   Copying overlay board/warp7/rootfs_overlay
>>>>   Generating root filesystem image rootfs.ext2
> rm -f /home/fabio/buildroot/output/build/_fakeroot.fs
> rm -f /home/fabio/buildroot/output/target/THIS_IS_NOT_YOUR_ROOT_FILESYSTEM
> rm -f /home/fabio/buildroot/output/build/_users_table.txt
> echo '#!/bin/sh' > /home/fabio/buildroot/output/build/_fakeroot.fs
> echo "set -e" >> /home/fabio/buildroot/output/build/_fakeroot.fs
> echo "chown -h -R 0:0 /home/fabio/buildroot/output/target" >>
> /home/fabio/buildroot/output/build/_fakeroot.fs
> printf '   \n' >> /home/fabio/buildroot/output/build/_users_table.txt
> PATH="/home/fabio/buildroot/output/host/bin:/home/fabio/buildroot/output/host/sbin:/home/fabio/buildroot/output/host/usr/bin:/home/fabio/buildroot/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
> /home/fabio/buildroot/support/scripts/mkusers
> /home/fabio/buildroot/output/build/_users_table.txt
> /home/fabio/buildroot/output/target >>
> /home/fabio/buildroot/output/build/_fakeroot.fs
> cat system/device_table.txt >
> /home/fabio/buildroot/output/build/_device_table.txt
> printf '   /bin/busybox                     f 4755 0  0 - - - - -\n
> /dev/console c 622 0 0 5 1 - - -\n\n' >>
> /home/fabio/buildroot/output/build/_device_table.txt
> echo "/home/fabio/buildroot/output/host/usr/bin/makedevs -d
> /home/fabio/buildroot/output/build/_device_table.txt
> /home/fabio/buildroot/output/target" >>
> /home/fabio/buildroot/output/build/_fakeroot.fs
> printf '   PATH="/home/fabio/buildroot/output/host/bin:/home/fabio/buildroot/output/host/sbin:/home/fabio/buildroot/output/host/usr/bin:/home/fabio/buildroot/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
> mke2img -d /home/fabio/buildroot/output/target -G 4 -R 1 -B 0 -I 0 -o
> /home/fabio/buildroot/output/images/rootfs.ext2\n' >>
> /home/fabio/buildroot/output/build/_fakeroot.fs
> chmod a+x /home/fabio/buildroot/output/build/_fakeroot.fs
> PATH="/home/fabio/buildroot/output/host/bin:/home/fabio/buildroot/output/host/sbin:/home/fabio/buildroot/output/host/usr/bin:/home/fabio/buildroot/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
> /home/fabio/buildroot/output/host/usr/bin/pseudo --
> /home/fabio/buildroot/output/build/_fakeroot.fs
> Warning: PSEUDO_PREFIX unset, defaulting to
> /home/fabio/buildroot/output/host/usr.
> rootdir=/home/fabio/buildroot/output/target
> table='/home/fabio/buildroot/output/build/_device_table.txt'
> makedevs: line 23: Couldnt create node
> /home/fabio/buildroot/output/target/dev/console: File exists
> fs/ext2/ext2.mk:46: recipe for target
> '/home/fabio/buildroot/output/images/rootfs.ext2' failed
> make[1]: *** [/home/fabio/buildroot/output/images/rootfs.ext2] Error 1
> Makefile:76: recipe for target '_all' failed
> make: *** [_all] Error 2
>
> Does anyone have any ideas on how to fix this error?
>
> Thanks

[Buildroot] warp7_defconfig build error

[Yann E. MORIN]

Fabio, All,

On 2016-11-04 18:38 -0200, Fabio Estevam spake thusly:
> On Fri, Nov 4, 2016 at 5:52 PM, Fabio Estevam <festevam@gmail.com> wrote:
> > Hi,
> >
> > Getting the following build error on a warp7_defconfig build with
> > latest mainline:
[--SNIP--]
> > /home/fabio/buildroot/output/host/usr/bin/pseudo --
> > /home/fabio/buildroot/output/build/_fakeroot.fs
> > Warning: PSEUDO_PREFIX unset, defaulting to
> > /home/fabio/buildroot/output/host/usr.
> > rootdir=/home/fabio/buildroot/output/target
> > table='/home/fabio/buildroot/output/build/_device_table.txt'
> > makedevs: line 23: Couldnt create node
> > /home/fabio/buildroot/output/target/dev/console: File exists
> > fs/ext2/ext2.mk:46: recipe for target
> > '/home/fabio/buildroot/output/images/rootfs.ext2' failed
> > make[1]: *** [/home/fabio/buildroot/output/images/rootfs.ext2] Error 1

We've recently switched to using pseudo instead of fakeroot (in an
attempt to solve #9286). But this is causing more problems.

We're investigating a solution, but it's not trivial.

In the meantime, you can try reverting ade91bc and 3cd88f1 (which we may
end up doing if we can't find a solution quickly).

Regards,
Yann E. MORIN.

-- 
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +33 662 376 056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| +33 223 225 172 `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
'------------------------------^-------^------------------^--------------------'

[Buildroot] warp7_defconfig build error

[Arnout Vandecappelle]

On 04-11-16 20:52, Fabio Estevam wrote:
> Hi,
> 
> Getting the following build error on a warp7_defconfig build with
> latest mainline:
> 
>>>>   Copying overlay board/warp7/rootfs_overlay
>>>>   Generating root filesystem image rootfs.ext2
[snip]
> PATH="/home/fabio/buildroot/output/host/bin:/home/fabio/buildroot/output/host/sbin:/home/fabio/buildroot/output/host/usr/bin:/home/fabio/buildroot/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
> /home/fabio/buildroot/output/host/usr/bin/pseudo --
> /home/fabio/buildroot/output/build/_fakeroot.fs
> Warning: PSEUDO_PREFIX unset, defaulting to
> /home/fabio/buildroot/output/host/usr.
> rootdir=/home/fabio/buildroot/output/target
> table='/home/fabio/buildroot/output/build/_device_table.txt'
> makedevs: line 23: Couldnt create node
> /home/fabio/buildroot/output/target/dev/console: File exists
> fs/ext2/ext2.mk:46: recipe for target
> '/home/fabio/buildroot/output/images/rootfs.ext2' failed
> make[1]: *** [/home/fabio/buildroot/output/images/rootfs.ext2] Error 1
> Makefile:76: recipe for target '_all' failed
> make: *** [_all] Error 2
> 
> Does anyone have any ideas on how to fix this error?

 I only get this error when makedevs is run for the second time, i.e. when
building the tarball, not the ext2. But perhaps you took this log by re-running
the build?

 Anyway, the problem is pretty clear: mknod() errors out if the target file
already exists. So the surprising thing really is that it used to work under
fakeroot... I guess fakeroot just implemented its mknod()-wrapper incorrectly to
*not* give an error in that case.

 I guess the solution is to update makedevs to remove any pre-existing file
before creating it.


 Regards,
 Arnout


> 
> Thanks
> _______________________________________________
> buildroot mailing list
> buildroot at busybox.net
> http://lists.busybox.net/mailman/listinfo/buildroot
> 

-- 
Arnout Vandecappelle                          arnout at mind be
Senior Embedded Software Architect            +32-16-286500
Essensium/Mind                                http://www.mind.be
G.Geenslaan 9, 3001 Leuven, Belgium           BE 872 984 063 RPR Leuven
LinkedIn profile: http://www.linkedin.com/in/arnoutvandecappelle
GPG fingerprint:  7493 020B C7E3 8618 8DEC 222C 82EB F404 F9AC 0DDF

[Buildroot] warp7_defconfig build error

[Fabio Estevam]

Hi Arnout,

On Fri, Nov 4, 2016 at 9:20 PM, Arnout Vandecappelle <arnout@mind.be> wrote:

>  I only get this error when makedevs is run for the second time, i.e. when
> building the tarball, not the ext2. But perhaps you took this log by re-running
> the build?

The error happens for me even if I start a fresh build:
make clean
make warp7_defconfig
make

Thanks,

Fabio Estevam

[Buildroot] warp7_defconfig build error

[Fabio Estevam]

Hi Yann,

On Fri, Nov 4, 2016 at 7:27 PM, Yann E. MORIN <yann.morin.1998@free.fr> wrote:

> We've recently switched to using pseudo instead of fakeroot (in an
> attempt to solve #9286). But this is causing more problems.
>
> We're investigating a solution, but it's not trivial.
>
> In the meantime, you can try reverting ade91bc and 3cd88f1 (which we may
> end up doing if we can't find a solution quickly).

Are these commit IDs correct? They don't seem to exist in my tree:

git show ade91bc
fatal: ambiguous argument 'ade91bc': unknown revision or path not in
the working tree.

Thanks

[Buildroot] warp7_defconfig build error

[Arnout Vandecappelle]

On 05-11-16 00:50, Fabio Estevam wrote:
> Hi Yann,
> 
> On Fri, Nov 4, 2016 at 7:27 PM, Yann E. MORIN <yann.morin.1998@free.fr> wrote:
> 
>> We've recently switched to using pseudo instead of fakeroot (in an
>> attempt to solve #9286). But this is causing more problems.
>>
>> We're investigating a solution, but it's not trivial.
>>
>> In the meantime, you can try reverting ade91bc and 3cd88f1 (which we may
>> end up doing if we can't find a solution quickly).
> 
> Are these commit IDs correct? They don't seem to exist in my tree:
> 
> git show ade91bc
> fatal: ambiguous argument 'ade91bc': unknown revision or path not in
> the working tree.

 Don't worry, I'm sending a patch...

 Regards,
 Arnout

> 
> Thanks
> _______________________________________________
> buildroot mailing list
> buildroot at busybox.net
> http://lists.busybox.net/mailman/listinfo/buildroot
> 

-- 
Arnout Vandecappelle                          arnout at mind be
Senior Embedded Software Architect            +32-16-286500
Essensium/Mind                                http://www.mind.be
G.Geenslaan 9, 3001 Leuven, Belgium           BE 872 984 063 RPR Leuven
LinkedIn profile: http://www.linkedin.com/in/arnoutvandecappelle
GPG fingerprint:  7493 020B C7E3 8618 8DEC 222C 82EB F404 F9AC 0DDF

[Buildroot] warp7_defconfig build error

[Yann E. MORIN]

Arnout, All,

On 2016-11-05 00:20 +0100, Arnout Vandecappelle spake thusly:
> On 04-11-16 20:52, Fabio Estevam wrote:
> > Hi,
> > 
> > Getting the following build error on a warp7_defconfig build with
> > latest mainline:
> > 
> >>>>   Copying overlay board/warp7/rootfs_overlay
> >>>>   Generating root filesystem image rootfs.ext2
> [snip]
> > PATH="/home/fabio/buildroot/output/host/bin:/home/fabio/buildroot/output/host/sbin:/home/fabio/buildroot/output/host/usr/bin:/home/fabio/buildroot/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
> > /home/fabio/buildroot/output/host/usr/bin/pseudo --
> > /home/fabio/buildroot/output/build/_fakeroot.fs
> > Warning: PSEUDO_PREFIX unset, defaulting to
> > /home/fabio/buildroot/output/host/usr.
> > rootdir=/home/fabio/buildroot/output/target
> > table='/home/fabio/buildroot/output/build/_device_table.txt'
> > makedevs: line 23: Couldnt create node
> > /home/fabio/buildroot/output/target/dev/console: File exists
> > fs/ext2/ext2.mk:46: recipe for target
> > '/home/fabio/buildroot/output/images/rootfs.ext2' failed
> > make[1]: *** [/home/fabio/buildroot/output/images/rootfs.ext2] Error 1
> > Makefile:76: recipe for target '_all' failed
> > make: *** [_all] Error 2
> > 
> > Does anyone have any ideas on how to fix this error?
> 
>  I only get this error when makedevs is run for the second time, i.e. when
> building the tarball, not the ext2. But perhaps you took this log by re-running
> the build?
> 
>  Anyway, the problem is pretty clear: mknod() errors out if the target file
> already exists. So the surprising thing really is that it used to work under
> fakeroot... I guess fakeroot just implemented its mknod()-wrapper incorrectly to
> *not* give an error in that case.
> 
>  I guess the solution is to update makedevs to remove any pre-existing file
> before creating it.

No, I prefer this is considered an error: the file should not be there
in the first place if the devtable says it is a dev-node.

In this specific case, as you guessed, that's because we build two FS,
one ext2 then a tarball. This is indeed an error, but it is an error
about how pseudo behaves.

After I re-read the entire pseudo doc, it appears that it is not a
drop-in replacement for fakeroot... In basic cases, it appears to work
as if it were, but once you reach not-really-complex scenarii, it ceases
to work as we expect.

That's because pseudo uses a "DB" and a daemon-mode. The daemon we
really don't care about; or more appropriately, it goes in our way.
As I understand it, the DB would be there to avoid all these issues, but
it fails.

I'm working on this, at least to understand what happens.

But I'm more and more convinced we should revert for this release.

Regards,
Yann E. MORIN.

-- 
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +33 662 376 056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| +33 223 225 172 `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
'------------------------------^-------^------------------^--------------------'

[Buildroot] warp7_defconfig build error

[Yann E. MORIN]

On 2016-11-04 21:47 -0200, Fabio Estevam spake thusly:
> On Fri, Nov 4, 2016 at 9:20 PM, Arnout Vandecappelle <arnout@mind.be> wrote:
> >  I only get this error when makedevs is run for the second time, i.e. when
> > building the tarball, not the ext2. But perhaps you took this log by re-running
> > the build?
> The error happens for me even if I start a fresh build:
> make clean
> make warp7_defconfig
> make

Yep, I could reproduce as well.

Regards,
Yann E. MORIN.

-- 
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +33 662 376 056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| +33 223 225 172 `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
'------------------------------^-------^------------------^--------------------'

[Buildroot] warp7_defconfig build error

[Yann E. MORIN]

Fabio, All,

On 2016-11-04 21:50 -0200, Fabio Estevam spake thusly:
> On Fri, Nov 4, 2016 at 7:27 PM, Yann E. MORIN <yann.morin.1998@free.fr> wrote:
> > We've recently switched to using pseudo instead of fakeroot (in an
> > attempt to solve #9286). But this is causing more problems.
> >
> > We're investigating a solution, but it's not trivial.
> >
> > In the meantime, you can try reverting ade91bc and 3cd88f1 (which we may
> > end up doing if we can't find a solution quickly).
> 
> Are these commit IDs correct? They don't seem to exist in my tree:

Damn. They are the commits I have locally that do the revert! :-)

The commits you want to revert are:
    325cff3 package/fakeroot: remove
    8035ceb fs: use pseudo instead of fakeroot

Regards,
Yann E. MORIN.

-- 
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +33 662 376 056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| +33 223 225 172 `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
'------------------------------^-------^------------------^--------------------'