New prelink version

New prelink version

[Mark Hatle]

I just wanted to updated people on the prelinker, and send out news of a new
release, but first some project announcements.

As some of you may be aware, the previous upstream to the Cross Prelinker has
effectively been abandoned.  This work was being done by Jakub Jelinek at Red
Hat.  However, there have not been any updates since October of 2013.  I have
tried to reach out to him a few times and have not gotten a response.

So effectively immediately, I am planning on supporting both a standalone
prelink and cross prelinker.  In order to do this, there are now two 'release'
branches in the git://git.yoctoproject.org/prelink-cross, 'master' and
'cross_prelink'.

The 'master' branch is intended to replace the former prelink that was created
and managed by Jakub.  It is a standalone project that does not provide any of
the cross compilation helper items, such as the prelink-rtld and sysroot
(--root=) processing.  It will contain all of the latest patches for
architecture functionality and bug fixes.

The 'cross_prelink' branch, as it has been, is the home for the cross
compilation version of the prelinker.  It will be functionally identical to the
'master' branch -- but contain prelink-rtld and the sysroot functions.

In addition, I intend to do regular date-based tags to indicate stable release
points.  This is similar to how Jakub did releases for the prelinker.

Two tags will be generated, both with the same date, and one ending in '_cross'.
 The _cross indicates it contains the cross compilation functionality.

...and now... the first release

20151030 and 20151030_cross

Common changes:

* Add additional debugging in certain places
* Take over full maintainership of the project
* general: Update type_class values to sync w/ glibc-2.22
* MIPS: Add SHT_MIPS_ABIFLAGS support
* ARM: Fix ARM IFUNC implementation (bad patch merge)

Cross changes:
* Rebase the prelink-rtld on glibc-2.22
* Add NIOS2 support to the prelink-rtld

Notes:

If you are using the standalone prelinker with glibc-2.22 on IA32 or ARM, due to
a bug in glibc-2.22, you -must- have the following patch applied to glibc:

https://sourceware.org/git/gitweb.cgi?p=glibc.git;h=cadaf1336332ca7bcdfe4a400776e5782a20e26d

for more info see:

https://sourceware.org/bugzilla/show_bug.cgi?id=19178

New prelink version

[Mark Hatle]

I have issued a new prelink release today.

git://git.yoctoproject.org/prelink-cross

master branch: target based prelink
new release tag: 20160818

cross_prelink branch: prelink w/ emulated 'rtld' (ld.so)
new release tag: 20160818_cross


From the README file there are a few known issues:

* The --preload option does not always work.  The preload1 test currently fails.

* quick2 test will fail if you do not have static libc installed.

* IFUNC on glibc.  glibc appears to have a bug related to specific IFUNC
ordering.  build_local_scope in glibc is processing depth first instead of
breadth-first processing as it should be.  The prelink-rtld version works
around this issue.  (Prelink-rtld is only available in the cross compile
version.)  See: https://bugzilla.yoctoproject.org/show_bug.cgi?id=9131

* ARM & PPC: both are currently failing the reloc8 and reloc9 test
Further investigation is in progress on these items.  Until an explanation
is found, you should hold off using this for ARM and PPC.


Changelog for the cross_prelink follows:

Common changes:

* Update configure.ac, libelf.m4 and */Makefile.am to avoid various auto* warnings
* Fixed a few compile warnings
* Add testcase for YP 9131 - IFUNC problem
* Fix LD_PRELOAD issues
* Fix section ordering problem (required for binutils-2.22)

Cross prelink specific changes:

* rtld: resync to glibc-2.23
* rtld: add additional debug scope support
* rtld: Add fix for YP 9131, IFUNC problem

Re: New prelink version

[Mark Hatle]

On 8/18/16 10:33 AM, Mark Hatle wrote:
> I have issued a new prelink release today.
> 
> git://git.yoctoproject.org/prelink-cross
> 
> master branch: target based prelink
> new release tag: 20160818
> 
> cross_prelink branch: prelink w/ emulated 'rtld' (ld.so)
> new release tag: 20160818_cross
> 
> 
> From the README file there are a few known issues:
> 
> * The --preload option does not always work.  The preload1 test currently fails.
> 
> * quick2 test will fail if you do not have static libc installed.
> 
> * IFUNC on glibc.  glibc appears to have a bug related to specific IFUNC
> ordering.  build_local_scope in glibc is processing depth first instead of
> breadth-first processing as it should be.  The prelink-rtld version works
> around this issue.  (Prelink-rtld is only available in the cross compile
> version.)  See: https://bugzilla.yoctoproject.org/show_bug.cgi?id=9131
> 
> * ARM & PPC: both are currently failing the reloc8 and reloc9 test
> Further investigation is in progress on these items.  Until an explanation
> is found, you should hold off using this for ARM and PPC.

It was determined the above items are related to a bug most likely in binutils.
The components failed to execute even before they were prelinked.  The prelinker
is safe to use on ARM and PPC.

--Mark

> 
> Changelog for the cross_prelink follows:
> 
> Common changes:
> 
> * Update configure.ac, libelf.m4 and */Makefile.am to avoid various auto* warnings
> * Fixed a few compile warnings
> * Add testcase for YP 9131 - IFUNC problem
> * Fix LD_PRELOAD issues
> * Fix section ordering problem (required for binutils-2.22)
> 
> Cross prelink specific changes:
> 
> * rtld: resync to glibc-2.23
> * rtld: add additional debug scope support
> * rtld: Add fix for YP 9131, IFUNC problem
> 

Re: New prelink version

[Khem Raj]

[-- Attachment #1: Type: text/plain, Size: 2200 bytes --]


> On Aug 19, 2016, at 6:39 PM, Mark Hatle <mark.hatle@windriver.com> wrote:
> 
> On 8/18/16 10:33 AM, Mark Hatle wrote:
>> I have issued a new prelink release today.
>> 
>> git://git.yoctoproject.org/prelink-cross
>> 
>> master branch: target based prelink
>> new release tag: 20160818
>> 
>> cross_prelink branch: prelink w/ emulated 'rtld' (ld.so)
>> new release tag: 20160818_cross
>> 
>> 
>> From the README file there are a few known issues:
>> 
>> * The --preload option does not always work.  The preload1 test currently fails.
>> 
>> * quick2 test will fail if you do not have static libc installed.
>> 
>> * IFUNC on glibc.  glibc appears to have a bug related to specific IFUNC
>> ordering.  build_local_scope in glibc is processing depth first instead of
>> breadth-first processing as it should be.  The prelink-rtld version works
>> around this issue.  (Prelink-rtld is only available in the cross compile
>> version.)  See: https://bugzilla.yoctoproject.org/show_bug.cgi?id=9131
>> 
>> * ARM & PPC: both are currently failing the reloc8 and reloc9 test
>> Further investigation is in progress on these items.  Until an explanation
>> is found, you should hold off using this for ARM and PPC.
> 
> It was determined the above items are related to a bug most likely in binutils.
> The components failed to execute even before they were prelinked.  The prelinker
> is safe to use on ARM and PPC.

Do you have failing samples that are due to ld issues ?

> 
> --Mark
> 
>> 
>> Changelog for the cross_prelink follows:
>> 
>> Common changes:
>> 
>> * Update configure.ac, libelf.m4 and */Makefile.am to avoid various auto* warnings
>> * Fixed a few compile warnings
>> * Add testcase for YP 9131 - IFUNC problem
>> * Fix LD_PRELOAD issues
>> * Fix section ordering problem (required for binutils-2.22)
>> 
>> Cross prelink specific changes:
>> 
>> * rtld: resync to glibc-2.23
>> * rtld: add additional debug scope support
>> * rtld: Add fix for YP 9131, IFUNC problem
>> 
> 
> --
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto


[-- Attachment #2: Message signed with OpenPGP using GPGMail --]
[-- Type: application/pgp-signature, Size: 211 bytes --]

Re: New prelink version

[Mark Hatle]

On 8/19/16 9:56 PM, Khem Raj wrote:
> 
>> On Aug 19, 2016, at 6:39 PM, Mark Hatle <mark.hatle@windriver.com> wrote:
>>
>> On 8/18/16 10:33 AM, Mark Hatle wrote:
>>> I have issued a new prelink release today.
>>>
>>> git://git.yoctoproject.org/prelink-cross
>>>
>>> master branch: target based prelink
>>> new release tag: 20160818
>>>
>>> cross_prelink branch: prelink w/ emulated 'rtld' (ld.so)
>>> new release tag: 20160818_cross
>>>
>>>
>>> From the README file there are a few known issues:
>>>
>>> * The --preload option does not always work.  The preload1 test currently fails.
>>>
>>> * quick2 test will fail if you do not have static libc installed.
>>>
>>> * IFUNC on glibc.  glibc appears to have a bug related to specific IFUNC
>>> ordering.  build_local_scope in glibc is processing depth first instead of
>>> breadth-first processing as it should be.  The prelink-rtld version works
>>> around this issue.  (Prelink-rtld is only available in the cross compile
>>> version.)  See: https://bugzilla.yoctoproject.org/show_bug.cgi?id=9131
>>>
>>> * ARM & PPC: both are currently failing the reloc8 and reloc9 test
>>> Further investigation is in progress on these items.  Until an explanation
>>> is found, you should hold off using this for ARM and PPC.
>>
>> It was determined the above items are related to a bug most likely in binutils.
>> The components failed to execute even before they were prelinked.  The prelinker
>> is safe to use on ARM and PPC.
> 
> Do you have failing samples that are due to ld issues ?

YP Bug 10168 has the details.

Short answer, build a target system that can compile..  grab the prelink
sources, and then 'make check'.

The reloc8.sh and reloc9.sh will fail.  They both use "-Wl,-z,nocopyreloc" when
linking.

They worked in 2.1 and 2.0, no longer works in 2.2 (master).

--Mark

>>
>> --Mark
>>
>>>
>>> Changelog for the cross_prelink follows:
>>>
>>> Common changes:
>>>
>>> * Update configure.ac, libelf.m4 and */Makefile.am to avoid various auto* warnings
>>> * Fixed a few compile warnings
>>> * Add testcase for YP 9131 - IFUNC problem
>>> * Fix LD_PRELOAD issues
>>> * Fix section ordering problem (required for binutils-2.22)
>>>
>>> Cross prelink specific changes:
>>>
>>> * rtld: resync to glibc-2.23
>>> * rtld: add additional debug scope support
>>> * rtld: Add fix for YP 9131, IFUNC problem
>>>
>>
>> --
>> _______________________________________________
>> yocto mailing list
>> yocto@yoctoproject.org
>> https://lists.yoctoproject.org/listinfo/yocto
>