(Ubuntu 16.04) automount 5.1.1 hardcoding libraries

NTAC:3NS-20

Thanks you Christian, much appreciated.

Mike Jackson
"When I am old, I shall wear purple" - Jenny Joseph
NTGS SE, 9/17/H, 50 Bank Street, LONDON E14 5NT | o: +44 207 982 2437 |
m: +44 7305 745 110 | WebEx: 146 663 9578
https://northerntrust.webex.com/meet/mj162
Northern Trust Global Services SE. Registered in Luxembourg under number
B232281. Registered office: 10 Rue du Château d'Eau, L-3364 Leudelange,
Grand-Duché de Luxembourg. Authorised by the European Central Bank and
subject to the prudential supervision of the European Central Bank and
the Luxembourg Commission de Surveillance du Secteur Financier.
Authorised and regulated by the Financial Conduct Authority in the
conduct of its UK depositary activities.
Please read our Privacy Notice to learn about how we use the personal
information you provide and the rights you have in relation to it.

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of
Christian Ehrhardt ?
Sent: 14 August 2020 11:19
To: Michael Jackson
Subject: [EXT] [Bug 1891551] Re: (Ubuntu 16.04) automount 5.1.1
hardcoding libraries

This email originated from outside the organization. Do not click links
or open attachments unless you have verified this email is legitimate.

** Tags added: server-triage-discuss

--
You received this bug notification because you are subscribed to the bug
report.
https://urldefense.com/v3/__https://bugs.launchpad.net/bugs/1891551__;!!
Oe2TtrU3ZNiRdQ!excnLvcfhw8yDe_Kr6ImXZJd8vxnBJ6vQUB6MScag3e3W3svYe7Q5HOM6
5nBxQ$
<https://urldefense.com/v3/__https:/bugs.launchpad.net/bugs/1891551__;!!
Oe2TtrU3ZNiRdQ!excnLvcfhw8yDe_Kr6ImXZJd8vxnBJ6vQUB6MScag3e3W3svYe7Q5HOM6
5nBxQ$>

Title:
  (Ubuntu 16.04) automount 5.1.1 hardcoding libraries

Status in autofs package in Ubuntu:
  New

Bug description:
  Unable to use ld.conf methods (LD_LIBRARY_PATH, LD_PRELOAD) to locate
  modules.

  Context: HP ThinPro 7.1 Service Pack 8 (latest) is still based on
Ubuntu 16.04 LTS
  Use Case: Thin Client -- HP will not allow Customers to install
anything to OS
  partition, e.g. to /usr. automount installed from Canonical's
repository but to
  /usr on a flash drive e.g. /media/GenericFlash_sdb1/usr

  the string: /usr/lib/x86_64-linux-gnu/autofs appears in the binary.
automount
  does not search /media/GenericFlash_sdb1/usr defined with
LD_LIBRARY_PATH.

  Source Package:
  *
https://urldefense.com/v3/__http://archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1.orig.tar.gz__;!!Oe2TtrU3ZNiRdQ!excnLvcfhw8yDe_Kr6Im
XZJd8vxnBJ6vQUB6MScag3e3W3svYe7Q5HMJx9nSug$
<https://urldefense.com/v3/__http:/archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1.orig.tar.gz__;!!Oe2TtrU3ZNiRdQ!excnLvcfhw8yDe_Kr6Im
XZJd8vxnBJ6vQUB6MScag3e3W3svYe7Q5HMJx9nSug$>
  *
https://urldefense.com/v3/__http://archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1-1ubuntu3.debian.tar.xz__;!!Oe2TtrU3ZNiRdQ!excnLvcfh
w8yDe_Kr6ImXZJd8vxnBJ6vQUB6MScag3e3W3svYe7Q5HMFJn2LCQ$
<https://urldefense.com/v3/__http:/archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1-1ubuntu3.debian.tar.xz__;!!Oe2TtrU3ZNiRdQ!excnLvcfh
w8yDe_Kr6ImXZJd8vxnBJ6vQUB6MScag3e3W3svYe7Q5HMFJn2LCQ$>

  Release:...

Hi again,
this might be a valid issue, but given what you want to achieve doesn't seem to be of interest of the majority of Ubuntu users. As is I have to beg your pardon and this can only be wishlist prio IMHO.

That means if you do the work and present a well rounded and tested patch one probably will look at review&sponsoring, but it is unlikely to find someone working on it a long time unless we identify it is more important.

This "HP ThinPro 7.1" POV might even be that they want to avoid it would work.

I'm unsure, it sounds more like a service request than a classic "bug" to me.

Also you reported this against v5.1.1 which is xenial, such a change could have rather unclear impacts which means it would only be implemented going forward (20.10 or later) but not back in 16.04 which your system is based on.

Also LD_LIBRARY_PATH in general works here:

root@g:~# export LD_LIBRARY_PATH=/mnt/test/; lddtree /usr/sbin/automount;
automount => /usr/sbin/automount (interpreter => /lib64/ld-linux-x86-64.so.2)
    libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0
        ld-linux-x86-64.so.2 => /lib64/ld-linux-x86-64.so.2
    libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2
    libxml2.so.2 => /mnt/test/libxml2.so.2
        libicuuc.so.67 => /lib/x86_64-linux-gnu/libicuuc.so.67
            libicudata.so.67 => /lib/x86_64-linux-gnu/libicudata.so.67
            libstdc++.so.6 => /lib/x86_64-linux-gnu/libstdc++.so.6
            libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1
        libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1
        liblzma.so.5 => /lib/x86_64-linux-gnu/liblzma.so.5
        libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6
    libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6

Might it be that you you need a different library to insert here?

Also the code has a bunch of dlopen calls
daemon/module.c:87: if (!(dh = dlopen(fnbuf, RTLD_NOW))) {
daemon/module.c:165: if (!(dh = dlopen(fnbuf, RTLD_NOW))) {
daemon/module.c:241: if (!(dh = dlopen(fnbuf, RTLD_NOW))) {
daemon/automount.c:2386: void *dh_xml2 = dlopen("libxml2.so", RTLD_NOW);
daemon/automount.c:2388: dh_xml2 = dlopen("libxml2.so.2", RTLD_NOW);
daemon/automount.c:2393: void *dh_tirpc = dlopen("libtirpc.so", RTLD_NOW);
daemon/automount.c:2395: dh_tirpc = dlopen("libtirpc.so.1", RTLD_NOW);
modules/lookup_sss.c:95: dh = dlopen(dlbuf, RTLD_LAZY);

Those might behave differently - are you after those or after the "normal" ld.so activity you see in the lddtree output above?

I really want to help you but I think I can't solve the full issue.

For the sake of being kind I checked what this flag is:

 980 /* Flag value in in the DT_FLAGS_1 .dynamic entry. */
 981 #define DF_1_NOW»···0x00000001
 982 #define DF_1_GLOBAL»0x00000002
 983 #define DF_1_GROUP»·0x00000004
 984 #define DF_1_NODELETE»··0x00000008
 985 #define DF_1_LOADFLTR»··0x00000010
 986 #define DF_1_INITFIRST»·0x00000020
 987 #define DF_1_NOOPEN»0x00000040
 988 #define DF_1_ORIGIN»0x00000080
 989 #define DF_1_DIRECT»0x00000100
 990 #define DF_1_TRANS»·0x00000200
 991 #define DF_1_INTERPOSE»·0x00000400
 992 #define DF_1_NODEFLIB»··0x00000800
 993 #define DF_1_NODUMP»0x00001000
 994 #define DF_1_CONFALT»···0x00002000
 995 #define DF_1_ENDFILTEE»·0x00004000
 996 #define»DF_1_DISPRELDNE»0x00008000
 997 #define»DF_1_DISPRELPND»0x00010000
 998 #define»DF_1_NODIRECT»··0x00020000
 999 #define»DF_1_IGNMULDEF»·0x00040000
1000 #define»DF_1_NOKSYMS»···0x00080000
1001 #define»DF_1_NOHDR»·0x00100000
1002 #define»DF_1_EDITED»0x00200000
1003 #define»DF_1_NORELOC»···0x00400000
1004 #define»DF_1_SYMINTPOSE»0x00800000
1005 #define»DF_1_GLOBAUDIT»·0x01000000
1006 #define»DF_1_SINGLETON»·0x02000000
1007 #define»DF_1_STUB»··0x04000000
1008 #define»DF_1_PIE»···0x08000000

So the assumption is that one binary is build with and one without PIE.

You'd need to fixup the lib you try to insert to match (much) better.
See also
https://stackoverflow.com/questions/2463150/what-is-the-fpie-option-for-position-independent-executables-in-gcc-and-ld
https://gcc.gnu.org/onlinedocs/gcc/Code-Gen-Options.html

NTAC:3NS-20

Christian, thank you.

I am not familiar with compiling on Intel-like instruction sets so don't
Understand why, if Intel-like processors actually support position
Independent code, why there is a mix in the libraries.

I notice that there is a mix of /lib/x86_64-linux-gnu/ and
/usr/lib/x86_64-linux-gnu in the ldd output below, however nothing in
either of those paths should have been changed as its forbidden.

Is there a way of listing whether -PIE is present in my libraries so
that I can begin to understand how it is that I seemingly have a mix
hence resulting in incompatibility.

I really needs NFS to work and would prefer not to be forced to have
to go to HP and ask forgiveness for unlocking the write filter and
installing the package in its usual place.

Kind regards,

M.

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of
Christian Ehrhardt ?
Sent: 17 August 2020 16:55
Subject: [EXT] [Bug 1891551] Re: (Ubuntu 16.04) automount 5.1.1
hardcoding libraries

This email originated from outside the organization. Do not click links
or open attachments unless you have verified this email is legitimate.

I really want to help you but I think I can't solve the full issue.

For the sake of being kind I checked what this flag is:

 980 /* Flag value in in the DT_FLAGS_1 .dynamic entry. */
981 #define DF_1_NOW>***0x00000001
982 #define DF_1_GLOBAL>0x00000002
983 #define DF_1_GROUP>*0x00000004
984 #define DF_1_NODELETE>**0x00000008
985 #define DF_1_LOADFLTR>**0x00000010
986 #define DF_1_INITFIRST>*0x00000020
987 #define DF_1_NOOPEN>0x00000040
988 #define DF_1_ORIGIN>0x00000080
989 #define DF_1_DIRECT>0x00000100
990 #define DF_1_TRANS>*0x00000200
991 #define DF_1_INTERPOSE>*0x00000400
992 #define DF_1_NODEFLIB>**0x00000800
993 #define DF_1_NODUMP>0x00001000
994 #define DF_1_CONFALT>***0x00002000
995 #define DF_1_ENDFILTEE>*0x00004000
996 #define>DF_1_DISPRELDNE>0x00008000
997 #define>DF_1_DISPRELPND>0x00010000
998 #define>DF_1_NODIRECT>**0x00020000
999 #define>DF_1_IGNMULDEF>*0x00040000
1000 #define>DF_1_NOKSYMS>***0x00080000
1001 #define>DF_1_NOHDR>*0x00100000
1002 #define>DF_1_EDITED>0x00200000
1003 #define>DF_1_NORELOC>***0x00400000
1004 #define>DF_1_SYMINTPOSE>0x00800000
1005 #define>DF_1_GLOBAUDIT>*0x01000000
1006 #define>DF_1_SINGLETON>*0x02000000
1007 #define>DF_1_STUB>**0x04000000
1008 #define>DF_1_PIE>***0x08000000

So the assumption is that one binary is build with and one without PIE.

You'd need to fixup the lib you try to insert to match (much) better.
See also
https://urldefense.com/v3/__https://stackoverflow.com/questions/2463150/
what-is-the-fpie-option-for-position-independent-executables-in-gcc-and-
ld__;!!Oe2TtrU3ZNiRdQ!aVh9voqF0iMMRz7nKecwkZ5kJc3E1R6-BZjEkKEoNL60vubTKn
X9Enuv3cM-GQ$
<https://urldefense.com/v3/__https:/stackoverflow.com/questions/2463150/
what-is-the-fpie-option-for-position-independent-executables-in-gcc-and-
ld__;!!Oe2TtrU3ZNiRdQ!aVh9voqF0iMMRz7nKecwkZ5kJc3E1R6-BZjEkKEoNL60vubTKn
X9Enuv3cM-GQ$>
https://urldefense.com/v3/__https://gcc.gnu.org/onlinedocs/gcc/Code-Gen-
Options.html__;!!Oe2TtrU3ZNiRdQ!aVh9voqF0iMMRz7nKecwkZ5kJc3E1R6-BZjEkKEo
NL60vubTKnX9E...

NTAC:4UC-11

Christian, thanks so unless I work-out how I've seemingly mangled
Libraries, I may have to be asking HP for a bye. Igel builds-in
NFS support and provides config of the required shares using its
GUI. Not sure why HP chose to leave it out.

Kind regards,

M

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of
Christian Ehrhardt ?
Sent: 17 August 2020 16:42
To: Michael Jackson
Subject: [EXT] [Bug 1891551] Re: (Ubuntu 16.04) automount 5.1.1
hardcoding libraries

This email originated from outside the organization. Do not click links
or open attachments unless you have verified this email is legitimate.

Also you reported this against v5.1.1 which is xenial, such a change
could have rather unclear impacts which means it would only be
implemented going forward (20.10 or later) but not back in 16.04 which
your system is based on.

--
You received this bug notification because you are subscribed to the bug
report.
https://urldefense.com/v3/__https://bugs.launchpad.net/bugs/1891551__;!!
Oe2TtrU3ZNiRdQ!cb9TbFZaRcspYUe_HjxGhtlX__esvKgj6_lHWw70hEqviPpYntFrrJ48d
dCY7Q$
<https://urldefense.com/v3/__https:/bugs.launchpad.net/bugs/1891551__;!!
Oe2TtrU3ZNiRdQ!cb9TbFZaRcspYUe_HjxGhtlX__esvKgj6_lHWw70hEqviPpYntFrrJ48d
dCY7Q$>

Title:
  (Ubuntu 16.04) automount 5.1.1 hardcoding libraries

Status in autofs package in Ubuntu:
  Confirmed

Bug description:
  Unable to use ld.conf methods (LD_LIBRARY_PATH, LD_PRELOAD) to locate
  modules.

  Context: HP ThinPro 7.1 Service Pack 8 (latest) is still based on
Ubuntu 16.04 LTS
  Use Case: Thin Client -- HP will not allow Customers to install
anything to OS
  partition, e.g. to /usr. automount installed from Canonical's
repository but to
  /usr on a flash drive e.g. /media/GenericFlash_sdb1/usr

  the string: /usr/lib/x86_64-linux-gnu/autofs appears in the binary.
automount
  does not search /media/GenericFlash_sdb1/usr defined with
LD_LIBRARY_PATH.

  Source Package:
  *
https://urldefense.com/v3/__http://archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1.orig.tar.gz__;!!Oe2TtrU3ZNiRdQ!cb9TbFZaRcspYUe_HjxG
htlX__esvKgj6_lHWw70hEqviPpYntFrrJ4QR7Y6bg$
<https://urldefense.com/v3/__http:/archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1.orig.tar.gz__;!!Oe2TtrU3ZNiRdQ!cb9TbFZaRcspYUe_HjxG
htlX__esvKgj6_lHWw70hEqviPpYntFrrJ4QR7Y6bg$>
  *
https://urldefense.com/v3/__http://archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1-1ubuntu3.debian.tar.xz__;!!Oe2TtrU3ZNiRdQ!cb9TbFZaR
cspYUe_HjxGhtlX__esvKgj6_lHWw70hEqviPpYntFrrJ4fk7RZnA$
<https://urldefense.com/v3/__http:/archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1-1ubuntu3.debian.tar.xz__;!!Oe2TtrU3ZNiRdQ!cb9TbFZaR
cspYUe_HjxGhtlX__esvKgj6_lHWw70hEqviPpYntFrrJ4fk7RZnA$>

  Release:
  Description: ThinPro 7.1.0
  Release: 7.1.0

  Binary Package:
  Package: autofs (5.1.1-1ubuntu3) autofs_5.1.1-1ubuntu3_amd64.deb
  *
https://urldefense.com/v3/__http://de.archive.ubuntu.com/ubuntu/pool/mai
n/a/autofs/autofs_5.1.1-1ubuntu3_amd64.deb__;!!Oe2TtrU3ZNiRdQ!cb9TbFZaRc
spYUe_HjxGhtlX__esvKgj6_lHWw70hEqviPpYntFrrJ7q1HSwUw$
<https://urldefense.com/v3/__http:/de.archive.ubuntu.com/ub...

>
> [...]
>
> Is there a way of listing whether -PIE is present in my libraries so
> that I can begin to understand how it is that I seemingly have a mix
> hence resulting in incompatibility.
>

Answered e.g. here which lists different ways to check:
https://unix.stackexchange.com/questions/89211/how-to-test-whether-a-linux-binary-was-compiled-as-position-independent-code

NTAC:3NS-20

[...]

Thanks for the link.

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of
Christian Ehrhardt ?
Sent: 18 August 2020 07:17
Subject: [EXT] Re: [Bug 1891551] Re: (Ubuntu 16.04) automount 5.1.1
hardcoding libraries

This email originated from outside the organization. Do not click links
or open attachments unless you have verified this email is legitimate.

>
> [...]
>
> Is there a way of listing whether -PIE is present in my libraries so
> that I can begin to understand how it is that I seemingly have a mix
> hence resulting in incompatibility.
>

Answered e.g. here which lists different ways to check:
https://urldefense.com/v3/__https://unix.stackexchange.com/questions/892
11/how-to-test-whether-a-linux-binary-was-compiled-as-position-independe
nt-code__;!!Oe2TtrU3ZNiRdQ!baNTGOKOQ2ys4HhIVdS0fYWg9pLvjRY3uug1s1QBNZAMw
NKzcrB8gMZWjnwPQA$
<https://urldefense.com/v3/__https:/unix.stackexchange.com/questions/892
11/how-to-test-whether-a-linux-binary-was-compiled-as-position-independe
nt-code__;!!Oe2TtrU3ZNiRdQ!baNTGOKOQ2ys4HhIVdS0fYWg9pLvjRY3uug1s1QBNZAMw
NKzcrB8gMZWjnwPQA$>

--
You received this bug notification because you are subscribed to the bug
report.
https://urldefense.com/v3/__https://bugs.launchpad.net/bugs/1891551__;!!
Oe2TtrU3ZNiRdQ!baNTGOKOQ2ys4HhIVdS0fYWg9pLvjRY3uug1s1QBNZAMwNKzcrB8gMZA0
akouw$
<https://urldefense.com/v3/__https:/bugs.launchpad.net/bugs/1891551__;!!
Oe2TtrU3ZNiRdQ!baNTGOKOQ2ys4HhIVdS0fYWg9pLvjRY3uug1s1QBNZAMwNKzcrB8gMZA0
akouw$>

Title:
  (Ubuntu 16.04) automount 5.1.1 hardcoding libraries

Status in autofs package in Ubuntu:
  Confirmed

Bug description:
  Unable to use ld.conf methods (LD_LIBRARY_PATH, LD_PRELOAD) to locate
  modules.

  Context: HP ThinPro 7.1 Service Pack 8 (latest) is still based on
Ubuntu 16.04 LTS
  Use Case: Thin Client -- HP will not allow Customers to install
anything to OS
  partition, e.g. to /usr. automount installed from Canonical's
repository but to
  /usr on a flash drive e.g. /media/GenericFlash_sdb1/usr

  the string: /usr/lib/x86_64-linux-gnu/autofs appears in the binary.
automount
  does not search /media/GenericFlash_sdb1/usr defined with
LD_LIBRARY_PATH.

  Source Package:
  *
https://urldefense.com/v3/__http://archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1.orig.tar.gz__;!!Oe2TtrU3ZNiRdQ!baNTGOKOQ2ys4HhIVdS0
fYWg9pLvjRY3uug1s1QBNZAMwNKzcrB8gMZE59B5pA$
<https://urldefense.com/v3/__http:/archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1.orig.tar.gz__;!!Oe2TtrU3ZNiRdQ!baNTGOKOQ2ys4HhIVdS0
fYWg9pLvjRY3uug1s1QBNZAMwNKzcrB8gMZE59B5pA$>
  *
https://urldefense.com/v3/__http://archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1-1ubuntu3.debian.tar.xz__;!!Oe2TtrU3ZNiRdQ!baNTGOKOQ
2ys4HhIVdS0fYWg9pLvjRY3uug1s1QBNZAMwNKzcrB8gMZ223O05Q$
<https://urldefense.com/v3/__http:/archive.ubuntu.com/ubuntu/pool/main/a
/autofs/autofs_5.1.1-1ubuntu3.debian.tar.xz__;!!Oe2TtrU3ZNiRdQ!baNTGOKOQ
2ys4HhIVdS0fYWg9pLvjRY3uug1s1QBNZAMwNKzcrB8gMZ223O05Q$>

  Release:
  Description: ThinPro 7.1.0
  Release: 7.1.0

  Binary Package:
  Package: autofs (5.1.1-1ubuntu3) autofs_5.1.1-1ubuntu3_amd64.deb
  *
http...