freeze searches libpython3.9.so in /usr/lib instead /usr/lib/x86_64-linux-gnu

[chba]

BPO	43229
Nosy	@doko42

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2021-02-15.14:36:35.829>
labels = ['build', 'library', '3.9']
title = 'freeze searches libpython3.9.so in /usr/lib instead /usr/lib/x86_64-linux-gnu'
updated_at = <Date 2021-03-09.13:59:05.291>
user = 'https://bugs.python.org/chba'

bugs.python.org fields:

activity = <Date 2021-03-09.13:59:05.291>
actor = 'chba'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Library (Lib)']
creation = <Date 2021-02-15.14:36:35.829>
creator = 'chba'
dependencies = []
files = []
hgrepos = []
issue_num = 43229
keywords = []
message_count = 6.0
messages = ['387015', '387016', '387576', '387843', '388359', '388363']
nosy_count = 2.0
nosy_names = ['doko', 'chba']
pr_nums = []
priority = 'normal'
resolution = None
stage = None
status = 'open'
superseder = None
type = 'compile error'
url = 'https://bugs.python.org/issue43229'
versions = ['Python 3.9']

[chba]

Now that the patch from bpo-42591 (https://bugs.python.org/issue42591), i.e., msg383154 from 12/16/20 has made it to Ubuntu 20.04 with packet version python3.9.1-1, there show some problems with that.

I did:

freeze/freeze.py -o frozen helloworld.py
cd frozen
make

This delivers a linker error
...xml__parsers.o M_xml__parsers__expat.o M_xml__sax.o M_xml__sax___exceptions.o M_xml__sax__expatreader.o M_xml__sax__handler.o M_xml__sax__saxutils.o M_xml__sax__xmlreader.o M_xmlrpc.o M_xmlrpc__client.o M_zipfile.o M_zipimport.o /usr/lib/libpython3.9.so -lexpat -L/usr/lib -lz -lexpat -lcrypt -lpthread -ldl -lutil -lm -lm -o helloworld
x86_64-linux-gnu-gcc: error: /usr/lib/libpython3.9.so: No such file or directory
make: *** [Makefile:1234: helloworld] Error 1

The linker searches libpython3.9 in /usr/lib instead in /usr/lib/x86_64-linux-gnu . The "hot-fix"

ln -s /usr/lib/x86_64-linux-gnu/libpython3.9.so /usr/lib/libpython3.9.so
fixes that, but brings another error:

freeze/freeze.py -o frozen helloworld.py
cd frozen
make

...xml__parsers.o M_xml__parsers__expat.o M_xml__sax.o M_xml__sax___exceptions.o M_xml__sax__expatreader.o M_xml__sax__handler.o M_xml__sax__saxutils.o M_xml__sax__xmlreader.o M_xmlrpc.o M_xmlrpc__client.o M_zipfile.o M_zipimport.o /usr/lib/libpython3.9.so -lexpat -L/usr/lib -lz -lexpat -lcrypt -lpthread -ldl -lutil -lm -lm -o helloworld
/usr/bin/ld: config.o:(.data.rel+0x278): undefined reference to `PyInit_lazr'
collect2: error: ld returned 1 exit status
make: *** [Makefile:1234: helloworld] Error 1

@victor: I know there are alternatives to freeze, however, I have to keep a larger legacy project running, and I am not that expert. Maybe you could have a look on the above.

[chba]

Sorry, my Ubuntu version I mentioned above is the development version of 21.04 and not 20.04.

I you would like or this would be a comfortable option for you, I can show this live/interactively in a shell of my test system to track down the error, say via a skype session.

[chba]

The same situation in Ubuntu development branch's package python3.9.2-0ubuntu2 .

Inserting the follwing

    if sysconfig.get_config_var('MULTIARCH'):
        masd = sysconfig.get_config_var('multiarchsubdir')
        if masd.startswith(os.sep):
            masd = masd[len(os.sep):]
        libdir = os.path.join(libdir, masd)

directly after line ~ 247 in freeze.py

    libdir = sysconfig.get_config_var('LIBDIR')

seems to fix the first problem.

[chba]

Anyone?

[doko42]

Please could you edit
/usr/lib/python3.9/_sysconfigdata__x86_64-linux-gnu.py
setting LIBDIR to /usr/lib/x86_64-linux-gnu
and see if that fixes the freeze issue?

that could also be fixed by configuring with --libdir=/usr/lib/x86_64-linux-gnu

but that also moves lib-dynload into the new libdir.

# Detailed destination directories
BINLIBDEST= $(LIBDIR)/python$(VERSION)
LIBDEST= $(SCRIPTDIR)/python$(VERSION)
DESTSHARED= $(BINLIBDEST)/lib-dynload

[chba]

As for some time now, first I have to manually fix https://bugs.python.org/issue40350 first, i.e., use the recommended workaround not None check for spec.loader in /usr/lib/python3.9/modulefinder.py.

Setting LIBDIR to /usr/lib/x86_64-linux-gnu in /usr/lib/python3.9/_sysconfigdata__x86_64-linux-gnu.py
setting seams to fixe the issue linking issue of libpython3.9.so .

However, then the missing PyInit_lazr problem (as indicated in my first posting) stays:

...ml__sax__handler.o M_xml__sax__saxutils.o M_xml__sax__xmlreader.o M_xmlrpc.o M_xmlrpc__client.o M_zipfile.o M_zipimport.o /usr/lib/x86_64-linux-gnu/libpython3.9.so -lexpat -L/usr/lib -lz -lexpat -lcrypt -lpthread -ldl -lutil -lm -lm -o helloworld
/usr/bin/ld: config.o:(.data.rel+0x278): undefined reference to `PyInit_lazr'
collect2: error: ld returned 1 exit status
make: *** [Makefile:900: helloworld] Error 1