[ptxdist] Random compile errors in host-system-python3-jinja2 package

[ptxdist] Random compile errors in host-system-python3-jinja2 package

[Bruno Thomsen]

Hi

After upgrading our ptxdist projects to 2024.07.0 we get compile errors
in around 10% of our builds in the host-system-python3-jinja2 package.

Has anyone else seen this?
I suspect a missing dependency in the rule, but have not looked into it yet.

/Bruno

--------------------------------8<----------------------------------

------------------------------------------
target: host-system-python3-jinja2.compile
------------------------------------------
Traceback (most recent call last):
  File "/builds/emperor/ptxdist/platform-emperor/build-host/system-Jinja2-3.1.3/setup.py",
line 1, in <module>
    from setuptools import setup
  File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/__init__.py",
line 8, in <module>
    import _distutils_hack.override  # noqa: F401
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/_distutils_hack/override.py",
line 1, in <module>
    __import__('_distutils_hack').do_override()
  File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/_distutils_hack/__init__.py",
line 77, in do_override
    ensure_local_distutils()
  File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/_distutils_hack/__init__.py",
line 63, in ensure_local_distutils
    core = importlib.import_module('distutils.core')
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/_distutils/core.py",
line 22, in <module>
    from .dist import Distribution
  File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/_distutils/dist.py",
line 27, in <module>
    from .util import check_environ, strtobool, rfc822_escape
  File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/_distutils/util.py",
line 18, in <module>
    from .spawn import spawn
  File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/_distutils/spawn.py",
line 15, in <module>
    from ._log import log
ModuleNotFoundError: No module named 'distutils._log'
make: *** [/usr/local/lib/ptxdist-2024.07.0/rules/post/ptxd_make_world_compile.make:19:
/builds/emperor/ptxdist/platform-emperor/state/host-system-python3-jinja2.compile]
Error 1
make: *** Waiting for unfinished jobs....

Re: [ptxdist] Random compile errors in host-system-python3-jinja2 package

[Michael Olbrich]

On Fri, Aug 23, 2024 at 08:11:40AM +0200, Bruno Thomsen wrote:
> Hi
> 
> After upgrading our ptxdist projects to 2024.07.0 we get compile errors
> in around 10% of our builds in the host-system-python3-jinja2 package.
> 
> Has anyone else seen this?
> I suspect a missing dependency in the rule, but have not looked into it yet.

I've not seen this. Some things to try:
Does "ptxdist install host-system-python3-jinja2" after "ptxdist clean"?
If yes, then it's probably not actually a missing dependency, but maybe
something breaks because the site-packages are modified while setup.py is
executed. In that case: Are you compiling with '-j<n>'? If yes, take a look
at the logfile. Is an install stage running at the same time as
host-system-python3-jinja2.compile?

Michael

> --------------------------------8<----------------------------------
> 
> ------------------------------------------
> target: host-system-python3-jinja2.compile
> ------------------------------------------
> Traceback (most recent call last):
>   File "/builds/emperor/ptxdist/platform-emperor/build-host/system-Jinja2-3.1.3/setup.py",
> line 1, in <module>
>     from setuptools import setup
>   File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/__init__.py",
> line 8, in <module>
>     import _distutils_hack.override  # noqa: F401
>     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>   File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/_distutils_hack/override.py",
> line 1, in <module>
>     __import__('_distutils_hack').do_override()
>   File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/_distutils_hack/__init__.py",
> line 77, in do_override
>     ensure_local_distutils()
>   File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/_distutils_hack/__init__.py",
> line 63, in ensure_local_distutils
>     core = importlib.import_module('distutils.core')
>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>   File "/usr/lib64/python3.12/importlib/__init__.py", line 90, in import_module
>     return _bootstrap._gcd_import(name[level:], package, level)
>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>   File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/_distutils/core.py",
> line 22, in <module>
>     from .dist import Distribution
>   File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/_distutils/dist.py",
> line 27, in <module>
>     from .util import check_environ, strtobool, rfc822_escape
>   File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/_distutils/util.py",
> line 18, in <module>
>     from .spawn import spawn
>   File "/builds/emperor/ptxdist/platform-emperor/sysroot-host/usr/lib/system-python3/lib64/python3.12/site-packages/setuptools/_distutils/spawn.py",
> line 15, in <module>
>     from ._log import log
> ModuleNotFoundError: No module named 'distutils._log'
> make: *** [/usr/local/lib/ptxdist-2024.07.0/rules/post/ptxd_make_world_compile.make:19:
> /builds/emperor/ptxdist/platform-emperor/state/host-system-python3-jinja2.compile]
> Error 1
> make: *** Waiting for unfinished jobs....
> 
> 

-- 
Pengutronix e.K.                           |                             |
Steuerwalder Str. 21                       | http://www.pengutronix.de/  |
31137 Hildesheim, Germany                  | Phone: +49-5121-206917-0    |
Amtsgericht Hildesheim, HRA 2686           | Fax:   +49-5121-206917-5555 |