[ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[Michael Olbrich]

Hi,

I'm happy to announce that I've just released ptxdist-2018.10.0.

The biggest change this time is the layer support. I've mentioned this
before. If you're interested, read the documentation[1] and ask questions.
If not, then your BSP should work as before.
There are also some changes to make the build more reproducible.
Several old packages from staging are now gone.
The rest is the usual mix of bugfixes, version bumps and new packages.

Note that the changes for the layer support where rather invasive. I've
tested this here intensively, but it's possible that I missed some
use-cases. Please test this release carefully and report any problems or
unexpected behaviour.

Thanks to all contributors and - as always - the shortlog below.

Enjoy,
Michael Olbrich

[1] https://www.ptxdist.org/doc/dev_manual.html#layers-in-ptxdist

Alexander Dahl (2):
      dfu-util: Fix download URL
      dfu-util: version bump 0.7 -> 0.9

Andreas Pretzsch (1):
      bzip2: fix URL (bzip.org archive gone, use Gentoo as mirror)

Artur Wiebe (2):
      efivar: new package
      efibootmgr: new package

Clemens Gruber (3):
      systemd: add patch for glibc 2.28 compatibility
      busybox: version bump 1.28.3 -> 1.29.3
      iproute2: add busybox guard dependency

Florian Bäuerle (25):
      ptxd_install_find: allow installing from /
      Introduce world/install-font
      xorg-font-ttf-android: separate from xorg-fonts
      xorg-font-ttf-bitstream-vera: separate from xorg-fonts
      xorg-font-ttf-caladea: separate from xorg-fonts
      xorg-font-ttf-carlito: separate from xorg-fonts
      xorg-font-ttf-dejavu: separate from xorg-fonts
      xorg-font-ttf-hanazono: separate from xorg-fonts
      xorg-font-ttf-liberation: separate from xorg-fonts
      xorg-font-ttf-lohit-assamese: separate from xorg-fonts
      xorg-font-ttf-lohit-bengali: separate from xorg-fonts
      xorg-font-ttf-lohit-devanagari: separate from xorg-fonts
      xorg-font-ttf-lohit-gujarati: separate from xorg-fonts
      xorg-font-ttf-lohit-kannada: separate from xorg-fonts
      xorg-font-ttf-lohit-malayalam: separate from xorg-fonts
      xorg-font-ttf-lohit-oriya: separate from xorg-fonts
      xorg-font-ttf-lohit-punjabi: separate from xorg-fonts
      xorg-font-ttf-lohit-tamil-classical: separate from xorg-fonts
      xorg-font-ttf-lohit-tamil: separate from xorg-fonts
      xorg-font-ttf-lohit-telugu: separate from xorg-fonts
      xorg-font-ttf-noto: separate from xorg-fonts
      xorg-font-ttf-vlgothic: separate from xorg-fonts
      xorg-font-bh-ttf: separate from xorg-fonts
      xorg-fonts: make all xorg-font-ttf packages tristate
      rauc: make installation of system configuration optional

Gavin Schenk (1):
      doc: Fix typo in layer documentation

Ladislav Michl (1):
      networkmanager: version bump 1.12.2 -> 1.14.0

Michael Olbrich (75):
      ptxd_lib_dgen: detect config/rules changes for image packages
      ptxd_lib_dgen: cleanup error handling
      ptxd_bailout: add empty lines to make error messages more visible
      template-barebox-make: make sure the correct pkg-config is used
      ptxd_lib_dgen: define variables for each pakage rule and menu file paths
      ptxd_make_world_common: propagate rule and menu file paths
      ptxd_make_world_update_md5: use pkg_makefile instead of guessing
      ptxdist: add package-info command
      ptxd_bailout: support multi-line error messages
      rules: rename ptx/get_alternative to ptx/get-alternative
      rules/pre: define ptx/in-path
      use ptx/get-alternative and ptx/in-path everywhere
      import kconfig script from Linux
      scripts/config: use more obscure char for sed
      ptxdist: find config files in multiple layers
      ptxd_make_world_init: make sure PTXDIST_LAYERS is defined
      ptxd_print_path: handle layers correctly
      ptxd_init_ptxdist_path: handle layers in PTXDIST_PATH
      ptxd_get_alternative: add layer support
      ptxd_make_xpkg_pkg: add layer support
      ptxd_in_path: expand relative paths with PTXDIST_PATH_LAYERS
      rules: implement & use ptx/in-platformconfigdir
      barebox: support layers with BAREBOX_EXTRA_ENV_PATH
      ptxd_kconfig: move to a separate script
      ptxd_kconfig: handle config files across multiple layers
      ptxd_make_world_kconfig: add helper to create and save .config
      kernel: use layer aware kconfig helper
      barebox: use layer aware kconfig helper
      ptxd_file_url_path: add layer support for relative file URLs
      dtc: support layers in DTC_OFTREE_DTS_PATH by default
      image-rauc: avoid shell calls if the package is not selected
      doc: initial layer documentation
      doc: add missing search paths for install_alternative
      efivar: disable icecc
      ptxd_make_world_init: fix redefining PTXDIST_LAYERS with older bash versions
      ptxd_kconfig_validate_config: skip the current layer when updating the config
      ptxd_kconfig_validate_config: handle <PKG>_REF_CONFIG
      ptxdist: improve layer error message
      ptxd_kconfig_validate_config: ignore last .diff for refconfigs
      ptxd_lib_kconfig: fix 'ptxdist setup'
      ptxd_lib_dgen: make sure $(<PKG>_SOURCE) refers to the primary package
      expat: version bump 2.2.5 -> 2.2.6
      rauc: fix quoting for when replacing @RAUC_BUNDLE_COMPATIBLE@
      define and use SOURCE_DATE_EPOCH
      host-opkg-utils: version bump 0.3.5 -> 0.3.6
      toolchain_options: disable TARGET_COMPILER_RECORD_SWITCHES by default
      wrapper: try to make all debug paths relative to PTXDIST_WORKSPACE
      libjpeg: make it more reproducible
      gstreamer1: version bump 1.14.2 -> 1.14.4
      gst-plugins-base1: version bump 1.14.2 -> 1.14.4
      gst-plugins-good1: version bump 1.14.2 -> 1.14.4
      gst-plugins-bad1: version bump 1.14.2 -> 1.14.4
      gst-plugins-ugly1: version bump 1.14.2 -> 1.14.4
      gst-libav1: version bump 1.14.2 -> 1.14.4
      gst-python1: version bump 1.14.2 -> 1.14.4
      gst-rtsp-server1: version bump 1.14.2 -> 1.14.4
      gst-validate1: version bump 1.14.2 -> 1.14.4
      gstreamer-vaapi1: version bump 1.14.2 -> 1.14.4
      gst-python1: use install_glob instead of manual find loop
      flup6: use install_glob instead of manual find loop
      networkmanager: use install_glob instead of manual find loop
      flup: use install_glob instead of manual find loop
      directfb: remove after on year in staging
      i915resolution: remove after one year in staging
      xorg-lib-xevie: remove after one year in staging
      xorg-lib-XprintUtil: remove after one year in staging
      xorg-lib-XprintAppUtil: remove after one year in staging
      xorg-lib-Xp: remove after one year in staging
      usplash: remove after one year in staging
      fbv: remove after one year in staging
      jed: fix cross-compile hack for parallel building
      keyutils: add patch to make the build reproducible
      nspr: version bump 4.19 -> 4.20
      libjpeg: make sure the build date is in UTC
      ptxdist: make sure PTXDIST_PTXCONFIG/PTXDIST_PLATFORMCONFIG are never empty

Ulrich Ölmann (1):
      modemmanager: version bump 1.8.0 -> 1.8.2

Uwe Kleine-König (1):
      ptxd_install_replace_figlet: Use sed instead of awk to quote backslashes

-- 
Pengutronix e.K.                           |                             |
Industrial Linux Solutions                 | http://www.pengutronix.de/  |
Peiner Str. 6-8, 31137 Hildesheim, Germany | Phone: +49-5121-206917-0    |
Amtsgericht Hildesheim, HRA 2686           | Fax:   +49-5121-206917-5555 |

_______________________________________________
ptxdist mailing list
ptxdist@pengutronix.de

Re: [ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[Alexander Dahl]

Hello Michael,

Am Freitag, 5. Oktober 2018, 16:21:40 CEST schrieb Michael Olbrich:
> Note that the changes for the layer support where rather invasive. I've
> tested this here intensively, but it's possible that I missed some
> use-cases. Please test this release carefully and report any problems or
> unexpected behaviour.

I got errors on target 'ipkg-push' when calling `ptxdist images`:


creating index.....:
Traceback (most recent call last):
  File "/home/adahl/Work/bsp/FOO/platform-v7a/sysroot-host/bin/opkg-make-
index", line 128, in <module>
    pkg = opkg.Package(abspath, relpath=pkg_dir, all_fields=opt_f)
  File "/home/adahl/Work/bsp/FOO/platform-v7a/sysroot-host/bin/opkg.py", line 
183, in __init__
    control = tarf.extractfile("./control")
  File "/usr/lib/python2.7/tarfile.py", line 2145, in extractfile
    tarinfo = self.getmember(member)
  File "/usr/lib/python2.7/tarfile.py", line 1829, in getmember
    raise KeyError("filename %r not found" % name)
KeyError: "filename './control' not found"
make: *** [/home/adahl/Work/bsp/FOO/platform-v7a/state/ipkg-push] Error 1
/usr/local/lib/ptxdist-2018.10.0/rules/post/image_ipkg.make:19: recipe for 
target '/home/adahl/Work/bsp/FOO/platform-v7a/state/ipkg-push' failed


I don't know Python, so I have no idea what's going on?!

Build host is Debian GNU/Linux 9 (stretch) on amd64.

Greets
Alex


_______________________________________________
ptxdist mailing list
ptxdist@pengutronix.de

Re: [ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[Alexander Dahl]

Hei hei,

Am Montag, 8. Oktober 2018, 09:44:12 CEST schrieb Alexander Dahl:
> Am Freitag, 5. Oktober 2018, 16:21:40 CEST schrieb Michael Olbrich:
> > Note that the changes for the layer support where rather invasive. I've
> > tested this here intensively, but it's possible that I missed some
> > use-cases. Please test this release carefully and report any problems or
> > unexpected behaviour.
> 
> I got errors on target 'ipkg-push' when calling `ptxdist images`:
> 
> 
> creating index.....:
> Traceback (most recent call last):
>   File "/home/adahl/Work/bsp/FOO/platform-v7a/sysroot-host/bin/opkg-make-
> index", line 128, in <module>
>     pkg = opkg.Package(abspath, relpath=pkg_dir, all_fields=opt_f)
>   File "/home/adahl/Work/bsp/FOO/platform-v7a/sysroot-host/bin/opkg.py",
> line 183, in __init__
>     control = tarf.extractfile("./control")
>   File "/usr/lib/python2.7/tarfile.py", line 2145, in extractfile
>     tarinfo = self.getmember(member)
>   File "/usr/lib/python2.7/tarfile.py", line 1829, in getmember
>     raise KeyError("filename %r not found" % name)
> KeyError: "filename './control' not found"
> make: *** [/home/adahl/Work/bsp/FOO/platform-v7a/state/ipkg-push] Error 1
> /usr/local/lib/ptxdist-2018.10.0/rules/post/image_ipkg.make:19: recipe for
> target '/home/adahl/Work/bsp/FOO/platform-v7a/state/ipkg-push' failed

Because Roland asked on IRC, the output above is from a custom BSP, but I can 
also reproduce that on current DistroKit master (platform-v7a) with the 
following diff:

diff --git a/configs/platform-v7a/platformconfig b/configs/platform-v7a/
platformconfig
index 27fe3bb..04babd2 100644
--- a/configs/platform-v7a/platformconfig
+++ b/configs/platform-v7a/platformconfig
@@ -241,9 +241,11 @@ PTXCONF_IMAGE_VEXPRESS=y
 #
 # ipkg options
 #
-# PTXCONF_IMAGE_IPKG_PUSH_TO_REPOSITORY is not set
+PTXCONF_IMAGE_IPKG_PUSH_TO_REPOSITORY=y
+PTXCONF_IMAGE_IPKG_FORCED_PUSH=y
+# PTXCONF_IMAGE_IPKG_SIGN_OPENSSL is not set
 # PTXCONF_IMAGE_INSTALL_FROM_IPKG_REPOSITORY is not set
-# PTXCONF_IMAGE_IPKG_INDEX is not set
+PTXCONF_IMAGE_IPKG_INDEX=y
 PTXCONF_IMAGE_XPKG_EXTRA_ARGS=""
 # PTXCONF_HOST_ACL is not set
 # PTXCONF_HOST_ATTR is not set

I'm using opkg on the target and let my workstation serve packages with a 
webserver, which worked fine with ptxdist 2018.09.0. Ping me, if you need any 
additional information.

Greets
Alex


_______________________________________________
ptxdist mailing list
ptxdist@pengutronix.de

Re: [ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[Michael Olbrich]

On Mon, Oct 08, 2018 at 02:03:21PM +0200, Alexander Dahl wrote:
> Hei hei,
> 
> Am Montag, 8. Oktober 2018, 09:44:12 CEST schrieb Alexander Dahl:
> > Am Freitag, 5. Oktober 2018, 16:21:40 CEST schrieb Michael Olbrich:
> > > Note that the changes for the layer support where rather invasive. I've
> > > tested this here intensively, but it's possible that I missed some
> > > use-cases. Please test this release carefully and report any problems or
> > > unexpected behaviour.
> > 
> > I got errors on target 'ipkg-push' when calling `ptxdist images`:
> > 
> > 
> > creating index.....:
> > Traceback (most recent call last):
> >   File "/home/adahl/Work/bsp/FOO/platform-v7a/sysroot-host/bin/opkg-make-
> > index", line 128, in <module>
> >     pkg = opkg.Package(abspath, relpath=pkg_dir, all_fields=opt_f)
> >   File "/home/adahl/Work/bsp/FOO/platform-v7a/sysroot-host/bin/opkg.py",
> > line 183, in __init__
> >     control = tarf.extractfile("./control")
> >   File "/usr/lib/python2.7/tarfile.py", line 2145, in extractfile
> >     tarinfo = self.getmember(member)
> >   File "/usr/lib/python2.7/tarfile.py", line 1829, in getmember
> >     raise KeyError("filename %r not found" % name)
> > KeyError: "filename './control' not found"
> > make: *** [/home/adahl/Work/bsp/FOO/platform-v7a/state/ipkg-push] Error 1
> > /usr/local/lib/ptxdist-2018.10.0/rules/post/image_ipkg.make:19: recipe for
> > target '/home/adahl/Work/bsp/FOO/platform-v7a/state/ipkg-push' failed
> 
> Because Roland asked on IRC, the output above is from a custom BSP, but I can 
> also reproduce that on current DistroKit master (platform-v7a) with the 
> following diff:
> 
> diff --git a/configs/platform-v7a/platformconfig b/configs/platform-v7a/
> platformconfig
> index 27fe3bb..04babd2 100644
> --- a/configs/platform-v7a/platformconfig
> +++ b/configs/platform-v7a/platformconfig
> @@ -241,9 +241,11 @@ PTXCONF_IMAGE_VEXPRESS=y
>  #
>  # ipkg options
>  #
> -# PTXCONF_IMAGE_IPKG_PUSH_TO_REPOSITORY is not set
> +PTXCONF_IMAGE_IPKG_PUSH_TO_REPOSITORY=y
> +PTXCONF_IMAGE_IPKG_FORCED_PUSH=y
> +# PTXCONF_IMAGE_IPKG_SIGN_OPENSSL is not set
>  # PTXCONF_IMAGE_INSTALL_FROM_IPKG_REPOSITORY is not set
> -# PTXCONF_IMAGE_IPKG_INDEX is not set
> +PTXCONF_IMAGE_IPKG_INDEX=y
>  PTXCONF_IMAGE_XPKG_EXTRA_ARGS=""
>  # PTXCONF_HOST_ACL is not set
>  # PTXCONF_HOST_ATTR is not set
> 
> I'm using opkg on the target and let my workstation serve packages with a 
> webserver, which worked fine with ptxdist 2018.09.0. Ping me, if you need any 
> additional information.

I can reproduce this. I broke this with the opkg-utils update. I'm working
on a fix.

Michael

-- 
Pengutronix e.K.                           |                             |
Industrial Linux Solutions                 | http://www.pengutronix.de/  |
Peiner Str. 6-8, 31137 Hildesheim, Germany | Phone: +49-5121-206917-0    |
Amtsgericht Hildesheim, HRA 2686           | Fax:   +49-5121-206917-5555 |

_______________________________________________
ptxdist mailing list
ptxdist@pengutronix.de

Re: [ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[Michael Olbrich]

On Tue, Oct 09, 2018 at 12:55:03PM +0200, Michael Olbrich wrote:
> On Mon, Oct 08, 2018 at 02:03:21PM +0200, Alexander Dahl wrote:
> > Hei hei,
> > 
> > Am Montag, 8. Oktober 2018, 09:44:12 CEST schrieb Alexander Dahl:
> > > Am Freitag, 5. Oktober 2018, 16:21:40 CEST schrieb Michael Olbrich:
> > > > Note that the changes for the layer support where rather invasive. I've
> > > > tested this here intensively, but it's possible that I missed some
> > > > use-cases. Please test this release carefully and report any problems or
> > > > unexpected behaviour.
> > > 
> > > I got errors on target 'ipkg-push' when calling `ptxdist images`:
> > > 
> > > 
> > > creating index.....:
> > > Traceback (most recent call last):
> > >   File "/home/adahl/Work/bsp/FOO/platform-v7a/sysroot-host/bin/opkg-make-
> > > index", line 128, in <module>
> > >     pkg = opkg.Package(abspath, relpath=pkg_dir, all_fields=opt_f)
> > >   File "/home/adahl/Work/bsp/FOO/platform-v7a/sysroot-host/bin/opkg.py",
> > > line 183, in __init__
> > >     control = tarf.extractfile("./control")
> > >   File "/usr/lib/python2.7/tarfile.py", line 2145, in extractfile
> > >     tarinfo = self.getmember(member)
> > >   File "/usr/lib/python2.7/tarfile.py", line 1829, in getmember
> > >     raise KeyError("filename %r not found" % name)
> > > KeyError: "filename './control' not found"
> > > make: *** [/home/adahl/Work/bsp/FOO/platform-v7a/state/ipkg-push] Error 1
> > > /usr/local/lib/ptxdist-2018.10.0/rules/post/image_ipkg.make:19: recipe for
> > > target '/home/adahl/Work/bsp/FOO/platform-v7a/state/ipkg-push' failed
> > 
> > Because Roland asked on IRC, the output above is from a custom BSP, but I can 
> > also reproduce that on current DistroKit master (platform-v7a) with the 
> > following diff:
> > 
> > diff --git a/configs/platform-v7a/platformconfig b/configs/platform-v7a/
> > platformconfig
> > index 27fe3bb..04babd2 100644
> > --- a/configs/platform-v7a/platformconfig
> > +++ b/configs/platform-v7a/platformconfig
> > @@ -241,9 +241,11 @@ PTXCONF_IMAGE_VEXPRESS=y
> >  #
> >  # ipkg options
> >  #
> > -# PTXCONF_IMAGE_IPKG_PUSH_TO_REPOSITORY is not set
> > +PTXCONF_IMAGE_IPKG_PUSH_TO_REPOSITORY=y
> > +PTXCONF_IMAGE_IPKG_FORCED_PUSH=y
> > +# PTXCONF_IMAGE_IPKG_SIGN_OPENSSL is not set
> >  # PTXCONF_IMAGE_INSTALL_FROM_IPKG_REPOSITORY is not set
> > -# PTXCONF_IMAGE_IPKG_INDEX is not set
> > +PTXCONF_IMAGE_IPKG_INDEX=y
> >  PTXCONF_IMAGE_XPKG_EXTRA_ARGS=""
> >  # PTXCONF_HOST_ACL is not set
> >  # PTXCONF_HOST_ATTR is not set
> > 
> > I'm using opkg on the target and let my workstation serve packages with a 
> > webserver, which worked fine with ptxdist 2018.09.0. Ping me, if you need any 
> > additional information.
> 
> I can reproduce this. I broke this with the opkg-utils update. I'm working
> on a fix.

I've pushed some stuff to master. Can you verify that this works now?

Michael

-- 
Pengutronix e.K.                           |                             |
Industrial Linux Solutions                 | http://www.pengutronix.de/  |
Peiner Str. 6-8, 31137 Hildesheim, Germany | Phone: +49-5121-206917-0    |
Amtsgericht Hildesheim, HRA 2686           | Fax:   +49-5121-206917-5555 |

_______________________________________________
ptxdist mailing list
ptxdist@pengutronix.de

Re: [ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[Alexander Dahl]

Hello Michael,

Am Dienstag, 9. Oktober 2018, 17:12:26 CEST schrieb Michael Olbrich:
> On Tue, Oct 09, 2018 at 12:55:03PM +0200, Michael Olbrich wrote:
> > I can reproduce this. I broke this with the opkg-utils update. I'm working
> > on a fix.
> 
> I've pushed some stuff to master. Can you verify that this works now?

I copied patches/opkg-0.3.6 and patches/opkg-utils-0.3.6 from current ptxdist 
master to the BSP and made a clean build. `ptxdist images` works fine again. 
:-)

Greets
Alex


_______________________________________________
ptxdist mailing list
ptxdist@pengutronix.de

Re: [ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[Tim Sander]

Hi Michael
Am Freitag, 5. Oktober 2018, 16:21:40 CEST schrieb Michael Olbrich:
> I'm happy to announce that I've just released ptxdist-2018.10.0.
I just tested the release and it seems to me that host- tools do not get the 
download location.
E.g. host-libconfuse is selected in platformconfig but when i build i get the 
following error:

--------------------------
target: confuse-3.0.tar.gz
--------------------------


error: empty parameter to 'ptxd_make_get'

/usr/local/lib/ptxdist-2018.10.0/rules/post/ptxd_make_world_get.make:17: 
recipe for target '/home/sander/work/next_pmx/ptx/src/confuse-3.0.tar.gz' 
failed

Activating libconfuse is a workaround but bloats my target :-(

Best regards
Tim



_______________________________________________
ptxdist mailing list
ptxdist@pengutronix.de

Re: [ptxdist] [ANNOUNCE] PTXdist 2018.10.0 released

[Roland Hieber]

Hi Tim,

this was fixed in commit 477cdd08aeeeb [1], which is still unreleased.
See this previous thread [2] for further info.

[1]: https://git.pengutronix.de/cgit/ptxdist/commit/?id=477cdd08aeeeb96
[2]: https://www.mail-archive.com/ptxdist@pengutronix.de/msg13542.html

 - Roland 

On Wed, Oct 17, 2018 at 04:48:08PM +0200, Tim Sander wrote:
> Hi Michael
> Am Freitag, 5. Oktober 2018, 16:21:40 CEST schrieb Michael Olbrich:
> > I'm happy to announce that I've just released ptxdist-2018.10.0.
> I just tested the release and it seems to me that host- tools do not get the 
> download location.
> E.g. host-libconfuse is selected in platformconfig but when i build i get the 
> following error:
> 
> --------------------------
> target: confuse-3.0.tar.gz
> --------------------------
> 
> 
> error: empty parameter to 'ptxd_make_get'
> 
> /usr/local/lib/ptxdist-2018.10.0/rules/post/ptxd_make_world_get.make:17: 
> recipe for target '/home/sander/work/next_pmx/ptx/src/confuse-3.0.tar.gz' 
> failed
> 
> Activating libconfuse is a workaround but bloats my target :-(
> 
> Best regards
> Tim
> 
> 
> 
> _______________________________________________
> ptxdist mailing list
> ptxdist@pengutronix.de

-- 
Roland Hieber                     | r.hieber@pengutronix.de     |
Pengutronix e.K.                  | https://www.pengutronix.de/ |
Peiner Str. 6-8, 31137 Hildesheim | Phone: +49-5121-206917-5086 |
Amtsgericht Hildesheim, HRA 2686  | Fax:   +49-5121-206917-5555 |

_______________________________________________
ptxdist mailing list
ptxdist@pengutronix.de