From mboxrd@z Thu Jan 1 00:00:00 1970 Delivery-date: Sun, 25 Feb 2024 15:49:24 +0100 Received: from metis.whiteo.stw.pengutronix.de ([2a0a:edc0:2:b01:1d::104]) by lore.white.stw.pengutronix.de with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1reFoi-006WWo-2a for lore@lore.pengutronix.de; Sun, 25 Feb 2024 15:49:24 +0100 Received: from localhost ([127.0.0.1] helo=metis.whiteo.stw.pengutronix.de) by metis.whiteo.stw.pengutronix.de with esmtp (Exim 4.92) (envelope-from ) id 1reFoi-0007yw-81; Sun, 25 Feb 2024 15:49:24 +0100 Received: from mail-vi1eur04on2102.outbound.protection.outlook.com ([40.107.8.102] helo=EUR04-VI1-obe.outbound.protection.outlook.com) by metis.whiteo.stw.pengutronix.de with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1reFoY-0007yl-UG for ptxdist@pengutronix.de; Sun, 25 Feb 2024 15:49:15 +0100 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hKutR9Jw/7xBFeJXuLOebNn2ge5PiA5oQadnkODE5hxtRSThC2MEMN4EACXvzIYIbyIGbHm3suMjwq+7ekUYSyd3iYjgM6UX9aOqQo5Nvq00BcoSH3e1xzisn5ASyhX0SA+7pYBvvKWYPatEEvhTI7vSl+fW5RYCBayoTcM6bpPcczOorWcVNoVf92xN0bbO0cPFTDgHJtlHZHGZ18b3mfGKatocdgnDP5Py8UeUDnIBBAj2IvuE12IIpQ5Pm93D+CAdMxT6RooNCaDYZIn14NUgZ4sqKayO3Zdgf5paWJdBqg9/EOF7pudaAZKv6Fbq3ttb2hR4clCO5an/vSBt0w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=yoZQGhm6x0B5BHMCEHcpLJl6fXOYAh6BxuV0iWc1wOo=; b=jQBzUYrbeKQ9io60LhZqHLR6iwG/rFCQoDrcvKqD1yyk+Vq+3CbXgOEbzpYnph/BZ2lbxOMwAsevdkXHYj/ib/QTZWvPFU74hUVaNnJ/1S8t1Ri7LDrYEPv03YZ5cutPwKPaf+Yiv44CMlN2if2+oHqb1BQ1MMFEe9WQXPsFIC0XZCJVcUFDpEsqQmCHbSEpKm1rYvNoMvYzeCAyYMpfB16AXtTlNyOSl2JI1eEPgd0f5PcQyFKrySLcDaf4GqzliqBCTvw1Q5yZTvZl5ktR5inHRBD01mK1QuzyNGUkxHlFzICl0hthfzKoM4eVqjH6n8F9g1zg6rr5JNmiWO0CXg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=t2data.com; dmarc=pass action=none header.from=t2data.com; dkim=pass header.d=t2data.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=t2datacom.onmicrosoft.com; s=selector1-t2datacom-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yoZQGhm6x0B5BHMCEHcpLJl6fXOYAh6BxuV0iWc1wOo=; b=M1Z3spcGbbazGeomFxzYfdINypAoTrktZMPeqSf9BTYhL35jGGCkUxD5kh+7YG3Y4N61CLHTGyOiX7NbAhaoKG7+Lr09hKiF/sAeO94Owke8PQpIa/ChVDR3EXyy+hAlBC6OEIH6zhT/m2IMEIeCrSjUudDZ9p5nrHHjIoRzEi8= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=t2data.com; Received: from DB9P251MB0618.EURP251.PROD.OUTLOOK.COM (2603:10a6:10:334::22) by DB9P251MB0451.EURP251.PROD.OUTLOOK.COM (2603:10a6:10:33f::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7316.33; Sun, 25 Feb 2024 14:49:12 +0000 Received: from DB9P251MB0618.EURP251.PROD.OUTLOOK.COM ([fe80::1398:9f4f:da3f:1862]) by DB9P251MB0618.EURP251.PROD.OUTLOOK.COM ([fe80::1398:9f4f:da3f:1862%3]) with mapi id 15.20.7316.034; Sun, 25 Feb 2024 14:49:12 +0000 From: Christian Melki To: ptxdist@pengutronix.de Date: Sun, 25 Feb 2024 15:49:06 +0100 Message-Id: <20240225144906.2406989-1-christian.melki@t2data.com> X-Mailer: git-send-email 2.34.1 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-ClientProxiedBy: GVX0EPF000013E7.SWEP280.PROD.OUTLOOK.COM (2603:10a6:144:1::20) To DB9P251MB0618.EURP251.PROD.OUTLOOK.COM (2603:10a6:10:334::22) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DB9P251MB0618:EE_|DB9P251MB0451:EE_ X-MS-Office365-Filtering-Correlation-Id: 4af96cd5-bad3-48ff-f9f0-08dc3610ee66 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: yXqfQ5AKa8Wu0OUDwphzjuC2DfCdjO7ludylYleXaPbYfGl2M8cX7MDieBnLn/qRxC49e96gzuZ35kwbKGGIucburfRUMWhucQqxBxpFoAkIJ+CC5tLop657HVjImSLWVTuersWzdzlFJe3FgERxx+ttTKUXbo8He28ykM0kx6iEO6bXJV7/2wLaAPYW2Uk5rMRRdSY23J80cyoP+0jbeDVUb0x6OJ0XNHgs2lmeNVBaqNNHicpH8biC3fYdG7XdgPCToIeRZGKlcUGA214faJqoHd5efv00uqp9FJd2IAPv1HXBJJ0w8TeYc5fUP+vvpFVXdw/3euoDtfId9Dsa1GNG4I/mFSKynFrFJQDPj1AXVj7gJQIR6f/jif3Owgf2j2IvwYjjUd9+v8UgwR24pgPBLGmMtqullqDdOxkVChS9jXnp6n3LQbQKHsFlF9JJrP5P/F7tjfe7iW4FHXz3nikRd+qLDUFGOrEBa0zdovVh/4XdQ3hMQSEus7OGwbLWPGBWFzI89WHDYo93jfRrf9tnqjCRax8AwxMcSVAjx+5rjWNh+vjJ1+AFR/hldNLcgD9lCaD0DCe+KMunzL8BEOeX/wtgLQ1MbGrTfRznpBk= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB9P251MB0618.EURP251.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230031)(38350700005); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?fcxfxsQjpMZ644MMkj25Y8k4z6mGPLm9BezcKVPocpKJQSG05LVbnG3i/kGD?= =?us-ascii?Q?zC25iS9D0xrIIh02dFERMix3nDNo0VCVzYSO/kFvAZM0ywc3VOeA5d1nkoOe?= =?us-ascii?Q?6wvuZtZHwG6r1pF25H4FRpG5Ixa86hFXI8T8cblSiCve8xWzJclC8CvWHT+m?= =?us-ascii?Q?Y52uhl/7j68qLmCEMtw2/eP3DNtGRgrwL28qF0KdY0sglMvXH/8OabRNGWSY?= =?us-ascii?Q?b1dgTanOGjRZD3tOpf/30VcVA965n86LIg15HH5LTE1IFOpFL81Di0rXgCMy?= =?us-ascii?Q?WHyrgDTl6CR545w832fwuG+yW2AfyWsRlTEMdcnTNDneRQ45eDavR/vddtEf?= =?us-ascii?Q?MYijjEHkOAxhksZT0RFgKW0fhBrtrkmfL2D9MKIfpEyzz0+xa93ZHoPL0WNd?= =?us-ascii?Q?C2d6HXLtrLVMTnhv+MuM7tk67zVY6b/7wiM5rCWsMGW5n9G1VF2vzXczgiAY?= =?us-ascii?Q?Q4FMVoeIz5w0irYtIzw0g1DIwua0797WLDPcawMJLG6EuR5lHqwXJVz3meFp?= =?us-ascii?Q?5uDFctDwigngXRKAMqHIDa+K7KVK1b3D+UEvJnqoFTVpZkgwKGnuXKUIxHFH?= =?us-ascii?Q?vml3D+P8j1g6VwUAX2yFUae8SYEj9UNIUfq3B8OCjfX8Z6hOBp5MZhAkCEpK?= =?us-ascii?Q?/v83XEvZvvyqyaZXlibv8zVkcrZx4vMNKxTUQbdfaoeNz3PnSvJBaKthFTx0?= =?us-ascii?Q?MPQ0lqJc/E2V2RLRfRNZrF4QEBfqhZ4XKgBFO4CRDOYD/2arKL8YQESnSzRS?= =?us-ascii?Q?pDd1IrJx4WIzyN1Y9dAGSi2gVA0v78QNKTI+FVVKyWEEzg5KY2hrDzCh7owx?= =?us-ascii?Q?SDVPlszFr5o6BG/usna4gmo6Bh1EctuYv+A3AHVe8Qly8HE9YKnAvQIen9Ss?= =?us-ascii?Q?Z8fCaqClH29OOI5p7o1TPlr35g+Kw1CLdjIez976yumKbMXKELXjwo2x2d1a?= =?us-ascii?Q?mW2VB/HrZ0lVZfTOvzF8ti4XEEgWWEhg0oCCEmrAatDJq5kS/nXBDRehjXLs?= =?us-ascii?Q?PwKTHJc5qGaoYM7Ws5jymqMI6OV+dwefwqKC8xiqnWjcej2a+4hwIWl9uP2I?= =?us-ascii?Q?3HzijST0ZYeLi3pgm/jvK+lJ6m6CbGeMSIvfBEHLjrByZ6w+pf3+vh3ttm+h?= =?us-ascii?Q?KSroXTszNsyvxexUta0in1fj/SloHbzhoBE1Hi2W5+LJfiDejFcVHKKc0c3V?= =?us-ascii?Q?SEE65DZsdHrLeuez3N20I0PkIJojB9mKlPK52tzuF4j7Py5pV1dhiXZkG4EH?= =?us-ascii?Q?oC7OlW5AzZh6VxIXpHlHaUeyZ59+O0x/FLrRWd+lBj/0UgrE9zcZDk2KPse1?= =?us-ascii?Q?Bd4SdSPC/kcnvK3ezweOSX5ldf+HxAk/IGLGjVQ5HguKtfHOzuM+bSEjSxNH?= =?us-ascii?Q?HjUFdWVcXPLccD+5DNp8cy1PJvRC2Vv5BJWE2cbkDeumlKvHJO7bSQIcqYee?= =?us-ascii?Q?UNh7OQbJ0pKjIPK89jbqQ4PM7j0cPmdKdZZU/nDR1PvdXxrqoU6ncR+NRhvL?= =?us-ascii?Q?1Q7ENh5JxrbkGyQQRxICuIZ1Ql1v/mosEj0XMvlPHQ29oRnX8gTMA9yA7dpw?= =?us-ascii?Q?5XDJ235tdC93L0iOKz1V2fmHnsCq0hlPrOxvcut2i0dNgK9I0ya+we6jitYn?= =?us-ascii?Q?BA=3D=3D?= X-OriginatorOrg: t2data.com X-MS-Exchange-CrossTenant-Network-Message-Id: 4af96cd5-bad3-48ff-f9f0-08dc3610ee66 X-MS-Exchange-CrossTenant-AuthSource: DB9P251MB0618.EURP251.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Feb 2024 14:49:12.8005 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 27928da5-aacd-4ba1-9566-c748a6863e6c X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 3rutBgdaTpxXXXuPWnB2iFsVA6npK202tlF2LzKDOS1RSsjCcNSR3pkSJ7i1M2Lx5XEvmLm2p36rM0Z3owpGE/sgiSnLujB4tnQkDbVq2m8= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB9P251MB0451 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on metis.whiteo.stw.pengutronix.de X-Spam-Level: X-Spam-Status: No, score=-2.1 required=4.0 tests=AWL,BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.2 Subject: [ptxdist] [PATCH] image-root-cpio.in: Use multithreaded XZ (revisited). X-BeenThere: ptxdist@pengutronix.de X-Mailman-Version: 2.1.29 Precedence: list List-Id: PTXdist Development Mailing List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: ptxdist@pengutronix.de Sender: "ptxdist" X-SA-Exim-Connect-IP: 127.0.0.1 X-SA-Exim-Mail-From: ptxdist-bounces@pengutronix.de X-SA-Exim-Scanned: No (on metis.whiteo.stw.pengutronix.de); SAEximRunCond expanded to false So, after asking questions about the default multithread mode of xz 5.6.0 and determinism, it turned out that there is a common misconception about determinism in xz. XZ compression varies between the two compressors. Ie, the single thread and multi thread variant. T0 always uses the multithread one, even if used on one core. But T1 uses the singlethread compressor. This has caused a very common misconception about determinism variability with number of threads. I've seen this discussion on a lot of places. So albeit true, it only applies to the distinct compressors, not how many threads are used in multithread mode. Now after giving this some thought I've decided to reenable threaded XZ, using T0. T0 should produce the same results always, on any target. Even unicore machines. And with the multithread compressor now being the default, users should end up with the same results unless they are actively using T1. Signed-off-by: Christian Melki --- platforms/image-root-cpio.in | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/platforms/image-root-cpio.in b/platforms/image-root-cpio.in index 0338175a0..546dda7fb 100644 --- a/platforms/image-root-cpio.in +++ b/platforms/image-root-cpio.in @@ -84,7 +84,7 @@ config IMAGE_ROOT_CPIO_COMPRESSION_UTIL default "" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_NONE default "gzip" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_GZ default "zstd -T0 -19" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_ZSTD - default "xz --check=crc32" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_XZ + default "xz -T0 --check=crc32" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_XZ default "lzop" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_LZOP endif -- 2.34.1