From mboxrd@z Thu Jan 1 00:00:00 1970 Delivery-date: Fri, 08 Mar 2024 19:07:15 +0100 Received: from metis.whiteo.stw.pengutronix.de ([2a0a:edc0:2:b01:1d::104]) by lore.white.stw.pengutronix.de with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1riecl-00DzGJ-0o for lore@lore.pengutronix.de; Fri, 08 Mar 2024 19:07:15 +0100 Received: from localhost ([127.0.0.1] helo=metis.whiteo.stw.pengutronix.de) by metis.whiteo.stw.pengutronix.de with esmtp (Exim 4.92) (envelope-from ) id 1riecl-00089K-1P; Fri, 08 Mar 2024 19:07:15 +0100 Received: from mail-vi1eur05on2094.outbound.protection.outlook.com ([40.107.21.94] helo=EUR05-VI1-obe.outbound.protection.outlook.com) by metis.whiteo.stw.pengutronix.de with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1riecV-000892-8J; Fri, 08 Mar 2024 19:07:00 +0100 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=F8mdkf5gbnMOzxm7n4GGHxoDPvbNzP3bRXokIgkoZ4SQJA2wDfGvIK82UT0hF+dedQtOsZfG62X7QLizUj+BxGTccFoPxLWzeTEbAPDveiqzhA4/Q7HV5JOGyBLwGRVgkSMeSAN8xrnAK4OD9IpdWqSwdlAdG6gmB8OgR6UDG1bfxrfCNzu9eVUxIeYXB+0Cs2bxqiE0iwYH6o6Bw3Qtekr2F9dGZ7TL96dBAv085j2gqtIVai8HvWBxyM5rNRECSGZwTwH/TyouwB6dK1r3adScIIJHQHEAsI7MhdvcQlgKLePG/F8CG7iT0eRgME/BP+gtVu5WN5FCp6bLG3Gvqg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=r/3bXxdJyP4w+LduANE/IRTFyXMpVwQt1Ykwlx+jO1E=; b=buKPU6CQqRu2p798OdK/tkoM+dDvN87NKxmPe+HNnTSIplF+btP+4/t3FpBbnDF9Ba+7LPqzYFHEOJeeJwZoOD2Eq+kaKf5ICBt/LY4jLR7FdEKfA4BLf9YFjoV8pZYpkoNT91DUkK8DYQ1YtPmwg9oyUxJp+KYeqvOKCwqznE8+gF6flOEG06vw8DeXWMGcRsOCGdXx+AmILIXeYNN0Fqo7L/ZnJDPk0d5/M11tqx20HE9V0hN9w4zWjIvbDvG4bdp3uxkRvlqhuN1Kl8ZOeM32xztwYQN2bpq2EZdwGwXBq7RUGO4IJ8g1Mv4RGWxaPo2Ug0dGTjGWrFeUR4g2Dw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=t2data.com; dmarc=pass action=none header.from=t2data.com; dkim=pass header.d=t2data.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=t2datacom.onmicrosoft.com; s=selector1-t2datacom-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=r/3bXxdJyP4w+LduANE/IRTFyXMpVwQt1Ykwlx+jO1E=; b=QyTBfI5s2lwSbJWuxZEqttMcxezJHa0ewRZx7zoYyBfzMDhvIjklQnPcciTJK8BvJo+IyFztAeNFx+NYONGVPi3RhiDAIEVynB9+7F5W9gJ+zBRXLiPbZ5pULamyZggdmEtypP4viUDPUOae4gckpFr1+vBcL7lgeD3/riGUK2I= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=t2data.com; Received: from DB9P251MB0618.EURP251.PROD.OUTLOOK.COM (2603:10a6:10:334::22) by PAXP251MB0424.EURP251.PROD.OUTLOOK.COM (2603:10a6:102:287::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7362.24; Fri, 8 Mar 2024 18:06:55 +0000 Received: from DB9P251MB0618.EURP251.PROD.OUTLOOK.COM ([fe80::ba8c:3db:3a02:7ce4]) by DB9P251MB0618.EURP251.PROD.OUTLOOK.COM ([fe80::ba8c:3db:3a02:7ce4%6]) with mapi id 15.20.7362.024; Fri, 8 Mar 2024 18:06:51 +0000 Message-ID: <0d90226b-f584-4374-ae3f-92caa8a06e3a@t2data.com> Date: Fri, 8 Mar 2024 19:04:34 +0100 User-Agent: Mozilla Thunderbird Content-Language: en-US To: Michael Olbrich References: <20240225144906.2406989-1-christian.melki@t2data.com> From: Christian Melki In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-ClientProxiedBy: GVYP280CA0003.SWEP280.PROD.OUTLOOK.COM (2603:10a6:150:fa::18) To DB9P251MB0618.EURP251.PROD.OUTLOOK.COM (2603:10a6:10:334::22) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DB9P251MB0618:EE_|PAXP251MB0424:EE_ X-MS-Office365-Filtering-Correlation-Id: ea417a92-0e62-4932-8275-08dc3f9a87d1 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: AnCnuG4nneC4UV6aLdMhyoAqx3NhjoTbfs06ZCp2/zyLE3ZDyAT9uxLuldKLRP3T/8/0pkAFwjdHlBXny17d2Crcfw4T1RteM3aax1zSA3WIpOxBR3npdQ1CNP+NMerCiuNj/e00AAWNJ6VjMumRTeZOyd0hWTpPMXg7uPwskkyYotGqlnGozWQi1wkm3r6aCNl1FO5a+DnuuJGop7haHqtKFtmql3r2Mex3hi73hK/u//KkVArYp0stQTsk4nOdyXzjdFxUGUvde/oczQ3bV4HVRdG5oWyJSDa2XOw/JaNJOElkV2dr2ICl2ir33LpKY6vI/a7gWaydMB6NNsJOSyagEOUlD4csKI60rfKPJM2Wa224jYRahAdxJcSRzfF/PEyhdbAOzS7VBEAlylnFhXMQj6FLHrNZgQhbBF9wPQwQ7KagPGUqQTXvz8tOT/sB+zAWCypnSQbl0OhpW6D24pRNDQRZtQMwY/n0dl7yv9sx//MDTB2eG3ea4e+/3ekMo7wpt09PVU23sqjbi8TyTnekhpKpo3Sh7pSPkmd4hqSGhIMUxcZYztzzMsM9aM+XrVBCic/xLXNTnk1zJtLGOoDMeUA+coxGbUwGmayIf/zAVnASk9IphQxmyOOGicViFTxJhnjk4nMBvUd6vHI3dzgd7wTT3zSPB9C30GQt+Yw= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB9P251MB0618.EURP251.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230031)(1800799015)(376005); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?dTk3NldveS9LVmhxdEJnWm9HUGJ5QjhwL1N2T09UOWMwRWZqOGF6UDVkMU5t?= =?utf-8?B?T2l3bEt5aldqd1BTbmFUWlJTVXh1cTIxNnpRNHNxOHJkWFVPNkt2YzluUmsr?= =?utf-8?B?WmVIK1dRM0hPVW9HVUM5ZTU1VVN0aDd6YXlWVG8ycTJoM3ExRGRhaGFBUHVK?= =?utf-8?B?eVBFTWltc0dFWGFSRXpZaVlURG1FRXhUeDNPYmZmc2tVdkl6c1Vxbk5RSW9B?= =?utf-8?B?VG41Nzdqd0h4Zk90OU9HY3N4YUZ1VlB6bjVtRjZoMDZKbzFPd2o4RG1MYUxU?= =?utf-8?B?OHJFWUs1QUZVWG9MNFVtQ3oyQzNXSU1VRVUvRFRKbXUzaXpiUVFLcVJTZlJp?= =?utf-8?B?d05JWEYvSGxTeDU0UmFkRVlsZkJaT1UxdzJKbDV5Wi9TQ0c1RWQySkpid0Qr?= =?utf-8?B?dTBwSXd4dkQyTFh2U2toV2VhbXZyYkQvRzBrRXNGRkNwc21oa3pKRjVPdEtX?= =?utf-8?B?dWFCNWlsWG1ORDd1OTNPKzJSTzhsQnh1Rzcxc0o2ZWpPeXFsSnAwaERIaW9S?= =?utf-8?B?aXlMSXFncWlsVnFqOFBpR05QVFFIOXFZYXA1dWJwRkdBaC9wdG1OZEVzNWFh?= =?utf-8?B?K3hpdmJLaFF0WjdRY0lONEdpdW1lQzhMR3JzWGRBUmV2Uno4ZzZWZmJwMFJy?= =?utf-8?B?OFQ1ZDBEVm1TV0FjaDVQaTM4bnQwZHpYNFRJYlRnd2xKaDhrZ1pQTXhRMEVy?= =?utf-8?B?NXJXTGhwSUFoK3FYZ0JqMFVoNkUydnFQUEpVTXE5N2RKVDE1RG5yQmlWNkxQ?= =?utf-8?B?UDZFNlpobzUvOWtsL3BmZE8wb1JjbW9adDRvTEpyU0g1L09mTzFyTjRNSElQ?= =?utf-8?B?S1pXMUlBZ1VXMXZwaVRMb2l2WCtNM3FycVI1WVcyd0NaYm5BbFlMZE1RQ1Zl?= =?utf-8?B?aGlBbkpqVWwyRmFjNEMyUHZiQVJmbjA1Y2xVckVFemp2UWsxSkh4RjQxdWN2?= =?utf-8?B?NzRyVDN0Vjk1djZUQTRMclZ5T0xxRjl4U1FvY0swU2Y4dXJMcUlWeVgweUN3?= =?utf-8?B?YUhXSWdnZktJSUs5RzVQNW4vOExldy9vVG5ZVTZwTHgzMDlyMS96bDlFUFoy?= =?utf-8?B?Tm1ldTQ0TVI1Zzlzd2UxSWgxY2Q5UVdteXZqRC82S3RITUtabTEvS3lyS3oz?= =?utf-8?B?SUNsV20wTVFET1RzMlgyQXVUY0F6L3pwcUJoWFNXaW41NlpWU1JZdDVqM08x?= =?utf-8?B?QUlaT2g0a2F5N21jQXN4dWNIMnJsQ3RMenJydm9kWmtpZnE3a3dacG1kYmtM?= =?utf-8?B?ajJTQnBBR2M3RUpibmxwVkFaQUhoVnRKYllYZzFpOFd6c2dSY1YwOC9ESFJD?= =?utf-8?B?Y2NyejdkUlU4Y0t0TUFITUNvNlBiRGg0eEF4U2RwRlRzK0xKWWZNaHRTY0hE?= =?utf-8?B?Y1BQVkt1dlUvaDlJRFlBWmh0Y3NVTHZsTlFPZUVveVRuVXp1M0VWdFNYNDhz?= =?utf-8?B?U2phbkRyRFZEN1JScDhPWXlHeTVKQ3RBT0hhbHJqcExmd3ZHNVFwV3dIM2Zi?= =?utf-8?B?aTYxZTVpNmtXNGtJZnZlaGxQT0FXTzR5V2dvT1VMUWxLTFUxRWhpcjM5ZnJv?= =?utf-8?B?clRlc1Y0YTdEYi84NGo3ZHFGSUhpUlg2bVpUeFpkUTQrWGRpWW1WYzY0OTRi?= =?utf-8?B?dzJIZmI4Y3MvRE0zQ3dFUHk1S2dHdGpjbXhlK3VBUU02QXpKK1E4eVBWMnE3?= =?utf-8?B?MzFDR1BNZEZWRlprYXp6aDRkSUFLeHZnU3dJa25qUEZOb3Q4dlFrNnR0Q2t2?= =?utf-8?B?My9UZE4zREZtYklZZ3RCMXNETm50by9JUEFFU3ozWktFak1DK1Z1YzYvamNv?= =?utf-8?B?Mk5xdnN1M3QyOTRodVBORkxWS0tsSEdrTDI3bUVJYnV2Q2ppRWVYQkxKR1FY?= =?utf-8?B?WVNxMTF4eUxVNXZhYnROVlJMUUxWZGRmcVFLekF2R1RtWjhFb1AxT0VNcFhN?= =?utf-8?B?aWlFR1p6d0gxS21ncjVvVVkxUDlUNXJnakljRThJL09KMVcxQlg2aUZXR3Fz?= =?utf-8?B?NWE1U0x3bVZyWjBpdUpkUzdjenBwdkZ0cXd3ei9NOVFhdHBIU3NiMjRUbFhV?= =?utf-8?B?dm9WblpQTjlKOWFiY011WCtKcTEyMFhvampWMEN2YTBBWVhBRkcwa0ZBQmxx?= =?utf-8?B?c1gzZUkrNU9wTEVkNDRtRFVjU0FLdi8zMnNEMFFibFFxQTlMejMxTUJreEFk?= =?utf-8?B?UVE9PQ==?= X-OriginatorOrg: t2data.com X-MS-Exchange-CrossTenant-Network-Message-Id: ea417a92-0e62-4932-8275-08dc3f9a87d1 X-MS-Exchange-CrossTenant-AuthSource: DB9P251MB0618.EURP251.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Mar 2024 18:06:51.8386 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 27928da5-aacd-4ba1-9566-c748a6863e6c X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: tN9AlRx9Nrx+XzGNedpFZmZTfDMqLe6Ves+ZW2P2rssl+qhVT07IEV23/w9JZcn8Pic+rKxCJJtzgXHugwXx1Rhab8CLtjQaskWKW2qfWsc= X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAXP251MB0424 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on metis.whiteo.stw.pengutronix.de X-Spam-Level: X-Spam-Status: No, score=-2.1 required=4.0 tests=AWL,BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.2 Subject: Re: [ptxdist] [PATCH] image-root-cpio.in: Use multithreaded XZ (revisited). X-BeenThere: ptxdist@pengutronix.de X-Mailman-Version: 2.1.29 Precedence: list List-Id: PTXdist Development Mailing List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: ptxdist@pengutronix.de, christian.melki@t2data.com Cc: "ptxdist@pengutronix.de" Sender: "ptxdist" X-SA-Exim-Connect-IP: 127.0.0.1 X-SA-Exim-Mail-From: ptxdist-bounces@pengutronix.de X-SA-Exim-Scanned: No (on metis.whiteo.stw.pengutronix.de); SAEximRunCond expanded to false On 3/7/24 17:04, Michael Olbrich wrote: > Hi, > > On Sun, Feb 25, 2024 at 03:49:06PM +0100, Christian Melki wrote: >> So, after asking questions about the default multithread mode >> of xz 5.6.0 and determinism, it turned out that there >> is a common misconception about determinism in xz. >> >> XZ compression varies between the two compressors. Ie, the single >> thread and multi thread variant. T0 always uses the multithread >> one, even if used on one core. But T1 uses the singlethread >> compressor. >> >> This has caused a very common misconception about determinism >> variability with number of threads. I've seen this discussion >> on a lot of places. So albeit true, it only applies to the >> distinct compressors, not how many threads are used in >> multithread mode. >> >> Now after giving this some thought I've decided to reenable >> threaded XZ, using T0. T0 should produce the same results always, >> on any target. Even unicore machines. And with the multithread >> compressor now being the default, users should end up with the >> same results unless they are actively using T1. > > So if I understand it correctly then multithreaded compression results i a > slightly larger output file. But it also means that it can be extracted > with multiple threads. > The question is: will that actually happen? The initramfs is extracted by > the kernel and I'm not sure if it supports that. > > Michael > Not sure I follow. You're asking if a multithreaded compressed archive can be decompressed by the in kernel (single thread, assumed) decompressor? It would seem it's very bad if it wasn't capable of doing so, so I never think about that. I just assume it. Regardless. You may drop this if you like, regarding slightly larger archives. It's a very trivial local change for those who thinks it's useful. Regards, Christian >> Signed-off-by: Christian Melki >> --- >> platforms/image-root-cpio.in | 2 +- >> 1 file changed, 1 insertion(+), 1 deletion(-) >> >> diff --git a/platforms/image-root-cpio.in b/platforms/image-root-cpio.in >> index 0338175a0..546dda7fb 100644 >> --- a/platforms/image-root-cpio.in >> +++ b/platforms/image-root-cpio.in >> @@ -84,7 +84,7 @@ config IMAGE_ROOT_CPIO_COMPRESSION_UTIL >> default "" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_NONE >> default "gzip" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_GZ >> default "zstd -T0 -19" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_ZSTD >> - default "xz --check=crc32" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_XZ >> + default "xz -T0 --check=crc32" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_XZ >> default "lzop" if IMAGE_ROOT_CPIO_COMPRESSION_MODE_LZOP >> >> endif >> -- >> 2.34.1 >> >> >> >