From mboxrd@z Thu Jan 1 00:00:00 1970 Delivery-date: Fri, 05 Nov 2021 10:32:04 +0100 Received: from metis.ext.pengutronix.de ([2001:67c:670:201:290:27ff:fe1d:cc33]) by lore.white.stw.pengutronix.de with esmtp (Exim 4.92) (envelope-from ) id 1mivZs-0003Qz-EB for lore@lore.pengutronix.de; Fri, 05 Nov 2021 10:32:04 +0100 Received: from localhost ([127.0.0.1] helo=metis.ext.pengutronix.de) by metis.ext.pengutronix.de with esmtp (Exim 4.92) (envelope-from ) id 1mivZs-0007Om-2T; Fri, 05 Nov 2021 10:32:04 +0100 Received: from mail-eopbgr130040.outbound.protection.outlook.com ([40.107.13.40] helo=EUR01-HE1-obe.outbound.protection.outlook.com) by metis.ext.pengutronix.de with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mivZY-0007Oa-Fv for ptxdist@pengutronix.de; Fri, 05 Nov 2021 10:31:45 +0100 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=l+7Q8Mcec1f7FbRxawBbO3WtCsnUAY2XI9KxmmZdjODmS/mNwy0XcBsp9i+1MGap00cM7p1DCWgNzDM0zNEknKxpLERFcWxdrqDPX47ugqZeMdujRPjdbqArDYI9vrjpr0brPjGC6Snih9Y6Eu1ow9pxTyP9bDRETt/9uZ6cXsaD4acowOHO4FDs3UvhAIgOEUcwF8wCL5RtGdtAVZkGHY88d7xc6pvuAitcf+7daj9FBRtc8vALGu49OYvgNHflO0KLyUfpPyVLA6oXS/WBKKf4F6Xy0+K33UceIApfQeWpLVAIEp0iCvWs05JuU90jMAG5NCbK/ytoVfyAY659pw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=L4Iu9cYSf7frskd/PHgdTWgPbpGJrSCZIVmrKeUr0/0=; b=HnEGj/jaIfwb8dxV0U9nEK5Ya1cMNoB1yOaq1kHOK7NcEASxmk1QWLjLewE3OGBkm97vkeZUnU4Px77YaakCp9WNVSiuW3yIjgtheb3jw5gDhUzUO1QpsUhcGoAedZR6hxXsAhchTyKYb33wZm6pkuKb7tMRPNN8fvMWdp6nWjF7fWj4G0oFUhPgxbMQMklbp0M0VIY5kwRv9+B3508wyUEeWGYavNuCqnPWcTjt5BNljq6bQ5YgPkUR+n4e6Mt2P5JqT06L63PZEK3TFcFmDU2GU969tv0jZhczQrMRSXfuSPanxWMqrbpM+GwZ2nhdcGSVQTALIiYP04DgSZVsYg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=t2data.com; dmarc=pass action=none header.from=t2data.com; dkim=pass header.d=t2data.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=t2datacom.onmicrosoft.com; s=selector1-t2datacom-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=L4Iu9cYSf7frskd/PHgdTWgPbpGJrSCZIVmrKeUr0/0=; b=fQ+Gf2Uoav3ggnb7BTkZAYCV68wiXDPPeviArnLMSbTOoLoryuSIKXkWGPok+BI+QeemCNM8wscTEkgBrS123/9G/uC6z+5eJvZqSB2yY0KjE0C9E95YJy3oj4p7CjlcM+0hOrCRWw4Hno+4Aoi40eFxoYbKOhJ9QwdAW+0Pn90= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=t2data.com; Received: from AS8P251MB0167.EURP251.PROD.OUTLOOK.COM (2603:10a6:20b:403::21) by AS8P251MB0215.EURP251.PROD.OUTLOOK.COM (2603:10a6:20b:406::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4669.10; Fri, 5 Nov 2021 09:31:42 +0000 Received: from AS8P251MB0167.EURP251.PROD.OUTLOOK.COM ([fe80::4512:e545:5ad5:7d61]) by AS8P251MB0167.EURP251.PROD.OUTLOOK.COM ([fe80::4512:e545:5ad5:7d61%9]) with mapi id 15.20.4669.013; Fri, 5 Nov 2021 09:31:42 +0000 Message-ID: <3bce4a46-0eb6-8bf1-3057-c0d0c2f393fe@t2data.com> Date: Fri, 5 Nov 2021 10:31:24 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.2.0 Content-Language: en-US To: ptxdist@pengutronix.de References: <4d8f168a-d731-8cc0-892c-19c9f0cdc879@t2data.com> <20211015131257.GE2239952@pengutronix.de> <351d7aec-e41a-c334-1835-5062e8825650@t2data.com> From: Christian Melki In-Reply-To: X-ClientProxiedBy: GV3P280CA0103.SWEP280.PROD.OUTLOOK.COM (2603:10a6:150:8::8) To AS8P251MB0167.EURP251.PROD.OUTLOOK.COM (2603:10a6:20b:403::21) MIME-Version: 1.0 Received: from [172.16.234.94] (212.247.174.226) by GV3P280CA0103.SWEP280.PROD.OUTLOOK.COM (2603:10a6:150:8::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4669.10 via Frontend Transport; Fri, 5 Nov 2021 09:31:41 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 368123ce-d2e2-431c-c4e7-08d9a03f1379 X-MS-TrafficTypeDiagnostic: AS8P251MB0215: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:4303; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: hhX3I4/wqHwSyyx53kwnYNSFH9NABSSkLTaKQ4azZQZrk9ZrbmWAJppqNLT5DHYV3U6mPOlF1H2EAPZ7lc2ZW6jnzgdiseQfCI3g1OJpqhuYZBxpmMQFwOa2qPGftYd9ueTQAHdTvSfV2SblNK6EI7pB2uDoq82jos40PUCfamCSLoVhUWLthCO/zYo7bGCSjk3DM5vvMm1rEdK8p+bkvJtWUH/mGZkohhx+daI/bzN+rqCtr1kjg7XJOAiIOAFS2HeRcpYTcspicwj+nlwony0PCNikleqoxiq/Rzz92+SViVwOuZwSmPRjZSZg57twz4WSqwFoIDlDljm2Cy4Icn/iItQrIXXqBXlRmOM0/B6zb+Yv3YCoJeicV5ZePmHtpX/HtW9EXn82ocai6avOZ9p9RiX14JVT0HYofT7Y0UtVp0fKiOV+NEh9FedoobyHYl28f6cFOKEAOqlSBTRtQh47JwmCYNzN/CBa0bybCvTtN0QETXpychmXfFj5mV2W4+EKLgqcBX9uiaOd5Gu7ZVBvbFkZXQ4/tOJVUxwwW8yy3Rb1WQaEbCu+Q3wcAeBhF+Km0xnZzlRjSKSYVa3hMgKRPbZHyiqj6L6H2psMa3+HI9v1Bsr94L5pGWLqTYSy2ACnH9o4S2LuUCMi+86BuyOT5VI6h9z0A5IfRjydVdzGDEudEAOhylaudkaoddQXSCo2tHIp4ReQHtiAi/F47bprvzSYUo1kbvpMGcnTvZh+wUEeDSxcp0dHY1Ql5sdIUBrC86VsjeSJj8pGcbyrCA== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AS8P251MB0167.EURP251.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(376002)(366004)(346002)(136003)(396003)(39830400003)(42606007)(2616005)(38350700002)(44832011)(6916009)(508600001)(52116002)(2906002)(316002)(956004)(66946007)(66556008)(66476007)(186003)(31696002)(83380400001)(8676002)(38100700002)(53546011)(16576012)(36756003)(31686004)(6666004)(6486002)(5660300002)(8936002)(86362001)(26005)(45980500001)(43740500002); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?RWhGMVNGQ0duc29XVmVJUk5BUDBXS2JXTnk4UEhuRmZ1UnJ2MWJhVjhtNk1l?= =?utf-8?B?UEFoWXFBU1EvdXZSN3JPZ3N4RzlqRHM2YXFxbWptQ1lKUGtGZHl1RFF5Z3Yy?= =?utf-8?B?M2lXcURFVFVYV2QreEEvd0s3aHlrUFZQMmdGRkdEKzJWRXRLQzNBVENsdjV5?= =?utf-8?B?alBwbWo2Sit1UkdVeVFEYVM4UStISHkvNlp5STZCRE9PWU9YSG8vVk9XUW1M?= =?utf-8?B?SE9pN1dBUGM1dTJNaklpbmZ0Y09obEhqV3VXNzNrckhIaUplbWFueWlHNzRY?= =?utf-8?B?RTB3Sm5wREhvNWJjMnk0N3U1MDhoQkhGa1pjSU1yYTBpZnVJMTdHaUVxcklu?= =?utf-8?B?M05yblp5ZXZXZ3pBdDJhd2w1Mi84OFUycWVaZlZWRVY0cnFwZC91Q2FibGM5?= =?utf-8?B?RURrYWFuSEZPcjAzMngzTTVMT05aMzlpM2J5dFdPdVU3SEoyakNQUGVnUEVi?= =?utf-8?B?dGducDdpb054Um1FalpsbTNubDRXNUlhSHZsQTRJY1RuRjhRdE16VWNiYkov?= =?utf-8?B?VFdwUm95L1o3S0h1ejNEeDdoWXpYLzFXOG9HalY4aXdPcmRlYmI2aXhobHdW?= =?utf-8?B?b0VTMmpVSmdla0I2TEZnRTVFOGN2WS9CeE9VcDFXL0VZdDI3aklxa3lPdkw4?= =?utf-8?B?MnJUaGNHN1FkWmsrQVBFYkFIeFh4OVBhOXlIZ2xBUmlVNDB4eEEvdUFFK2tO?= =?utf-8?B?WHJxNGl4cEw3b3pqQzhIbVc5QVdlSW1kYmhSM1F3N0RMcXI2amsrcTJCVld2?= =?utf-8?B?OGlDUTNnUVZ6V1pGZm1oU0RWOFZGNnhHV0MwbENobkNReGIrOTlOOTc0TmZp?= =?utf-8?B?eHJiNWVvbDhraXh2bzg2K3ZodDdiNmJOd1JQZEl4ZHFvOFNmMW5xKzhzVkJs?= =?utf-8?B?QUFKUTh6eER0bmloOGhxOFJCY2tGSEdnT25VeEh3QXFhcmgwdmFoOFZrdjUv?= =?utf-8?B?czRwME5NSTFRSHh4NDl2aUhYbS96ZVMvcXVDWGFpNUdvTERPRFNFcEJEbUpj?= =?utf-8?B?QThZL0NNaDllYW5qY3RLc3lLSUdoRjFQZTlaMXJpTlZHNTl0SktCd0lOZlpt?= =?utf-8?B?R1R2dk55SHZ1aTJVRmlXSXFVOFJlYmQ1K2F4T1BzUmtMSzVmQnQ5ekdiZmt0?= =?utf-8?B?S25mS1BBeWt5Zk9xbWU4NDQwUUVuRkN0OHBkc3hLa1NuUjc1OFBHb2RmdWlP?= =?utf-8?B?ZXB4T2wxSG1BcXMvTG85TW02SFpqeitpOXJSSW5zWU0rdHZyd2NOckVrMDN2?= =?utf-8?B?UVJJTW5RdWZqOWlsZW96cHU0c3lTYS9YdmNKQkVJUG9FcFUwcXV0bDI2L2FC?= =?utf-8?B?RTVUaHY2WDJ6WFdQdDU3eC9BaUVJd1BJSVowQXNwRFBWZmd1dFJpU1JoUWZa?= =?utf-8?B?YWlWdU9OMFJTa3J2RHJvVkFJblZ6eVhIZmlucnhDeCtDRy94elhPR2RtdjJ4?= =?utf-8?B?ZCswSzJ6M1Z0bGxVZzM3YjJpeDRZNU9lRzZzOFJIcmdWWHVhYUtFbFZuaFRH?= =?utf-8?B?VnN3VWJrZzZCUDhyU2F3ak5JZ3JjaHcwdEd1a08rQmFDNytKclRQRVBiMitQ?= =?utf-8?B?MDYxb3F4SHpuZktOUWtaOHh6ZTFsSmxZR0xoekJWL0NoWG1pdWpnUEFnUDlE?= =?utf-8?B?b0ZZdjdZMnBUSFhCa0gyU0RBU1JnMTJCSWtlVUVwaVhOOVFEeXBWb0JEUkFF?= =?utf-8?B?QWdvQkt1UGtKVVBPUnlSVHBPOGJ6RzQ4OEduZ1VNU29FUGpjbkdUYWpJeEZY?= =?utf-8?B?WElZQmhWMi9Gbkg2ZUdiWFUyT21iQjhkZlVRNVYvdlgxd0d5dTZmRXQ5Q3Yv?= =?utf-8?B?clM5UWtSZEhWdmg5WkFxSktmK3BCNGlvdmRhOEF5TVhKT0RhYVRxRjlkcG9P?= =?utf-8?B?ZjVqa013d3c1Z1FzQlR4Tjd2TlNSYWpJNGYxQVdyblpoZGJNMmRmSWRabTU3?= =?utf-8?B?Skt3YVpRVk85VFFGUytpL3RyemJmUkw1Mk5qZnZ6NHZwdVFteGF1THRjNFZP?= =?utf-8?B?ZHhzcXMzVWRoamRYWlR5bUJZSXBsNXhnb2JEYjNhT01yWWprQWNxY1ZPbVRn?= =?utf-8?B?cjRtYjJudktKc3pzYlpxTlhNdmptbkx0OEROVjhMNUVwSU8xeXB4TjNaT3hB?= =?utf-8?B?U1IxWmd5QkVEY1dMbTZrbFNuR1IzdWRwaXZnS3QzYjFyaXZldm5xWlhvZHhI?= =?utf-8?B?d3VHbmtrVU95dkFockhkWlZqdHdUdHg4MHR1N0l5NTMyNThMMEdGdkxYNDN5?= =?utf-8?Q?MbWbFyO5sEsmlwFUqhjpsDmXxcy1fUBCpKKVsL4Vss=3D?= X-OriginatorOrg: t2data.com X-MS-Exchange-CrossTenant-Network-Message-Id: 368123ce-d2e2-431c-c4e7-08d9a03f1379 X-MS-Exchange-CrossTenant-AuthSource: AS8P251MB0167.EURP251.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Nov 2021 09:31:42.0842 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 27928da5-aacd-4ba1-9566-c748a6863e6c X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: csRTlh62j48VNwCb2hJDREvRPn8hfbf/oFbtUWs0QMaxEKn2QSUh8sbOPm65AWLTMpq7TS7ZZT98/Tt4K0OGF0jMWpp6toZcgfh8loyQ39o= X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS8P251MB0215 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on metis.ext.pengutronix.de X-Spam-Level: X-Spam-Status: No, score=-3.7 required=4.0 tests=AWL,BAYES_00,DKIM_SIGNED, DKIM_VALID,MSGID_FROM_MTA_HEADER,NICE_REPLY_A,RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS autolearn=ham autolearn_force=no version=3.4.2 Subject: Re: [ptxdist] Request for comments: CROSS_LIB_DIR handling etc. X-BeenThere: ptxdist@pengutronix.de X-Mailman-Version: 2.1.29 Precedence: list List-Id: PTXdist Development Mailing List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: ptxdist@pengutronix.de Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: "ptxdist" X-SA-Exim-Connect-IP: 127.0.0.1 X-SA-Exim-Mail-From: ptxdist-bounces@pengutronix.de X-SA-Exim-Scanned: No (on metis.ext.pengutronix.de); SAEximRunCond expanded to false On 11/5/21 9:57 AM, Michael Olbrich wrote: > Hi, > > On Thu, Nov 04, 2021 at 11:06:13AM +0100, Christian Melki wrote: >> Bump. > > Right, this got lost on my side, sorry. > Np. :) >> No more comments? Action? >> >> On 10/15/21 3:34 PM, Christian Melki wrote: >>> On 10/15/21 3:12 PM, Michael Olbrich wrote: >>>> Hi, >>>> >>>> On Wed, Oct 13, 2021 at 09:29:24AM +0200, Christian Melki wrote: >>>>> I've been correcting various hardcoded paths in ptxdist packages >>>>> and whatnot >>>>> lately. This started with ptxdist not coping well with toolchains that >>>>> adhere to the ABI path for various architectures. >>>>> >>>>> Yesterday, I dug into the problem that on x86_64 (/lib64), all >>>>> .pc.in -> .pc >>>>> file transformations looked broken with hardcoded paths. At >>>>> first I thought >>>>> it had something to do with autoconf or pkg-config but after a >>>>> while I found >>>>> this. >>>>> >>>>> scripts/lib/ptxd_make_world_install_mangle_pc.awk >>>>> >>>>> Which after a while made me realize that there is still a lot of code in >>>>> ptxdist core stuff that assumes that lib-paths are only /lib and nothing >>>>> else. >>>>> >>>>> So. I'm presenting a two options here. >>>>> >>>>> 1. Fix all ptxdist core stuff, because really, ptxdist should be more >>>>> flexible than hardcoded paths. Esp. for libs. >>>>> >>>>> 2. Split ptxd_get_lib_dir, because, ld.so path should not be >>>>> assumed to be >>>>> the same as main library install path. So ptxd_get_ld_lib_dir which does >>>>> what it does today and install ld there and ptxd_get_lib_dir = >>>>> /lib and be >>>>> done with all the userspace library transformations. >>>> >>>> So, put everything in lib/ and only the ld.so in lib64/, right? >>>> >>> >>> Yes. And depending on toolchain configuration.. + glibc, but not the >>> rest of the userspace libs as you say. Since the copy_toolchain routines >>> query the linker by itself afaiu. > > Good point about copy_toolchain. I don't mind if glibc (etc.) is installed > in /lib64 as well. Whatever is easier to start with. We can change that > later if necessary. > Ok. I'll prepare a patch for hardcoding ptxdist to /lib for non toolchain related things. I will be naive/stupid/simple, but the discussion about configurability etc can start there. >>> Either way, the important bit is the hardcoded path to ld.so in the ABI >>> declaration. That's the one you have to hit, otherwise you'll have >>> bricked userspace. :) The rest can be solved with ld.so.conf. > > So /usr/lib is not in the default search path and /etc/ld.so.conf is > necessary in this case? > Hmm. If we do nothing then I guess that depends on the toolchain. If the toolchain is configured with an extended "user-defined-trusted-dirs" option you probably don't need an ld.so.conf for the default search paths. But otherwise, I'd say yes? Can't remember. I use an ld.so.conf that always includes the usual suspects and prepare a cache when I boot (after ld.so has been hit). To me it looks like glibc expects the default usr search path to be the usr/ld.so path (/lib64, /usr/lib64) This is what it looks like during glibc generation: --- (glibc) Makefile: # Build a file mentioning all trustworthy directories to look for shared # libraries when using LD_LIBRARY_PATH in a setuid program. The user can # add directories to the list by defining $(user-defined-trusted-dirs) # before starting make. $(objpfx)trusted-dirs.h: $(objpfx)trusted-dirs.st; @: $(objpfx)trusted-dirs.st: Makefile $(..)Makeconfig $(make-target-directory) echo "$(subst :, ,$(default-rpath) $(user-defined-trusted-dirs))" \ | $(AWK) -f gen-trusted-dirs.awk > ${@:st=T}; echo '#define DL_DST_LIB "$(notdir $(slibdir))"' >> ${@:st=T} $(move-if-change) ${@:st=T} ${@:st=h} touch $@ --- (non-extended, generated glibc header, on x86_64) trusted-dirs.h: #define SYSTEM_DIRS \ "/lib64/" "\0" "/usr/lib64/" #define SYSTEM_DIRS_LEN \ 7, 11 #define SYSTEM_DIRS_MAX_LEN 11 #define DL_DST_LIB "lib64" >>>>> So. Number one probably requires a lot of more work and a lot of >>>>> headache. >>>> >>>> And we'll probably break it more often. >>> >>> Pretty much guaranteed, yes. >>> >>>>> Number two should be rather straightforward, atleast in theory. >>>> >>>> There will be some packages that will use lib64/ anyways, because they >>>> query the toolchain directly. We have a platform-foo/sysroot-host/lib64 >>>> symlink because of that. >>>> >>>>> Any thoughts? >>>> >>>> I actually really like option 2. It sounds like a lot less work and >>>> problems in the long run. >>> >>> While I'd like a more generic solution, I can absolutely value things >>> that works and are simple. So, less problems it is. :) > > :-) > >>>> If necessary, we could also make lib64/ a symlink to lib/ (in >>>> ptxd_make_world_install_prepare() and in the final rootfs). That way, it >>>> wouldn't matter which one the packages are using. >>>> But I'd like to avoid that if possible. >>> >>> Mmm. I botched my rules to always include a separate lib64 now, but >>> that's just a hack. > > Michael > _______________________________________________ ptxdist mailing list ptxdist@pengutronix.de To unsubscribe, send a mail with subject "unsubscribe" to ptxdist-request@pengutronix.de