charm AT lists.cs.illinois.edu

Subject: Charm++ parallel programming system

List archive

[charm] Need help building on a hybrid system.

From: "Sheppard, Raymond W" <rsheppar AT iu.edu>
To: "charm AT cs.illinois.edu" <charm AT cs.illinois.edu>
Subject: [charm] Need help building on a hybrid system.
Date: Fri, 23 Jul 2021 16:21:57 +0000
Accept-language: en-US
Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=iu.edu; dmarc=pass action=none header.from=iu.edu; dkim=pass header.d=iu.edu; arc=none
Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=noGo1AgyE1JFP1j3E8q0YG8SsS/EBq4Pmb3pMi4moUk=; b=ka76zQ9AHJ6CNOnymniQs1vTSYzc5t/Whe9/6Bcg8rggSl9QMY+K7Yu1SkpQA54e6FKfCdyfNOgHMKLZmrwZnak+qk+E0c20SRjD9aeelqb9grCcDhZFyhnatG0qOKkd2Rb+Lq0Z0x2EwGhyGvhkVPOFcUPD52Zir3zg/gUxjiSrgKnF09SPXGQQa0EriqqOstBGtPZNvALcl5U1fihdGPGJh0GcYEDZBi02NtQLJz/BLPoG6dEzl9FGg7XlFVhgRuxDxZtAHfBMuO3pTGcoifygxN+CTTx+XWkQMldnwARQa6CTLXl2Ttvi7oFesYvFN12I366hpWAFxafyCmlFFg==
Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lBn2Y896HZ6VtYBFsKGl6X0TmEK6RMzgNFdp+Gk18BIKLpFLC2tqF8ZOOjiJxzEb0BhiF6Ugp3DRTb0sBaYwyc4QwiW9zaiv/nXuvnaKeVHESBk4q4OFIJdkfqxJYXyCTb5qyme2wYpMRAKxGLk/2yPKpLdCNQDc6YpfVo2zePfPdvYY2laBjGZi//kfdWAvyi+UKmlpjHX4MrR2rFUNJ67l3MvLHYp7j42Bn8dTWK0PWTctSOW/yawjDA+seUbKMnPi5Lp5hdUeS3i2jQf+QBYovOEsOy0EWZtudzV35f/Lty2Wvw4V+MtQot54srK+TO6fF71dt6F5dE/M3T4vvA==
Authentication-results: ppops.net; spf=neutral smtp.mailfrom=rsheppar AT iu.edu; dkim=pass header.s=iu header.d=iu.edu; dkim=pass header.s=selector2-indiana-onmicrosoft-com header.d=indiana.onmicrosoft.com
Authentication-results: cs.illinois.edu; dkim=none (message not signed) header.d=none;cs.illinois.edu; dmarc=none action=none header.from=iu.edu;
Ironport-sdr: LceKmKVKINWEM4iNqJNpL1Qz5fZ6tfPMxBz88s7B6Cg63sZNLWyV5YquvB5PeCwDKtEr2MCFEb P5/aPXiP3f41z3xj2+tB1FtruyWSUSRY4CHvpUl7hJad5eQjqRDqSJCULnxsQUYRjqd5WWPYsm mmD7F394LpF/aSUSiimh87HS6UAqUmyCxf53SVFeiCWqHbsPlVfsI2HT2N4bbOUdiRmd8ZBT5Z WI8Ht/mKNj7d5b1RfI2uefeXvXTD8JBK0Sfjs3pbCupNHf3xlfSLR1uRAfh1C+vErCNMUnbsg1 UdI=

Hi,
I am lost. We are building a new Cray (HPE) system. Software wise, it
looks like a Cray (PrgEnv-accc, cray-mpich is preferred).
However it is made of those new AMD chips (128 cores on a node in co-located
pairs of 64 with a shared memory access penalty between pairs). There is no
GNI. OpenFabrics is the default and UDP can be sort of made to work. I think
I need something in between:

./build charm++ mpi-linux-x86_64 mpicxx --with-production

and

./build charm++ mpi-linux-x86_64 craycc --with-production

I've tried a lot of other crazy stuff (like pretending it is an XC40,
renaming compiler env vars, etc.), but no luck yet. I keep thinking I can
pull pieces out of one file to fill in another, but I have not hit the magic
combination. Any help appreciated. Thanks.
Ray

[charm] Need help building on a hybrid system., Sheppard, Raymond W, 07/23/2021
- Re: [charm] Need help building on a hybrid system., Sheppard, Raymond W, 07/24/2021
  - Re: [charm] Need help building on a hybrid system., Bohm, Eric J, 07/29/2021