charm AT lists.cs.illinois.edu

Subject: Charm++ parallel programming system

List archive

Re: [charm] Need help building on a hybrid system.

From: "Sheppard, Raymond W" <rsheppar AT iu.edu>
To: "charm AT cs.illinois.edu" <charm AT cs.illinois.edu>
Subject: Re: [charm] Need help building on a hybrid system.
Date: Sat, 24 Jul 2021 06:59:28 +0000
Accept-language: en-US
Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=iu.edu; dmarc=pass action=none header.from=iu.edu; dkim=pass header.d=iu.edu; arc=none
Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7ljaOCNAWydzm8yUkpgDp4ygm/aHOSqvyLdyBTXpE4E=; b=UTAoGVqGiLeUtN21uCX65tmXoG4fwC0m75DwiYf4lruHwoJ3iwCJKZWlRTMuUR7Uqc3c2XwzFqN2Rwr+bjH5karti+KI7Hc5IKf/5rujOHVBgWWefIw/EeBr3Kqiri+5aZVOn8zYQMBPztLcHEhiYlmAoD9/zOvmKKKVkd8ZO5E7RlJtrhuqBFH+/WUK+kXA23TnnKXVHxaCvS3tyEAUk0kw5c9ERM9SZnb2Lro3ZQX6BYuhOeFCIxxUFm8Npqpp4xuy7iSH9Qufj07X6XJy3Uag7j6jx0/WUAiHzE4affE6DEBSRHF+igTbklrUeQMmZDSw3nMp6OLkc5hK09IJ2g==
Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=iMLA82oGuA6+W2jyjpNTWjyiupJDkzvgQQ/Q3ZlvZs3Jnn2sSJ3bGOU1BV36D8HYlmNJVRRelCTqsZ3HB456LtBEBRYuhXooGeZG7jopLUjkI7WcnWBKW30Fcm+6PKsQdAMEjjmSd7laAmpv3O8vpLvWMTThtANlWZ+RydC9zS6Autb7wfX9eXWwE6ztNZwVSGvXX1dO+aLN4nG6dblUCj83kpjV/izGb5HD79AEQc2dlvGYNXsK4xvPcShzJEcsYDNkzQAupe9ZgETZfltHjjx2KKIqFBxcZoFic2On0NHZBoUGEgup+U6JcNAHZ8WcyHwGNmFf9FFApdK5mimbzQ==
Authentication-results: ppops.net; spf=neutral smtp.mailfrom=rsheppar AT iu.edu; dkim=pass header.s=iu header.d=iu.edu; dkim=pass header.s=selector2-indiana-onmicrosoft-com header.d=indiana.onmicrosoft.com
Authentication-results: cs.illinois.edu; dkim=none (message not signed) header.d=none;cs.illinois.edu; dmarc=none action=none header.from=iu.edu;
Ironport-sdr: hHi8K7gCpg4KS+UVAgkzZveUjyEZFoKbnosM2XnfsXFvNM6RazkaNblhpgCn4XGLwC1rA9+j4g s7n+GB8M/YQ7aRUHCrH3Pq/LjWVXI9Q/zN/9FnbCl3Y2KvkUwT58YeIsEgw+o3GurwDyNalavx +MLtDqLsuFVgnqJW6XRMNPIdfsyZ9SUFlsrDlyywlGJXlOkQPyFHuhqYIXpTaaYK9Jh/8A6uYB oZNlSaGA4bKM16E0ZMRUupKYresNo1hkWYXfJzDailg5nLPsKWMyoPxSHJZIj835G7XeboSe+c A4I=

Hello again,
Just a follow up of things I omitted that may be helpful. The system is
running SLES-15 and my module list looks like this:

rsheppar@login1:/N/soft/sles15/namd/build/namd_july_2021./charm-6.10.2/src/arch>
module list

Currently Loaded Modules:
1) aocc/2.2.0.1 3) craype-x86-rome/1.0.0 5) craype-network-ofi 7)
perftools-base/21.05.0 9) cray-libsci/21.05.1.1
2) craype/2.7.7 4) libfabric/1.11.0.3.71 6) cray-dsmml/0.1.5 8)
cray-mpich/8.1.5 10) PrgEnv-aocc/8.0.0

Thanks in advance for any help building here.
Ray

________________________________________
From: Sheppard, Raymond W
<rsheppar AT iu.edu>
Sent: Friday, July 23, 2021 12:21 PM
To:
charm AT cs.illinois.edu
Subject: Need help building on a hybrid system.

Hi,
I am lost. We are building a new Cray (HPE) system. Software wise, it
looks like a Cray (PrgEnv-accc, cray-mpich is preferred).
However it is made of those new AMD chips (128 cores on a node in co-located
pairs of 64 with a shared memory access penalty between pairs). There is no
GNI. OpenFabrics is the default and UDP can be sort of made to work. I think
I need something in between:

./build charm++ mpi-linux-x86_64 mpicxx --with-production

and

./build charm++ mpi-linux-x86_64 craycc --with-production

I've tried a lot of other crazy stuff (like pretending it is an XC40,
renaming compiler env vars, etc.), but no luck yet. I keep thinking I can
pull pieces out of one file to fill in another, but I have not hit the magic
combination. Any help appreciated. Thanks.
Ray

[charm] Need help building on a hybrid system., Sheppard, Raymond W, 07/23/2021
- Re: [charm] Need help building on a hybrid system., Sheppard, Raymond W, 07/24/2021
  - Re: [charm] Need help building on a hybrid system., Bohm, Eric J, 07/29/2021