charm AT lists.cs.illinois.edu

Subject: Charm++ parallel programming system

List archive

Re: [charm] [EXTERNAL] Re: Segfault from TreeLB::loadConfigFile()?

From: Ronak Buch <rabuch2 AT illinois.edu>
To: Jozsef Bakosi <jbakosi AT lanl.gov>
Cc: "charm AT lists.cs.illinois.edu" <charm AT lists.cs.illinois.edu>
Subject: Re: [charm] [EXTERNAL] Re: Segfault from TreeLB::loadConfigFile()?
Date: Sat, 23 Oct 2021 14:00:36 -0400
Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=illinois.edu; dmarc=pass action=none header.from=illinois.edu; dkim=pass header.d=illinois.edu; arc=none
Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=H3aWfHJ2mHdYUHvs2qRP03+Uy2idYZ0hBFYz76Vwqew=; b=NlyMtM03PPRqWtgduQgDBRtrVHcHAIWspRoKjJEsUnnGn1GIRXAMDKE2vJ9GOTvO00lSsqrdSZLV4eNPqKak2KPNvnMdsMk0mVprn5d5GaUKT4b73QWSO7Gx5l9jH43Yv8oFTDGojmDSn0I+ImKEKnp1HwKEPX9KyGx3xCIS/igewDNS/OPtnGOGPyGENVwIsMpzt1xgp6M6XBQ2NrW5ogW7rS274Iew2y5cbQDl3nytJdzSrPC5seRihBxMPV1+Od344C8T93E0FjckGAqB+BvZ6XnVuIVrvKQKlCXrku5fKQ7n+fQLd9pDYgPGzZ+qGturzor5AYDlI317ZjRC7g==
Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=UAHTd9gRZLX9iUdRer6AmUGgmp3BaIZo1z5CbyatwOHBOFydJ6IbpbiWupfiLXWzVV0ScpqnrRjD3ZANpDJNWT+KsrdntbTEhz/Serlc4X0bKcXGv4qUMkuVqIlDOxu6ljlkZfqg2aLBhhQdNomCBQdDCw0yuQOII32LkebBjLno5iFVbSLcLaACHOQlIZXTbOqyymMwNu5W92DJz7ftJkf9r9sUaCkR7ln96d2N+wsNZQZQPKEj033joEVO0CALLbcSlxfdaYyqanJBdUv0G2CJ+z7LtClctMmYoXtpyIid2DwIO5f9d3w1lqZNrhIedX7ef14FLvnQGenKc2E6rQ==
Authentication-results: ppops.net; spf=softfail smtp.mailfrom=rabuch2 AT illinois.edu; dkim=pass header.s=selector2-uillinoisedu-onmicrosoft-com header.d=uillinoisedu.onmicrosoft.com
Authentication-results: lanl.gov; dkim=none (message not signed) header.d=none;lanl.gov; dmarc=none action=none header.from=illinois.edu;

I've been unable to reproduce this, I've tried both netlrts and MPI builds, running both Charm++ example programs and Quinoa with the command line you've given, with and without Docker. Are you still seeing these segfaults? Do you have any other ideas as to how to reproduce this?

On 9/27/21 18:16, Jozsef Bakosi wrote:

The command line is

$ mpirun -n 4 --bind-to none -oversubscribe
/home/quinoa/quinoa/build/Main/inciter -c slot_cyl_cfl_diagcg.q -i
unitsquare_01_3.6k.exo -v -l 10 -u 0.9 +balancer RandCentLB +LBDebug 1 +cs

The -u 0.9 means we do overdecomposition.

Thanks, Ronak
Jozsef

On 09.27.2021 22:07, Buch, Ronak Akshay wrote:

I haven't seen this before, but I'll investigate. What's your full command
line?

On Sep 27, 2021 16:02, Jozsef Bakosi
<jbakosi AT lanl.gov>
wrote:
Hi folks,

I'm running into a segfault, apparently from TreeLB::loadConfigFile() ,
only in a docker container:

------------- Processor 1 Exiting: Caught Signal ------------
Reason: Segmentation fault
[1] Stack Traceback:
[1:1] libpthread.so.0 0x7f00d55db730
[1:2] libc.so.6 0x7f00d55641a7
[1:3] inciter 0x5557cb625af7
[1:4] inciter 0x5557cb6295cc TreeLB::loadConfigFile(CkLBOptions const&)
[1:5] inciter 0x5557cb652017 TreeLB::TreeLB(CkLBOptions const&)
[1:6] inciter 0x5557cb62a36b CkIndex_TreeLB::_call_TreeLB_marshall1(void*,
void*)

That's all I have as a trace. This is with v7.0.0-rc1. This only happens
with LB on, using RandCentLB.

Does anyone have an idea what might go wrong and what other info you
need.

Thanks,
Jozsef

Re: [charm] [EXTERNAL] Re: Segfault from TreeLB::loadConfigFile()?, Ronak Buch, 10/23/2021
- Re: [charm] [EXTERNAL] Re: Segfault from TreeLB::loadConfigFile()?, Jozsef Bakosi, 10/29/2021