Charm++ parallel programming system

[Abhishek Gupta <gupta59 AT illinois.edu>]

As Chao said in the previous email, that for infiniband network it is better to build charm++ with 
"./build net-linux-x86_64 smp ibverbs --with-production" 

Note the ibverbs flag in the build line. Did you use that?

Thanks,
Abhishek

On Sat, Mar 24, 2012 at 6:17 PM, Shad Kirmani <sxk5292 AT cse.psu.edu> wrote:

Hello Abhishek,

I was able to compile and run my code using net-linux-x86_64 but it instead gives 3-times worse performance than mpi-linux-x86_64. The cluster I am using has an infiniband network. What I might be doing wrong?

Thanks,

Shad

On Fri, Mar 9, 2012 at 9:08 PM, Abhishek Gupta <gupta59 AT illinois.edu> wrote:

Hi Shad,

Is there a particular reason why you are trying to use mpi-linux instead of net-linux. In general, I would recommend that you use net-linux since it has better performance compared to mpi-linux. You can use the following command for building:

./build charm++ net-linux-x86_64 smp

Also, please tell the command that you are using to run your program. For SMP version, you need to specify a
+ppn workerThreadPerNode  runtime argument . You should leave one core for communication thread.e.g for 16 core node, you can use +ppn 15 to specify 15 worker threads per node.

Thanks,

Abhishek

On Fri, Mar 9, 2012 at 7:48 PM, Shad Kirmani <sxk5292 AT cse.psu.edu> wrote:

Hello,

I am trying to build charm++ with SMP support. My machine specifications are:

[sxk5292@cyberstar84 test]$ uname -a

Linux cyberstar84.hpc.rcc.psu.edu 2.6.18-274.7.1.el5 #1 SMP Mon Oct 17 11:57:14 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux

Please also visit http://www.ics.psu.edu/infrast/specs.html for more detailed specifications.

To build charm++, I chose the version mpi-linux-x86_64 with smp option set. 

When I run my code I get the following output from charm++:

[sxk5292@cyberstar84 test]$ ./pbsall.sh 

Charm++> Running on MPI version: 2.1

Charm++> level of thread support used: MPI_THREAD_SINGLE (desired: MPI_THREAD_FUNNELED)

Charm++> Running on SMP mode, 1 worker threads per process

Charm++> The comm. thread both sends and receives messages

Converse/Charm++ Commit ID: v6.3.0-1293-g7f245d0

Warning> Randomization of stack pointer is turned on in kernel.

------------- Processor 14 Exiting: Caught Signal ------------

Signal: 11

------------- Processor 49 Exiting: Caught Signal ------------

Signal: 11

--------------------------------------------------------------------------

mpirun noticed that process rank 14 with PID 21394 on node cyberstar83 exited on signal 11 (Segmentation fault).

--------------------------------------------------------------------------

...

...

I have tried building charm++ with the following command line arguments:

./build charm++ mpi-linux-x86_64 smp 

and

./build charm++ mpi-linux-x86_64 smp -DCMK_SMP=1 -DCMK_MPI_INIT_THREAD=1

Can anybody please help with the command line arguments to build charm++.

Thanks,

Shad

_______________________________________________
charm mailing list
charm AT cs.uiuc.edu
http://lists.cs.uiuc.edu/mailman/listinfo/charm

_______________________________________________
ppl mailing list
ppl AT cs.uiuc.edu
http://lists.cs.uiuc.edu/mailman/listinfo/ppl