Charm++ parallel programming system

["Van Der Wijngaart, Rob F" <rob.f.van.der.wijngaart AT intel.com>]

Very good, thanks, Jeff and Phil!

 

Rob

 

From: Jeff Hammond [mailto:jeff.science AT gmail.com]
Sent: Tuesday, September 02, 2014 6:34 PM
To: Phil Miller
Cc: Van Der Wijngaart, Rob F; charm AT cs.illinois.edu
Subject: Re: [charm] Problem building charm++ on Intel platform

 

Rob,

 

Luster isn't a posix compliant filesystem afaik and my guess is that you are hitting a weak coherency issue. Compiling in /tmp and then installing in /home etc is the way to go. 

 

Best,

 

Jeff

On Tuesday, September 2, 2014, Phil Miller <mille121 AT illinois.edu> wrote:

On Tue, Sep 2, 2014 at 5:49 PM, Van Der Wijngaart, Rob F <rob.f.van.der.wijngaart AT intel.com> wrote:

Hi Phil, another quick question: If I install Charm++ in /tmp on a node in my cluster, it won’t be visible on other nodes. Is that going to bite me? Thanks.

 

The default build process generates static binaries and library archives (libfoo.a) of the various components of Charm++. These components, and applications linked against them, should have no runtime dependence on the build tree.

When running the code, you may need to copy the application executable itself and the 'charmrun' binary to a parallel filesystem visible to the compute nodes and the head node, respectively.

 

 

Rob

 

From: unmobile AT gmail.com [mailto:unmobile AT gmail.com] On Behalf Of Phil Miller
Sent: Tuesday, September 02, 2014 2:59 PM
To: Van Der Wijngaart, Rob F
Cc: charm AT cs.illinois.edu
Subject: Re: [charm] Problem building charm++ on Intel platform

 

Could you try your build on a local filesystem (perhaps /tmp) or one hosted on NFS rather than Lustre?

 

On Tue, Sep 2, 2014 at 3:00 PM, Van Der Wijngaart, Rob F <rob.f.van.der.wijngaart AT intel.com> wrote:

Dear Charm++ developers,

 

I tried to build Charm++ on a standard Intel Xeon platform with the following command:

./build charm++ mpi-linux-x86_64 ifort mpicxx

Ifort and mpicxx are both installed, and on my path. However, the build always fails in the following way (complete output follows; I’m highlighting the error).

Can you tell me how to resolve this issue? Thanks!

 

Regards,

Rob

 

find . -type l -exec rm {} \;

rm -rf QuickThreads

rm -rf libs

rm -rf ../bin ; mkdir ../bin

rm -rf ../lib ; mkdir ../lib

rm -rf ../lib_so ; mkdir ../lib_so; touch ../lib_so/.charmso

rm -rf ../examples

rm -rf ../tests

rm -rf ../doc ; ln -s ../doc ../doc

../../src/scripts/gatherflat ../../src/scripts .

./gatherflat ../../src/conv-core        .

./gatherflat ../../src/conv-ldb         .

./gatherflat ../../src/conv-ccs         .

./gatherflat ../../src/conv-perf        .

./gatherflat ../../src/ck-core          .

./gatherflat ../../src/util             .

./gatherflat ../../src/ck-perf          .

./gatherflat ../../src/ck-ldb           .

./gatherflat ../../src/ck-com           .

./gatherflat ../../src/ck-cp            .

./gatherflat ../../src/conv-com         .

./gatherflat ../../src/langs/simplemsg  .

./gatherflat ../../src/langs/pvmc       .

./gatherflat ../../src/langs/bluegene   .

./gatherflat ../../src/langs/f90charm   .

./gatherflat ../../src/xlat-i           .

./gatherflat ../../src/xlatcpm          .

./gathertree ../../src/QuickThreads     QuickThreads

./gathertree ../../src/libs             libs

./gathertree ../../src/arch/util        .

./gathertree ../../src/langs            langs

./gathertree ../../src/langs/jade       langs/jade

./gathertree ../../src/arch/common      .

./gathertree ../../src/arch/`cat .gdir` .

test -f ../../src/arch/`cat .gdir`/gdir_link && cat ../../src/arch/`cat .gdir`/gdir_link > .gdir.new && ./gathertree ../../src/arch/`cat .gdir.new`      . || true

./gatherflat ../../src/arch/`cat .vdir` .

./gathertree ../../examples             ../examples

./gathertree ../../tests                ../tests

rm -f ../bin/dep.pl ; cp dep.pl ../bin/

chmod +x charmc

./system_ln  ../tmp/charmc ../bin/

rm -rf ../include ; mkdir ../include

./system_ln  ../tmp/conv-*.*h ../include

./system_ln  ../tmp/cc-*.*h ../include

./system_ln  ../tmp/conv-mach-opt.sh ../include

if [ -x ./special.sh ] ; then ./special.sh ; fi

if [ ! -f conv-common.h ] ; then ( touch conv-common.h ) ; fi

touch dirs+sources

/usr/bin/gmake charmxi

gmake[1]: Entering directory `/lustre/home/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp'

Makefile:1144: Variable OPTS is defined to an empty string. Are you sure this is what you want?

./configure

Error checking is enabled

Statistics collection is enabled

Charm tracing is enabled

Charm tracing communication thread is disabled

CharmDebug is enabled

Charm record/replay is enabled

CCS is enabled

Charm control point is enabled

Setting load balancing timer type as 'double'

checking machine name... mpi-linux-x86_64-ifort-mpicxx

checking "cp command as"... cp -p

checking "C++ compiler as"... "mpicxx -m64 -fPIC      "

checking "whether C++ compiler works"... "ok"

checking "C++ linker as"... "mpicxx -m64 -fPIC      "

checking "whether linker works"... "ok"

checking "Native C++ compiler as"... "g++ -m64 -fPIC "

checking "Sequential C++ compiler as"... "mpicxx -m64 -fPIC "

checking "whether compiler accept -fno-stack-protector"... "ok"

Setting charm++ envelope refnum field to unsigned short

Configuring support for message priorities of arbitrary size (bitvectors)

checking "whether compiler generates code for 64-bit"... "yes"

checking "whether has strings.h "... "yes"

checking "whether has values.h "... "yes"

checking "whether has stdint.h "... "yes"

checking "whether has malloc.h "... "yes"

checking "whether has alloca.h "... "yes"

checking "whether has regex.h "... "yes"

checking "whether C++ bool works"... "ok"

checking "whether long long works"... "yes"

checking "whether __int64 works"... "no"

checking "whether __int128 (128-bit integer) works"... "yes"

checking "whether __int128_t (128-bit integer) works"... "yes"

checking "whether long double works"... "yes"

checking "whether ucontext has FPU pointer"... "yes"

checking "whether ucontext uses uc_regs"... "no"

checking "whether ucontext has pointer (v_regs) of vector type"... "no"

checking "whether ibverbs ibv_port_attr has link_layer field"... "yes"

checking "whether inline works in C"... "yes"

checking "whether C++ class explicit keyword works"... "ok"

checking "whether C++ signed char and char differ"... "yes"

checking "whether C++ *_casts<> work"... "ok"

checking "whether C++ allows declaration of varsize array"... "yes"

checking "whether namespaces work"... "ok"

checking "whether typeinfo/typeid works"... "ok"

checking "whether std::iterator_traits is defined"... "ok"

checking "whether std::distance is defined"... "ok"

checking "whether std::inserter is defined"... "ok"

checking "whether std::unordered_map is defined"... "no"

checking "whether anon structs are permitted"... "yes"

checking "whether operator delete can be overloaded in same class"... "ok"

checking "whether offsetof is defined"... "yes"

checking "whether GCC x86 assembly works"... "yes"

checking "whether GCC x86 assembly for atomic increment works"... "yes"

checking "whether GCC IA64 assembly works"... "no"

checking "whether asm eieio assembly works"... "no"

checking "whether __thread (Thread Local Storage) is supported"... "yes"

checking "whether synchronization primitives (__sync_add_and_fetch) works in C"... "yes"

checking "whether synchronization primitives (__sync_synchronize) works in C"... "yes"

checking "whether fence intrinsic primitives (__builtin_Xfence_ia32) works in C"... "no"

checking "whether switching TLS register (64-bit) is supported"... "yes"

checking "whether build on MPI"... "yes"

checking "whether need to specify MPI library"... "no"

checking "whether MPI_Init_thread is supported"... "yes"

checking "whether getrusage accepts RUSAGE_THREAD"... "yes"

checking "whether has asctime"... "yes"

checking "whether has log2"... "yes"

checking "whether has sqrtf"... "yes"

checking "whether has fabsf"... "yes"

checking "whether has mkstemp"... "yes"

checking "whether has system"... "yes"

checking "whether has sync()"... "yes"

checking "whether has sbrk"... "yes"

checking "whether has _setjmp/_longjmp"... "yes"

checking "whether has mstats"... "no"

checking "whether has mallinfo"... "yes"

checking "whether has popen"... "yes"

checking "whether has poll"... "yes"

checking "whether has getpagesize"... "yes"

checking "whether has getpid"... "yes"

checking "whether has kill"... "yes"

checking "whether has setpriority"... "yes"

checking "whether to use signal-safe system() "... "no"

checking "whether sched_setaffinity call exists"... "yes"

checking "whether pthread_setaffinity_np call exists"... "yes"

checking "whether pthread_spin_lock exists"... "yes"

checking "whether bindprocessor call exists"... "no"

checking "whether dlopen links without -ldl"... "yes"

checking "whether dlopen links with -ldl"... "yes"

checking "whether gethostname call exists"... "yes"

checking "whether getProcAddress works"... "no"

checking "whether has socklen_t"... "yes"

checking "whether getifaddrs call exists"... "yes"

checking "whether the mmap() syscall exists"... "yes"

checking "whether mmap() accepts MAP_ANON"... "yes"

checking "whether mmap() accepts MAP_NORESERVE"... "yes"

checking "whether has get_myaddress"... "yes"

checking "whether has mprotect"... "yes"

checking "whether glibc backtrace works"... "yes"

checking "whether has sleep "... "yes"

checking "whether has usleep "... "yes"

checking "whether personality() and ADDR_NO_RANDOMIZE exist"... "yes"

checking "whether has zlib"... "yes"

checking "whether has elf.h "... "yes"

checking "whether has Multiprocessing.h for Apple "... "no"

checking "whether ntohl is available"... "yes"

checking "whether has libjpeg"... "no"

checking "whether Python is installed"... "yes"

checking "whether can build shared library"... "yes"

checking "whether can build shared library with MPI"... "yes"

checking for sync... sync

checking "F77 compiler as"... "ifort -auto -fpic "

checking "whether Fortran 77 compiler works"... "yes"

checking "F90 compiler as"... "ifort -auto -fpic "

checking "whether Fortran 90 compiler works"... "yes"

checking subroutine name used by Fortran 90 compiler... ONESCORE

checking Fortran 90 mod name is capital... "no"

checking Fortran 90 mod name extension... "mod"

configure: creating ./config.status

config.status: creating libs/ck-libs/ampi/ampiCC

config.status: creating libs/ck-libs/ampi/ampirun

config.status: creating conv-autoconfig.h

config.status: executing default commands

../bin/charmc -host  xi-main.C

gmake[1]: execvp: ../bin/charmc: Text file busy

gmake[1]: *** [xi-main.o] Error 127

gmake[1]: Leaving directory `/lustre/home/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp'

gmake: *** [headers] Error 2

-------------------------------------------------

Charm++ NOT BUILT. Either cd into mpi-linux-x86_64-ifort-mpicxx/tmp and try

to resolve the problems yourself, visit

http://charm.cs.illinois.edu/

for more information. Otherwise, email the developers at charm AT cs.illinois.edu

_______________________________________________
charm mailing list
charm AT cs.uiuc.edu
http://lists.cs.uiuc.edu/mailman/listinfo/charm

 

 

--
Jeff Hammond
jeff.science AT gmail.com
http://jeffhammond.github.io/