Charm++ parallel programming system

["Van Der Wijngaart, Rob F" <rob.f.van.der.wijngaart AT intel.com>]

OK, I built in /tmp and got a lot further, but the build still breaks, see attached complete output. I am inserting the last few lines resulting from this command:

./build charm++ mpi-linux-x86_64 ifort mpicxx

I can go into mpi-interoperate,{C,h} and try to fix things, but am wondering if you have run into this before. Thanks!

 

Rob

 

../bin/charmc   -c -I. cktiming.C

../bin/charmc   -c -I. ckbitvector.C

../bin/charmc   -c -I. pathHistory.C

../bin/charmc   -c -I. controlPoints.C

../bin/charmc   -c -I. arrayRedistributor.C

../bin/charmc   -c -I. cp_effects.C

../bin/charmc   -c -I. trace-controlPoints.C

../bin/charmc   -c -I. mpi-interoperate.C

In file included from /opt/intel//impi/4.1.1.036/intel64/include/mpi.h:1279:0,

                 from mpi-interoperate.h:9,

                 from mpi-interoperate.C:3:

/opt/intel//impi/4.1.1.036/intel64/include/mpicxx.h:95:2: error: #error "SEEK_SET is #defined but must not be for the C++ binding of MPI. Include mpi.h before stdio.h"

#error "SEEK_SET is #defined but must not be for the C++ binding of MPI. Include mpi.h before stdio.h"

  ^

/opt/intel//impi/4.1.1.036/intel64/include/mpicxx.h:99:2: error: #error "SEEK_CUR is #defined but must not be for the C++ binding of MPI. Include mpi.h before stdio.h"

#error "SEEK_CUR is #defined but must not be for the C++ binding of MPI. Include mpi.h before stdio.h"

  ^

/opt/intel//impi/4.1.1.036/intel64/include/mpicxx.h:104:2: error: #error "SEEK_END is #defined but must not be for the C++ binding of MPI. Include mpi.h before stdio.h"

#error "SEEK_END is #defined but must not be for the C++ binding of MPI. Include mpi.h before stdio.h"

  ^

Fatal Error by charmc in directory /tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp

   Command mpicxx -m64 -fPIC -I../bin/../include -D__CHARMC__=1 -I. -fno-stack-protector -c mpi-interoperate.C -o mpi-interoperate.o returned error code 1

charmc exiting...

gmake: *** [mpi-interoperate.o] Error 1

-------------------------------------------------

Charm++ NOT BUILT. Either cd into mpi-linux-x86_64-ifort-mpicxx/tmp and try

to resolve the problems yourself, visit

http://charm.cs.illinois.edu/

for more information. Otherwise, email the developers at charm AT cs.illinois.edu

 

From: Jeff Hammond [mailto:jeff.science AT gmail.com]
Sent: Tuesday, September 02, 2014 6:34 PM
To: Phil Miller
Cc: Van Der Wijngaart, Rob F; charm AT cs.illinois.edu
Subject: Re: [charm] Problem building charm++ on Intel platform

 

Rob,

 

Luster isn't a posix compliant filesystem afaik and my guess is that you are hitting a weak coherency issue. Compiling in /tmp and then installing in /home etc is the way to go. 

 

Best,

 

Jeff

On Tuesday, September 2, 2014, Phil Miller <mille121 AT illinois.edu> wrote:

On Tue, Sep 2, 2014 at 5:49 PM, Van Der Wijngaart, Rob F <rob.f.van.der.wijngaart AT intel.com> wrote:

Hi Phil, another quick question: If I install Charm++ in /tmp on a node in my cluster, it won’t be visible on other nodes. Is that going to bite me? Thanks.

 

The default build process generates static binaries and library archives (libfoo.a) of the various components of Charm++. These components, and applications linked against them, should have no runtime dependence on the build tree.

When running the code, you may need to copy the application executable itself and the 'charmrun' binary to a parallel filesystem visible to the compute nodes and the head node, respectively.

 

 

Rob

 

From: unmobile AT gmail.com [mailto:unmobile AT gmail.com] On Behalf Of Phil Miller
Sent: Tuesday, September 02, 2014 2:59 PM
To: Van Der Wijngaart, Rob F
Cc: charm AT cs.illinois.edu
Subject: Re: [charm] Problem building charm++ on Intel platform

 

Could you try your build on a local filesystem (perhaps /tmp) or one hosted on NFS rather than Lustre?

 

On Tue, Sep 2, 2014 at 3:00 PM, Van Der Wijngaart, Rob F <rob.f.van.der.wijngaart AT intel.com> wrote:

Dear Charm++ developers,

 

I tried to build Charm++ on a standard Intel Xeon platform with the following command:

./build charm++ mpi-linux-x86_64 ifort mpicxx

Ifort and mpicxx are both installed, and on my path. However, the build always fails in the following way (complete output follows; I’m highlighting the error).

Can you tell me how to resolve this issue? Thanks!

 

Regards,

Rob

 

find . -type l -exec rm {} \;

rm -rf QuickThreads

rm -rf libs

rm -rf ../bin ; mkdir ../bin

rm -rf ../lib ; mkdir ../lib

rm -rf ../lib_so ; mkdir ../lib_so; touch ../lib_so/.charmso

rm -rf ../examples

rm -rf ../tests

rm -rf ../doc ; ln -s ../doc ../doc

../../src/scripts/gatherflat ../../src/scripts .

./gatherflat ../../src/conv-core        .

./gatherflat ../../src/conv-ldb         .

./gatherflat ../../src/conv-ccs         .

./gatherflat ../../src/conv-perf        .

./gatherflat ../../src/ck-core          .

./gatherflat ../../src/util             .

./gatherflat ../../src/ck-perf          .

./gatherflat ../../src/ck-ldb           .

./gatherflat ../../src/ck-com           .

./gatherflat ../../src/ck-cp            .

./gatherflat ../../src/conv-com         .

./gatherflat ../../src/langs/simplemsg  .

./gatherflat ../../src/langs/pvmc       .

./gatherflat ../../src/langs/bluegene   .

./gatherflat ../../src/langs/f90charm   .

./gatherflat ../../src/xlat-i           .

./gatherflat ../../src/xlatcpm          .

./gathertree ../../src/QuickThreads     QuickThreads

./gathertree ../../src/libs             libs

./gathertree ../../src/arch/util        .

./gathertree ../../src/langs            langs

./gathertree ../../src/langs/jade       langs/jade

./gathertree ../../src/arch/common      .

./gathertree ../../src/arch/`cat .gdir` .

test -f ../../src/arch/`cat .gdir`/gdir_link && cat ../../src/arch/`cat .gdir`/gdir_link > .gdir.new && ./gathertree ../../src/arch/`cat .gdir.new`      . || true

./gatherflat ../../src/arch/`cat .vdir` .

./gathertree ../../examples             ../examples

./gathertree ../../tests                ../tests

rm -f ../bin/dep.pl ; cp dep.pl ../bin/

chmod +x charmc

./system_ln  ../tmp/charmc ../bin/

rm -rf ../include ; mkdir ../include

./system_ln  ../tmp/conv-*.*h ../include

./system_ln  ../tmp/cc-*.*h ../include

./system_ln  ../tmp/conv-mach-opt.sh ../include

if [ -x ./special.sh ] ; then ./special.sh ; fi

if [ ! -f conv-common.h ] ; then ( touch conv-common.h ) ; fi

touch dirs+sources

/usr/bin/gmake charmxi

gmake[1]: Entering directory `/lustre/home/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp'

Makefile:1144: Variable OPTS is defined to an empty string. Are you sure this is what you want?

./configure

Error checking is enabled

Statistics collection is enabled

Charm tracing is enabled

Charm tracing communication thread is disabled

CharmDebug is enabled

Charm record/replay is enabled

CCS is enabled

Charm control point is enabled

Setting load balancing timer type as 'double'

checking machine name... mpi-linux-x86_64-ifort-mpicxx

checking "cp command as"... cp -p

checking "C++ compiler as"... "mpicxx -m64 -fPIC      "

checking "whether C++ compiler works"... "ok"

checking "C++ linker as"... "mpicxx -m64 -fPIC      "

checking "whether linker works"... "ok"

checking "Native C++ compiler as"... "g++ -m64 -fPIC "

checking "Sequential C++ compiler as"... "mpicxx -m64 -fPIC "

checking "whether compiler accept -fno-stack-protector"... "ok"

Setting charm++ envelope refnum field to unsigned short

Configuring support for message priorities of arbitrary size (bitvectors)

checking "whether compiler generates code for 64-bit"... "yes"

checking "whether has strings.h "... "yes"

checking "whether has values.h "... "yes"

checking "whether has stdint.h "... "yes"

checking "whether has malloc.h "... "yes"

checking "whether has alloca.h "... "yes"

checking "whether has regex.h "... "yes"

checking "whether C++ bool works"... "ok"

checking "whether long long works"... "yes"

checking "whether __int64 works"... "no"

checking "whether __int128 (128-bit integer) works"... "yes"

checking "whether __int128_t (128-bit integer) works"... "yes"

checking "whether long double works"... "yes"

checking "whether ucontext has FPU pointer"... "yes"

checking "whether ucontext uses uc_regs"... "no"

checking "whether ucontext has pointer (v_regs) of vector type"... "no"

checking "whether ibverbs ibv_port_attr has link_layer field"... "yes"

checking "whether inline works in C"... "yes"

checking "whether C++ class explicit keyword works"... "ok"

checking "whether C++ signed char and char differ"... "yes"

checking "whether C++ *_casts<> work"... "ok"

checking "whether C++ allows declaration of varsize array"... "yes"

checking "whether namespaces work"... "ok"

checking "whether typeinfo/typeid works"... "ok"

checking "whether std::iterator_traits is defined"... "ok"

checking "whether std::distance is defined"... "ok"

checking "whether std::inserter is defined"... "ok"

checking "whether std::unordered_map is defined"... "no"

checking "whether anon structs are permitted"... "yes"

checking "whether operator delete can be overloaded in same class"... "ok"

checking "whether offsetof is defined"... "yes"

checking "whether GCC x86 assembly works"... "yes"

checking "whether GCC x86 assembly for atomic increment works"... "yes"

checking "whether GCC IA64 assembly works"... "no"

checking "whether asm eieio assembly works"... "no"

checking "whether __thread (Thread Local Storage) is supported"... "yes"

checking "whether synchronization primitives (__sync_add_and_fetch) works in C"... "yes"

checking "whether synchronization primitives (__sync_synchronize) works in C"... "yes"

checking "whether fence intrinsic primitives (__builtin_Xfence_ia32) works in C"... "no"

checking "whether switching TLS register (64-bit) is supported"... "yes"

checking "whether build on MPI"... "yes"

checking "whether need to specify MPI library"... "no"

checking "whether MPI_Init_thread is supported"... "yes"

checking "whether getrusage accepts RUSAGE_THREAD"... "yes"

checking "whether has asctime"... "yes"

checking "whether has log2"... "yes"

checking "whether has sqrtf"... "yes"

checking "whether has fabsf"... "yes"

checking "whether has mkstemp"... "yes"

checking "whether has system"... "yes"

checking "whether has sync()"... "yes"

checking "whether has sbrk"... "yes"

checking "whether has _setjmp/_longjmp"... "yes"

checking "whether has mstats"... "no"

checking "whether has mallinfo"... "yes"

checking "whether has popen"... "yes"

checking "whether has poll"... "yes"

checking "whether has getpagesize"... "yes"

checking "whether has getpid"... "yes"

checking "whether has kill"... "yes"

checking "whether has setpriority"... "yes"

checking "whether to use signal-safe system() "... "no"

checking "whether sched_setaffinity call exists"... "yes"

checking "whether pthread_setaffinity_np call exists"... "yes"

checking "whether pthread_spin_lock exists"... "yes"

checking "whether bindprocessor call exists"... "no"

checking "whether dlopen links without -ldl"... "yes"

checking "whether dlopen links with -ldl"... "yes"

checking "whether gethostname call exists"... "yes"

checking "whether getProcAddress works"... "no"

checking "whether has socklen_t"... "yes"

checking "whether getifaddrs call exists"... "yes"

checking "whether the mmap() syscall exists"... "yes"

checking "whether mmap() accepts MAP_ANON"... "yes"

checking "whether mmap() accepts MAP_NORESERVE"... "yes"

checking "whether has get_myaddress"... "yes"

checking "whether has mprotect"... "yes"

checking "whether glibc backtrace works"... "yes"

checking "whether has sleep "... "yes"

checking "whether has usleep "... "yes"

checking "whether personality() and ADDR_NO_RANDOMIZE exist"... "yes"

checking "whether has zlib"... "yes"

checking "whether has elf.h "... "yes"

checking "whether has Multiprocessing.h for Apple "... "no"

checking "whether ntohl is available"... "yes"

checking "whether has libjpeg"... "no"

checking "whether Python is installed"... "yes"

checking "whether can build shared library"... "yes"

checking "whether can build shared library with MPI"... "yes"

checking for sync... sync

checking "F77 compiler as"... "ifort -auto -fpic "

checking "whether Fortran 77 compiler works"... "yes"

checking "F90 compiler as"... "ifort -auto -fpic "

checking "whether Fortran 90 compiler works"... "yes"

checking subroutine name used by Fortran 90 compiler... ONESCORE

checking Fortran 90 mod name is capital... "no"

checking Fortran 90 mod name extension... "mod"

configure: creating ./config.status

config.status: creating libs/ck-libs/ampi/ampiCC

config.status: creating libs/ck-libs/ampi/ampirun

config.status: creating conv-autoconfig.h

config.status: executing default commands

../bin/charmc -host  xi-main.C

gmake[1]: execvp: ../bin/charmc: Text file busy

gmake[1]: *** [xi-main.o] Error 127

gmake[1]: Leaving directory `/lustre/home/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp'

gmake: *** [headers] Error 2

-------------------------------------------------

Charm++ NOT BUILT. Either cd into mpi-linux-x86_64-ifort-mpicxx/tmp and try

to resolve the problems yourself, visit

http://charm.cs.illinois.edu/

for more information. Otherwise, email the developers at charm AT cs.illinois.edu

_______________________________________________
charm mailing list
charm AT cs.uiuc.edu
http://lists.cs.uiuc.edu/mailman/listinfo/charm

 

 

--
Jeff Hammond
jeff.science AT gmail.com
http://jeffhammond.github.io/

[rfvander@bar1
 charm-6.5.1]$ ./build charm++ mpi-linux-x86_64 ifort mpicxx                  
                                            
Selected Compiler: mpicxx
Selected Options:  ifort
Creating dir: mpi-linux-x86_64-ifort-mpicxx
Creating dir: mpi-linux-x86_64-ifort-mpicxx/tmp
Copying src/scripts/Makefile to mpi-linux-x86_64-ifort-mpicxx/tmp
Soft-linking over bin
Soft-linking over lib
Soft-linking over lib_so
Soft-linking over include
Soft-linking over tmp
Generating mpi-linux-x86_64-ifort-mpicxx/tmp/conv-mach-pre.sh
Generating mpi-linux-x86_64-ifort-mpicxx/tmp/conv-mach-opt.h, conv-mach-opt.sh
Performing '/usr/bin/gmake basics OPTS= QUIET= CONFIG_OPTS=' in 
mpi-linux-x86_64-ifort-mpicxx/tmp
Makefile:1144: Variable OPTS is defined to an empty string. Are you sure this 
is what you want?
pwd
/tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp
find . -type l -exec rm {} \;
rm -rf QuickThreads
rm -rf libs
rm -rf ../bin ; mkdir ../bin
rm -rf ../lib ; mkdir ../lib
rm -rf ../lib_so ; mkdir ../lib_so; touch ../lib_so/.charmso
rm -rf ../examples
rm -rf ../tests
rm -rf ../doc ; ln -s ../doc ../doc
../../src/scripts/gatherflat ../../src/scripts .
./gatherflat ../../src/conv-core        .
./gatherflat ../../src/conv-ldb         .
./gatherflat ../../src/conv-ccs         .
./gatherflat ../../src/conv-perf        .
./gatherflat ../../src/ck-core          .
./gatherflat ../../src/util             .
./gatherflat ../../src/ck-perf          .
./gatherflat ../../src/ck-ldb           .
./gatherflat ../../src/ck-com           .
./gatherflat ../../src/ck-cp            .
./gatherflat ../../src/conv-com         .
./gatherflat ../../src/langs/simplemsg  .
./gatherflat ../../src/langs/pvmc       .
./gatherflat ../../src/langs/bluegene   .
./gatherflat ../../src/langs/f90charm   .
./gatherflat ../../src/xlat-i           .
./gatherflat ../../src/xlatcpm          .
./gathertree ../../src/QuickThreads     QuickThreads
./gathertree ../../src/libs             libs
./gathertree ../../src/arch/util        .
./gathertree ../../src/langs            langs
./gathertree ../../src/langs/jade       langs/jade
./gathertree ../../src/arch/common      .
./gathertree ../../src/arch/`cat .gdir` .
test -f ../../src/arch/`cat .gdir`/gdir_link && cat ../../src/arch/`cat 
.gdir`/gdir_link > .gdir.new && ./gathertree ../../src/arch/`cat .gdir.new`   
   . || true
./gatherflat ../../src/arch/`cat .vdir` .
./gathertree ../../examples             ../examples
./gathertree ../../tests                ../tests
rm -f ../bin/dep.pl ; cp dep.pl ../bin/
chmod +x charmc
./system_ln  ../tmp/charmc ../bin/
rm -rf ../include ; mkdir ../include
./system_ln  ../tmp/conv-*.*h ../include
./system_ln  ../tmp/cc-*.*h ../include
./system_ln  ../tmp/conv-mach-opt.sh ../include
if [ -x ./special.sh ] ; then ./special.sh ; fi
if [ ! -f conv-common.h ] ; then ( touch conv-common.h ) ; fi
touch dirs+sources
/usr/bin/gmake charmxi
gmake[1]: Entering directory 
`/tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp'
Makefile:1144: Variable OPTS is defined to an empty string. Are you sure this 
is what you want?
./configure
Error checking is enabled
Statistics collection is enabled
Charm tracing is enabled
Charm tracing communication thread is disabled
CharmDebug is enabled
Charm record/replay is enabled
CCS is enabled
Charm control point is enabled
Setting load balancing timer type as 'double'
checking machine name... mpi-linux-x86_64-ifort-mpicxx
checking "cp command as"... cp -p
checking "C++ compiler as"... "mpicxx -m64 -fPIC      "
checking "whether C++ compiler works"... "ok"
checking "C++ linker as"... "mpicxx -m64 -fPIC      "
checking "whether linker works"... "ok"
checking "Native C++ compiler as"... "g++ -m64 -fPIC "
checking "Sequential C++ compiler as"... "mpicxx -m64 -fPIC "
checking "whether compiler accept -fno-stack-protector"... "ok"
Setting charm++ envelope refnum field to unsigned short
Configuring support for message priorities of arbitrary size (bitvectors)
checking "whether compiler generates code for 64-bit"... "yes"
checking "whether has strings.h "... "yes"
checking "whether has values.h "... "yes"
checking "whether has stdint.h "... "yes"
checking "whether has malloc.h "... "yes"
checking "whether has alloca.h "... "yes"
checking "whether has regex.h "... "yes"
checking "whether C++ bool works"... "ok"
checking "whether long long works"... "yes"
checking "whether __int64 works"... "no"
checking "whether __int128 (128-bit integer) works"... "yes"
checking "whether __int128_t (128-bit integer) works"... "yes"
checking "whether long double works"... "yes"
checking "whether ucontext has FPU pointer"... "yes"
checking "whether ucontext uses uc_regs"... "no"
checking "whether ucontext has pointer (v_regs) of vector type"... "no"
checking "whether ibverbs ibv_port_attr has link_layer field"... "yes"
checking "whether inline works in C"... "yes"
checking "whether C++ class explicit keyword works"... "ok"
checking "whether C++ signed char and char differ"... "yes"
checking "whether C++ *_casts<> work"... "ok"
checking "whether C++ allows declaration of varsize array"... "yes"
checking "whether namespaces work"... "ok"
checking "whether typeinfo/typeid works"... "ok"
checking "whether std::iterator_traits is defined"... "ok"
checking "whether std::distance is defined"... "ok"
checking "whether std::inserter is defined"... "ok"
checking "whether std::unordered_map is defined"... "no"
checking "whether anon structs are permitted"... "yes"
checking "whether operator delete can be overloaded in same class"... "ok"
checking "whether offsetof is defined"... "yes"
checking "whether GCC x86 assembly works"... "yes"
checking "whether GCC x86 assembly for atomic increment works"... "yes"
checking "whether GCC IA64 assembly works"... "no"
checking "whether asm eieio assembly works"... "no"
checking "whether __thread (Thread Local Storage) is supported"... "yes"
checking "whether synchronization primitives (__sync_add_and_fetch) works in 
C"... "yes"
checking "whether synchronization primitives (__sync_synchronize) works in 
C"... "yes"
checking "whether fence intrinsic primitives (__builtin_Xfence_ia32) works in 
C"... "no"
checking "whether switching TLS register (64-bit) is supported"... "yes"
checking "whether build on MPI"... "yes"
checking "whether need to specify MPI library"... "no"
checking "whether MPI_Init_thread is supported"... "yes"
checking "whether getrusage accepts RUSAGE_THREAD"... "yes"
checking "whether has asctime"... "yes"
checking "whether has log2"... "yes"
checking "whether has sqrtf"... "yes"
checking "whether has fabsf"... "yes"
checking "whether has mkstemp"... "yes"
checking "whether has system"... "yes"
checking "whether has sync()"... "yes"
checking "whether has sbrk"... "yes"
checking "whether has _setjmp/_longjmp"... "yes"
checking "whether has mstats"... "no"
checking "whether has mallinfo"... "yes"
checking "whether has popen"... "yes"
checking "whether has poll"... "yes"
checking "whether has getpagesize"... "yes"
checking "whether has getpid"... "yes"
checking "whether has kill"... "yes"
checking "whether has setpriority"... "yes"
checking "whether to use signal-safe system() "... "no"
checking "whether sched_setaffinity call exists"... "yes"
checking "whether pthread_setaffinity_np call exists"... "yes"
checking "whether pthread_spin_lock exists"... "yes"
checking "whether bindprocessor call exists"... "no"
checking "whether dlopen links without -ldl"... "yes"
checking "whether dlopen links with -ldl"... "yes"
checking "whether gethostname call exists"... "yes"
checking "whether getProcAddress works"... "no"
checking "whether has socklen_t"... "yes"
checking "whether getifaddrs call exists"... "yes"
checking "whether the mmap() syscall exists"... "yes"
checking "whether mmap() accepts MAP_ANON"... "yes"
checking "whether mmap() accepts MAP_NORESERVE"... "yes"
checking "whether has get_myaddress"... "yes"
checking "whether has mprotect"... "yes"
checking "whether glibc backtrace works"... "yes"
checking "whether has sleep "... "yes"
checking "whether has usleep "... "yes"
checking "whether personality() and ADDR_NO_RANDOMIZE exist"... "yes"
checking "whether has zlib"... "yes"
checking "whether has elf.h "... "yes"
checking "whether has Multiprocessing.h for Apple "... "no"
checking "whether ntohl is available"... "yes"
checking "whether has libjpeg"... "no"
checking "whether Python is installed"... "yes"
checking "whether can build shared library"... "yes"
checking "whether can build shared library with MPI"... "yes"
checking for sync... sync 
checking "F77 compiler as"... "ifort -auto -fpic "
checking "whether Fortran 77 compiler works"... "yes"
checking "F90 compiler as"... "ifort -auto -fpic "
checking "whether Fortran 90 compiler works"... "yes"
checking subroutine name used by Fortran 90 compiler... ONESCORE
checking Fortran 90 mod name is capital... "no"
checking Fortran 90 mod name extension... "mod"
configure: creating ./config.status
config.status: creating libs/ck-libs/ampi/ampiCC
config.status: creating libs/ck-libs/ampi/ampirun
config.status: creating conv-autoconfig.h
config.status: executing default commands
../bin/charmc -host  xi-main.C
../bin/charmc -host  xi-symbol.C
../bin/charmc -host  xi-grammar.tab.C
../bin/charmc -host  -I. -DYY_NEVER_INTERACTIVE xi-scan.C
../bin/charmc -host  xi-util.C
../bin/charmc -host  -c sdag-globals.C
../bin/charmc -host  -c CSdagConstruct.C
../bin/charmc -host  -c CEntry.C
../bin/charmc -host  -c CParsedFile.C
../bin/charmc -host  -language c++ -cp ../bin/ -o charmxi xi-main.o 
xi-symbol.o xi-grammar.tab.o xi-scan.o xi-util.o sdag-globals.o 
CSdagConstruct.o CEntry.o CParsedFile.o
gmake[1]: Leaving directory 
`/tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp'
/usr/bin/gmake headerlinks
gmake[1]: Entering directory 
`/tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp'
Makefile:1144: Variable OPTS is defined to an empty string. Are you sure this 
is what you want?
../bin/charmc -intrinsic  ckcallback.ci && touch ckcallback.ci.stamp
../bin/charmc -intrinsic  BlockLB.ci && touch BlockLB.ci.stamp
../bin/charmc -intrinsic  CommLB.ci && touch CommLB.ci.stamp
../bin/charmc -intrinsic  DummyLB.ci && touch DummyLB.ci.stamp
../bin/charmc -intrinsic  GreedyAgentLB.ci && touch GreedyAgentLB.ci.stamp
../bin/charmc -intrinsic  GreedyCommLB.ci && touch GreedyCommLB.ci.stamp
../bin/charmc -intrinsic  GreedyLB.ci && touch GreedyLB.ci.stamp
../bin/charmc -intrinsic  NeighborCommLB.ci && touch NeighborCommLB.ci.stamp
../bin/charmc -intrinsic  NeighborLB.ci && touch NeighborLB.ci.stamp
../bin/charmc -intrinsic  OrbLB.ci && touch OrbLB.ci.stamp
../bin/charmc -intrinsic  PhasebyArrayLB.ci && touch PhasebyArrayLB.ci.stamp
../bin/charmc -intrinsic  RandCentLB.ci && touch RandCentLB.ci.stamp
../bin/charmc -intrinsic  RecBipartLB.ci && touch RecBipartLB.ci.stamp
../bin/charmc -intrinsic  RefineLB.ci && touch RefineLB.ci.stamp
../bin/charmc -intrinsic  RefineCommLB.ci && touch RefineCommLB.ci.stamp
../bin/charmc -intrinsic  RotateLB.ci && touch RotateLB.ci.stamp
../bin/charmc -intrinsic  TreeMatchLB.ci && touch TreeMatchLB.ci.stamp
../bin/charmc -intrinsic  RefineSwapLB.ci && touch RefineSwapLB.ci.stamp
../bin/charmc -intrinsic  CommAwareRefineLB.ci && touch 
CommAwareRefineLB.ci.stamp
../bin/charmc -intrinsic  AdaptiveLB.ci && touch AdaptiveLB.ci.stamp
../bin/charmc -intrinsic  ComboCentLB.ci && touch ComboCentLB.ci.stamp
../bin/charmc -intrinsic  GraphPartLB.ci && touch GraphPartLB.ci.stamp
../bin/charmc -intrinsic  GraphBFTLB.ci && touch GraphBFTLB.ci.stamp
../bin/charmc -intrinsic  GridCommLB.ci && touch GridCommLB.ci.stamp
../bin/charmc -intrinsic  GridCommRefineLB.ci && touch 
GridCommRefineLB.ci.stamp
../bin/charmc -intrinsic  GridHybridLB.ci && touch GridHybridLB.ci.stamp
../bin/charmc -intrinsic  GridHybridSeedLB.ci && touch 
GridHybridSeedLB.ci.stamp
../bin/charmc -intrinsic  GridMetisLB.ci && touch GridMetisLB.ci.stamp
../bin/charmc -intrinsic  HbmLB.ci && touch HbmLB.ci.stamp
../bin/charmc -intrinsic  HybridLB.ci && touch HybridLB.ci.stamp
../bin/charmc -intrinsic  RefineKLB.ci && touch RefineKLB.ci.stamp
../bin/charmc -intrinsic  RefineTopoLB.ci && touch RefineTopoLB.ci.stamp
../bin/charmc -intrinsic  TopoCentLB.ci && touch TopoCentLB.ci.stamp
../bin/charmc -intrinsic  TopoLB.ci && touch TopoLB.ci.stamp
../bin/charmc -intrinsic  TempAwareRefineLB.ci && touch 
TempAwareRefineLB.ci.stamp
../bin/charmc -intrinsic  TempAwareCommLB.ci && touch TempAwareCommLB.ci.stamp
../bin/charmc -intrinsic  TempAwareGreedyLB.ci && touch 
TempAwareGreedyLB.ci.stamp
../bin/charmc -intrinsic  MetisLB.ci && touch MetisLB.ci.stamp
../bin/charmc -intrinsic  ScotchLB.ci && touch ScotchLB.ci.stamp
../bin/charmc -intrinsic  TeamLB.ci && touch TeamLB.ci.stamp
../bin/charmc -intrinsic  WSLB.ci && touch WSLB.ci.stamp
../bin/charmc -intrinsic  ckmarshall.ci && touch ckmarshall.ci.stamp
../bin/charmc -intrinsic  ckarray.ci && touch ckarray.ci.stamp
../bin/charmc -intrinsic  cklocation.ci && touch cklocation.ci.stamp
../bin/charmc -intrinsic  ckreduction.ci && touch ckreduction.ci.stamp
../bin/charmc -intrinsic  ckarrayreductionmgr.ci && touch 
ckarrayreductionmgr.ci.stamp
../bin/charmc -intrinsic  tempo.ci && touch tempo.ci.stamp
../bin/charmc -intrinsic  waitqd.ci && touch waitqd.ci.stamp
../bin/charmc -intrinsic  ckfutures.ci && touch ckfutures.ci.stamp
../bin/charmc -intrinsic  ckcheckpoint.ci && touch ckcheckpoint.ci.stamp
../bin/charmc -intrinsic  ckmemcheckpoint.ci && touch ckmemcheckpoint.ci.stamp
../bin/charmc -intrinsic  LBDatabase.ci && touch LBDatabase.ci.stamp
../bin/charmc -intrinsic  MetaBalancer.ci && touch MetaBalancer.ci.stamp
../bin/charmc -intrinsic  CentralLB.ci && touch CentralLB.ci.stamp
../bin/charmc -intrinsic  NullLB.ci && touch NullLB.ci.stamp
../bin/charmc -intrinsic  BaseLB.ci && touch BaseLB.ci.stamp
../bin/charmc -intrinsic  NborBaseLB.ci && touch NborBaseLB.ci.stamp
../bin/charmc -intrinsic  HybridBaseLB.ci && touch HybridBaseLB.ci.stamp
../bin/charmc -intrinsic  EveryLB.ci && touch EveryLB.ci.stamp
../bin/charmc -intrinsic  CommonLBs.ci && touch CommonLBs.ci.stamp
../bin/charmc -intrinsic  charisma.ci && touch charisma.ci.stamp
../bin/charmc -intrinsic  trace-summary.ci && touch trace-summary.ci.stamp
../bin/charmc -intrinsic  trace-projections.ci && touch 
trace-projections.ci.stamp
../bin/charmc -intrinsic  trace-simple.ci && touch trace-simple.ci.stamp
../bin/charmc -intrinsic  trace-controlPoints.ci && touch 
trace-controlPoints.ci.stamp
../bin/charmc -intrinsic  trace-Tau.ci && touch trace-Tau.ci.stamp
../bin/charmc -intrinsic  trace-utilization.ci && touch 
trace-utilization.ci.stamp
../bin/charmc -intrinsic  BlueGene.ci && touch BlueGene.ci.stamp
../bin/charmc -intrinsic  ComlibManager.ci && touch ComlibManager.ci.stamp
../bin/charmc -intrinsic  controlPoints.ci && touch controlPoints.ci.stamp
../bin/charmc -intrinsic  pathHistory.ci && touch pathHistory.ci.stamp
Soft-linking headers...
for hdr in ck.h ckstream.h envelope.h init.h qd.h charm.h charm++.h 
ckfutures.h ckIgetControl.h cktiming.h debug-charm.h ckcallback.h 
CkCallback.decl.h ckcallback-ccs.h ckarrayreductionmgr.h cksection.h 
ckarrayindex.h ckarray.h cklocation.h ckreduction.h ckcheckpoint.h 
ckmemcheckpoint.h ckevacuation.h ckmessagelogging.h ckcausalmlog.h ckobjid.h 
ckobjQ.h readonly.h charisma.h comlib.h ComlibArrayListener.h 
ComlibStrategy.h ComlibLearner.h pup.h pupf.h pup_c.h pup_stl.h pup_mpi.h 
pup_toNetwork.h pup_toNetwork4.h pup_paged.h pup_cmialloc.h ckimage.h ckdll.h 
ckhashtable.h ckbitvector.h cklists.h ckliststring.h cksequence.h 
ckstatistics.h ckvector3d.h conv-lists.h RTH.h ckcomplex.h sockRoutines.h 
sockRoutines.c ckpool.h BGLTorus.h BGPTorus.h BGQTorus.h TopoManager.h 
XTTorus.h cmimemcpy.h simd.h SSE-Double.h SSE-Float.h crc32.h ckBIconfig.h 
tempo.h waitqd.h LBDatabase.h MetaBalancer.h lbdb.h lbdb++.h LBProfit.h 
BlockLB.h BlockLB.decl.h CommLB.h CommLB.decl.h DummyLB.h DummyLB.decl.h 
GreedyAgentLB.h GreedyAgentLB.decl.h GreedyCommLB.h GreedyCommLB.decl.h 
GreedyLB.h GreedyLB.decl.h NeighborCommLB.h NeighborCommLB.decl.h 
NeighborLB.h NeighborLB.decl.h OrbLB.h OrbLB.decl.h PhasebyArrayLB.h 
PhasebyArrayLB.decl.h RandCentLB.h RandCentLB.decl.h RecBipartLB.h 
RecBipartLB.decl.h RefineLB.h RefineLB.decl.h RefineCommLB.h 
RefineCommLB.decl.h RotateLB.h RotateLB.decl.h TreeMatchLB.h 
TreeMatchLB.decl.h RefineSwapLB.h RefineSwapLB.decl.h CommAwareRefineLB.h 
CommAwareRefineLB.decl.h AdaptiveLB.h AdaptiveLB.decl.h ComboCentLB.h 
ComboCentLB.decl.h GraphPartLB.h GraphPartLB.decl.h GraphBFTLB.h 
GraphBFTLB.decl.h GridCommLB.h GridCommLB.decl.h GridCommRefineLB.h 
GridCommRefineLB.decl.h GridHybridLB.h GridHybridLB.decl.h GridHybridSeedLB.h 
GridHybridSeedLB.decl.h GridMetisLB.h GridMetisLB.decl.h HbmLB.h HbmLB.decl.h 
HybridLB.h HybridLB.decl.h RefineKLB.h RefineKLB.decl.h RefineTopoLB.h 
RefineTopoLB.decl.h TopoCentLB.h TopoCentLB.decl.h TopoLB.h TopoLB.decl.h 
TempAwareRefineLB.h TempAwareRefineLB.decl.h TempAwareCommLB.h 
TempAwareCommLB.decl.h TempAwareGreedyLB.h TempAwareGreedyLB.decl.h MetisLB.h 
MetisLB.decl.h ScotchLB.h ScotchLB.decl.h TeamLB.h TeamLB.decl.h WSLB.h 
WSLB.decl.h LBDBManager.h    LBComm.h LBOM.h LBObj.h LBMachineUtil.h 
LBAgent.h RefinerTemp.h Refiner.h RefinerApprox.h RefinerComm.h ckgraphTemp.h 
ckgraph.h ckheap.h elements.h CommLBHeap.h topology.h manager.h BaseLB.h 
CentralLB.h CentralLBMsg.h NborBaseLB.h HybridBaseLB.h HybridLBMsg.h 
NeighborLBMsg.h BlueGene.h middle.h middle-conv.h middle-blue.h 
CkMarshall.decl.h CkArray.decl.h CkLocation.decl.h CkReduction.decl.h 
CkArrayReductionMgr.decl.h tempo.decl.h waitqd.decl.h CkFutures.decl.h 
CkCheckpoint.decl.h CkMemCheckpoint.decl.h LBDatabase.decl.h 
MetaBalancer.decl.h CentralLB.decl.h NullLB.decl.h BaseLB.decl.h 
NborBaseLB.decl.h HybridBaseLB.decl.h EveryLB.decl.h CommonLBs.decl.h 
charisma.decl.h TraceSummary.decl.h TraceProjections.decl.h 
TraceSimple.decl.h TraceControlPoints.decl.h TraceTau.decl.h 
TraceUtilization.decl.h BlueGene.decl.h comlib.decl.h ComlibManager.h 
DummyStrategy.h MulticastStrategy.h DirectMulticastStrategy.h 
RingMulticastStrategy.h ChunkMulticastStrategy.h OneTimeMulticastStrategy.h 
MultiRingMulticast.h EachToManyMulticastStrategy.h MsgPacker.h 
StreamingStrategy.h NodeMulticast.h PipeBroadcastStrategy.h 
MeshStreamingStrategy.h PrioStreaming.h MPIStrategy.h MsgPacker.h 
StreamingStrategy.h BroadcastStrategy.h ComlibSectionInfo.h AAPLearner.h 
AAMLearner.h ComlibStats.h RectMulticastStrategy.h ckdirect.h 
ControlPoints.decl.h PathHistory.decl.h pathHistory.h envelope-path.h 
controlPoints.h controlPointsf.h arrayRedistributor.h cp_effects.h register.h 
stats.h cksequence_internal.h cksequence_factory.h random_sequence.h 
strided_sequence.h mpi-interoperate.h cpthreads.h converse.h conv-trace.h 
conv-random.h conv-qd.h msgq.h queueing.h conv-cpath.h conv-cpm.h 
persistent.h trace.h trace-common.h trace-bluegene.h trace-projections.h 
trace-simple.h trace-controlPoints.h charm-api.h conv-ccs.h ccs-client.c 
ccs-client.h ccs-server.h ccs-auth.c ccs-auth.h memory-isomalloc.h 
debug-conv.h debug-conv++.h conv-autoconfig.h conv-common.h conv-config.sh 
conv-config.h conv-mach.h conv-mach.sh blue.h blue-conv.h bgconverse.h 
cmipool.h mempool.h cmiqueue.h cmidirect.h cmidirectmanytomany.h cmitls.h 
3dgridrouter.h hypercuberouter.h hypercubetopology.h routerstrategy.h 
convcomlibstrategy.h  convcomlib.h dummyconversestrategy.h  treerouter.h 
convcomlibmanager.h graphrouter.h petable.h gridrouter.h router.h 
prefixrouter.h pipebroadcastconverse.h pipelinestrategy.h simplemsg.h sm.h 
pvmc.h pvm3.h sdag.h vector2d.h graph.h bitvecset.h ckset.h LBSimulation.h 
blue_types.h bigsim_timing.h blue_defs.h bigsim_logs.h blue.h blue_impl.h 
bigsim_network.h bigsim_record.h bigsim_ooc.h bigsim_debug.h shared-alloc.h ; 
do test ! -f "../include/$hdr" && ./system_ln "../tmp/$hdr" ../include ; done
touch headerlinks
gmake[1]: Leaving directory 
`/tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp'
touch basics
Performing '/usr/bin/gmake charm++ OPTS= QUIET=' in 
mpi-linux-x86_64-ifort-mpicxx/tmp
Makefile:1144: Variable OPTS is defined to an empty string. Are you sure this 
is what you want?
../bin/charmc   -c -I. BlockLB.C
../bin/charmc   -o ../lib/libmoduleBlockLB.a BlockLB.o 
ar: creating ../lib/libmoduleBlockLB.a
../bin/charmc   -c -I. CommLB.C
../bin/charmc   -o ../lib/libmoduleCommLB.a CommLB.o 
ar: creating ../lib/libmoduleCommLB.a
../bin/charmc   -c -I. DummyLB.C
../bin/charmc   -o ../lib/libmoduleDummyLB.a DummyLB.o 
ar: creating ../lib/libmoduleDummyLB.a
../bin/charmc   -c -I. GreedyAgentLB.C
../bin/charmc   -o ../lib/libmoduleGreedyAgentLB.a GreedyAgentLB.o 
ar: creating ../lib/libmoduleGreedyAgentLB.a
../bin/charmc   -c -I. GreedyCommLB.C
../bin/charmc   -c -I. manager.C
../bin/charmc   -o ../lib/libmoduleGreedyCommLB.a GreedyCommLB.o manager.o
ar: creating ../lib/libmoduleGreedyCommLB.a
../bin/charmc   -c -I. GreedyLB.C
../bin/charmc   -o ../lib/libmoduleGreedyLB.a GreedyLB.o 
ar: creating ../lib/libmoduleGreedyLB.a
../bin/charmc   -c -I. NeighborCommLB.C
../bin/charmc   -o ../lib/libmoduleNeighborCommLB.a NeighborCommLB.o 
ar: creating ../lib/libmoduleNeighborCommLB.a
../bin/charmc   -c -I. NeighborLB.C
../bin/charmc   -o ../lib/libmoduleNeighborLB.a NeighborLB.o 
ar: creating ../lib/libmoduleNeighborLB.a
../bin/charmc   -c -I. OrbLB.C
../bin/charmc   -o ../lib/libmoduleOrbLB.a OrbLB.o 
ar: creating ../lib/libmoduleOrbLB.a
../bin/charmc   -c -I. PhasebyArrayLB.C
../bin/charmc   -o ../lib/libmodulePhasebyArrayLB.a PhasebyArrayLB.o 
ar: creating ../lib/libmodulePhasebyArrayLB.a
../bin/charmc   -c -I. RandCentLB.C
../bin/charmc   -o ../lib/libmoduleRandCentLB.a RandCentLB.o 
ar: creating ../lib/libmoduleRandCentLB.a
../bin/charmc   -c -I. RecBipartLB.C
../bin/charmc   -o ../lib/libmoduleRecBipartLB.a RecBipartLB.o 
ar: creating ../lib/libmoduleRecBipartLB.a
../bin/charmc   -c -I. RefineLB.C
../bin/charmc   -o ../lib/libmoduleRefineLB.a RefineLB.o 
ar: creating ../lib/libmoduleRefineLB.a
../bin/charmc   -c -I. RefineCommLB.C
../bin/charmc   -o ../lib/libmoduleRefineCommLB.a RefineCommLB.o 
ar: creating ../lib/libmoduleRefineCommLB.a
cp -f libmoduleRefineCommLB.dep ../lib/
../bin/charmc   -c -I. RotateLB.C
../bin/charmc   -o ../lib/libmoduleRotateLB.a RotateLB.o 
ar: creating ../lib/libmoduleRotateLB.a
../bin/charmc   -c -I. TreeMatchLB.C
../bin/charmc   -c -I. tm_tree.c
../bin/charmc   -c -I. tm_bucket.c
../bin/charmc   -c -I. tm_timings.c
../bin/charmc   -c -I. tm_mapping.c
../bin/charmc   -o ../lib/libmoduleTreeMatchLB.a TreeMatchLB.o tm_tree.o 
tm_bucket.o tm_timings.o tm_mapping.o
ar: creating ../lib/libmoduleTreeMatchLB.a
../bin/charmc   -c -I. RefineSwapLB.C
../bin/charmc   -o ../lib/libmoduleRefineSwapLB.a RefineSwapLB.o 
ar: creating ../lib/libmoduleRefineSwapLB.a
../bin/charmc   -c -I. CommAwareRefineLB.C
../bin/charmc   -o ../lib/libmoduleCommAwareRefineLB.a CommAwareRefineLB.o 
ar: creating ../lib/libmoduleCommAwareRefineLB.a
../bin/charmc   -c -I. AdaptiveLB.C
../bin/charmc   -o ../lib/libmoduleAdaptiveLB.a AdaptiveLB.o 
ar: creating ../lib/libmoduleAdaptiveLB.a
../bin/charmc   -c -I. ComboCentLB.C
../bin/charmc   -o ../lib/libmoduleComboCentLB.a ComboCentLB.o 
ar: creating ../lib/libmoduleComboCentLB.a
../bin/charmc   -c -I. GraphPartLB.C
../bin/charmc   -o ../lib/libmoduleGraphPartLB.a GraphPartLB.o 
ar: creating ../lib/libmoduleGraphPartLB.a
../bin/charmc   -c -I. GraphBFTLB.C
../bin/charmc   -o ../lib/libmoduleGraphBFTLB.a GraphBFTLB.o 
ar: creating ../lib/libmoduleGraphBFTLB.a
../bin/charmc   -c -I. GridCommLB.C
../bin/charmc   -o ../lib/libmoduleGridCommLB.a GridCommLB.o manager.o
ar: creating ../lib/libmoduleGridCommLB.a
../bin/charmc   -c -I. GridCommRefineLB.C
../bin/charmc   -o ../lib/libmoduleGridCommRefineLB.a GridCommRefineLB.o 
manager.o
ar: creating ../lib/libmoduleGridCommRefineLB.a
../bin/charmc   -c -I. GridHybridLB.C
../bin/charmc   -o ../lib/libmoduleGridHybridLB.a GridHybridLB.o manager.o
ar: creating ../lib/libmoduleGridHybridLB.a
../bin/charmc   -c -I. GridHybridSeedLB.C
../bin/charmc   -o ../lib/libmoduleGridHybridSeedLB.a GridHybridSeedLB.o 
manager.o
ar: creating ../lib/libmoduleGridHybridSeedLB.a
../bin/charmc   -c -I. GridMetisLB.C
../bin/charmc   -o ../lib/libmoduleGridMetisLB.a GridMetisLB.o 
ar: creating ../lib/libmoduleGridMetisLB.a
cp -f libmoduleGridMetisLB.dep ../lib/
../bin/charmc   -c -I. HbmLB.C
../bin/charmc   -o ../lib/libmoduleHbmLB.a HbmLB.o 
ar: creating ../lib/libmoduleHbmLB.a
../bin/charmc   -c -I. HybridLB.C
../bin/charmc   -o ../lib/libmoduleHybridLB.a HybridLB.o 
ar: creating ../lib/libmoduleHybridLB.a
../bin/charmc   -c -I. RefineKLB.C
../bin/charmc   -o ../lib/libmoduleRefineKLB.a RefineKLB.o 
ar: creating ../lib/libmoduleRefineKLB.a
../bin/charmc   -c -I. RefineTopoLB.C
../bin/charmc   -o ../lib/libmoduleRefineTopoLB.a RefineTopoLB.o 
ar: creating ../lib/libmoduleRefineTopoLB.a
../bin/charmc   -c -I. TopoCentLB.C
../bin/charmc   -o ../lib/libmoduleTopoCentLB.a TopoCentLB.o 
ar: creating ../lib/libmoduleTopoCentLB.a
../bin/charmc   -c -I. TopoLB.C
../bin/charmc   -o ../lib/libmoduleTopoLB.a TopoLB.o 
ar: creating ../lib/libmoduleTopoLB.a
../bin/charmc   -c -I. TempAwareRefineLB.C
../bin/charmc   -o ../lib/libmoduleTempAwareRefineLB.a TempAwareRefineLB.o 
ar: creating ../lib/libmoduleTempAwareRefineLB.a
../bin/charmc   -c -I. TempAwareCommLB.C
../bin/charmc   -o ../lib/libmoduleTempAwareCommLB.a TempAwareCommLB.o 
ar: creating ../lib/libmoduleTempAwareCommLB.a
../bin/charmc   -c -I. EveryLB.C
../bin/charmc   -o ../lib/libmoduleEveryLB.a EveryLB.o BlockLB.o CommLB.o 
DummyLB.o GreedyAgentLB.o GreedyCommLB.o GreedyLB.o NeighborCommLB.o 
NeighborLB.o OrbLB.o PhasebyArrayLB.o RandCentLB.o RecBipartLB.o RefineLB.o 
RefineCommLB.o RotateLB.o TreeMatchLB.o RefineSwapLB.o CommAwareRefineLB.o 
AdaptiveLB.o ComboCentLB.o GraphPartLB.o GraphBFTLB.o GridCommLB.o 
GridCommRefineLB.o GridHybridLB.o GridHybridSeedLB.o GridMetisLB.o HbmLB.o 
HybridLB.o RefineKLB.o RefineTopoLB.o TopoCentLB.o TopoLB.o 
TempAwareRefineLB.o TempAwareCommLB.o manager.o tm_tree.o tm_timings.o 
tm_bucket.o tm_mapping.o
ar: creating ../lib/libmoduleEveryLB.a
../bin/charmc   -c -I. CommonLBs.C
../bin/charmc   -o ../lib/libmoduleCommonLBs.a CommonLBs.o BlockLB.o CommLB.o 
DummyLB.o GreedyAgentLB.o GreedyCommLB.o GreedyLB.o NeighborCommLB.o 
NeighborLB.o OrbLB.o PhasebyArrayLB.o RandCentLB.o RecBipartLB.o RefineLB.o 
RefineCommLB.o RotateLB.o TreeMatchLB.o RefineSwapLB.o CommAwareRefineLB.o 
AdaptiveLB.o manager.o tm_tree.o tm_timings.o tm_bucket.o tm_mapping.o
ar: creating ../lib/libmoduleCommonLBs.a
/usr/bin/gmake -C libs/ck-libs/completion
gmake[1]: Entering directory 
`/tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp/libs/ck-libs/completion'
../../../../bin/charmc  -c completion.ci
../../../../bin/charmc  -I../../../../tmp -o completion.o completion.C
../../../../bin/charmc  -o ../../../../lib/libmodulecompletion.a completion.o 
ar: creating ../../../../lib/libmodulecompletion.a
/bin/cp completion.decl.h ../../../../include
/bin/cp completion.def.h ../../../../include
/bin/cp completion.h ../../../../include
gmake[1]: Leaving directory 
`/tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp/libs/ck-libs/completion'
../bin/charmc -seq  -o sockRoutines-seq.o sockRoutines.c
../bin/charmc   -c -I. trace-common.C
../bin/charmc   -c -I. tracec.C
../bin/charmc   -c -I. tracef.C
../bin/charmc   -c -I. init.C
../bin/charmc   -c -I. register.C
../bin/charmc   -c -I. qd.C
../bin/charmc   -c -I. ck.C
../bin/charmc   -c -I. main.C
../bin/charmc   -c -I. msgalloc.C
../bin/charmc   -c -I. ckfutures.C
../bin/charmc   -c -I. ckIgetControl.C
../bin/charmc   -c -I. debug-message.C
../bin/charmc   -c -I. debug-charm.C
../bin/charmc   -c -I. ckcallback.C
../bin/charmc   -c -I. cklocation.C
../bin/charmc   -c -I. ckarray.C
../bin/charmc   -c -I. ckreduction.C
../bin/charmc   -c -I. ckarrayreductionmgr.C
../bin/charmc   -c -I. tempo.C
../bin/charmc   -c -I. waitqd.C
../bin/charmc   -c -I. LBDatabase.C
../bin/charmc   -c -I. MetaBalancer.C
../bin/charmc   -c -I. lbdb.C
../bin/charmc   -c -I. lbdbf.C
../bin/charmc   -c -I. charisma.C
../bin/charmc   -c -I. ckobjQ.C
../bin/charmc   -c -I. LBAgent.C
../bin/charmc   -c -I. LBProfit.C
../bin/charmc   -c -I. ckcheckpoint.C
../bin/charmc   -c -I. ckmemcheckpoint.C
../bin/charmc   -c -I. ckevacuation.C
../bin/charmc   -c -I. ckmessagelogging.C
../bin/charmc   -c -I. ckcausalmlog.C
../bin/charmc   -c -I. ckobjid.C
../bin/charmc   -c -I. LBDBManager.C
../bin/charmc   -c -I. LBComm.C
../bin/charmc   -c -I. LBObj.C
../bin/charmc   -c -I. LBMachineUtil.C
../bin/charmc   -c -I. CentralPredictor.C
../bin/charmc   -c -I. BaseLB.C
../bin/charmc   -c -I. CentralLB.C
../bin/charmc   -c -I. HybridBaseLB.C
../bin/charmc   -c -I. NborBaseLB.C
../bin/charmc   -c -I. ckgraphTemp.C
../bin/charmc   -c -I. ckgraph.C
../bin/charmc   -c -I. LButil.C
../bin/charmc   -c -I. RefinerTemp.C
../bin/charmc   -c -I. Refiner.C
../bin/charmc   -c -I. RefinerApprox.C
../bin/charmc   -c -I. RefinerComm.C
../bin/charmc   -c -I. bitvecset.c
../bin/charmc   -c -I. ckset.C
../bin/charmc   -c -I. ckheap.C
../bin/charmc   -c -I. CommLBHeap.C
../bin/charmc   -c -I. NullLB.C
../bin/charmc   -c -I. LBSimulation.C
../bin/charmc   -c -I. ComlibModuleInterface.C
../bin/charmc   -c -I. modifyScheduler.C
../bin/charmc   -c -I. charmProjections.C
../bin/charmc   -c -I. cktiming.C
../bin/charmc   -c -I. ckbitvector.C
../bin/charmc   -c -I. pathHistory.C
../bin/charmc   -c -I. controlPoints.C
../bin/charmc   -c -I. arrayRedistributor.C
../bin/charmc   -c -I. cp_effects.C
../bin/charmc   -c -I. trace-controlPoints.C
../bin/charmc   -c -I. mpi-interoperate.C
In file included from /opt/intel//impi/4.1.1.036/intel64/include/mpi.h:1279:0,
                 from mpi-interoperate.h:9,
                 from mpi-interoperate.C:3:
/opt/intel//impi/4.1.1.036/intel64/include/mpicxx.h:95:2: error: #error 
"SEEK_SET is #defined but must not be for the C++ binding of MPI. Include 
mpi.h before stdio.h"
 #error "SEEK_SET is #defined but must not be for the C++ binding of MPI. 
Include mpi.h before stdio.h"
  ^
/opt/intel//impi/4.1.1.036/intel64/include/mpicxx.h:99:2: error: #error 
"SEEK_CUR is #defined but must not be for the C++ binding of MPI. Include 
mpi.h before stdio.h"
 #error "SEEK_CUR is #defined but must not be for the C++ binding of MPI. 
Include mpi.h before stdio.h"
  ^
/opt/intel//impi/4.1.1.036/intel64/include/mpicxx.h:104:2: error: #error 
"SEEK_END is #defined but must not be for the C++ binding of MPI. Include 
mpi.h before stdio.h"
 #error "SEEK_END is #defined but must not be for the C++ binding of MPI. 
Include mpi.h before stdio.h"
  ^
Fatal Error by charmc in directory 
/tmp/rfvander/charm-6.5.1/mpi-linux-x86_64-ifort-mpicxx/tmp
   Command mpicxx -m64 -fPIC -I../bin/../include -D__CHARMC__=1 -I. 
-fno-stack-protector -c mpi-interoperate.C -o mpi-interoperate.o returned 
error code 1
charmc exiting...
gmake: *** [mpi-interoperate.o] Error 1
-------------------------------------------------
Charm++ NOT BUILT. Either cd into mpi-linux-x86_64-ifort-mpicxx/tmp and try
to resolve the problems yourself, visit
http://charm.cs.illinois.edu/
for more information. Otherwise, email the developers at 
charm AT cs.illinois.edu