Charm++ parallel programming system

[Haowei Huang <huangh AT in.tum.de>]

  Hi,

       I have already built a charm++ on Cray and a directory called mpi-crayxt is generated. Then I used this command to build Tau

      ./build Tau mpi-crayxt pgcc pgf90 --tau-makefile=$TAU_MAKEFILE -O3

       you mean I also need to build charm++ under directory mpi-crayxt-pgf90-pgcc/tmp using make charm++.  Is this directory a final version of charm++ including tracemodes projections and Tau?

       When I make charm++ under mpi-crayxt-pgf90-pgcc/tmp directory, I met such linking error:

../bin/charmc   -c -I. modifyScheduler.C

../bin/charmc    -L/home/u1/huangh/backup/tau-2.19.1/craycnl/lib -ltau-mpi-pgi                   -o ../lib/libconv-core.a convcore.o conv-conds.o queueing.o msgmgr.o cpm.o cpthreads.o futures.o cldb.o topology.o random.o debug-conv.o generate.o edgelist.o conv-ccs.o ccs-builtins.o traceCore.o traceCoreCommon.o tracec.o converseProjections.o machineProjections.o quiescence.o isomalloc.o mem-arena.o conv-counter.o global-nop.o cmipool.o cpuaffinity.o cputopology.o modifyScheduler.o

Warning: creating ../lib_so/libconv-core.so

ar: creating ../lib/libconv-core.a

../bin/charmc   -o machine.o  -DFOR_CPLUS=1 machine.c

PGC-F-0206-Can't find include file mpi.h (machine.c: 17)

PGC/x86-64 Linux 10.2-0: compilation aborted

Fatal Error by charmc in directory /home/u1/huangh/backup/charm-6.2.0/mpi-crayxt-pgf90-pgcc/tmp

   Command pgcc -fPIC -I../bin/../include -D__CHARMC__=1 -DFOR_CPLUS=1 -DPROFILING_ON -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_LINUX_TIMERS -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -DTAU_BFD -DTAU_MPIFILE -DHAVE_GNU_DEMANGLE -I/home/u1/huangh/backup/tau-2.19.1/include -c machine.c -o machine.o returned error code 2

charmc exiting...

make: *** [../lib/libconv-cplus-n.a] Error 1

   

2010/6/21 Phil Miller <mille121 AT illinois.edu>

When you ran this build command:

./build Tau mpi-crayxt pgcc pgf90 --tau-makefile=$TAU_MAKEFILE -O3

you told our scripts to build just the Tau tracing modules for Charm++
(the 'Tau' target).

You'll also need to actually build charm++ in that tree:
cd mpi-crayxt-pgf90-pgcc/tmp
make charm++

Phil

Appendix: The relevant snippet of our Makefile reads

Tau:
       echo "buliding charm trace library with support for TAU."
       $(MAKE) $(L)/libtrace-Tau.a $(L)/libtrace-all.a
TAU_TRACE_OBJ=libtrace-Tau.o

On Mon, Jun 21, 2010 at 01:32, Chee Wai Lee <cheewai1972 AT gmail.com> wrote:
> Hi Haowei,
> This build just tells Charm++ where to find the PGI fortran and C compilers.
> In this case, it looks like the linker is unable to locate the Charm++ load
> balancer. You will probably get more mileage from Phil for this problem than
> from me. I'm CC-ing this so he can take a look at it for you.
> Thanks!
> Best Regards,
> Chee Wai
> Phil: Why is it looking for a ".o" instead of a ".a" for the libldb-rand
> library file?
> On Jun 20, 2010, at 1:19 PM, Haowei Huang wrote:
>
>   Hi Chee Wai,
>        Thanks.Now I can build it on cray successfully and a directory called
> mpi-crayxt-pgf90-pgcc is created. What is the difference between this
> directory and the former directory mpi-crayxt? When I compile simpleHello
> program under directory mpi-crayxt, it shows no Tau trace mode. If I compile
> simpleHello under mpi-crayxt-pgf90-pgcc I meet such error( there are only
> two library files under mpi-crayxt-pgf90-pgcc/lib  libtrace-all.a,
> libtrace-Tau.a).
>
> louhi-login4
> ~/backup/charm-6.2.0/mpi-crayxt-pgf90-pgcc/tests/charm++/simplearrayhello>
> make OPTS='-tracemode Tau -no-trace-mpi'
> ../../../bin/charmc -tracemode Tau -no-trace-mpi  hello.ci
> ../../../bin/charmc -tracemode Tau -no-trace-mpi -c hello.C
> ../../../bin/charmc -tracemode Tau -no-trace-mpi -language charm++ -o hello
> hello.o
> ls: libldb-*: No such file or directory
> Fatal Error by charmc in directory
> /home/u1/huangh/backup/charm-6.2.0/mpi-crayxt-pgf90-pgcc/tests/charm++/simplearrayhello
>    Unknown load balancer rand / ../../../bin/../lib/libldb-rand.o
> charmc exiting...
> make: *** [hello] Error 1
>
>
> 2010/6/20 Chee Wai Lee <cheewai1972 AT gmail.com>
>>
>> Hi Haowei,
>> I think you have an extra "/" at the back of "mpi-crayxt"
>> Best Regards,
>> Chee Wai
>> On Jun 20, 2010, at 10:55 AM, Haowei Huang wrote:
>>
>>   Chee Wai,
>>
>>              Thank you for your advice. I encountered such error when I
>> build TAU under charm++ directory follow your instructions
>> http://www.nic.uoregon.edu/tau-wiki/Guide:NAMDTAU.
>>
>> louhi-login4 ~/backup/charm-6.2.0> ./build Tau mpi-crayxt/ pgcc pgf90
>> --tau-makefile=$TAU_MAKEFILE -O3
>> Selected Compiler: pgcc
>> Selected Options:  pgf90
>> Copying src/scripts/Makefile to mpi-crayxt/-pgf90-pgcc/tmp
>> Soft-linking over bin
>> Soft-linking over lib
>> Soft-linking over lib_so
>> Soft-linking over include
>> Soft-linking over tmp
>> Generating mpi-crayxt/-pgf90-pgcc/tmp/conv-mach-pre.sh
>> TAU>>>> makefile config option:
>> /fs/u1/huangh/backup/tau-2.19.1/craycnl/lib/Makefile.tau-mpi-pgi
>> TAU>>>> configuring with this TAU makefile:
>> /fs/u1/huangh/backup/tau-2.19.1/craycnl/lib/Makefile.tau-mpi-pgi
>> Performing '/usr/bin/gmake basics OPTS= -O3 QUIET=' in
>> mpi-crayxt/-pgf90-pgcc/tmp
>> gmake: Makefile: No such file or directory
>> gmake: *** No rule to make target `Makefile'.  Stop.
>> -------------------------------------------------
>> Charm++ NOT BUILT. Either cd into mpi-crayxt/-pgf90-pgcc/tmp and try
>> to resolve the problems yourself, visit
>> http://charm.cs.uiuc.edu/
>> for more information. Otherwise, email the developers at charm AT cs.uiuc.edu
>>
>>
>>              Do you have any idea about this? Thank you so much.
>>
>>
>>
>> 2010/6/20 Chee Wai Lee <cheewai1972 AT gmail.com>
>>>
>>> Hi Haowei,
>>> Yes, and it would be very helpful to get feedback on the use of this
>>> feature outside of NAMD. The instructions (for NAMD) can be found
>>> here: http://www.nic.uoregon.edu/tau-wiki/Guide:NAMDTAU. These instructions
>>> will assume you have a working version of TAU built (craycnl, I assume) on
>>> the Cray.
>>> I have previously checked-in the code for TAU support into the Charm++
>>> repository, so it should have been released along with Charm 6.2. I will
>>> verify that the instructions still do work with the current repository or
>>> release versions of Charm++ and get back to you. Please let us know if you
>>> have any questions or difficulties. Feel free to ask Scott or myself about
>>> TAU and Charm++. I am still familiar with the inner workings of Projections
>>> as well, so if you have questions there, I can try my best to answer them.
>>> Best Regards,
>>> Chee Wai Lee
>>> Computer Scientist, Performance Research Lab,
>>> NeuroInformatics Center,
>>> University of Oregon.
>>> On Jun 20, 2010, at 6:52 AM, Haowei Huang wrote:
>>>
>>>  Hi,
>>>
>>>       You just mentioned a trace-based tool called Projections in the
>>> charm++ manual. How can we use TAU to profile Charm++ applications on Cray?
>>> I used pgi MPI as MPI configuration to build TAU on Cray. Should we add
>>> configuration related to charm++ library when we build TAU on Cray machine?
>>> Thank you so much.
>>>
>>> --
>>> Haowei Huang
>>> Ph.D. student
>>> Technische Universitaet Muenchen
>>> Institut fuer Informatik, I10
>>> Boltzmannstr. 3
>>> D-85748 Garching
>>> Room 01.06.061
>>> Phone: +49 (89) 289 18477
>>> mailto: huangh AT in.tum.de
>>> _______________________________________________
>>> charm mailing list
>>> charm AT cs.uiuc.edu
>>> http://lists.cs.uiuc.edu/mailman/listinfo/charm
>>>
>>
>>
>>
>> --
>> Haowei Huang
>> Ph.D. student
>> Technische Universitaet Muenchen
>> Institut fuer Informatik, I10
>> Boltzmannstr. 3
>> D-85748 Garching
>> Room 01.06.061
>> Phone: +49 (89) 289 18477
>> mailto: huangh AT in.tum.de
>>
>
>
>
> --
> Haowei Huang
> Ph.D. student
> Technische Universitaet Muenchen
> Institut fuer Informatik, I10
> Boltzmannstr. 3
> D-85748 Garching
> Room 01.06.061
> Phone: +49 (89) 289 18477
> mailto: huangh AT in.tum.de
>
>

--
Haowei Huang
Ph.D. student
Technische Universitaet Muenchen
Institut fuer Informatik, I10
Boltzmannstr. 3
D-85748 Garching
Room 01.06.061
Phone: +49 (89) 289 18477
mailto: huangh AT in.tum.de