Difference between revisions of "BlueGene"

From Tau Wiki
Jump to: navigation, search
(→‎IBM Blue Gene/L or /P)
 
(8 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
= IBM Blue Gene/L =
+
= IBM Blue Gene/(L,P) =
  
−
A collection of information on how to configure and tau on IMB Blue Gene/L.
+
A collection of information on how to use TAU with IBM Blue Gene/L systems.
  
−
== Configuring PDT ==
+
== Building PDT ==
  
−
Configure pdt with g++
+
Configure and build [[PDT]]:
−
  ./configure
+
  ./configure -XLC
 
  make clean install
 
  make clean install
  
−
== Configuring TAU ==
+
== Building TAU for the back-end ==
−
  ./configure -arch=bgl -mpi -pdt=<dir> -pdt_c++=g++
+
for IBM BG/P
 +
  ./configure -arch=bgp -mpi -pdt=<dir> -pdt_c++=xlC
 
  make clean install
 
  make clean install
  
 +
for IBM BG/L
 +
 +
./configure -arch=bgl -mpi -pdt=<dir> -pdt_c++=xlC
 +
make clean install
 +
 +
== Building front-end tools ==
 
The binaries in <tt><taudir>/bgl/bin</tt> are not usable on the front-end, to build tools for the front-end, use:
 
The binaries in <tt><taudir>/bgl/bin</tt> are not usable on the front-end, to build tools for the front-end, use:
 
  ./configure  
 
  ./configure  
Line 20: Line 27:
  
 
== Fast BGL Timers ==
 
== Fast BGL Timers ==
−
BlueGene systems have a special cycle counter that can be used for low overhead timings, to use it with TAU configure with
+
BlueGene systems have a special clock cycle counter that can be used for low overhead timings, to use it with TAU configure with
 
  -BGLTIMERS
 
  -BGLTIMERS
 +
 +
== A Sample Session ==
 +
Following is a set of commands and their output which should work on most BlueGene systems
 +
<pre>
 +
# aqcuire sources
 +
wget http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
 +
wget http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
 +
 +
# build PDT
 +
tar -xzf pdt_latest.tar.gz
 +
cd pdtoolkit-3.10
 +
./configure
 +
make install
 +
cd ..
 +
 +
# build front-end
 +
tar -xzf tau_latest.tar.gz
 +
cd tau-*
 +
./configure
 +
make clean install
 +
 +
# build back-end
 +
./configure -arch=bgl -mpi -pdt=`pwd`/../pdtoolkit-3.10 -pdt_c++=g++
 +
make clean install
 +
 +
# build and run example auto-instrumented MPI fortran 90 application
 +
cd examples/pdt_mpi/f90
 +
make
 +
cqsub -t5 -n4 ./ring
 +
 +
# after job completes, view simple report
 +
../../../ppc64/bin/pprof
 +
</pre>
 +
 +
Typescript Output:
 +
 +
<pre>
 +
% # aqcuire sources
 +
% wget http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
 +
--23:27:54--  http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
 +
          => `pdt_latest.tar.gz'
 +
Resolving www.cs.uoregon.edu... 128.223.4.25
 +
Connecting to www.cs.uoregon.edu[128.223.4.25]:80... connected.
 +
HTTP request sent, awaiting response... 200 OK
 +
Length: 110,312,097 [application/x-tar]
 +
 +
100%[=====================================================================================================>] 110,312,097  400.94K/s    ETA 00:00
 +
 +
23:32:25 (397.35 KB/s) - `pdt_latest.tar.gz' saved [110312097/110312097]
 +
 +
% wget http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
 +
--23:32:25--  http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
 +
          => `tau_latest.tar.gz'
 +
Resolving www.cs.uoregon.edu... 128.223.4.25
 +
Connecting to www.cs.uoregon.edu[128.223.4.25]:80... connected.
 +
HTTP request sent, awaiting response... 200 OK
 +
Length: 15,381,525 [application/x-tar]
 +
 +
100%[=====================================================================================================>] 15,381,525  398.22K/s    ETA 00:00
 +
 +
23:33:03 (395.82 KB/s) - `tau_latest.tar.gz' saved [15381525/15381525]
 +
 +
%
 +
% # build PDT
 +
% tar -xzf pdt_latest.tar.gz
 +
% cd pdtoolkit-3.10
 +
% ./configure
 +
Program Database Toolkit (PDT) Configuration
 +
--------------------------------------------
 +
Looks like a Linux machine ...
 +
Looking for C++ compilers .. done
 +
Unpacking ppc64/bin ...
 +
Unpacking ppc64/bin/gfortran ...
 +
==> ARCH is PPCLINUX
 +
==> PLATFORM is ppc64
 +
==> Using /usr/bin/g++
 +
==> Default compiler options are -O2
 +
==> Makefiles were configured
 +
==> cparse was configured
 +
==> cxxparse was configured
 +
==> f90parse was configured
 +
==> f95parse was configured
 +
==> gfparse was configured
 +
 +
Configuration is complete!
 +
 +
Run "make" and "make install"
 +
Add "/home/amorris/wiki/pdtoolkit-3.10/ppc64//bin" to your path
 +
% make install
 +
(cd ductape; make "MAKE=make" all)
 +
make[1]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
 +
(cd lib; make "MAKE=make" all CXX="g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    " CXXAR="ar  cr " RANLIB="echo Built libpdb.a" PRELINK="echo Building libpdb.a" EXTRAOBJS="")
 +
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/lib'
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbRead.cc
 +
true pdbRead.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbMisc.cc
 +
true pdbMisc.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbItem.cc
 +
true pdbItem.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbGroup.cc
 +
true pdbGroup.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbClass.cc
 +
true pdbClass.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbModule.cc
 +
true pdbModule.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbRoutine.cc
 +
true pdbRoutine.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbCRoutine.cc
 +
true pdbCRoutine.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbFRoutine.cc
 +
true pdbFRoutine.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbTemplate.cc
 +
true pdbTemplate.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbGroupField.cc
 +
true pdbGroupField.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbWrite.cc
 +
true pdbWrite.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbMacro.cc
 +
true pdbMacro.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbNamespace.cc
 +
true pdbNamespace.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbType.cc
 +
true pdbType.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbFile.cc
 +
true pdbFile.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbSimpleItem.cc
 +
true pdbSimpleItem.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbTemplateItem.cc
 +
true pdbTemplateItem.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbFatItem.cc
 +
true pdbFatItem.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbTemplateArg.cc
 +
true pdbTemplateArg.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbPragma.cc
 +
true pdbPragma.cc
 +
echo Building libpdb.a
 +
Building libpdb.a
 +
ar  cr  libpdb.a pdbRead.o pdbMisc.o pdbItem.o pdbGroup.o pdbClass.o pdbModule.o pdbRoutine.o pdbCRoutine.o pdbFRoutine.o pdbTemplate.o pdbGroupField.o pdbWrite.o pdbMacro.o pdbNamespace.o pdbType.o pdbFile.o pdbSimpleItem.o pdbTemplateItem.o pdbFatItem.o pdbTemplateArg.o pdbPragma.o
 +
echo Built libpdb.a
 +
Built libpdb.a
 +
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/lib'
 +
(cd src; make "MAKE=make" all CXX="g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    ")
 +
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbconv.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbconv.o -o pdbconv ../lib/libpdb.a
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbtree.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbtree.o -o pdbtree ../lib/libpdb.a
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbmerge.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbmerge.o -o pdbmerge ../lib/libpdb.a
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbcomment.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbcomment.o -o pdbcomment ../lib/libpdb.a
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbstmt.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbstmt.o -o pdbstmt ../lib/libpdb.a
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c xmlgen.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc xmlgen.o -o xmlgen ../lib/libpdb.a
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    -I../inc -c pdbhtml.cc
 +
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbhtml.o -o pdbhtml ../lib/libpdb.a
 +
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
 +
make[1]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
 +
/bin/rm -f /home/amorris/wiki/pdtoolkit-3.10/ppc64//lib/libpdb.a
 +
(cd ductape; make "MAKE=make" install)
 +
make[1]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
 +
(cd src; make "MAKE=make" install)
 +
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
 +
cp pdbconv pdbtree pdbmerge pdbcomment pdbstmt xmlgen pdbhtml /home/amorris/wiki/pdtoolkit-3.10/ppc64//bin
 +
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
 +
make[1]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
 +
cp ./ductape/lib/libpdb.a /home/amorris/wiki/pdtoolkit-3.10/ppc64//lib
 +
echo "*****DONE*****"
 +
*****DONE*****
 +
% cd ..
 +
%
 +
% # build front-end
 +
% tar -xzf tau_latest.tar.gz
 +
% cd tau-*
 +
% ./configure
 +
-------------------- TAU configure script ---------------
 +
  The TAU source code has just been configured to use the
 +
  tau root directory /home/amorris/wiki/tau-2.16.1.
 +
  If you move the Tau distribution, you must either
 +
    * set an environment variable TAUROOT containing the new
 +
      location before running any TAU tools
 +
  or
 +
    * run configure again and recompile
 +
-----------------------------------------------------------------
 +
Attempting to auto-configure system, determining architecture...
 +
I think this is a ppc64...
 +
-PROFILE and/or -TRACE should be specified. Choosing -PROFILE as the default
 +
which: no xlf90 in (/home/amorris/tau2/ppc64/bin:/opt/ibmll/LoadL/full/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/usr/lib/java/bin)
 +
Default C++ compiler will be  g++ version 3.3.3 (SuSE Linux)
 +
Default C compiler will be  gcc version 3.3.3 (SuSE Linux)
 +
Checking if open takes O_LARGEFILE... yes
 +
C++ compiler supports Std Runtime Type Information (default)
 +
Supporting GNU RTTI options
 +
Testing for Standard C++ Library support for string class
 +
Found support for Standard C++ Library string
 +
NOTE: Compiling Profiling Library and Applications with -DTAU_STDCXXLIB
 +
***********************************************************************
 +
Using GNU lib dir as /usr/lib/gcc-lib/powerpc-suse-linux/3.3.3/
 +
Found an IBM PPC-64 Linux configuration definition
 +
TAU: installing TAU's ParaProf profile browser
 +
jdk version 1.4 or better found
 +
TAU: installed paraprof in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
TAU: installed ParaProf, PerfDMF, PerfExplorer and supporting jars in /home/amorris/wiki/tau-2.16.1/ppc64/lib
 +
TAU: installed tau_compiler.sh in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
TAU: installed TAU's Java trace writer api tf_writer.jar
 +
TAU: installing TAU's PerfDMF database utilities in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
TAU: installed tau_analyze in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
TAU: installed Makefile.inc in /home/amorris/wiki/tau-2.16.1/tools/src/TauIL
 +
TAU: installed TauIL and supporting jars in /home/amorris/wiki/tau-2.16.1/ppc64/lib
 +
 +
TAU: installing tools in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
NOTE: *** IBM pSeries Linux environment found. ***
 +
NOTE: Enabled Profiling. Compiling with -DPROFILING_ON
 +
NOTE: IBM xlf90 compiler specific options used
 +
NOTE: Using the O_LARGEFILE flag to open
 +
NOTE: Using Standard C++ Library
 +
NOTE: GNU g++ options used
 +
Script to modify Makefiles created.
 +
Applying script to all Makefiles, please wait, this may take a while...
 +
...................................................................................................................
 +
 +
Configuring TAU Build scripts...
 +
Modifying Makefiles in the examples subdirectory...
 +
Platform does not support JOGL, no 3d displays will be available in ParaProf......
 +
 +
Configuration complete!
 +
  Please add  /home/amorris/wiki/tau-2.16.1/ppc64/bin  to your path
 +
  Type "make install" to begin compilation
 +
% make clean install
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
 +
/bin/rm -rf *.o tau_reduce pprof tau_convert tau_merge                *.dep lib*.a *.ii *.ti ti_files cxx_repository ii_files rii_files
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
/bin/rm -rf *.ii *.ti ti_files cxx_repository ii_files rii_files *.a *.o *.so
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
 +
/bin/rm -f simple.o simple
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
 +
/bin/rm -f hello.o hello
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
 +
/bin/rm -f hello.o hello
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
 +
/bin/rm -f hello.o hello
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
 +
/bin/rm -f cubes.o cubes
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
 +
Determining Configuration...
 +
System previously configured as a ppc64
 +
*********** RECURSIVELY MAKING SUBDIRECTORIES ***********
 +
*** COMPILING utils DIRECTORY
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c pprof.cpp
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c function_data.cpp
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c user_event_data.cpp
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  pprof.o user_event_data.o function_data.o -o pprof -lm
 +
Installing pprof in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
 +
                  else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
 +
/bin/cp pprof /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c tau_reduce.cpp
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c pprof_elem.cpp
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  tau_reduce.o pprof_elem.o -o tau_reduce -lm
 +
Installing tau_reduce in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
 +
          else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
 +
/bin/cp tau_reduce /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c  tau_merge.c
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c tau_events.cpp
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_merge.o tau_events.o -o tau_merge -lm
 +
Installing tau_merge in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
 +
                  else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
 +
/bin/cp tau_merge /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
g++                  -I../include  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_convert.c -o tau_convert -lm
 +
Installing tau_convert in /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
 +
                  else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
 +
/bin/cp tau_convert /home/amorris/wiki/tau-2.16.1/ppc64/bin
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
 +
*** COMPILING src/Profile DIRECTORY
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c Profiler.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TulipTimers.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c UserEvent.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c FunctionInfo.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c RtsLayer.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c RtsThread.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauCAPI.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauFAPI.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauMapping.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauHooks.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauHandler.cpp
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauMemory.cpp
 +
ar              rcv  libtau-gnu.a Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
 +
a - Profiler.o
 +
a - TulipTimers.o
 +
a - UserEvent.o
 +
a - FunctionInfo.o
 +
a - RtsLayer.o
 +
a - RtsThread.o
 +
a - TauCAPI.o
 +
a - TauFAPI.o
 +
a - TauMapping.o
 +
a - TauHooks.o
 +
a - TauHandler.o
 +
a - TauMemory.o
 +
echo "Built"  libtau-gnu.a
 +
Built libtau-gnu.a
 +
Installing libtau-gnu.a in /home/amorris/wiki/tau-2.16.1/ppc64/lib
 +
/bin/cp libtau-gnu.a /home/amorris/wiki/tau-2.16.1/ppc64/lib
 +
/bin/cp /home/amorris/wiki/tau-2.16.1/include/Makefile /home/amorris/wiki/tau-2.16.1/ppc64/lib/Makefile.tau-gnu
 +
g++                  -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                  -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauDisable.cpp
 +
ar              rcv  libTauDisable.a TauDisable.o
 +
a - TauDisable.o
 +
echo "Built"  libTauDisable.a
 +
Built libTauDisable.a
 +
Installing libTauDisable.a in /home/amorris/wiki/tau-2.16.1/ppc64/lib
 +
/bin/cp libTauDisable.a /home/amorris/wiki/tau-2.16.1/ppc64/lib
 +
g++                  -shared    -o  libTAUsh-gnu.so              Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
 +
Installing libTAUsh-gnu.so in /home/amorris/wiki/tau-2.16.1/ppc64/lib
 +
/bin/cp libTAUsh-gnu.so /home/amorris/wiki/tau-2.16.1/ppc64/lib
 +
/bin/rm -rf /home/amorris/wiki/tau-2.16.1/ppc64/lib/libTAU.so
 +
cd /home/amorris/wiki/tau-2.16.1/ppc64/lib && ln -s libTAUsh-gnu.so                libTAU.so
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
***************** DONE ************************
 +
%
 +
% # build back-end
 +
% ./configure -arch=bgl -mpi -pdt=`pwd`/../pdtoolkit-3.10 -pdt_c++=g++
 +
-------------------- TAU configure script ---------------
 +
  The TAU source code has just been configured to use the
 +
  tau root directory /home/amorris/wiki/tau-2.16.1.
 +
  If you move the Tau distribution, you must either
 +
    * set an environment variable TAUROOT containing the new
 +
      location before running any TAU tools
 +
  or
 +
    * run configure again and recompile
 +
-----------------------------------------------------------------
 +
WARNING!! Auto-detect:ppc64 overridden with bgl
 +
-PROFILE and/or -TRACE should be specified. Choosing -PROFILE as the default
 +
Default C++ compiler will be IBMs xlC C++ compiler
 +
which: no xlf90 in (/home/amorris/tau2/ppc64/bin:/opt/ibmll/LoadL/full/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/usr/lib/java/bin)
 +
Not using the thread-safe version of the IBM compiler
 +
Thread-safe MPI interface is defined...
 +
MPI-2 Interface is defined...
 +
MPI-2 Grequest Interface is defined...
 +
MPI-2 MPI_Datarep_conversion_function Interface is defined...
 +
MPI-2 Comm_create_errhandler Interface is defined...
 +
MPI-2 MPI*attr_functions are defined...
 +
MPI-2 MPI_Type_dup and MPI_Exscan are defined...
 +
MPI-2 MPI_Add_error* functions are defined...
 +
MPI_Status f2c/c2f found...
 +
NOTE: MPI library does not have a threaded _r suffix
 +
Default C compiler will be blrts_xlc
 +
Checking if open takes O_LARGEFILE... yes
 +
C++ compiler supports Std Runtime Type Information (default)
 +
Testing for Standard C++ Library support for string class
 +
Found support for Standard C++ Library string
 +
NOTE: Compiling Profiling Library and Applications with -DTAU_STDCXXLIB
 +
***********************************************************************
 +
Found an IBM PPC-64 BGL Linux configuration definition
 +
PDT supports Fortran Loop Level information
 +
TAU: installing TAU's ParaProf profile browser
 +
jdk version 1.4 or better found
 +
TAU: installed paraprof in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
TAU: installed ParaProf, PerfDMF, PerfExplorer and supporting jars in /home/amorris/wiki/tau-2.16.1/bgl/lib
 +
TAU: installed tau_compiler.sh in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
TAU: installed tau_load.sh in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
TAU: installed TAU's Java trace writer api tf_writer.jar
 +
TAU: installing TAU's PerfDMF database utilities in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
TAU: installed tau_analyze in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
TAU: installed Makefile.inc in /home/amorris/wiki/tau-2.16.1/tools/src/TauIL
 +
TAU: installed TauIL and supporting jars in /home/amorris/wiki/tau-2.16.1/bgl/lib
 +
 +
TAU: installing tools in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
NOTE: *** IBM BlueGene/L development environment found. ***
 +
NOTE: Enabled Profiling. Compiling with -DPROFILING_ON
 +
NOTE: Using the IBM xlC C++ compiler
 +
NOTE: IBM xlf90 compiler specific options used
 +
NOTE: Using the TAU MPI Profiling Interface
 +
NOTE: Using the TAU MPI_Init_thread Profiling Interface Wrapper
 +
NOTE: Using TAU's MPI-2 extensions
 +
NOTE: Using TAU's MPI-2 Grequest extensions
 +
NOTE: Using TAU's MPI-2 Datarep_conversion extensions
 +
NOTE: Using TAU's MPI-2 Error handler extensions
 +
NOTE: Using TAU's MPI-2 Attr extensions
 +
NOTE: Using TAU's MPI-2 Type and Exscan extensions
 +
NOTE: Using TAU's MPI-2 Add_error extensions
 +
NOTE: Using default cc compiler.
 +
NOTE: Using the O_LARGEFILE flag to open
 +
NOTE: Using Standard C++ Library
 +
NOTE: Using PDT for TAU Source Code Instrumentation ***
 +
NOTE: Using a different compiler for tau_instrumentor
 +
Script to modify Makefiles created.
 +
Applying script to all Makefiles, please wait, this may take a while...
 +
...................................................................................................................
 +
 +
Configuring TAU Build scripts...
 +
Modifying Makefiles in the examples subdirectory...
 +
Platform does not support JOGL, no 3d displays will be available in ParaProf..................
 +
 +
Configuration complete!
 +
  Please add  /home/amorris/wiki/tau-2.16.1/bgl/bin  to your path
 +
  Type "make install" to begin compilation
 +
% make clean install
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
 +
/bin/rm -rf *.o tau_reduce pprof tau_convert tau_merge      tau_instrumentor          *.dep lib*.a *.ii *.ti ti_files cxx_repository ii_files rii_files
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
/bin/rm -rf *.ii *.ti ti_files cxx_repository ii_files rii_files *.a *.o *.so
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
 +
/bin/rm -f simple.o simple
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
 +
/bin/rm -f hello.o hello
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
 +
/bin/rm -f hello.o hello
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
 +
/bin/rm -f hello.o hello
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
 +
/bin/rm -f cubes.o cubes
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/pi'
 +
/bin/rm -f cpi.o cpi
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/pi'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/NPB2.3'
 +
rm -f core
 +
rm -f *~ */core */*~ */*.o */npbparams.h */*.obj */*.exe
 +
rm -f MPI_dummy/test MPI_dummy/libmpi.a
 +
rm -f sys/setparams sys/makesuite sys/setparams.h
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/NPB2.3'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/autoinstrument'
 +
/bin/rm -f klargest.o klargest.inst.cpp klargest klargest.pdb
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/autoinstrument'
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/reduce'
 +
/bin/rm -f klargest.o klargest.inst.cpp klargest klargest.pdb *.refined* profile* pprof.dat
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/reduce'
 +
Determining Configuration...
 +
System previously configured as a bgl
 +
*********** RECURSIVELY MAKING SUBDIRECTORIES ***********
 +
*** COMPILING utils DIRECTORY
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c pprof.cpp
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c function_data.cpp
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c user_event_data.cpp
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  pprof.o user_event_data.o function_data.o -o pprof -lm
 +
Installing pprof in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
 +
                  else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
 +
/bin/cp pprof /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c tau_reduce.cpp
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  -c pprof_elem.cpp
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE  tau_reduce.o pprof_elem.o -o tau_reduce -lm
 +
Installing tau_reduce in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
 +
          else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
 +
/bin/cp tau_reduce /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c  tau_merge.c
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c tau_events.cpp
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_merge.o tau_events.o -o tau_merge -lm
 +
Installing tau_merge in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
 +
                  else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
 +
/bin/cp tau_merge /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
blrts_xlC    -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_convert.c -o tau_convert -lm
 +
Installing tau_convert in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
 +
                  else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
 +
/bin/cp tau_convert /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_instrumentor.cpp
 +
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_instrument.cpp
 +
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_selective.cpp
 +
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w    -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_instrumentor.o tau_instrument.o tau_selective.o -o tau_instrumentor -L/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/bgl/lib -lpdb  -lm
 +
Installing tau_instrumentor in /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
 +
                  else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
 +
/bin/cp tau_instrumentor /home/amorris/wiki/tau-2.16.1/bgl/bin
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
 +
*** COMPILING src/Profile DIRECTORY
 +
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c Profiler.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c TulipTimers.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c UserEvent.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c FunctionInfo.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c RtsLayer.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c RtsThread.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c TauCAPI.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c TauFAPI.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c TauMapping.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c TauHooks.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c TauHandler.cpp
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c TauMemory.cpp
 +
ar              rcv  libtau-mpi-pdt.a Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
 +
a - Profiler.o
 +
a - TulipTimers.o
 +
a - UserEvent.o
 +
a - FunctionInfo.o
 +
a - RtsLayer.o
 +
a - RtsThread.o
 +
a - TauCAPI.o
 +
a - TauFAPI.o
 +
a - TauMapping.o
 +
a - TauHooks.o
 +
a - TauHandler.o
 +
a - TauMemory.o
 +
echo "Built"  libtau-mpi-pdt.a
 +
Built libtau-mpi-pdt.a
 +
Installing libtau-mpi-pdt.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
 +
/bin/cp libtau-mpi-pdt.a /home/amorris/wiki/tau-2.16.1/bgl/lib
 +
/bin/cp /home/amorris/wiki/tau-2.16.1/include/Makefile /home/amorris/wiki/tau-2.16.1/bgl/lib/Makefile.tau-mpi-pdt
 +
blrts_xlC    -DTAU_LIBRARY_SOURCE  -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include  -c TauDisable.cpp
 +
ar              rcv  libTauDisable.a TauDisable.o
 +
a - TauDisable.o
 +
echo "Built"  libTauDisable.a
 +
Built libTauDisable.a
 +
Installing libTauDisable.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
 +
/bin/cp libTauDisable.a /home/amorris/wiki/tau-2.16.1/bgl/lib
 +
make -f Makefile.wrapper
 +
make[2]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
blrts_xlc  -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC      -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauMpi.c
 +
blrts_xlc  -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC      -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauFMpi.c
 +
"TauFMpi.c", line 4088.54: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
 +
"TauFMpi.c", line 4235.79: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
 +
"TauFMpi.c", line 4906.48: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
 +
"TauFMpi.c", line 5011.79: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
 +
blrts_xlc  -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                  -DTAU_STDCXXLIB                      -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC      -DTAU_MPI -DTAU_MPI_THREADED                    -DTAU_MPIGREQUEST    -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER    -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR        -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauMpiExtensions.c
 +
ar              rcv libTauMpi-mpi-pdt.a TauMpi.o TauFMpi.o        TauMpiExtensions.o
 +
a - TauMpi.o
 +
a - TauFMpi.o
 +
a - TauMpiExtensions.o
 +
echo "Built"  libTauMpi-mpi-pdt.a
 +
Built libTauMpi-mpi-pdt.a
 +
make[2]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
make -f Makefile.wrapper install
 +
make[2]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
Installing libTauMpi-mpi-pdt.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
 +
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/lib ] ; then true; \
 +
                  else mkdir /home/amorris/wiki/tau-2.16.1/bgl/lib ;fi
 +
/bin/cp libTauMpi-mpi-pdt.a /home/amorris/wiki/tau-2.16.1/bgl/lib
 +
make[2]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
 +
***************** DONE ************************
 +
% # build and run example auto-instrumented MPI fortran 90 application
 +
% cd examples/pdt_mpi/f90
 +
% make
 +
/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/bgl/bin/f95parse ring.f90 -I/home/amorris/wiki/tau-2.16.1/include -I/bgl/BlueLight/ppcfloor/bglsys/include ; ../../../bgl/bin/tau_instrumentor ring.pdb ring.f90 -o ring.inst.f90 ; blrts_xlf90          -I/home/amorris/wiki/tau-2.16.1/include -I/bgl/BlueLight/ppcfloor/bglsys/include -qsuffix=f=f90  -c ring.inst.f90 -o ring.o ; rm -f ring.pdb ;
 +
** func  === End of Compilation 1 ===
 +
** main  === End of Compilation 2 ===
 +
1501-510  Compilation successful for file ring.inst.f90.
 +
blrts_xlf90              ring.o -o ring -L/home/amorris/wiki/tau-2.16.1/bgl/lib -lTauMpi-mpi-pdt -L/bgl/BlueLight/ppcfloor/bglsys/lib -lmpich.rts -lmsglayer.rts -ldevices.rts -lrts.rts -ldevices.rts -lrt    -L/home/amorris/wiki/tau-2.16.1/bgl/lib -ltau-mpi-pdt              -L/usr/bin/../blrts_dev_lib -L/usr/bin/../blrts_lib -L/opt/ibmcmp/vacpp/bg/8.0/blrts_lib -libmc++ -L/bgl/BlueLight/ppcfloor/blrts-gnu/powerpc-bgl-blrts-gnu/lib-lstdc++
 +
% cqsub -t5 -n4 ./ring
 +
5332
 +
% # after job completes, view simple report
 +
% ../../../ppc64/bin/pprof
 +
Reading Profile files in profile.*
 +
 +
NODE 0;CONTEXT 0;THREAD 0:
 +
---------------------------------------------------------------------------------------
 +
%Time    Exclusive    Inclusive      #Call      #Subrs  Inclusive Name
 +
              msec  total msec                          usec/call
 +
---------------------------------------------------------------------------------------
 +
100.0        0.088            1          1          5      1420 MAIN
 +
54.9        0.606        0.78          1          4        780 FUNC
 +
37.5        0.532        0.532          1          0        532 MPI_Init()
 +
  8.5        0.121        0.121          1          0        121 MPI_Recv()
 +
  1.7        0.024        0.024          1          0        24 MPI_Send()
 +
  1.5        0.021        0.021          1          0        21 MPI_Bcast()
 +
  0.8        0.012        0.012          1          0        12 MPI_Finalize()
 +
  0.6        0.008        0.008          1          0          8 MPI_Barrier()
 +
  0.3        0.004        0.004          1          0          4 MPI_Comm_rank()
 +
  0.3        0.004        0.004          1          0          4 MPI_Comm_size()
 +
---------------------------------------------------------------------------------------
 +
 +
USER EVENTS Profile :NODE 0, CONTEXT 0, THREAD 0
 +
---------------------------------------------------------------------------------------
 +
NumSamples  MaxValue  MinValue  MeanValue  Std. Dev.  Event Name
 +
---------------------------------------------------------------------------------------
 +
        1        40        40        40          0  Message size for broadcast
 +
        1        40        40        40          0  Message size received from all nodes
 +
        1        40        40        40          0  Message size sent to all nodes
 +
---------------------------------------------------------------------------------------
 +
 +
NODE 1;CONTEXT 0;THREAD 0:
 +
---------------------------------------------------------------------------------------
 +
%Time    Exclusive    Inclusive      #Call      #Subrs  Inclusive Name
 +
              msec  total msec                          usec/call
 +
---------------------------------------------------------------------------------------
 +
100.0        0.086            1          1          5      1414 MAIN
 +
52.1        0.55        0.736          1          4        736 FUNC
 +
37.1        0.525        0.525          1          0        525 MPI_Init()
 +
  7.8        0.11        0.11          1          0        110 MPI_Bcast()
 +
  4.1        0.058        0.058          1          0        58 MPI_Finalize()
 +
  2.8        0.039        0.039          1          0        39 MPI_Recv()
 +
  1.5        0.021        0.021          1          0        21 MPI_Barrier()
 +
  1.1        0.016        0.016          1          0        16 MPI_Send()
 +
  0.4        0.005        0.005          1          0          5 MPI_Comm_size()
 +
  0.3        0.004        0.004          1          0          4 MPI_Comm_rank()
 +
---------------------------------------------------------------------------------------
 +
 +
USER EVENTS Profile :NODE 1, CONTEXT 0, THREAD 0
 +
---------------------------------------------------------------------------------------
 +
NumSamples  MaxValue  MinValue  MeanValue  Std. Dev.  Event Name
 +
---------------------------------------------------------------------------------------
 +
        1        40        40        40          0  Message size for broadcast
 +
        1        40        40        40          0  Message size received from all nodes
 +
        1        40        40        40          0  Message size sent to all nodes
 +
---------------------------------------------------------------------------------------
 +
 +
NODE 2;CONTEXT 0;THREAD 0:
 +
---------------------------------------------------------------------------------------
 +
%Time    Exclusive    Inclusive      #Call      #Subrs  Inclusive Name
 +
              msec  total msec                          usec/call
 +
---------------------------------------------------------------------------------------
 +
100.0        0.083            1          1          5      1415 MAIN
 +
54.2        0.544        0.767          1          4        767 FUNC
 +
37.3        0.528        0.528          1          0        528 MPI_Init()
 +
  5.7        0.08        0.08          1          0        80 MPI_Recv()
 +
  4.8        0.068        0.068          1          0        68 MPI_Bcast()
 +
  4.1        0.058        0.058          1          0        58 MPI_Barrier()
 +
  2.0        0.028        0.028          1          0        28 MPI_Finalize()
 +
  1.2        0.017        0.017          1          0        17 MPI_Send()
 +
  0.4        0.005        0.005          1          0          5 MPI_Comm_size()
 +
  0.3        0.004        0.004          1          0          4 MPI_Comm_rank()
 +
---------------------------------------------------------------------------------------
 +
 +
USER EVENTS Profile :NODE 2, CONTEXT 0, THREAD 0
 +
---------------------------------------------------------------------------------------
 +
NumSamples  MaxValue  MinValue  MeanValue  Std. Dev.  Event Name
 +
---------------------------------------------------------------------------------------
 +
        1        40        40        40          0  Message size for broadcast
 +
        1        40        40        40          0  Message size received from all nodes
 +
        1        40        40        40          0  Message size sent to all nodes
 +
---------------------------------------------------------------------------------------
 +
 +
NODE 3;CONTEXT 0;THREAD 0:
 +
---------------------------------------------------------------------------------------
 +
%Time    Exclusive    Inclusive      #Call      #Subrs  Inclusive Name
 +
              msec  total msec                          usec/call
 +
---------------------------------------------------------------------------------------
 +
100.0        0.086            1          1          5      1411 MAIN
 +
53.2        0.55        0.751          1          4        751 FUNC
 +
37.0        0.522        0.522          1          0        522 MPI_Init()
 +
  8.6        0.121        0.121          1          0        121 MPI_Recv()
 +
  3.0        0.043        0.043          1          0        43 MPI_Finalize()
 +
  2.6        0.036        0.036          1          0        36 MPI_Barrier()
 +
  1.9        0.027        0.027          1          0        27 MPI_Bcast()
 +
  1.2        0.017        0.017          1          0        17 MPI_Send()
 +
  0.4        0.005        0.005          1          0          5 MPI_Comm_size()
 +
  0.3        0.004        0.004          1          0          4 MPI_Comm_rank()
 +
---------------------------------------------------------------------------------------
 +
 +
USER EVENTS Profile :NODE 3, CONTEXT 0, THREAD 0
 +
---------------------------------------------------------------------------------------
 +
NumSamples  MaxValue  MinValue  MeanValue  Std. Dev.  Event Name
 +
---------------------------------------------------------------------------------------
 +
        1        40        40        40          0  Message size for broadcast
 +
        1        40        40        40          0  Message size received from all nodes
 +
        1        40        40        40          0  Message size sent to all nodes
 +
---------------------------------------------------------------------------------------
 +
 +
FUNCTION SUMMARY (total):
 +
---------------------------------------------------------------------------------------
 +
%Time    Exclusive    Inclusive      #Call      #Subrs  Inclusive Name
 +
              msec  total msec                          usec/call
 +
---------------------------------------------------------------------------------------
 +
100.0        0.343            5          4          20      1415 MAIN
 +
53.6            2            3          4          16        758 FUNC
 +
37.2            2            2          4          0        527 MPI_Init()
 +
  6.4        0.361        0.361          4          0        90 MPI_Recv()
 +
  4.0        0.226        0.226          4          0        56 MPI_Bcast()
 +
  2.5        0.141        0.141          4          0        35 MPI_Finalize()
 +
  2.2        0.123        0.123          4          0        31 MPI_Barrier()
 +
  1.3        0.074        0.074          4          0        18 MPI_Send()
 +
  0.3        0.019        0.019          4          0          5 MPI_Comm_size()
 +
  0.3        0.016        0.016          4          0          4 MPI_Comm_rank()
 +
 +
FUNCTION SUMMARY (mean):
 +
---------------------------------------------------------------------------------------
 +
%Time    Exclusive    Inclusive      #Call      #Subrs  Inclusive Name
 +
              msec  total msec                          usec/call
 +
---------------------------------------------------------------------------------------
 +
100.0      0.0858            1          1          5      1415 MAIN
 +
53.6        0.562        0.758          1          4        758 FUNC
 +
37.2        0.527        0.527          1          0        527 MPI_Init()
 +
  6.4      0.0902      0.0902          1          0        90 MPI_Recv()
 +
  4.0      0.0565      0.0565          1          0        56 MPI_Bcast()
 +
  2.5      0.0352      0.0352          1          0        35 MPI_Finalize()
 +
  2.2      0.0307      0.0307          1          0        31 MPI_Barrier()
 +
  1.3      0.0185      0.0185          1          0        18 MPI_Send()
 +
  0.3      0.00475      0.00475          1          0          5 MPI_Comm_size()
 +
  0.3        0.004        0.004          1          0          4 MPI_Comm_rank()
 +
%       
 +
 +
 +
 +
</pre>

Latest revision as of 00:19, 9 November 2007

IBM Blue Gene/(L,P)

A collection of information on how to use TAU with IBM Blue Gene/L systems.

Building PDT

Configure and build PDT: 

./configure -XLC
make clean install

Building TAU for the back-end

for IBM BG/P 

./configure -arch=bgp -mpi -pdt=<dir> -pdt_c++=xlC
make clean install

for IBM BG/L 

./configure -arch=bgl -mpi -pdt=<dir> -pdt_c++=xlC
make clean install

Building front-end tools

The binaries in <taudir>/bgl/bin are not usable on the front-end, to build tools for the front-end, use: 

./configure 
make clean install

This will build and install tools (such as Paraprof, pprof) in the <taudir>/ppc64/bin directory.

Fast BGL Timers

BlueGene systems have a special clock cycle counter that can be used for low overhead timings, to use it with TAU configure with 

-BGLTIMERS

A Sample Session

Following is a set of commands and their output which should work on most BlueGene systems 

# aqcuire sources
wget http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
wget http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz

# build PDT
tar -xzf pdt_latest.tar.gz
cd pdtoolkit-3.10
./configure
make install
cd ..

# build front-end
tar -xzf tau_latest.tar.gz
cd tau-*
./configure
make clean install

# build back-end
./configure -arch=bgl -mpi -pdt=`pwd`/../pdtoolkit-3.10 -pdt_c++=g++
make clean install

# build and run example auto-instrumented MPI fortran 90 application
cd examples/pdt_mpi/f90
make
cqsub -t5 -n4 ./ring

# after job completes, view simple report
../../../ppc64/bin/pprof

Typescript Output: 

% # aqcuire sources
% wget http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
--23:27:54--  http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
           => `pdt_latest.tar.gz'
Resolving www.cs.uoregon.edu... 128.223.4.25
Connecting to www.cs.uoregon.edu[128.223.4.25]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 110,312,097 [application/x-tar]

100%[=====================================================================================================>] 110,312,097  400.94K/s    ETA 00:00

23:32:25 (397.35 KB/s) - `pdt_latest.tar.gz' saved [110312097/110312097]

% wget http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
--23:32:25--  http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
           => `tau_latest.tar.gz'
Resolving www.cs.uoregon.edu... 128.223.4.25
Connecting to www.cs.uoregon.edu[128.223.4.25]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 15,381,525 [application/x-tar]

100%[=====================================================================================================>] 15,381,525   398.22K/s    ETA 00:00

23:33:03 (395.82 KB/s) - `tau_latest.tar.gz' saved [15381525/15381525]

%
% # build PDT
% tar -xzf pdt_latest.tar.gz
% cd pdtoolkit-3.10
% ./configure
Program Database Toolkit (PDT) Configuration
--------------------------------------------
Looks like a Linux machine ...
Looking for C++ compilers .. done
Unpacking ppc64/bin ...
Unpacking ppc64/bin/gfortran ...
==> ARCH is PPCLINUX
==> PLATFORM is ppc64
==> Using /usr/bin/g++
==> Default compiler options are -O2
==> Makefiles were configured
==> cparse was configured
==> cxxparse was configured
==> f90parse was configured
==> f95parse was configured
==> gfparse was configured

Configuration is complete!

Run "make" and "make install"
Add "/home/amorris/wiki/pdtoolkit-3.10/ppc64//bin" to your path
% make install
(cd ductape; make "MAKE=make" all)
make[1]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
(cd lib; make "MAKE=make" all CXX="g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    " CXXAR="ar  cr " RANLIB="echo Built libpdb.a" PRELINK="echo Building libpdb.a" EXTRAOBJS="")
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/lib'
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbRead.cc
true pdbRead.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbMisc.cc
true pdbMisc.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbItem.cc
true pdbItem.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbGroup.cc
true pdbGroup.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbClass.cc
true pdbClass.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbModule.cc
true pdbModule.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbRoutine.cc
true pdbRoutine.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbCRoutine.cc
true pdbCRoutine.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbFRoutine.cc
true pdbFRoutine.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbTemplate.cc
true pdbTemplate.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbGroupField.cc
true pdbGroupField.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbWrite.cc
true pdbWrite.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbMacro.cc
true pdbMacro.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbNamespace.cc
true pdbNamespace.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbType.cc
true pdbType.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbFile.cc
true pdbFile.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbSimpleItem.cc
true pdbSimpleItem.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbTemplateItem.cc
true pdbTemplateItem.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbFatItem.cc
true pdbFatItem.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbTemplateArg.cc
true pdbTemplateArg.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbPragma.cc
true pdbPragma.cc
echo Building libpdb.a
Building libpdb.a
ar  cr  libpdb.a pdbRead.o pdbMisc.o pdbItem.o pdbGroup.o pdbClass.o pdbModule.o pdbRoutine.o pdbCRoutine.o pdbFRoutine.o pdbTemplate.o pdbGroupField.o pdbWrite.o pdbMacro.o pdbNamespace.o pdbType.o pdbFile.o pdbSimpleItem.o pdbTemplateItem.o pdbFatItem.o pdbTemplateArg.o pdbPragma.o
echo Built libpdb.a
Built libpdb.a
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/lib'
(cd src; make "MAKE=make" all CXX="g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    ")
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbconv.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbconv.o -o pdbconv ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbtree.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbtree.o -o pdbtree ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbmerge.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbmerge.o -o pdbmerge ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbcomment.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbcomment.o -o pdbcomment ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbstmt.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbstmt.o -o pdbstmt ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c xmlgen.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc xmlgen.o -o xmlgen ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbhtml.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbhtml.o -o pdbhtml ../lib/libpdb.a
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
make[1]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
/bin/rm -f /home/amorris/wiki/pdtoolkit-3.10/ppc64//lib/libpdb.a
(cd ductape; make "MAKE=make" install)
make[1]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
(cd src; make "MAKE=make" install)
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
cp pdbconv pdbtree pdbmerge pdbcomment pdbstmt xmlgen pdbhtml /home/amorris/wiki/pdtoolkit-3.10/ppc64//bin
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
make[1]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
cp ./ductape/lib/libpdb.a /home/amorris/wiki/pdtoolkit-3.10/ppc64//lib
echo "*****DONE*****"
*****DONE*****
% cd ..
%
% # build front-end
% tar -xzf tau_latest.tar.gz
% cd tau-*
% ./configure
-------------------- TAU configure script ---------------
  The TAU source code has just been configured to use the
  tau root directory /home/amorris/wiki/tau-2.16.1.
  If you move the Tau distribution, you must either
    * set an environment variable TAUROOT containing the new
      location before running any TAU tools
  or
    * run configure again and recompile
-----------------------------------------------------------------
Attempting to auto-configure system, determining architecture...
I think this is a ppc64...
-PROFILE and/or -TRACE should be specified. Choosing -PROFILE as the default
which: no xlf90 in (/home/amorris/tau2/ppc64/bin:/opt/ibmll/LoadL/full/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/usr/lib/java/bin)
Default C++ compiler will be  g++ version 3.3.3 (SuSE Linux)
Default C compiler will be  gcc version 3.3.3 (SuSE Linux)
Checking if open takes O_LARGEFILE... yes
C++ compiler supports Std Runtime Type Information (default)
Supporting GNU RTTI options
Testing for Standard C++ Library support for string class
Found support for Standard C++ Library string
NOTE: Compiling Profiling Library and Applications with -DTAU_STDCXXLIB
***********************************************************************
Using GNU lib dir as /usr/lib/gcc-lib/powerpc-suse-linux/3.3.3/
Found an IBM PPC-64 Linux configuration definition
TAU: installing TAU's ParaProf profile browser
jdk version 1.4 or better found
TAU: installed paraprof in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed ParaProf, PerfDMF, PerfExplorer and supporting jars in /home/amorris/wiki/tau-2.16.1/ppc64/lib
TAU: installed tau_compiler.sh in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed TAU's Java trace writer api tf_writer.jar
TAU: installing TAU's PerfDMF database utilities in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed tau_analyze in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed Makefile.inc in /home/amorris/wiki/tau-2.16.1/tools/src/TauIL
TAU: installed TauIL and supporting jars in /home/amorris/wiki/tau-2.16.1/ppc64/lib

TAU: installing tools in /home/amorris/wiki/tau-2.16.1/ppc64/bin
NOTE: *** IBM pSeries Linux environment found. ***
NOTE: Enabled Profiling. Compiling with -DPROFILING_ON
NOTE: IBM xlf90 compiler specific options used
NOTE: Using the O_LARGEFILE flag to open
NOTE: Using Standard C++ Library
NOTE: GNU g++ options used
Script to modify Makefiles created.
Applying script to all Makefiles, please wait, this may take a while...
...................................................................................................................

Configuring TAU Build scripts...
Modifying Makefiles in the examples subdirectory...
Platform does not support JOGL, no 3d displays will be available in ParaProf......

Configuration complete!
   Please add  /home/amorris/wiki/tau-2.16.1/ppc64/bin  to your path
   Type "make install" to begin compilation
% make clean install
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
/bin/rm -rf *.o tau_reduce pprof tau_convert tau_merge                *.dep lib*.a *.ii *.ti ti_files cxx_repository ii_files rii_files
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
/bin/rm -rf *.ii *.ti ti_files cxx_repository ii_files rii_files *.a *.o *.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
/bin/rm -f simple.o simple
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
/bin/rm -f cubes.o cubes
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
Determining Configuration...
System previously configured as a ppc64
*********** RECURSIVELY MAKING SUBDIRECTORIES ***********
*** COMPILING utils DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c pprof.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c function_data.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c user_event_data.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   pprof.o user_event_data.o function_data.o -o pprof -lm
Installing pprof in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp pprof /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c tau_reduce.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c pprof_elem.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   tau_reduce.o pprof_elem.o -o tau_reduce -lm
Installing tau_reduce in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
          else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_reduce /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c  tau_merge.c
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c tau_events.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_merge.o tau_events.o -o tau_merge -lm
Installing tau_merge in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_merge /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_convert.c -o tau_convert -lm
Installing tau_convert in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_convert /home/amorris/wiki/tau-2.16.1/ppc64/bin
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
*** COMPILING src/Profile DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c Profiler.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TulipTimers.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c UserEvent.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c FunctionInfo.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c RtsLayer.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c RtsThread.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauCAPI.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauFAPI.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauMapping.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauHooks.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauHandler.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauMemory.cpp
ar               rcv  libtau-gnu.a Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
a - Profiler.o
a - TulipTimers.o
a - UserEvent.o
a - FunctionInfo.o
a - RtsLayer.o
a - RtsThread.o
a - TauCAPI.o
a - TauFAPI.o
a - TauMapping.o
a - TauHooks.o
a - TauHandler.o
a - TauMemory.o
echo "Built"  libtau-gnu.a
Built libtau-gnu.a
Installing libtau-gnu.a in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libtau-gnu.a /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp /home/amorris/wiki/tau-2.16.1/include/Makefile /home/amorris/wiki/tau-2.16.1/ppc64/lib/Makefile.tau-gnu
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauDisable.cpp
ar               rcv  libTauDisable.a TauDisable.o
a - TauDisable.o
echo "Built"  libTauDisable.a
Built libTauDisable.a
Installing libTauDisable.a in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libTauDisable.a /home/amorris/wiki/tau-2.16.1/ppc64/lib
g++                  -shared     -o   libTAUsh-gnu.so              Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
Installing libTAUsh-gnu.so in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libTAUsh-gnu.so /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/rm -rf /home/amorris/wiki/tau-2.16.1/ppc64/lib/libTAU.so
cd /home/amorris/wiki/tau-2.16.1/ppc64/lib && ln -s libTAUsh-gnu.so                libTAU.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
***************** DONE ************************
%
% # build back-end
% ./configure -arch=bgl -mpi -pdt=`pwd`/../pdtoolkit-3.10 -pdt_c++=g++
-------------------- TAU configure script ---------------
  The TAU source code has just been configured to use the
  tau root directory /home/amorris/wiki/tau-2.16.1.
  If you move the Tau distribution, you must either
    * set an environment variable TAUROOT containing the new
      location before running any TAU tools
  or
    * run configure again and recompile
-----------------------------------------------------------------
WARNING!! Auto-detect:ppc64 overridden with bgl
-PROFILE and/or -TRACE should be specified. Choosing -PROFILE as the default
Default C++ compiler will be IBMs xlC C++ compiler
which: no xlf90 in (/home/amorris/tau2/ppc64/bin:/opt/ibmll/LoadL/full/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/usr/lib/java/bin)
Not using the thread-safe version of the IBM compiler
Thread-safe MPI interface is defined...
MPI-2 Interface is defined...
MPI-2 Grequest Interface is defined...
MPI-2 MPI_Datarep_conversion_function Interface is defined...
MPI-2 Comm_create_errhandler Interface is defined...
MPI-2 MPI*attr_functions are defined...
MPI-2 MPI_Type_dup and MPI_Exscan are defined...
MPI-2 MPI_Add_error* functions are defined...
MPI_Status f2c/c2f found...
NOTE: MPI library does not have a threaded _r suffix
Default C compiler will be blrts_xlc
Checking if open takes O_LARGEFILE... yes
C++ compiler supports Std Runtime Type Information (default)
Testing for Standard C++ Library support for string class
Found support for Standard C++ Library string
NOTE: Compiling Profiling Library and Applications with -DTAU_STDCXXLIB
***********************************************************************
Found an IBM PPC-64 BGL Linux configuration definition
PDT supports Fortran Loop Level information
TAU: installing TAU's ParaProf profile browser
jdk version 1.4 or better found
TAU: installed paraprof in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed ParaProf, PerfDMF, PerfExplorer and supporting jars in /home/amorris/wiki/tau-2.16.1/bgl/lib
TAU: installed tau_compiler.sh in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed tau_load.sh in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed TAU's Java trace writer api tf_writer.jar
TAU: installing TAU's PerfDMF database utilities in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed tau_analyze in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed Makefile.inc in /home/amorris/wiki/tau-2.16.1/tools/src/TauIL
TAU: installed TauIL and supporting jars in /home/amorris/wiki/tau-2.16.1/bgl/lib

TAU: installing tools in /home/amorris/wiki/tau-2.16.1/bgl/bin
NOTE: *** IBM BlueGene/L development environment found. ***
NOTE: Enabled Profiling. Compiling with -DPROFILING_ON
NOTE: Using the IBM xlC C++ compiler
NOTE: IBM xlf90 compiler specific options used
NOTE: Using the TAU MPI Profiling Interface
NOTE: Using the TAU MPI_Init_thread Profiling Interface Wrapper
NOTE: Using TAU's MPI-2 extensions
NOTE: Using TAU's MPI-2 Grequest extensions
NOTE: Using TAU's MPI-2 Datarep_conversion extensions
NOTE: Using TAU's MPI-2 Error handler extensions
NOTE: Using TAU's MPI-2 Attr extensions
NOTE: Using TAU's MPI-2 Type and Exscan extensions
NOTE: Using TAU's MPI-2 Add_error extensions
NOTE: Using default cc compiler.
NOTE: Using the O_LARGEFILE flag to open
NOTE: Using Standard C++ Library
NOTE: Using PDT for TAU Source Code Instrumentation ***
NOTE: Using a different compiler for tau_instrumentor
Script to modify Makefiles created.
Applying script to all Makefiles, please wait, this may take a while...
...................................................................................................................

Configuring TAU Build scripts...
Modifying Makefiles in the examples subdirectory...
Platform does not support JOGL, no 3d displays will be available in ParaProf..................

Configuration complete!
   Please add  /home/amorris/wiki/tau-2.16.1/bgl/bin  to your path
   Type "make install" to begin compilation
% make clean install
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
/bin/rm -rf *.o tau_reduce pprof tau_convert tau_merge      tau_instrumentor           *.dep lib*.a *.ii *.ti ti_files cxx_repository ii_files rii_files
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
/bin/rm -rf *.ii *.ti ti_files cxx_repository ii_files rii_files *.a *.o *.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
/bin/rm -f simple.o simple
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
/bin/rm -f cubes.o cubes
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/pi'
/bin/rm -f cpi.o cpi
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/pi'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/NPB2.3'
rm -f core
rm -f *~ */core */*~ */*.o */npbparams.h */*.obj */*.exe
rm -f MPI_dummy/test MPI_dummy/libmpi.a
rm -f sys/setparams sys/makesuite sys/setparams.h
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/NPB2.3'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/autoinstrument'
/bin/rm -f klargest.o klargest.inst.cpp klargest klargest.pdb
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/autoinstrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/reduce'
/bin/rm -f klargest.o klargest.inst.cpp klargest klargest.pdb *.refined* profile* pprof.dat
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/reduce'
Determining Configuration...
System previously configured as a bgl
*********** RECURSIVELY MAKING SUBDIRECTORIES ***********
*** COMPILING utils DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c pprof.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c function_data.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c user_event_data.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   pprof.o user_event_data.o function_data.o -o pprof -lm
Installing pprof in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp pprof /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c tau_reduce.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c pprof_elem.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   tau_reduce.o pprof_elem.o -o tau_reduce -lm
Installing tau_reduce in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
          else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_reduce /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c  tau_merge.c
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c tau_events.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_merge.o tau_events.o -o tau_merge -lm
Installing tau_merge in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_merge /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_convert.c -o tau_convert -lm
Installing tau_convert in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_convert /home/amorris/wiki/tau-2.16.1/bgl/bin
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE     -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_instrumentor.cpp
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE     -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_instrument.cpp
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE     -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_selective.cpp
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE     tau_instrumentor.o tau_instrument.o tau_selective.o -o tau_instrumentor -L/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/bgl/lib -lpdb  -lm
Installing tau_instrumentor in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_instrumentor /home/amorris/wiki/tau-2.16.1/bgl/bin
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
*** COMPILING src/Profile DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c Profiler.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TulipTimers.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c UserEvent.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c FunctionInfo.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c RtsLayer.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c RtsThread.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauCAPI.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauFAPI.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauMapping.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauHooks.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauHandler.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauMemory.cpp
ar              rcv  libtau-mpi-pdt.a Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
a - Profiler.o
a - TulipTimers.o
a - UserEvent.o
a - FunctionInfo.o
a - RtsLayer.o
a - RtsThread.o
a - TauCAPI.o
a - TauFAPI.o
a - TauMapping.o
a - TauHooks.o
a - TauHandler.o
a - TauMemory.o
echo "Built"  libtau-mpi-pdt.a
Built libtau-mpi-pdt.a
Installing libtau-mpi-pdt.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp libtau-mpi-pdt.a /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp /home/amorris/wiki/tau-2.16.1/include/Makefile /home/amorris/wiki/tau-2.16.1/bgl/lib/Makefile.tau-mpi-pdt
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauDisable.cpp
ar              rcv  libTauDisable.a TauDisable.o
a - TauDisable.o
echo "Built"  libTauDisable.a
Built libTauDisable.a
Installing libTauDisable.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp libTauDisable.a /home/amorris/wiki/tau-2.16.1/bgl/lib
make -f Makefile.wrapper
make[2]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
blrts_xlc   -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC       -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                 -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauMpi.c
blrts_xlc   -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC       -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                 -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauFMpi.c
"TauFMpi.c", line 4088.54: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 4235.79: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 4906.48: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 5011.79: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
blrts_xlc   -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC       -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                 -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauMpiExtensions.c
ar              rcv libTauMpi-mpi-pdt.a TauMpi.o TauFMpi.o        TauMpiExtensions.o
a - TauMpi.o
a - TauFMpi.o
a - TauMpiExtensions.o
echo "Built"  libTauMpi-mpi-pdt.a
Built libTauMpi-mpi-pdt.a
make[2]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make -f Makefile.wrapper install
make[2]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
Installing libTauMpi-mpi-pdt.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/lib ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/lib ;fi
/bin/cp libTauMpi-mpi-pdt.a /home/amorris/wiki/tau-2.16.1/bgl/lib
make[2]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
***************** DONE ************************
% # build and run example auto-instrumented MPI fortran 90 application
% cd examples/pdt_mpi/f90
% make
/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/bgl/bin/f95parse ring.f90 -I/home/amorris/wiki/tau-2.16.1/include -I/bgl/BlueLight/ppcfloor/bglsys/include ; ../../../bgl/bin/tau_instrumentor ring.pdb ring.f90 -o ring.inst.f90 ; blrts_xlf90          -I/home/amorris/wiki/tau-2.16.1/include -I/bgl/BlueLight/ppcfloor/bglsys/include -qsuffix=f=f90   -c ring.inst.f90 -o ring.o ; rm -f ring.pdb ;
** func   === End of Compilation 1 ===
** main   === End of Compilation 2 ===
1501-510  Compilation successful for file ring.inst.f90.
blrts_xlf90              ring.o -o ring -L/home/amorris/wiki/tau-2.16.1/bgl/lib -lTauMpi-mpi-pdt -L/bgl/BlueLight/ppcfloor/bglsys/lib -lmpich.rts -lmsglayer.rts -ldevices.rts -lrts.rts -ldevices.rts -lrt    -L/home/amorris/wiki/tau-2.16.1/bgl/lib -ltau-mpi-pdt               -L/usr/bin/../blrts_dev_lib -L/usr/bin/../blrts_lib -L/opt/ibmcmp/vacpp/bg/8.0/blrts_lib -libmc++ -L/bgl/BlueLight/ppcfloor/blrts-gnu/powerpc-bgl-blrts-gnu/lib-lstdc++
% cqsub -t5 -n4 ./ring
5332
% # after job completes, view simple report
% ../../../ppc64/bin/pprof
Reading Profile files in profile.*

NODE 0;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.088            1           1           5       1420 MAIN
 54.9        0.606         0.78           1           4        780 FUNC
 37.5        0.532        0.532           1           0        532 MPI_Init()
  8.5        0.121        0.121           1           0        121 MPI_Recv()
  1.7        0.024        0.024           1           0         24 MPI_Send()
  1.5        0.021        0.021           1           0         21 MPI_Bcast()
  0.8        0.012        0.012           1           0         12 MPI_Finalize()
  0.6        0.008        0.008           1           0          8 MPI_Barrier()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
  0.3        0.004        0.004           1           0          4 MPI_Comm_size()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 0, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1         40         40         40          0  Message size for broadcast
         1         40         40         40          0  Message size received from all nodes
         1         40         40         40          0  Message size sent to all nodes
---------------------------------------------------------------------------------------

NODE 1;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.086            1           1           5       1414 MAIN
 52.1         0.55        0.736           1           4        736 FUNC
 37.1        0.525        0.525           1           0        525 MPI_Init()
  7.8         0.11         0.11           1           0        110 MPI_Bcast()
  4.1        0.058        0.058           1           0         58 MPI_Finalize()
  2.8        0.039        0.039           1           0         39 MPI_Recv()
  1.5        0.021        0.021           1           0         21 MPI_Barrier()
  1.1        0.016        0.016           1           0         16 MPI_Send()
  0.4        0.005        0.005           1           0          5 MPI_Comm_size()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 1, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1         40         40         40          0  Message size for broadcast
         1         40         40         40          0  Message size received from all nodes
         1         40         40         40          0  Message size sent to all nodes
---------------------------------------------------------------------------------------

NODE 2;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.083            1           1           5       1415 MAIN
 54.2        0.544        0.767           1           4        767 FUNC
 37.3        0.528        0.528           1           0        528 MPI_Init()
  5.7         0.08         0.08           1           0         80 MPI_Recv()
  4.8        0.068        0.068           1           0         68 MPI_Bcast()
  4.1        0.058        0.058           1           0         58 MPI_Barrier()
  2.0        0.028        0.028           1           0         28 MPI_Finalize()
  1.2        0.017        0.017           1           0         17 MPI_Send()
  0.4        0.005        0.005           1           0          5 MPI_Comm_size()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 2, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1         40         40         40          0  Message size for broadcast
         1         40         40         40          0  Message size received from all nodes
         1         40         40         40          0  Message size sent to all nodes
---------------------------------------------------------------------------------------

NODE 3;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.086            1           1           5       1411 MAIN
 53.2         0.55        0.751           1           4        751 FUNC
 37.0        0.522        0.522           1           0        522 MPI_Init()
  8.6        0.121        0.121           1           0        121 MPI_Recv()
  3.0        0.043        0.043           1           0         43 MPI_Finalize()
  2.6        0.036        0.036           1           0         36 MPI_Barrier()
  1.9        0.027        0.027           1           0         27 MPI_Bcast()
  1.2        0.017        0.017           1           0         17 MPI_Send()
  0.4        0.005        0.005           1           0          5 MPI_Comm_size()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 3, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1         40         40         40          0  Message size for broadcast
         1         40         40         40          0  Message size received from all nodes
         1         40         40         40          0  Message size sent to all nodes
---------------------------------------------------------------------------------------

FUNCTION SUMMARY (total):
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.343            5           4          20       1415 MAIN
 53.6            2            3           4          16        758 FUNC
 37.2            2            2           4           0        527 MPI_Init()
  6.4        0.361        0.361           4           0         90 MPI_Recv()
  4.0        0.226        0.226           4           0         56 MPI_Bcast()
  2.5        0.141        0.141           4           0         35 MPI_Finalize()
  2.2        0.123        0.123           4           0         31 MPI_Barrier()
  1.3        0.074        0.074           4           0         18 MPI_Send()
  0.3        0.019        0.019           4           0          5 MPI_Comm_size()
  0.3        0.016        0.016           4           0          4 MPI_Comm_rank()

FUNCTION SUMMARY (mean):
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0       0.0858            1           1           5       1415 MAIN
 53.6        0.562        0.758           1           4        758 FUNC
 37.2        0.527        0.527           1           0        527 MPI_Init()
  6.4       0.0902       0.0902           1           0         90 MPI_Recv()
  4.0       0.0565       0.0565           1           0         56 MPI_Bcast()
  2.5       0.0352       0.0352           1           0         35 MPI_Finalize()
  2.2       0.0307       0.0307           1           0         31 MPI_Barrier()
  1.3       0.0185       0.0185           1           0         18 MPI_Send()
  0.3      0.00475      0.00475           1           0          5 MPI_Comm_size()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
%
Retrieved from "http://tau.uoregon.edu/mediawiki-tau/index.php?title=BlueGene&oldid=1603"