FACETS

To use FACETS on Intrepid, see Facets on Intrepid

To run FACETS on zorak:

% module load petsc
% module load python/2.4.4
% module load mpi/mpich2-1.0.4p1_gnu-3.4.6

Loads the env.

Then, run the code:

% cd apps/techx/facets/fcpy
% mpirun -np 2 python FcImplcitCoupledSystem.py -t 50

TAU configuration:

%  configure -pdt=/usr/local/packages/pdtoolkit-3.10/ -pdtcompdir=gnu -c++=g++ -cc=gcc -pythoninc=/usr/local/packages/python-2.4.4/include/python2.4 -mpiinc=/usr/local/packages/mpich2-1.0.4p1/gnu-3.4.6/include -mpilib=/usr/local/packages/mpich2-1.0.4p1/gnu-3.4.6/lib
%  make clean install

Make a wrapper script:

[[sameer@zorak fcpy]]$ cat runtau.py
import tau

def main():
    import FcImplicitCoupledSystem

tau.run('main()')

And before running it, add to your .cshrc file:

module load mpi/mpich2-1.0.4p1_gnu-3.4.6 petsc python/2.4.4

Then, edit tau_load.sh to add the MPI library:

export LD_PRELOAD=$TAU_LOADLIB:/usr/local/packages/mpich2-1.0.4p1/gnu-3.4.6/lib/libmpich.so

And run it:

% mpirun -np 2 tau_load.sh python runtau.py -t 50
% pprof