wiki:mpidem
Last modified 4 years ago Last modified on 06/21/13 15:06:15

Running the mpidem Application

See Common Build instructions for compiling needed packages

Local Swarthmore CS

Construct stream files containing tiles and points. I usually do this on savory where I have the raw lidar files.

ssh savory
cd /terrain/terrastream
cp /home/adanner/research/terrastream/build/modules/*.so .
cp /home/adanner/research/terrastream/build/modules/Model-quadtree .

\rm /terrain/adanner/tmp/SCALGO_*
./Model-quadtree-construction \
	--tmppath=/terrain/usrname/tmp \
	--input=/terrain/quick/ \
	--input-type=mosaic-las --input-mosaic-las-classification=2 \
	--leaf-max=30 \
	--qbox-metadata-cell-size=20 \
	--qbox-metadata-origin-x=2630000.0 \
	--qbox-metadata-end-x=2640000.0 \
	--qbox-metadata-origin-y=220000.0 \
	--qbox-metadata-end-y=210000.0

Migrate data files to scratch

cd /terrain/adanner/tmp/
mv SCALGO_Temporary_QTLeaves_hH1bskWr.tpie quickleaves.tpie
mv SCALGO_Temporary_QTLPoints_qkYFPmgK.tpie quickpoints.tpie
cp quick*.tpie /scratch/adanner/mpitest/

Run mpi_build_grid

$ pwd
/scratch/adanner/mpitest

$ cat qhosts 
onion slots=1
vanilla slots=1
cheese slots=1
orange slots=1

$ cat gtest.cfg 
leaf = /scratch/adanner/mpitest/quickleaves.tpie
points = /scratch/adanner/mpitest/quickpoints.tpie
grid = /scratch/adanner/mpitest/test_grid.asc
tmppath = /scratch/adanner/tmp/
maxpts = 3000
tension = 40
smoothing = 0.1
messagepass = probe
usecuda = true
evalleaf = leaf

$ \rm ../tmp/TPIE_* mpilog* test_grid.asc;
$ mpirun -np 4 --pernode --hostfile qhosts orte-clean --verbose

$ mpirun -np 4 --hostfile qhosts --output-filename mpilog ./mpi_build_grid -c gtest.cfg

Runtime for above test on four hosts using small quick dataset is about 90 seconds

Verify output

grass65

> r.in.ascii /scratch/adanner/mpitest/test_grid.asc output=test --o

> g.region rast=test -p
projection: 2 (State Plane)
zone:       0
datum:      ** unknown (default: WGS84) **
ellipsoid:  a=6378137 es=0.0066943800229
north:      220000
south:      209980
west:       2629999.99999
east:       2640019.99999
nsres:      20
ewres:      20
rows:       501
cols:       501
cells:      251001

> r.colors test color=wave
> d.mon x0
> d.rast test

> d.out.file output=test
Saving display from Monitor: [x0] to <test.png>

test.png