forked from pkcoff/OFI-BGQ-BuildEnv
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathREADME
64 lines (46 loc) · 2.54 KB
/
README
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
This README contains instructions on how to download and build MPICH CH4 over OFI Libfabric on Blue Gene /Q. Please note that the V1R2M4 driver is required. There are three github repositories with the relevant code. The first of these is this github which is the build environment itself.
mkdir <build_env_root_dir>
cd <build_env_root_dir>
git clone https://github.com/pkcoff/OFI-BGQ-BuildEnv.git
Then clone the libfabric github repo into this environment:
cd OFI-BGQ-BuildEnv/ofi
git clone https://github.com/ofiwg/libfabric.git
Then clone the mpich github repo into this environment:
cd ../mpi
git clone https://github.com/pmodels/mpich.git
Then create a link from the mpich directory into libfabric to support the libfabric embedded build within mpich:
cd mpich/src/mpid/ch4/netmod/ofi && ln -s `cd ../../../../../../../ofi/libfabric && pwd`
Then run autoconf as follows:
cd <build_env_root_dir>/OFI-BGQ-BuildEnv
./autogen.sh --with-autotools=/soft/buildtools/autotools/feb2015/bin ---> add the --with-autotools in the Argonne machines due to downlevel autoconf default
./configure
cd ofi/libfabric
./autogen.sh --with-autotools=/soft/buildtools/autotools/feb2015/bin
cd ../../mpi/mpich
./autogen.sh --with-autotools=/soft/buildtools/autotools/feb2015/bin
cd ..
vi simple_configure
--- change : ${INSTALL_DIR:= to the install dir you want
--------------------------------------------------------------------------------------------
SPECIAL NOTE FOR BUILDING ON MIRA:
Mira is currently still at V1R2M2 and has not yet moved to V1R2M4. As a workaround for now,
the V1R2M4 system files have been made available in /soft/libraries/unsupported/V1R2M4-sys.
To utilize them, you'll need to change the following 2 files:
config.site: change this:
MPICHLIB_CPPFLAGS="-I/bgsys/drivers/ppcfloor/spi/include/kernel/cnk -I/bgsys/drivers/ppcfloor"
to this:
MPICHLIB_CPPFLAGS="-I/soft/libraries/unsupported/V1R2M4-sys/spi/include/kernel/cnk -I/soft/libraries/unsupported/V1R2M4-sys"
ofi/libfabric/prov/bgq/configure.m4: change this:
bgq_driver=/bgsys/drivers/ppcfloor
to this:
bgq_driver=/soft/libraries/unsupported/V1R2M4-sys
--------------------------------------------------------------------------------------------
then for gnu 4.7.2 build:
cd <build_directory>
DEBUG build:
CONFIG_TOOLCHAIN=gnu CONFIG_FLAVOR=debug <build_env_root_dir>/ofi-bgq/mpi/simple_configure
OPT build:
CONFIG_TOOLCHAIN=gnu CONFIG_FLAVOR=optimized <build_env_root_dir>/ofi-bgq/mpi/simple_configure
then:
make -j16 install
Look in <build_env_root_dir>/config.site for details on compilers and options.