View source for Lustre: Installation of lustre 2.1 whamcloud

== Prerequisite ==
* Vanilla centos 6.2 installation. 
* SSH keys setup between hosts and consistent users
* SElinuux disabled

== Grab all the packages ==
Downloaded from two areas: 
* http://downloads.whamcloud.com/public/lustre/latest-maintenance-release/el6/client/RPMS/x86_64/
* http://downloads.whamcloud.com/public/lustre/latest-maintenance-release/el6/server/RPMS/x86_64/
And for the e2fsprogs and dependencies:
* http://build.whamcloud.com/job/e2fsprogs-master/arch=x86_64,distro=el6/

Heres a list of all the packages pulled down from the repos above:
<syntaxhighlight>
[root@blade1 maintenance]# ls
e2fsprogs-1.42.3.wc3-7.el6.x86_64.rpm                              lustre-client-debuginfo-2.1.3-2.6.32_279.2.1.el6.x86_64.x86_64.rpm
e2fsprogs-debuginfo-1.42.3.wc3-7.el6.x86_64.rpm                    lustre-client-modules-2.1.3-2.6.32_279.2.1.el6.x86_64.x86_64.rpm
e2fsprogs-devel-1.42.3.wc3-7.el6.x86_64.rpm                        lustre-client-source-2.1.3-2.6.32_279.2.1.el6.x86_64.x86_64.rpm
e2fsprogs-libs-1.42.3.wc3-7.el6.x86_64.rpm                         lustre-client-tests-2.1.3-2.6.32_279.2.1.el6.x86_64.x86_64.rpm
e2fsprogs-static-1.42.3.wc3-7.el6.x86_64.rpm                       lustre-debuginfo-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm
kernel-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm               lustre-ldiskfs-3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm
kernel-debuginfo-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm     lustre-ldiskfs-debuginfo-3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm
kernel-devel-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm         lustre-modules-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm
kernel-firmware-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm      lustre-source-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm
kernel-headers-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm       lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm
libcom_err-1.42.3.wc3-7.el6.x86_64.rpm                             perf-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm
libcom_err-devel-1.42.3.wc3-7.el6.x86_64.rpm                       perf-debuginfo-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm
libss-1.42.3.wc3-7.el6.x86_64.rpm                                  pulldown.sh
libss-devel-1.42.3.wc3-7.el6.x86_64.rpm                            python-perf-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm
lustre-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm  python-perf-debuginfo-2.6.32-279.2.1.el6_lustre.gc46c389.x86_64.rpm
</syntaxhighlight>

== Install Lustre Patched Kernel ==
Install the following packages:
* <code>kernel</code>
* <code>kernel-firmware</code>

Install these RPMs with <code>yum localinstall ./kernel*</code>
<syntaxhighlight>
[root@rhel6_vanilla ~]# yum localinstall ./kernel*
Loaded plugins: fastestmirror, security
Setting up Local Package Process
Examining ./kernel-2.6.32-220.el6_lustre.x86_64.rpm: kernel-2.6.32-220.el6_lustre.x86_64
Marking ./kernel-2.6.32-220.el6_lustre.x86_64.rpm as an update to kernel-2.6.32-220.el6.x86_64
base                                                                                  | 3.7 kB     00:00
base/primary_db                                                                       | 4.5 MB     00:02
extras                                                                                | 3.5 kB     00:00
extras/primary_db                                                                     | 6.3 kB     00:00
updates                                                                               | 3.5 kB     00:00
updates/primary_db                                                                    | 1.2 MB     00:00
Examining ./kernel-firmware-2.6.32-220.el6_lustre.x86_64.rpm: kernel-firmware-2.6.32-220.el6_lustre.x86_64
Marking ./kernel-firmware-2.6.32-220.el6_lustre.x86_64.rpm as an update to kernel-firmware-2.6.32-220.el6.noarch
Resolving Dependencies
--> Running transaction check
---> Package kernel.x86_64 0:2.6.32-220.el6_lustre will be installed
--> Processing Dependency: kernel-firmware >= 2.6.32-220.el6_lustre for package: kernel-2.6.32-220.el6_lustre.x86_64
--> Running transaction check
---> Package kernel-firmware.noarch 0:2.6.32-220.el6 will be updated
---> Package kernel-firmware.noarch 0:2.6.32-220.4.1.el6 will be an update
--> Finished Dependency Resolution
 
Dependencies Resolved
 
=============================================================================================================
 Package              Arch        Version                    Repository                                 Size
=============================================================================================================
Installing:
 kernel               x86_64      2.6.32-220.el6_lustre      /kernel-2.6.32-220.el6_lustre.x86_64      112 M
Updating for dependencies:
 kernel-firmware      noarch      2.6.32-220.4.1.el6         updates                                   6.2 M
 
Transaction Summary
=============================================================================================================
Install       1 Package(s)
Upgrade       1 Package(s)
 
Total size: 118 M
Total download size: 6.2 M
Is this ok [y/N]: y
Downloading Packages:
kernel-firmware-2.6.32-220.4.1.el6.noarch.rpm                                         | 6.2 MB     00:01
warning: rpmts_HdrFromFdno: Header V3 RSA/SHA1 Signature, key ID c105b9de: NOKEY
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-6
Importing GPG key 0xC105B9DE:
 Userid : CentOS-6 Key (CentOS 6 Official Signing Key) <centos-6-key@centos.org>
 Package: centos-release-6-2.el6.centos.7.x86_64 (@anaconda-CentOS-201112102333.x86_64/6.2)
 From   : /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-6
Is this ok [y/N]: y
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Updating   : kernel-firmware-2.6.32-220.4.1.el6.noarch                                                 1/3
  Installing : kernel-2.6.32-220.el6_lustre.x86_64                                                       2/3
  Cleanup    : kernel-firmware-2.6.32-220.el6.noarch                                                     3/3
 
Installed:
  kernel.x86_64 0:2.6.32-220.el6_lustre
 
Dependency Updated:
  kernel-firmware.noarch 0:2.6.32-220.4.1.el6
 
Complete!
</syntaxhighlight>

== Install e2fsprogs ==
<syntaxhighlight>
[root@blade1 maintenance]# yum localinstall ./e2fsprogs-1.42.3.wc3-7.el6.x86_64.rpm ./e2fsprogs-libs-1.42.3.wc3-7.el6.x86_64.rpm ./libcom_err-* ./libss-*
Loaded plugins: fastestmirror, security
Setting up Local Package Process
Examining ./e2fsprogs-1.42.3.wc3-7.el6.x86_64.rpm: e2fsprogs-1.42.3.wc3-7.el6.x86_64
Marking ./e2fsprogs-1.42.3.wc3-7.el6.x86_64.rpm as an update to e2fsprogs-1.41.12-12.el6.x86_64
Loading mirror speeds from cached hostfile
 * base: mirror.proserve.nl
 * extras: archive.cs.uu.nl
 * updates: mirror.widexs.nl
Examining ./e2fsprogs-libs-1.42.3.wc3-7.el6.x86_64.rpm: e2fsprogs-libs-1.42.3.wc3-7.el6.x86_64
Marking ./e2fsprogs-libs-1.42.3.wc3-7.el6.x86_64.rpm as an update to e2fsprogs-libs-1.41.12-12.el6.x86_64
Examining ./libcom_err-1.42.3.wc3-7.el6.x86_64.rpm: libcom_err-1.42.3.wc3-7.el6.x86_64
Marking ./libcom_err-1.42.3.wc3-7.el6.x86_64.rpm as an update to libcom_err-1.41.12-12.el6.x86_64
Skipping: ./libcom_err-1.42.3.wc3-7.el6.x86_64.rpm.1, filename does not end in .rpm.
Examining ./libcom_err-devel-1.42.3.wc3-7.el6.x86_64.rpm: libcom_err-devel-1.42.3.wc3-7.el6.x86_64
Marking ./libcom_err-devel-1.42.3.wc3-7.el6.x86_64.rpm to be installed
Examining ./libss-1.42.3.wc3-7.el6.x86_64.rpm: libss-1.42.3.wc3-7.el6.x86_64
Marking ./libss-1.42.3.wc3-7.el6.x86_64.rpm as an update to libss-1.41.12-12.el6.x86_64
Examining ./libss-devel-1.42.3.wc3-7.el6.x86_64.rpm: libss-devel-1.42.3.wc3-7.el6.x86_64
Marking ./libss-devel-1.42.3.wc3-7.el6.x86_64.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package e2fsprogs.x86_64 0:1.41.12-12.el6 will be updated
---> Package e2fsprogs.x86_64 0:1.42.3.wc3-7.el6 will be an update
---> Package e2fsprogs-libs.x86_64 0:1.41.12-12.el6 will be updated
---> Package e2fsprogs-libs.x86_64 0:1.42.3.wc3-7.el6 will be an update
---> Package libcom_err.x86_64 0:1.41.12-12.el6 will be updated
---> Package libcom_err.x86_64 0:1.42.3.wc3-7.el6 will be an update
---> Package libcom_err-devel.x86_64 0:1.42.3.wc3-7.el6 will be installed
---> Package libss.x86_64 0:1.41.12-12.el6 will be updated
---> Package libss.x86_64 0:1.42.3.wc3-7.el6 will be an update
---> Package libss-devel.x86_64 0:1.42.3.wc3-7.el6 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

====================================================================================================================================================================================================================
 Package                                        Arch                                 Version                                          Repository                                                               Size
====================================================================================================================================================================================================================
Installing:
 libcom_err-devel                               x86_64                               1.42.3.wc3-7.el6                                 /libcom_err-devel-1.42.3.wc3-7.el6.x86_64                                17 k
 libss-devel                                    x86_64                               1.42.3.wc3-7.el6                                 /libss-devel-1.42.3.wc3-7.el6.x86_64                                     10 k
Updating:
 e2fsprogs                                      x86_64                               1.42.3.wc3-7.el6                                 /e2fsprogs-1.42.3.wc3-7.el6.x86_64                                      2.6 M
 e2fsprogs-libs                                 x86_64                               1.42.3.wc3-7.el6                                 /e2fsprogs-libs-1.42.3.wc3-7.el6.x86_64                                 344 k
 libcom_err                                     x86_64                               1.42.3.wc3-7.el6                                 /libcom_err-1.42.3.wc3-7.el6.x86_64                                      56 k
 libss                                          x86_64                               1.42.3.wc3-7.el6                                 /libss-1.42.3.wc3-7.el6.x86_64                                           67 k

Transaction Summary
====================================================================================================================================================================================================================
Install       2 Package(s)
Upgrade       4 Package(s)

Total size: 3.1 M
Is this ok [y/N]: y
Downloading Packages:
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Warning: RPMDB altered outside of yum.
  Updating   : libcom_err-1.42.3.wc3-7.el6.x86_64                                                                                                                                                              1/10 
  Updating   : libss-1.42.3.wc3-7.el6.x86_64                                                                                                                                                                   2/10 
  Installing : libcom_err-devel-1.42.3.wc3-7.el6.x86_64                                                                                                                                                        3/10 
  Updating   : e2fsprogs-libs-1.42.3.wc3-7.el6.x86_64                                                                                                                                                          4/10 
  Updating   : e2fsprogs-1.42.3.wc3-7.el6.x86_64                                                                                                                                                               5/10 
  Installing : libss-devel-1.42.3.wc3-7.el6.x86_64                                                                                                                                                             6/10 
  Cleanup    : e2fsprogs-1.41.12-12.el6.x86_64                                                                                                                                                                 7/10 
  Cleanup    : e2fsprogs-libs-1.41.12-12.el6.x86_64                                                                                                                                                            8/10 
  Cleanup    : libss-1.41.12-12.el6.x86_64                                                                                                                                                                     9/10 
  Cleanup    : libcom_err-1.41.12-12.el6.x86_64                                                                                                                                                               10/10 

Installed:
  libcom_err-devel.x86_64 0:1.42.3.wc3-7.el6                                                                  libss-devel.x86_64 0:1.42.3.wc3-7.el6                                                                 

Updated:
  e2fsprogs.x86_64 0:1.42.3.wc3-7.el6                 e2fsprogs-libs.x86_64 0:1.42.3.wc3-7.el6                 libcom_err.x86_64 0:1.42.3.wc3-7.el6                 libss.x86_64 0:1.42.3.wc3-7.el6                

Complete!
</syntaxhighlight>

== Install Lustre ==
Next up, the lustre packages (install on all hosts)
* lustre
* lustre-modules
* lustre-ldiskfs
* lustre-tests

<syntaxhighlight>
[root@blade1 maintenance]# yum localinstall ./lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm ./lustre-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm ./lustre-modules-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm ./lustre-ldiskfs-3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm 
Loaded plugins: fastestmirror, security
Setting up Local Package Process
Examining ./lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm: lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64
Marking ./lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm to be installed
Loading mirror speeds from cached hostfile
 * base: mirror.proserve.nl
 * extras: mirror.widexs.nl
 * updates: mirror.widexs.nl
Examining ./lustre-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm: lustre-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64
Marking ./lustre-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm to be installed
Examining ./lustre-modules-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm: lustre-modules-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64
Marking ./lustre-modules-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm to be installed
Examining ./lustre-ldiskfs-3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm: lustre-ldiskfs-3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64
Marking ./lustre-ldiskfs-3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package lustre.x86_64 0:2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64 will be installed
---> Package lustre-ldiskfs.x86_64 0:3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64 will be installed
---> Package lustre-modules.x86_64 0:2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64 will be installed
---> Package lustre-tests.x86_64 0:2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64 will be installed
--> Processing Dependency: /usr/bin/expect for package: lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64
--> Processing Dependency: libmpi.so.1()(64bit) for package: lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64
--> Running transaction check
---> Package expect.x86_64 0:5.44.1.15-4.el6 will be installed
--> Processing Dependency: libtcl8.5.so()(64bit) for package: expect-5.44.1.15-4.el6.x86_64
---> Package openmpi.x86_64 0:1.5.4-1.el6 will be installed
--> Processing Dependency: librdmacm.so.1(RDMACM_1.0)(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libibverbs.so.1(IBVERBS_1.1)(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libibverbs.so.1(IBVERBS_1.0)(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libgomp.so.1(OMP_1.0)(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libgomp.so.1(GOMP_1.0)(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: environment-modules for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: librdmacm.so.1()(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libpsm_infinipath.so.1()(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libibverbs.so.1()(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libgomp.so.1()(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libgfortran.so.3()(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Processing Dependency: libesmtp.so.5()(64bit) for package: openmpi-1.5.4-1.el6.x86_64
--> Running transaction check
---> Package environment-modules.x86_64 0:3.2.7b-6.el6 will be installed
---> Package infinipath-psm.x86_64 0:2.9-926.1005_open.2.el6 will be installed
---> Package libesmtp.x86_64 0:1.0.4-15.el6 will be installed
---> Package libgfortran.x86_64 0:4.4.6-4.el6 will be installed
---> Package libgomp.x86_64 0:4.4.6-4.el6 will be installed
---> Package libibverbs.x86_64 0:1.1.6-4.el6 will be installed
---> Package librdmacm.x86_64 0:1.0.15-2.el6 will be installed
---> Package tcl.x86_64 1:8.5.7-6.el6 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

====================================================================================================================================================================================================================
 Package                           Arch                 Version                                                          Repository                                                                            Size
====================================================================================================================================================================================================================
Installing:
 lustre                            x86_64               2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64                  /lustre-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64                        26 M
 lustre-ldiskfs                    x86_64               3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64                  /lustre-ldiskfs-3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64               8.6 M
 lustre-modules                    x86_64               2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64                  /lustre-modules-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64               146 M
 lustre-tests                      x86_64               2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64                  /lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64                  13 M
Installing for dependencies:
 environment-modules               x86_64               3.2.7b-6.el6                                                     base                                                                                  96 k
 expect                            x86_64               5.44.1.15-4.el6                                                  base                                                                                 256 k
 infinipath-psm                    x86_64               2.9-926.1005_open.2.el6                                          base                                                                                 157 k
 libesmtp                          x86_64               1.0.4-15.el6                                                     base                                                                                  57 k
 libgfortran                       x86_64               4.4.6-4.el6                                                      base                                                                                 264 k
 libgomp                           x86_64               4.4.6-4.el6                                                      base                                                                                 117 k
 libibverbs                        x86_64               1.1.6-4.el6                                                      base                                                                                  45 k
 librdmacm                         x86_64               1.0.15-2.el6                                                     base                                                                                  29 k
 openmpi                           x86_64               1.5.4-1.el6                                                      base                                                                                 2.1 M
 tcl                               x86_64               1:8.5.7-6.el6                                                    base                                                                                 1.9 M

Transaction Summary
====================================================================================================================================================================================================================
Install      14 Package(s)

Total size: 198 M
Installed size: 207 M
Is this ok [y/N]: y
Downloading Packages:
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing : 1:tcl-8.5.7-6.el6.x86_64                                                                                                                                                                        1/14 
  Installing : libibverbs-1.1.6-4.el6.x86_64                                                                                                                                                                   2/14 
  Installing : librdmacm-1.0.15-2.el6.x86_64                                                                                                                                                                   3/14 
  Installing : environment-modules-3.2.7b-6.el6.x86_64                                                                                                                                                         4/14 
  Installing : expect-5.44.1.15-4.el6.x86_64                                                                                                                                                                   5/14 
  Installing : lustre-ldiskfs-3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64                                                                                                                           6/14 
  Installing : lustre-modules-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64                                                                                                                           7/14 
  Installing : lustre-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64                                                                                                                                   8/14 
  Installing : libgomp-4.4.6-4.el6.x86_64                                                                                                                                                                      9/14 
  Installing : infinipath-psm-2.9-926.1005_open.2.el6.x86_64                                                                                                                                                  10/14 
  Installing : libgfortran-4.4.6-4.el6.x86_64                                                                                                                                                                 11/14 
  Installing : libesmtp-1.0.4-15.el6.x86_64                                                                                                                                                                   12/14 
  Installing : openmpi-1.5.4-1.el6.x86_64                                                                                                                                                                     13/14 
  Installing : lustre-tests-2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64.x86_64                                                                                                                            14/14 

Installed:
  lustre.x86_64 0:2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64                                          lustre-ldiskfs.x86_64 0:3.3.0-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64                                 
  lustre-modules.x86_64 0:2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64                                  lustre-tests.x86_64 0:2.1.3-2.6.32_279.2.1.el6_lustre.gc46c389.x86_64                                   

Dependency Installed:
  environment-modules.x86_64 0:3.2.7b-6.el6      expect.x86_64 0:5.44.1.15-4.el6      infinipath-psm.x86_64 0:2.9-926.1005_open.2.el6      libesmtp.x86_64 0:1.0.4-15.el6      libgfortran.x86_64 0:4.4.6-4.el6     
  libgomp.x86_64 0:4.4.6-4.el6                   libibverbs.x86_64 0:1.1.6-4.el6      librdmacm.x86_64 0:1.0.15-2.el6                      openmpi.x86_64 0:1.5.4-1.el6        tcl.x86_64 1:8.5.7-6.el6             

Complete!
</syntaxhighlight>

== Configure Lustre ==
Setup the MDT/MDS:
<syntaxhighlight>
mkfs.lustre --fsname=lustrefs --mgs --mdt /dev/scinib
mkdir /mnt/mdt
mount -t lustre /dev/scinib /mnt/mdt/

# and bring up the network on the MDS
modprobe lnet
lctl network up
lctl list_nids
</syntaxhighlight>

Then on each OSS:
<syntaxhighlight>
[root@blade8 maintenance]# mkfs.lustre --ost --fsname=lustrefs --mgsnode=172.16.10.10@tcp /dev/scinia

   Permanent disk data:
Target:     lustrefs-OSTffff
Index:      unassigned
Lustre FS:  lustrefs
Mount type: ldiskfs
Flags:      0x72
              (OST needs_index first_time update )
Persistent mount opts: errors=remount-ro,extents,mballoc
Parameters: mgsnode=172.16.10.10@tcp

checking for existing Lustre data: not found
device size = 106496MB
formatting backing filesystem ldiskfs on /dev/scinia
	target name  lustrefs-OSTffff
	4k blocks     27262976
	options        -J size=400 -I 256 -i 69905 -q -O extents,uninit_bg,dir_nlink,huge_file,flex_bg -G 256 -E resize=4290772992,lazy_journal_init -F
mkfs_cmd = mke2fs -j -b 4096 -L lustrefs-OSTffff  -J size=400 -I 256 -i 69905 -q -O extents,uninit_bg,dir_nlink,huge_file,flex_bg -G 256 -E resize=4290772992,lazy_journal_init -F /dev/scinia 27262976
Writing CONFIGS/mountdata
[root@blade8 maintenance]# modprobe lnet
[root@blade8 maintenance]# lctl network up 
LNET configured
[root@blade8 maintenance]# lctl list_nids
172.16.10.8@tcp
[root@blade6 ~]# mkdir /mnt/ost
[root@blade6 ~]# mount -t lustre /dev/scinia /mnt/ost/
</syntaxhighlight>

On your lustre client:
<syntaxhighlight>
[root@blade1 maintenance]# mkdir /mnt/lustre ; mount -t lustre 172.16.10.10@tcp:/lustrefs /mnt/lustre 
[root@blade1 maintenance]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup-lv_root
                       50G  2.9G   44G   7% /
tmpfs                  16G   87M   16G   1% /dev/shm
/dev/sda1             485M  100M  360M  22% /boot
/dev/mapper/VolGroup-lv_home
                      834G  201M  791G   1% /home
172.16.10.10@tcp:/lustrefs
                      519G  2.3G  490G   1% /mnt/lustre
</syntaxhighlight>