Lustre Intel: Installation Notes for IEEL 2.0

• Notes from the Installation of IEEL 2.0 for Montana
• IEEL Bug: Must Install on Centos 6.5 only, if repos update pacakges from 6.6 the install will not work correctly
• IML was installed on the headnode as a VM (Bridged networking required)

Hardware Configuration

• Mike please fill out here with notes on the Synchro setup and specifics on the hardware used

Setup IML on the Headnode

• Mike please add the notes on setting up the bridged networking for the headnode. The notes below are to setup on a compute node

Setup KVM on the Node

yum groupinstall  Virtualisation 'Virtualization Client' 'Virtualization Platform' 'Virtualization Tools'
/etc/init.d/libvirtd restart

Setup Bridged Networking

chkconfig NetworkManager off
chkconfig network on
service NetworkManager stop
service network start

[root@amd1 network-scripts]# pwd
/etc/sysconfig/network-scripts
[root@amd1 network-scripts]# cat ifcfg-eth0
DEVICE="eth0"
ONBOOT="yes"
BRIDGE=br0
[root@amd1 network-scripts]# cat ifcfg-br0
DEVICE=br0
TYPE=Bridge
IPADDR=173.16.0.15
NETMASK=255.255.0.0
NETWORK=173.16.0.0
DNS1=173.16.255.254
ONBOOT=yes
DELAY=0

iptables -I FORWARD -m physdev --physdev-is-bridged -j ACCEPT

[root@amd1 network-scripts]# service iptables save
iptables: Saving firewall rules to /etc/sysconfig/iptables:[  OK  ]

[root@amd1 network-scripts]# service iptables restart
iptables: Setting chains to policy ACCEPT: nat mangle filte[  OK  ]
iptables: Flushing firewall rules:                         [  OK  ]
iptables: Unloading modules:                               [  OK  ]
iptables: Applying firewall rules:                         [  OK  ]


[root@amd1 network-scripts]# service network  restart
Shutting down interface eth0:  bridge br0 does not exist!
                                                           [  OK  ]
Shutting down interface ib0:                               [  OK  ]
Shutting down loopback interface:                          [  OK  ]
Bringing up loopback interface:                            [  OK  ]
Bringing up interface eth0:                                [  OK  ]
Bringing up interface ib0:  RTNETLINK answers: Invalid argument
Determining if ip address 174.16.0.15 is already in use for device ib0...
                                                           [  OK  ]
Bringing up interface br0:  Determining if ip address 173.16.0.15 is already in use for device br0...
                                                           [  OK  ]

[root@amd1 network-scripts]# /etc/init.d/libvirtd restart
Stopping libvirtd daemon:                                  [  OK  ]
Starting libvirtd daemon:                                  [  OK  ]

[root@amd1 network-scripts]# brctl show
bridge name     bridge id               STP enabled     interfaces
br0             8000.002590106d7e       no              eth0
virbr0          8000.525400bacba2       yes             virbr0-nic

Setup a Centos 6.5 VM for IML

# install centos 6.5 minimal
mkdir /local/vm/images -p
cd /local/vm/images/ 
wget http://www.mirrorservice.org/sites/mirror.centos.org/6.5/isos/x86_64/CentOS-6.5-x86_64-minimal.iso
 virt-install --name=iml-centos65-take2 --disk path=/local/vm/images/iml-centos65-take2,size=10,sparse=false --vnc --vcpus=2 --ram=2048 --cdrom=/local/vm/images/CentOS-6.5-x86_64-minimal.iso  --network bridge=br0 --os-type=linux --os-variant=rhel6

Starting install...
Creating storage file iml-centos65                                                     10% [=======-                                                                     ]  33 MB/s | 1.0 GB     04:42 ETA


# had a problem launching virt-manager, this cmd seems to overcome  that
dbus-launch --exit-with-session virt-manager

# Netinstall Centos 
defaults for the first few screens
go through the first few screens and when its ask how to install, select URL: then put in http://mirror.umd.edu/centos/6/os/x86_64
use simple storage device
replace all data
select basic server (not required for minimal install)

Rest of the defaults should be ok

Boot up the VM and configure IML

• Boot up the VM and copy across ieel2 software
• make sure the VM can resolve its hostname:

[root@iml-centos65 ieel-2.0.1.2]# vi /etc/hosts
[root@iml-centos65 ieel-2.0.1.2]# ping iml-centos65
PING iml-centos65 (173.16.165.255) 56(84) bytes of data.
64 bytes from iml-centos65 (173.16.165.255): icmp_seq=1 ttl=64 time=0.045 ms

• Install IEEL 2

tar zxvf ieel-2.0.1.2.tar.gz
cd ieel-2.0.1.2
./install

• IEEL Install Log

# Install log 
Do you agree to the license terms?  (yes/no) yes
Starting Intel(R) Manager for Lustre* software installation
Testing YUM
Loaded plugins: fastestmirror
Unpacking installation package
Installing Intel(R) Manager for Lustre*
\
Starting setup...

Setting up PostgreSQL service...
Creating database owner 'chroma'...

Creating database 'chroma'...

Creating database tables...
Loaded 11 default power device types.
Creating groups...
An administrative user account will now be created using the credentials which you provide.
Username: david
Email: david.power@boston.co.uk
Password:
Confirm password:
User 'david' successfully created.
Building static directory...
NTP Server [localhost]:
Writing ntp configuration: localhost
Closing firewall for ntp
Opening firewall for ntp
Restarting ntp
Starting RabbitMQ...
Restarting rabbitmq-server: RabbitMQ is not running
SUCCESS
rabbitmq-server.
Creating RabbitMQ user...
Creating RabbitMQ vhost...
Enabling daemons
Starting daemons
Checking service configuration...

Setup complete.
Registering profiles
chroma-manager 2.1.1.2-3895 is currently installed

Intel(R) Manager for Lustre* software installation completed successfully

Setup the MDS / OSS nodes

• Prevent the nodes from updating to Centos 6.5, setup the up the repos as follows:

CentOS-Base.repo:baseurl=http://199.184.211.76/CENTOS6.5/REPO-6.5
CentOS-Base.repo:baseurl=http://199.184.211.76/CENTOS6.5/UPDATE-6.5