Orch:Headnode install - Revision history

Mohammed at 16:55, 23 January 2017

2017-01-23T16:55:37Z

Mohammed at 16:54, 23 January 2017

2017-01-23T16:54:17Z

Mohammed at 16:51, 23 January 2017

2017-01-23T16:51:58Z

Mohammed at 16:45, 23 January 2017

2017-01-23T16:45:06Z

Mohammed at 16:07, 23 January 2017

2017-01-23T16:07:34Z

Mohammed at 16:05, 23 January 2017

2017-01-23T16:05:50Z

Mohammed: /* Add genders */

2017-01-23T15:42:52Z

Add genders

Mohammed: /* Add genders */

2017-01-23T15:42:39Z

Add genders

Mohammed at 15:41, 23 January 2017

2017-01-23T15:41:58Z

Mohammed: Created page with "In the following we assume the availability of a single head node master, some -at least one- compute nodes, and the Intel Orchestrator ISO file (if you don't have it, contact..."

2017-01-23T15:14:54Z

Created page with "In the following we assume the availability of a single head node master, some -at least one- compute nodes, and the Intel Orchestrator ISO file (if you don't have it, contact..."

New page

In the following we assume the availability of a single head node master, some -at least one- compute nodes, and the Intel Orchestrator ISO file (if you don't have it, contact David). The master node is provisioned with Centos7.2, and serves as the overall system management server (SMS). In its role as an SMS, the master node is configured to provision the remaining compute in a stateless configuration using Warewulf.

We assume the ISO file is copied in a location like /tmp/Intel_HPC_Orchestrator-rhel7.2-16.01.004.ga.iso

== Enable local Intel® HPC Orchestrator repository ==
On the head node, mount the image and install the Orchestrator RPMs
<syntaxhighlight>
mkdir -p /mnt/hpc_orch_iso
mount -o loop /tmp/Intel-HPC-Orchestrator-rhel7.2-16.01.004.ga.iso /mnt/hpc_orch_iso ; echo $?
rpm -Uvh /mnt/hpc_orch_iso/x86_64/Intel_HPC_Orchestrator_release-*.x86_64.rpm
rpm --import /etc/pki/pgp/HPC-Orchestrator*.asc
rpm --import /etc/pki/pgp/PSXE-keyfile.asc
</syntaxhighlight>

@@ Line 116: / Line 116: @@
 mkdir -p $CHROOT/mnt/hpc_orch_iso
 mount -o loop /tmp/Intel_HPC_Orchestrator-rhel7.2-16.01.004.ga.iso $CHROOT/mnt/hpc_orch_iso ; echo $?
-rpm -Uvh $CHROOT/mnt/hpc_orch_iso/x86_64/Intel_HPC_Orchestrator_release-*.x86_64.rpm
+chroot $CHROOT rpm -Uvh /mnt/hpc_orch_iso/x86_64/Intel_HPC_Orchestrator_release-*.x86_64.rpm
 chroot $CHROOT rpm --import /etc/pki/pgp/HPC-Orchestrator*.asc
-chroot $CHROOT  rpm --import /etc/pki/pgp/PSXE-keyfile.asc
+chroot $CHROOT rpm --import /etc/pki/pgp/PSXE-keyfile.asc
 </syntaxhighlight>

@@ Line 77: / Line 77: @@
 export internal_netmask = 255.255.255.0
 export sms_ip = 10.10.10.1
 # Configure Warewulf provisioning to use desired internal interface
@@ Line 178: / Line 179: @@
 <syntaxhighlight>
 echo "${sms_ip}:/home /home nfs nfsvers=3,rsize=1024,wsize=1024,cto 0 0" >> $CHROOT/etc/fstab
-echo "${sms_ip}:/opt/ohpc/pub /opt/ohpc/pub nfs nfsvers=3,rsize=1024,wsize=1024,cto 0 0" >> $CHROOT/etc/fstab
+echo "${sms_ip}:/opt/intel /opt/intel nfs nfsvers=3,rsize=1024,wsize=1024,cto 0 0" >> $CHROOT/etc/fstab
 echo "/home *(rw,no_subtree_check,fsid=10,no_root_squash)" >> /etc/exports
-echo "/opt/ohpc/pub *(ro,no_subtree_check,fsid=11)" >> /etc/exports
+echo "/opt/intel *(ro,no_subtree_check,fsid=11,no_root_squash)" >> /etc/exports
+echo "/opt/intel/hpc-orchestrator *(ro,no_subtree_check,fsid=12,no_root_squash,nohide)" /etc/exports
 exportfs -a
 systemctl restart rpcbind
 systemctl restart nfs-server.service
@@ Line 203: / Line 209: @@
 wwsh file import /etc/slurm/slurm.conf
 wwsh file import /etc/munge/munge.key
-wwsh file import /opt/ohpc/pub/examples/network/centos/ifcfg-ib0.ww
+wwsh file import /opt/intel/hpc-orchestrator/pub/examples/network/centos/ifcfg-ib0.ww
 wwsh -y file set ifcfg-ib0.ww --path=/etc/sysconfig/network-scripts/ifcfg-ib0
 wwsh file resync # If changes are made and do not want to wait 5 mins for resync.
@@ Line 216: / Line 222: @@
 == Adding the compute nodes to the database with the correct parameters to allow for statefull provisioning ==
 <syntaxhighlight>
-wwsh node new c0 --ipaddr=some.ip.address.here -M 255.255.255.0 -G ${sms_ip} --domain=ohpc.net  --hwaddr=some.mac.address.here -D eth1 #eno "notation" does cause problems
+wwsh node new c0 --ipaddr=some.ip.address.here -M 255.255.255.0 -G ${sms_ip} --domain=orch.net  --hwaddr=some.mac.address.here -D eth1 #eno "notation" does cause problems
 echo "GATEWAYDEV=${eth_provision}" > /tmp/network.$$
 wwsh -y file import /tmp/network.$$ --name network

@@ Line 74: / Line 74: @@
 <syntaxhighlight>
 # we recommended to add the following "exports" to your .bashrc file so that you do not have to export it each time after reboot
-export ${sms_eth_internal} = eno1
+export sms_eth_internal = eno1
-export ${internal_netmask} = 255.255.255.0
+export internal_netmask = 255.255.255.0
-export ${sms_ip} = 10.10.10.1
+export sms_ip = 10.10.10.1
 # Configure Warewulf provisioning to use desired internal interface
@@ Line 91: / Line 91: @@
 # IPADDR=10.10.10.1, NETMASK=255.255.255.0, and ONBOOT=yes, Otherwise run the following (make sure that these changes persist
 # after any reboot
 # Restart/enable relevant services to support provisioning
 systemctl restart xinetd
@@ Line 99: / Line 99: @@
 systemctl enable httpd.service
 systemctl restart httpd
 </syntaxhighlight>

@@ Line 88: / Line 88: @@
 perl -ni -e "print unless /^\s+Order allow,deny/" $MODFILE
-# Enable internal interface for provisioning; here it is better to edit /etc/sysconfig/network-scripts/ifcfg-eno1 and set BOOTPROTO to "static", IPADDR=10.10.10.1, NETMASK=255.255.255.0, and ONBOOT=yes
+# Enable internal interface for provisioning; here it is better to edit /etc/sysconfig/network-scripts/ifcfg-eno1 and set BOOTPROTO to "static",
 ifconfig ${sms_eth_internal} ${sms_ip} netmask ${internal_netmask} up #ifconfig not installed? run yum install net-tools
 # Restart/enable relevant services to support provisioning
 systemctl restart xinetd

← Older revision		Revision as of 16:05, 23 January 2017
Line 69:		Line 69:
	== Add genders ==		== Add genders ==
	This is not required for basic installation		This is not required for basic installation
		+
		+	== Complete basic Warewulf setup for master node ==
		+	At this stage, we have to decide which interface on the head node will be used for the provisioning, e.g. eno1
		+	<syntaxhighlight>
		+	# we recommended to add the following "exports" to your .bashrc file so that you do not have to export it each time after reboot
		+	export ${sms_eth_internal} = eno1
		+	export ${internal_netmask} = 255.255.255.0
		+	export ${sms_ip} = 10.10.10.1
		+
		+	# Configure Warewulf provisioning to use desired internal interface
		+	perl -pi -e "s/device = eth1/device = ${sms_eth_internal}/" /etc/warewulf/provision.conf
		+	# Enable tftp service for compute node image distribution
		+	perl -pi -e "s/^\s+disable\s+= yes/ disable = no/" /etc/xinetd.d/tftp
		+	# Enable http access for Warewulf cgi-bin directory to support newer apache syntax
		+	export MODFILE=/etc/httpd/conf.d/warewulf-httpd.conf
		+	perl -pi -e "s/cgi-bin>\$/cgi-bin>\n Require all granted/" $MODFILE
		+	perl -pi -e "s/Allow from all/Require all granted/" $MODFILE
		+	perl -ni -e "print unless /^\s+Order allow,deny/" $MODFILE
		+
		+	# Enable internal interface for provisioning; here it is better to edit /etc/sysconfig/network-scripts/ifcfg-eno1 and set BOOTPROTO to "static", IPADDR=10.10.10.1, NETMASK=255.255.255.0, and ONBOOT=yes
		+
		+	ifconfig ${sms_eth_internal} ${sms_ip} netmask ${internal_netmask} up #ifconfig not installed? run yum install net-tools
		+
		+	# Restart/enable relevant services to support provisioning
		+	systemctl restart xinetd
		+	systemctl enable mariadb.service
		+	systemctl restart mariadb
		+	systemctl enable httpd.service
		+	systemctl restart httpd
		+	</syntaxhighlight>

@@ Line 3: / Line 3: @@
 We assume the ISO file is copied in a location like /tmp/Intel_HPC_Orchestrator-rhel7.2-16.01.004.ga.iso
 == Enable local Intel® HPC Orchestrator repository ==
 On the head node, mount the image and enable Orchestrator as a local repository using the "hpc-orch-release" package rpm.

← Older revision		Revision as of 15:42, 23 January 2017
Line 68:		Line 68:

	== Add genders ==		== Add genders ==
−	! This is not required for basic installation	+	This is not required for basic installation