Difference between revisions of "Bright: Bright Cluster Manager"

From Define Wiki
Jump to navigation Jump to search
 
(44 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
[[File:Bright-Logo.png‎ | center | 600px]]
 
[[File:Bright-Logo.png‎ | center | 600px]]
−
 
  
 
<center>
 
<center>
 
{| class="wikitable"
 
{| class="wikitable"
 
! style="width: 250px;"| Installation
 
! style="width: 250px;"| Installation
−
! style="width: 250px;"| Cluster Configuration  
+
! style="width: 250px;"| Cluster Management
 +
! style="width: 250px;"| Cluster Configuration
 
! style="width: 250px;"| Network Configuration
 
! style="width: 250px;"| Network Configuration
−
! style="width: 250px;"| Day to Day Admin
 
 
|-
 
|-
 +
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Linux-network.jpg|100x100px]]
 
! style="background: white"| [[File:Linux-network.jpg|100x100px]]
−
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
 
|- valign="top"
 
|- valign="top"
 
! style="background: white"| [[Bright:Head_node_baremetal | Head Node Bare Metal Install]]
 
! style="background: white"| [[Bright:Head_node_baremetal | Head Node Bare Metal Install]]
−
! style="background: white"| [[Bright:License the Cluster | Bright Cluster Licence]] <br/> [[Bright:General_Settings | Main Configuration Settings]]
+
! style="background: white"| [[Bright:Concepts | Bright Concepts]] <br/> [[Bright:Modules_Enviroment | Bright Modules]] <br/> [[Bright:Authentication | Authentication]] <br/> [[Bright:GUI | GUI]] <br/> [[Bright:Shell | Shell]] <br/> [[Bright:Daemon | CMDaemon]]
 +
! style="background: white"| [[Bright:License the Cluster | Bright Cluster Licence]] <br/> [[Bright:General_Settings | Main Configuration Settings]] <br/> [[Bright:Hostname Change | Changing a node's Hostname]] <br/> [[Bright:Change the external network domain | Change the externalnet domain]]
 
! style="background: white"| [[Bright:Network_settings | Network Settings]] <br/> [[Bright:Bridge | Bridge Interfaces]] <br/> [[Bright:Bonded_interface | Bonded Interfaces]] <br/> [[Bright:infiniband | Infiniband Interfaces]] <br/> [[Bright:IPMI | IPMI Interfaces]] <br/> [[Bright:DNS | Add a new nameserver]]
 
! style="background: white"| [[Bright:Network_settings | Network Settings]] <br/> [[Bright:Bridge | Bridge Interfaces]] <br/> [[Bright:Bonded_interface | Bonded Interfaces]] <br/> [[Bright:infiniband | Infiniband Interfaces]] <br/> [[Bright:IPMI | IPMI Interfaces]] <br/> [[Bright:DNS | Add a new nameserver]]
−
! style="background: white"| [[Bright:pshell | Parallel Shell]] <br/> [[Bright:Support | Bright Suppport]] <br/> [[Bright:backup | Back ups]] <br/> [[Bright:BIOS | BIOS Update]] <br/> [[Bright:Hardware_health | Hardware Health Check]] <br/> [[Bright:SOL | SOL]]
 
 
|-
 
|-
 
|}
 
|}
Line 25: Line 24:
 
<center>
 
<center>
 
{| class="wikitable"
 
{| class="wikitable"
−
! style="width: 250px;"| Switch and PDU Configuration
+
! style="width: 250px;"| Power Management
−
! style="width: 250px;"| Disk, NFS and Storage Configuration
+
! style="width: 250px;"| Node Provisioning
−
! style="width: 250px;"| GPU Configuration
+
! style="width: 250px;"| Cloud Bursting
−
! style="width: 250px;"| Image Configuration
+
! style="width: 250px;"| User Management
 
|-
 
|-
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
−
! style="background: white"| [[File:Nvidia_logo.jpg|100x100px]]
+
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
|- valign="top"
 
|- valign="top"
−
! style="background: white"|  
+
! style="background: white"| [[Bright:Power_config | Power Parameters]] <br/> [[Bright:Power_Operations | Power Operations]] <br/> [[Bright:Power_monitor | Monitoring Power]] <br/> [[Bright_power_cpu | CPU Scaling Governors]]
−
! style="background: white"|  
+
! style="background: white"| [[Bright: node_provision | LDAP Client ]] <br/> [[Bright:node_status_alert| Node Status Alert]]
−
! style="background: white"| [[CUDA/Bright | Installing CUDA on Bright]]
+
! style="background: white"| [[Bright:Openstack-install | Openstack Installation]] <br/> [[Bright:Openstack-config| Openstack Configuration]] <br/>[[Bright:Add GPUs to OpenStack | Add GPUs to OpenStack]]<br/> [[Bright:CaaS | CaaS Installation]] <br/> [[Bright:Use-CaaS | Use CaaS]] <br/> [[Bright:Troubleshoot-CaaS | CaaS Troubleshooting]]
−
! style="background: white"| [[Bright:Create_Image | Create a new Image]] <br/> [[Bright:Node_image_management | Node Image Management]]
+
! style="background: white"| [[Bright:Add_user_gui | Add a User through the GUI]] <br/> [[Bright:Add_user_cmd | Add a User through CMSH]] <br/>[[Bright:mysql | MySQL]] <br/> [[Bright:Setup_user_quotas | Setup User Quotas]]
 
|-
 
|-
 
|}
 
|}
 
</center>
 
</center>
 +
  
  
 
<center>
 
<center>
 
{| class="wikitable"
 
{| class="wikitable"
−
! style="width: 250px;"| Compute Node Configuration
+
! style="width: 250px;"| Workload Managment
−
! style="width: 250px;"| User Configuration
+
! style="width: 250px;"| Post Installation Software Management
−
! style="width: 250px;"| Maintenance
+
! style="width: 250px;"| Cluster Monitoring
−
! style="width: 250px;"| Service Configuration
+
! style="width: 250px;"| Day to Day Admin
 
|-
 
|-
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
Line 56: Line 56:
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
|- valign="top"
 
|- valign="top"
−
! style="background: white"| [[Bright:Compute_node_provisioning_gui | Provision a compute node]] <br/> [[Bright:Compute_node_remove_gui | Remove a compute node]]
+
! style="background: white"| [[Bright: WLM_Slurm | Using SLURM]] <br/> [[Bright: Freeze Torque config files | Freeze Torque config files]]
−
! style="background: white"| [[Bright:Add_user_gui | Add a User through the GUI]] <br/> [[Bright:Add_user_cmd | Add a User through CMSH]]
+
! style="background: white"| [[Bright:RPM_Packages | RPM Packages and Naming]] <br/> [[Bright:Package_Management_head | Package Management on Headnode]] <br/> [[Bright: Kernel Management | Kernel Management]] <br/> [[Bright:Package_Management_image | Package Management on an image]] <br/> [[Bright:Non_RPM Packages | Non-RPM packages on Images]] <br/> [[Bright:Bright:Custom_Image | Create A Custom Image]]
−
! style="background: white"| [[Bright:Add kernel module to pxeboot image | Add Kernel Module to Image]] <br/> [[Bright:Run_Burn_test | Run a Burn test on a Node]]
+
! style="background: white"| [[Bright:concept | Monitoring Concept]] <br/> [[ Bright:visualization | Monitoring Visualization with cmgui]] <br/> [[ Bright:config| Monitoring Configuration with cmgui]] <br/> [[ Bright:metrics_disable| Disable Monitoring Metrics in Bright cmsh / opahfi ]]
−
! style="background: white"|  
+
! style="background: white"| [[Bright:pshell | Parallel Shell]] <br/> [[Bright:Support | Bright Suppport]] <br/> [[Bright:backup | Back ups]] <br/> [[Bright:BIOS | BIOS Update]] <br/> [[Bright: Health Checks| Health Checks within Bright]] <br/> [[Bright:SOL | SOL]]
 
|-
 
|-
 
|}
 
|}
Line 70: Line 70:
 
! style="width: 250px;"| Shorewall (IPTABLES)
 
! style="width: 250px;"| Shorewall (IPTABLES)
 
! style="width: 250px;"| Intel Xeon Phi
 
! style="width: 250px;"| Intel Xeon Phi
−
! style="width: 250px;"|  
+
! style="width: 250px;"| GPU Configuration
 
|-
 
|-
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 
! style="background: white"| [[File:Linux-firewall.jpg|100x100px]]
 
! style="background: white"| [[File:Linux-firewall.jpg|100x100px]]
 
! style="background: white"| [[File:Xeon_Phi.png|100x100px]]
 
! style="background: white"| [[File:Xeon_Phi.png|100x100px]]
−
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
+
! style="background: white"| [[File:Nvidia_logo.jpg|100x100px]]
 
|- valign="top"
 
|- valign="top"
 
! style="background: white"| [[Bright:Modules | Modules available on Bright]] <br/>  [[Bright:Intel_Cluster_Ready | Running cluster-checker]] <br/> [[Bright:ScaleMP | ScaleMP on Bright]] <br/> [[Bright:Luster | Lustre on Bright]] <br/> [[Bright:OFED | OFED on Bright]] <br/> [[Bright:Compilers | Compilers on Bright]]
 
! style="background: white"| [[Bright:Modules | Modules available on Bright]] <br/>  [[Bright:Intel_Cluster_Ready | Running cluster-checker]] <br/> [[Bright:ScaleMP | ScaleMP on Bright]] <br/> [[Bright:Luster | Lustre on Bright]] <br/> [[Bright:OFED | OFED on Bright]] <br/> [[Bright:Compilers | Compilers on Bright]]
 
! style="background: white"| [[Bright:Shorewall_files | Shorewall Files]] <br/> [[Bright:Shorewall_interfaces | Shorewall Interfaces and Zones]] <br/> [[Bright:Shorrewall_rules | Shorewall Rules]] <br/>*[[Bright:Shorewall:port_forwarding |Port Forwarding ]] <br/> [[Bright:Shorewall:port_open |Port Opening]] <br/>
 
! style="background: white"| [[Bright:Shorewall_files | Shorewall Files]] <br/> [[Bright:Shorewall_interfaces | Shorewall Interfaces and Zones]] <br/> [[Bright:Shorrewall_rules | Shorewall Rules]] <br/>*[[Bright:Shorewall:port_forwarding |Port Forwarding ]] <br/> [[Bright:Shorewall:port_open |Port Opening]] <br/>
 
! style="background: white"| [[Bright:PHI_software | PHI software installation]] <br/> [[Bright:Phi_config | Phi Configuration ]] <br/> [[Bright:PHI_update | PHI Flash Update]] <br/> [[Bright:PHI_other | PHI: other useful information]]
 
! style="background: white"| [[Bright:PHI_software | PHI software installation]] <br/> [[Bright:Phi_config | Phi Configuration ]] <br/> [[Bright:PHI_update | PHI Flash Update]] <br/> [[Bright:PHI_other | PHI: other useful information]]
−
! style="background: white"|  
+
! style="background: white"| [[CUDA/Bright | Installing CUDA on Bright]]
 
|-
 
|-
 
|}
 
|}
 
</center>
 
</center>
  
−
==Installation==
 
  
−
[[Bright:Head_node_baremetal | Head Node Bare Metal Install (recommended)]]
 
  
−
== Cluster Configuration ==
+
<center>
 +
{| class="wikitable"
 +
! style="width: 250px;"| Compute Node Configuration
 +
! style="width: 250px;"| Image Configuration
 +
! style="width: 250px;"| Maintenance
 +
! style="width: 250px;"| High Availability
 +
|-
 +
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 +
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 +
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 +
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
 +
|- valign="top"
 +
! style="background: white"| [[Bright:Compute_node_provisioning_gui | Provision a compute node]] <br/> [[Bright:Compute_node_remove_gui | Remove a compute node]]
 +
! style="background: white"| [[Bright:Create_Image | Create a new Image]] <br/> [[Bright:Node_image_management | Node Image Management]] <br/> [[Bright:upgrade image | clone and upgrade image]] <br> [[Bright:Install_Brub_Bootloader | Install GRUB Bootloader]]
 +
! style="background: white"| [[Bright:Add kernel module to pxeboot image | Add Kernel Module to Image]] <br/> [[Bright:Run_Burn_test | Run a Burn test on a Node]] <br/> [[Check disk failure and send alert]]
 +
! style="background: white"| [[Bright:HA_concepts | HA concepts]] <br/> [[Bright:HA_setup | HA Setup]] <br/> [[Bright:HA_Management | Managing HA]]
 +
|-
 +
|}
 +
</center>
  
−
*[[Bright:License the Cluster | Bright Cluster Licence]]
 
−
*[[Bright:General_Settings | Main Configuration Settings]]
 
  
−
== Network Configuration ==
 
  
−
*[[Bright:Network_settings | Network Settings]]
+
<center>
−
*[[Bright:Bridge | Bridge Interfaces]]
+
{| class="wikitable"
−
*[[Bright:Bonded_interface | Bonded Interfaces]]
+
! style="width: 250px;"| MPI
−
*[[Bright:infiniband | Infiniband Interfaces]]
+
! style="width: 250px;"| Cloud Infrastructures
−
*[[Bright:IPMI | IPMI Interfaces]]
+
|-
−
*[[Bright:DNS | Add a new nameserver]]
+
! style="background: white"| [[File:Bright_computing_sm.jpg|100x100px]]
−
 
+
! style="background: white"| [[File:Hadoop.jpg|200x200px]]
−
== Switch and PDU Configuration ==
+
|- valign="top"
−
 
+
! style="background: white"| [[Bright:Using MPI | Using MPI]]
−
 
+
! style="background: white"| [[Bright:Deploying Hadoop | Deploying Hadoop]] <br/> [[Bright:Testing Hadoop | Testing Hadoop]] <br/> [[Bright:Configuring Hadoop | Configuring Hadoop]] <br/> [[Bright:Troubleshooting Hadoop | Troubleshooting Hadoop]]
−
== Disk, NFS and Storage Configuration ==
+
|-
−
 
+
|}
−
 
+
</center>
−
== Service Configuration ==
 
−
 
 
−
 
 
−
== GPU Configuration ==
 
−
 
 
−
 
 
−
== Image Configuration ==
 
−
 
 
−
*[[Bright:Create_Image | Create a new Image]]
 
−
*[[Bright:Node_image_management | Node Image Management]]
 
−
 
 
−
== Compute Node Configuration ==
 
−
 
 
−
*[[Bright:Compute_node_provisioning_gui | Provision a compute node]]  
 
−
*[[Bright:Compute_node_remove_gui | Remove a compute node]]
 
−
 
 
−
== User Configuration ==
 
  
−
*[[Bright:Add_user_gui | Add a User through the GUI]]
 
−
*[[Bright:Add_user_cmd | Add a User through CMSH]]
 
  
 
== Command Line ==
 
== Command Line ==
  
 
*[[Bright_cmsh:Basic_commands | Basic Commands]]
 
*[[Bright_cmsh:Basic_commands | Basic Commands]]
−
*[[Bright:Add_user_cmd | Add a User]]
 
−
 
−
== Maintenance ==
 
−
 
−
 
−
*[[Bright:Add kernel module to pxeboot image | Add Kernel Module to PXEBoot Image]]
 
−
*[[Bright:Run_Burn_test | Run a Burn test on a Node]]
 
−
 
−
== Web Interface ==
 
−
 
−
== Third Party Software and Modules ==
 
−
 
−
 
−
*[[Bright:Modules | Modules available on Bright]]
 
−
*[[CUDA/Bright | Installing CUDA on Bright]]
 
−
*[[Bright:Intel_Cluster_Ready | Running cluster-checker (Intel Cluster Ready)]]
 
−
*[[Bright:ScaleMP | ScaleMP on Bright]]
 
−
*[[Bright:Luster | Lustre on Bright]]
 
−
*[[Bright:OFED | OFED on Bright]]
 
−
*[[Bright:Compilers | Compilers on Bright]]
 
−
 
−
== Shorewall (IPTABLES REPLACEMENT) ==
 
−
 
−
*[[Bright:Shorewall_files | Shorewall Files]]
 
−
*[[Bright:Shorewall_interfaces | Shorewall Interfaces and Zones]]
 
−
*[[Bright:Shorrewall_rules | Shorewall Rules]]
 
−
 
−
*[[Bright:Shorewall:port_forwarding |Port Forwarding ]]
 
−
*[[Bright:Shorewall:port_open |Port Opening]]
 
−
 
−
== Intel Xeon PHI ==
 
−
 
−
*[[Bright:PHI_software | PHI software installation]]
 
−
*[[Bright:Phi_config | Phi Configuration ]]
 
−
*[[Bright:PHI_update | PHI Flash Update]]
 
−
*[[Bright:PHI_other | PHI: other useful information]]
 

Latest revision as of 17:05, 10 February 2017

Bright-Logo.png
Installation Cluster Management Cluster Configuration Network Configuration
Bright computing sm.jpg Bright computing sm.jpg Bright computing sm.jpg
Error creating thumbnail: File missing
Head Node Bare Metal Install Bright Concepts
Bright Modules
Authentication
GUI
Shell
CMDaemon 		Bright Cluster Licence
Main Configuration Settings
Changing a node's Hostname
Change the externalnet domain 		Network Settings
Bridge Interfaces
Bonded Interfaces
Infiniband Interfaces
IPMI Interfaces
Add a new nameserver


Power Management Node Provisioning Cloud Bursting User Management
Bright computing sm.jpg Bright computing sm.jpg Bright computing sm.jpg Bright computing sm.jpg
Power Parameters
Power Operations
Monitoring Power
CPU Scaling Governors 		LDAP Client
Node Status Alert 		Openstack Installation
Openstack Configuration
Add GPUs to OpenStack
CaaS Installation
Use CaaS
CaaS Troubleshooting 		Add a User through the GUI
Add a User through CMSH
MySQL
Setup User Quotas


Workload Managment Post Installation Software Management Cluster Monitoring Day to Day Admin
Bright computing sm.jpg Bright computing sm.jpg Bright computing sm.jpg Bright computing sm.jpg
Using SLURM
Freeze Torque config files 		RPM Packages and Naming
Package Management on Headnode
Kernel Management
Package Management on an image
Non-RPM packages on Images
Create A Custom Image 		Monitoring Concept
Monitoring Visualization with cmgui
Monitoring Configuration with cmgui
Disable Monitoring Metrics in Bright cmsh / opahfi 		Parallel Shell
Bright Suppport
Back ups
BIOS Update
Health Checks within Bright
SOL


Third Party Software Shorewall (IPTABLES) Intel Xeon Phi GPU Configuration
Bright computing sm.jpg
Error creating thumbnail: File missing
Error creating thumbnail: File missing
Error creating thumbnail: File missing
Modules available on Bright
Running cluster-checker
ScaleMP on Bright
Lustre on Bright
OFED on Bright
Compilers on Bright 		Shorewall Files
Shorewall Interfaces and Zones
Shorewall Rules
*Port Forwarding
Port Opening
PHI software installation
Phi Configuration
PHI Flash Update
PHI: other useful information 		Installing CUDA on Bright


Compute Node Configuration Image Configuration Maintenance High Availability
Bright computing sm.jpg Bright computing sm.jpg Bright computing sm.jpg Bright computing sm.jpg
Provision a compute node
Remove a compute node 		Create a new Image
Node Image Management
clone and upgrade image
Install GRUB Bootloader 		Add Kernel Module to Image
Run a Burn test on a Node
Check disk failure and send alert 		HA concepts
HA Setup
Managing HA


MPI Cloud Infrastructures
Bright computing sm.jpg
Error creating thumbnail: File missing
Using MPI Deploying Hadoop
Testing Hadoop
Configuring Hadoop
Troubleshooting Hadoop


Command Line

Retrieved from "http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=Bright:_Bright_Cluster_Manager&oldid=21021"