Bright:Deploying Hadoop

First steps

• Before any installation, make sure you have the appropriate licence to install Hadoop nodes.
• Preferably, create a new Node Category, which will include all the Hadoop nodes (nameservers, datanodes etc.)
• Install the cm-hortonworks-hadoop package, through Bright:

 sudo yum install cm-hortonworks-hadoop

Installing from CMGUI

• Go to the "Hadoop HDFS" tab and click "Add HDFS Instance"

Error creating thumbnail: File missing

• Provide instance name, java installation path and Hadoop data path:

Error creating thumbnail: File missing

• Provide Hadoop distribution and make sure the tarball names are correct:

Error creating thumbnail: File missing

• Select namenodes and Yarn server host:

Error creating thumbnail: File missing

• Select the category of the Hadoop nodes:

Error creating thumbnail: File missing

• Select any other optional nodes to act as data nodes:

Error creating thumbnail: File missing

• Select Zookeeper nodes (at least 3):

Error creating thumbnail: File missing

• Select HBASE nodes:

Error creating thumbnail: File missing

• Review the configuration file and save it if it's needed:

Error creating thumbnail: File missing

After clicking "Next" on the last step, the installation will start.

Installing from terminal

• If you have an xml Hadoop configuration file, just run:

 cm-hadoop-setup -c <config.xml>

Some example configuration files are located in /cm/local/apps/cluster-tools/hadoop/conf/

• If you don't have a configuration file then run:

 cm-hadoop-setup

Then follow the on screen instructions, which are the same as the CMGUI ones. A configuration file will be then created.