Bright:Configuring Hadoop

Adding Drives in pre-installed instance

Existing configuration uses directory /disk1 and we need to add /disk2.

1. Partition and format the drive
2. Add an FS Mount, for that drive, on the nodes/categories required, through Bright (in our case /disk2)

Adding disks to Datanodes

Assuming datanode role assigned on hadoop category.

cmsh
[hadooptest]% category roles hadoop
[hadooptest->category[hadoop]->roles]% configurations hadoopdatanode
[hadooptest->category[hadoop]->roles[hadoopdatanode]->configurations]% get boston-hdfs datadirectories
/disk1/hadoop/hdfs/datanode
[hadooptest->category[hadoop]->roles[hadoopdatanode]->configurations]% set boston-hdfs datadirectories /disk1/hadoop/hdfs/datanode /disk2/hadoop/hdfs/datanode
[hadooptest->category*[hadoop*]->roles*[hadoopdatanode*]->configurations*]% commit

Adding disks to Namenodes

Assuming namenode role assigned on hadoop1 node.

cmsh
[hadooptest]% device roles hadoop1
[hadooptest->device[hadoop1]->roles]% configurations hadoopnamenode
[hadooptest->device[hadoop1]->roles[hadoopnamenode]->configurations]% get boston-hdfs datadirectories
/disk1/hadoop/hdfs/namenode
[hadooptest->device[hadoop1]->roles[hadoopnamenode]->configurations]% set boston-hdfs datadirectories /disk1/hadoop/hdfs/namenode /disk2/hadoop/hdfs/namenode
[hadooptest->device*[hadoop1*]->roles*[hadoopnamenode*]->configurations*]% commit