Openstack:Setting up Mapr 5.0.0 CentOS Sahara cluster

From Define Wiki
Revision as of 06:28, 28 July 2016 by Vipul (talk | contribs)
Jump to navigation Jump to search

Following is a description of the steps followed to setup Sahara Mapr 5.0.0 CentOS cluster on Openstack Liberty. Some steps in between include modifications done specifically for deployment on Keele University Openstack.

Upload Mapr Image to Glance

Some pre-built sahara images are available at http://sahara-files.mirantis.com/images/upstream/liberty/. Since Sahara deployments in Liberty don't offer cloud-init, hence we need to modify the qcow2 image before uploading it to glance. For this, we use a tool called guestfish. Following changes are done to the image:

  • (Keele University infra only) Add proxy for yum package manager and shell sessions. Also, add custom DHCP servers
$ guestfish --rw -a sahara-liberty-mapr-5.0.0-centos-6.6.qcow2
<fs> run
<fs> mount /dev/sda1 /
<fs> vi /etc/yum.conf
# Add the below line
proxy=http://wwwcache.keele.ac.uk:8080

<fs> write /etc/dhcp/dhclient.conf "prepend domain-name-servers 160.5.40.3, 160.5.169.62;"
  • In the Mapr plugin inside Openstack Liberty 3.0.2, some oozie process related bugs were encountered, specifically

1) When the mapr packages are installed after spawning instances, the warden.oozie.conf is not placed in the correct directory, hence the warden process fails to recognize the presence of oozie, which ultimately make the cluster go into Error state. To overcome this, we'll be placing the warden.oozie.conf file in the correct location. 

<fs> mkdir -p /opt/mapr/conf/conf.d
<fs> write /opt/mapr/conf/conf.d/warden.oozie.conf ""
<fs> vi /opt/mapr/conf/conf.d/warden.oozie.conf

# Write the below contents
services=oozie:1:cldb
service.displayname=Oozie
service.command.start=/opt/mapr/oozie/oozie-4.1.0/bin/oozied.sh start
service.command.stop=/opt/mapr/oozie/oozie-4.1.0/bin/oozied.sh stop
service.command.type=BACKGROUND
service.command.monitorcommand=/opt/mapr/oozie/oozie-4.1.0/bin/oozied.sh status
service.port=11000
service.ui.port=11000
service.uri=/oozie
service.logs.location=/opt/mapr/oozie/oozie-4.1.0/logs
service.process.type=JAVA
service.env="MAPR_MAPREDUCE_MODE=default"

2) At the end of configuration phase, sahara restarts oozie. Before going to Running state, it is stuck in standby state for some time. Sahara process only waits 60s for this to happen. Even in a big instance, oozie may not start within 60s. Hence, predefined parameter timeout's value in function _wait_for_status is changed from 60 to 180 in file /usr/lib/python2.7/site-packages/sahara/plugins/mapr/domain/node_process.py

When the image is ready, upload it to glance.

Register the image with Sahara

In Data processing tab in Horizon dahsboard, register the image uploaded to glance with plugin tags 'mapr' & '5.0.0.mrv2'. For centos images, configure user as 'cloud-user'. For ubuntu images, the user would be 'ubuntu'

Retrieved from "http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=Openstack:Setting_up_Mapr_5.0.0_CentOS_Sahara_cluster&oldid=14481"