Difference between revisions of "Hadoop: Setup a single host test system"
Jump to navigation
Jump to search
(Created page with "Tests performed on a single calxeda SOC with ubuntu 12.10 == Prerequisites == * Install Java/JRE <syntaxhighlight> apt-get update apt-get install default-jre </syntaxhighlight> * Setup passwo...") |
|||
| Line 2: | Line 2: | ||
== Prerequisites == | == Prerequisites == | ||
| − | + | ||
| + | === Install Java/JRE === | ||
<syntaxhighlight> | <syntaxhighlight> | ||
apt-get update | apt-get update | ||
| Line 8: | Line 9: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| − | + | === Setup Passwordless Access === | |
| + | Setup passwordless ssh for user/root (I used root in this example, separate hadoop user should really be setup!) | ||
<syntaxhighlight> | <syntaxhighlight> | ||
ssh-keygen -t rsa | ssh-keygen -t rsa | ||
| Line 16: | Line 18: | ||
chmod 600 authorized_keys | chmod 600 authorized_keys | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| + | |||
| + | == Install Hadoop == | ||
| + | |||
| + | === Get latest stable release === | ||
| + | The latest release is available from: http://ftp.heanet.ie/mirrors/www.apache.org/dist/hadoop/common/stable/ | ||
| + | <syntaxhighlight> | ||
| + | wget http://ftp.heanet.ie/mirrors/www.apache.org/dist/hadoop/common/stable/hadoop-1.0.3.tar.gz | ||
| + | cd /opt | ||
| + | tar zxvf /path/to/download/hadoop-1.0.3.tar.gz | ||
| + | </syntaxhighlight> | ||
| + | |||
| + | === Setup Config Files === | ||
Revision as of 16:20, 17 July 2012
Tests performed on a single calxeda SOC with ubuntu 12.10
Prerequisites
Install Java/JRE
apt-get update
apt-get install default-jreSetup Passwordless Access
Setup passwordless ssh for user/root (I used root in this example, separate hadoop user should really be setup!)
ssh-keygen -t rsa
# dont enter a passphrase, just hit enter twice for a blank passphrase
cd .ssh
cat id_rsa.pub >> authorized_keys
chmod 600 authorized_keysInstall Hadoop
Get latest stable release
The latest release is available from: http://ftp.heanet.ie/mirrors/www.apache.org/dist/hadoop/common/stable/
wget http://ftp.heanet.ie/mirrors/www.apache.org/dist/hadoop/common/stable/hadoop-1.0.3.tar.gz
cd /opt
tar zxvf /path/to/download/hadoop-1.0.3.tar.gz