Wednesday, October 30, 2013

Hadoop 2 on Ubuntu on Azure.

This is to be read in conjunction with http://ac31004.blogspot.co.uk/2013/10/installing-hadoop-2-on-mac_29.html

Fire up a Azure Ubuntu server and ssh to it

Install a Java JDK:
apt-get install default-jdk

On you home machine, download a copy of Hadoop and secure copy it to the Azure machine (your username and machine will be different)
scp hadoop-2.2.0.tar.gz user@Hadoopmachine.cloudapp.net:

Unzip it and untar it
gunzip hadoop-2.2.0.tar.gz
tar xvf  hadoop-2.2.0.tar

You'll still need to set up the env variables
export JAVA_HOME=/usr/lib/jvm/default-java
export HADOOP_INSTALL=/home/user/hadoop-2.2.0
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin


Also add JAVA_HOME, add Hadoop_INSTALL and change path in /etc/environment, see http://trentrichardson.com/2010/02/10/how-to-set-java_home-in-ubuntu/ for details

After setting up core-site.xml and hdfs-site.xml  you'll make the datanode and name nodename directories

mkdir -p /home/hadoop/yarn/namenode
mkdir /home/hadoop/yarn/datanode

Everything else should be the same.
Posted by at
Labels:

4 comments:

  1. sundara rami reddyJuly 24, 2014 at 1:24 PM

    Hi,its really nice post on hadoop. i appreciate for your post. thanks for shearing it with us. keep it up.
    Hadoop Training in hyderabad

    ReplyDelete
  2. steve sebastianOctober 8, 2014 at 12:29 PM

    I hope these information should be more useful to the web developers who are working on ubuntu field.
    Website Designing Bangalore | Website Design Company Bangalore

    ReplyDelete
  3. amsa lekaNovember 25, 2018 at 9:45 AM

    Thanks for your great and helpful presentation I like your good service. I always appreciate your post. That is very interesting I love reading and I am always searching for informative information like this. Well written article Thank You for Sharing with Us pmp training near me | pmp training courses online | pmp training fee | project management training certification | project management training in chennai | project management certification online |

    ReplyDelete
  4. swathiJanuary 22, 2019 at 5:45 AM


    In this post having more usefull information and improve our knowledge.Can you share more valuable information present Technology.
    I like your page.Businesses have become very sophisticated today. It is even much likely that most sellers and producers never get to see the actual clients who consume their goods, and vice versa.Thanks for great information you write it very clean. I am very lucky to get this tips from you.
    Logistics Software
    Fleet Management system
    ERP Software Companies
    Manufacturing ERP
    Human Resources Management Software
    CCTV Camera Dealers in Chennai
    Web Development

    ReplyDelete

Subscribe to: Post Comments (Atom)