Wednesday, October 30, 2013

Hadoop 2 on Ubuntu on Azure.

This is to be read in conjunction with http://ac31004.blogspot.co.uk/2013/10/installing-hadoop-2-on-mac_29.html

Fire up a Azure Ubuntu server and ssh to it

Install a Java JDK:
apt-get install default-jdk

On you home machine, download a copy of Hadoop and secure copy it to the Azure machine (your username and machine will be different)
scp hadoop-2.2.0.tar.gz user@Hadoopmachine.cloudapp.net:

Unzip it and untar it
gunzip hadoop-2.2.0.tar.gz
tar xvf  hadoop-2.2.0.tar

You'll still need to set up the env variables
export JAVA_HOME=/usr/lib/jvm/default-java
export HADOOP_INSTALL=/home/user/hadoop-2.2.0
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin


Also add JAVA_HOME, add Hadoop_INSTALL and change path in /etc/environment, see http://trentrichardson.com/2010/02/10/how-to-set-java_home-in-ubuntu/ for details

After setting up core-site.xml and hdfs-site.xml  you'll make the datanode and name nodename directories

mkdir -p /home/hadoop/yarn/namenode
mkdir /home/hadoop/yarn/datanode

Everything else should be the same.

46 comments:

  1. Hi,its really nice post on hadoop. i appreciate for your post. thanks for shearing it with us. keep it up.
    Hadoop Training in hyderabad

    ReplyDelete
  2. I hope these information should be more useful to the web developers who are working on ubuntu field.
    Website Designing Bangalore | Website Design Company Bangalore

    ReplyDelete
  3. " I enjoy what you guys are usually up too. This sort of clever work and coverage! Keep up the wonderful works guys I’ve added you guys to my blog roll.
    "
    iWatch service center chennai | apple ipad service center in chennai | apple iphone service center in chennai | Apple laptop service center in chennai

    ReplyDelete
  4. "Hello! Someone in my Facebook group shared this website with us, so I came to give it a look. I’m enjoying the information. I’m bookmarking and will be tweeting this to my followers! Wonderful blog and amazing design and style.
    "
    iWatch service center chennai | apple ipad service center in chennai | apple iphone service center in chennai

    ReplyDelete
  5. This comment has been removed by the author.

    ReplyDelete
  6. That blog is such a best blog posting, if you are looking the job posting tips on google then this blog does 100% help you thanks for sharing your experience.
    USA Dedicated Server Hosting

    ReplyDelete
  7. This blog is very attractive you are providing a good information from this article.
    This is excellent information. It is amazing and wonderful to visit your site. It really gives me an insight on this topic Finland VPS ………..It is very helpful and I am really thankful of you.

    ReplyDelete
  8. You are creating a very useful information regarding a property.Thanks for sharing your blog. Thanks author for giving us your valuable time. Europe VPS Hosting this is very nice hosting in the marker that makes your business strong.

    ReplyDelete
  9. Yes, It is important for software to be developed and I was searching all over the internet about it, that's when I found your blog. This was really extremely good.
    Do you know Japan VPS Hosting is remarkable VPS Hosting which is also budget-friendly. If you want to know more, you can contact us for more details.

    ReplyDelete
  10. Thanks a lot for giving us amazing information, I appreciated this blog post. Blog about "Adventures in Web Development". If you have a little interest in doing online business then Onlive Server one of the best platforms where you could book,Israel VPS Hosting you can ask us for more details and services.

    ReplyDelete
  11. Have you a website that's good, but if you haven't chosen a dedicated server hosting services then we are sure you faced some problems in running your online business website. A dedicated server hosting makes an easy step to getting your target so choose a best-dedicated server and get full root access in this blog post.
    USA Dedicated Server Hosting

    ReplyDelete
  12. Wow-what information! There is numerous reseller web hosting provider, Which offers fully managed hosting services. So we have the best reseller hosting services plan for your online business growing.
    Reseller Web Hosting

    ReplyDelete
  13. Hi!! Very interesting information glad that I came across such an informative post. I really liked your Information. Keep up the good work friend.this time hard to find right information from internet.
    Dedicated Server

    ReplyDelete
  14. Wonderful article! this is amazing fact about this topic. I am really glad I found your blog. Thanks for sharing this informative post. Dubai Dedicated Server Hosting

    ReplyDelete
  15. Thanks for the high quality backlinks list that will surely boost my web design website. Great blog you have here.
    Canada Dedicated Server Hosting

    ReplyDelete
  16. “I don't remember the last time I read something as good as your blog like Adventures in Web Development. If you are looking for fastest and Best Cheap VPS you can ask us for more details and services.

    ReplyDelete
  17. Awesome. This blog is very impressive and very helpful. You make so many great points here that You can get more information by visiting Instant Domain Search. you can ask us for more details and services.

    ReplyDelete

  18. Yeah, this is a too awesome blog and which you have written in this blog, each and every word is also great. Nice dear!! Thanks to sharing this with us! Fastest WordPress Hosting Thanks a lot!!!! Fastest WordPress Hosting

    ReplyDelete
  19. I like your articles. your article must be good and easily understandable. I really impressed by your post. I am going to share your post on my Facebook page. Thanks for sharing this post. Also, I can help you about WordPress Web Hosting .

    ReplyDelete
  20. Wow-what information! There is a great many Linux VPS Hosting provider, Which offers fully managed hosting services. So we have the best Cheap Linux VPSservices plan for your online business growing.

    ReplyDelete
  21. I love reading an article. your article must be good and easily understandable. I am going to share your post on my Linkedin page. Thanks for sharing this post. Also, I can help you with VPS Hosting For WordPress.

    ReplyDelete
  22. Yes, It is important for software to be developed and I was searching all over the internet about it, that's when I found your blog. This was really extremely good. the remarkable USA Dedicated that is also budget-friendly.USA Dedicated Server If you want to know more, you can contact us for more details.

    ReplyDelete
  23. Best and Important article. It is very important software. Thank You for sharing this. VPS Cloud Hosting

    ReplyDelete
  24. Thanks a lot for giving us remarkable information, I preferred this weblog post. Blog about "Adventures in Web Development". If you have a little pastime in doing on-line commercial enterprise then Onlive Server one of the nice systems the place you ought to book, Israel VPS Hosting you can ask us for extra important points and services. best cloud vps hosting
    through Onlive Server.

    ReplyDelete
  25. first thanking to you make a blog on Adventures in Web Development. If you are looking for the fastest and cheapest Linux Shared Hosting you can ask us for more details and services.

    ReplyDelete
  26. Very well-written article. Thanks for sharing Adventures in Web Development. If you are looking for the fastest and cheapest Linux Shared Hosting ​you can ask us for more details and services.

    ReplyDelete
  27. I want to Know that how to open website page in blogger hiding website address. Please must reply me. Linux Shared Hosting I m waiting.

    ReplyDelete
  28. Thank you for an additional excellent post. Exactly where else could anybody get that kind of facts in this kind of ideal way of writing? Linux Shared Hosting

    ReplyDelete
  29. I am really impressed with your blog article, thanks for sharing. I always appreciate your post. Here I also want to share some information about Linux Shared Hosting services for your website.

    ReplyDelete
  30. Awesome explanation in this blog. thank you for sharing it. This is what I was wondering about! Nice information. Keep it up!! I have come with very important information about Web Hosting if you won't know about it then click on Linux Shared Hosting

    ReplyDelete
  31. Thank you a lot......for sharing info with us
    Wonderful Blogpost by you. It's very nice & Useful info. I want to share this info with my friend and good people. If you want more info on Linux Shared Hosting to increase your business growth. Then I will help you.

    ReplyDelete
  32. In this post having more useful information and improve our knowledge. Can you share more valuable information present Technology. I am here to give you some information on Cloud VPS Hosting . It helps you to grow your business very easily.

    ReplyDelete
  33. Thanks for the nice blog. It was very useful for me. I'm happy I found this blog. Thank you for sharing with us,I too always learn something new from your post.

    Best NFT Marketplace For Artists

    ReplyDelete
  34. Thank you for your post, I look for such an article for a long time, today I find it finally. this post gives me lots of advice it is very useful for me.

    NFT Marketplace Clone Script

    ReplyDelete
  35. Thanks for the nice blog. It was very useful for me. I'm happy I found this blog. Thank you for sharing with us,I too always learn something new from your post.

    NFT Art Marketplace

    ReplyDelete
  36. This article is very good and we got lot useful and informative, beneficial information from this article, so I share this article for are user
    Polygon token

    ReplyDelete
  37. Bravo to the author for writing such a fantastic article. It was a pleasure to read! Know more about situs slot gacor and situs judi slot terbaik dan terpercaya no.1 go with 365raja that is best sloting platform.

    ReplyDelete
  38. Fantastic! I appreciated the author's use of data and statistics to support their arguments, which gave the article a lot of credibility. Get the best Nv Dmv Services from DMV Made Easy. Its services are too reliable...

    ReplyDelete
  39. Such a great information! a great read that I would recommend to others. Are you organize a party and locate some that make your party too good then look for Alcohol North Las Vegas Thank you...........

    ReplyDelete