Wednesday, October 30, 2013

Hadoop 2 on Ubuntu on Azure.

This is to be read in conjunction with http://ac31004.blogspot.co.uk/2013/10/installing-hadoop-2-on-mac_29.html

Fire up a Azure Ubuntu server and ssh to it

Install a Java JDK:
apt-get install default-jdk

On you home machine, download a copy of Hadoop and secure copy it to the Azure machine (your username and machine will be different)
scp hadoop-2.2.0.tar.gz user@Hadoopmachine.cloudapp.net:

Unzip it and untar it
gunzip hadoop-2.2.0.tar.gz
tar xvf  hadoop-2.2.0.tar

You'll still need to set up the env variables
export JAVA_HOME=/usr/lib/jvm/default-java
export HADOOP_INSTALL=/home/user/hadoop-2.2.0
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin


Also add JAVA_HOME, add Hadoop_INSTALL and change path in /etc/environment, see http://trentrichardson.com/2010/02/10/how-to-set-java_home-in-ubuntu/ for details

After setting up core-site.xml and hdfs-site.xml  you'll make the datanode and name nodename directories

mkdir -p /home/hadoop/yarn/namenode
mkdir /home/hadoop/yarn/datanode

Everything else should be the same.

58 comments:

  1. Hi,its really nice post on hadoop. i appreciate for your post. thanks for shearing it with us. keep it up.
    Hadoop Training in hyderabad

    ReplyDelete
    Replies
    1. Big data is a term that describes the large volume of data – both structured and unstructured – that inundates a business on a day-to-day basis. big data projects for students But it’s not the amount of data that’s important.Project Centres in Chennai

      Python Training in Chennai Python Training in Chennai The new Angular TRaining will lay the foundation you need to specialise in Single Page Application developer. Angular Training Project Centers in Chennai

      Delete
  2. I hope these information should be more useful to the web developers who are working on ubuntu field.
    Website Designing Bangalore | Website Design Company Bangalore

    ReplyDelete
  3. Thanks for your great and helpful presentation I like your good service. I always appreciate your post. That is very interesting I love reading and I am always searching for informative information like this. Well written article Thank You for Sharing with Us pmp training near me | pmp training courses online | pmp training fee | project management training certification | project management training in chennai | project management certification online |

    ReplyDelete

  4. In this post having more usefull information and improve our knowledge.Can you share more valuable information present Technology.
    I like your page.Businesses have become very sophisticated today. It is even much likely that most sellers and producers never get to see the actual clients who consume their goods, and vice versa.Thanks for great information you write it very clean. I am very lucky to get this tips from you.
    Logistics Software
    Fleet Management system
    ERP Software Companies
    Manufacturing ERP
    Human Resources Management Software
    CCTV Camera Dealers in Chennai
    Web Development

    ReplyDelete
  5. " I enjoy what you guys are usually up too. This sort of clever work and coverage! Keep up the wonderful works guys I’ve added you guys to my blog roll.
    "
    iWatch service center chennai | apple ipad service center in chennai | apple iphone service center in chennai | Apple laptop service center in chennai

    ReplyDelete
  6. "Hello! Someone in my Facebook group shared this website with us, so I came to give it a look. I’m enjoying the information. I’m bookmarking and will be tweeting this to my followers! Wonderful blog and amazing design and style.
    "
    iWatch service center chennai | apple ipad service center in chennai | apple iphone service center in chennai

    ReplyDelete
  7. This comment has been removed by the author.

    ReplyDelete

  8. Thank you for sharing the article. The data that you provided in the blog is informative and effective.
    Best Devops Training Institute

    ReplyDelete
  9. Nice Post
    "Sanjary Academy provides excellent training for Piping design course. Best Piping Design Training Institute in Hyderabad,
    Telangana. We have offer professional Engineering Course like Piping Design Course,QA / QC Course,document Controller
    course,pressure Vessel Design Course, Welding Inspector Course, Quality Management Course, #Safety officer course."
    Piping Design Course in India­
    Piping Design Course in Hyderabad
    Piping Design Course in Hyderabad
    QA / QC Course
    QA / QC Course in india
    QA / QC Course in Hyderabad
    Document Controller course
    Pressure Vessel Design Course
    Welding Inspector Course
    Quality Management Course
    Quality Management Course in india
    Safety officer course

    ReplyDelete
  10. Thanks for sharing
    Yaaron Studios is one of the rapidly growing editing studios in Hyderabad. We are the best Video Editing services in Hyderabad. We provides best graphic works like logo reveals, corporate presentation Etc. And also we gives the best Outdoor/Indoor shoots and Ad Making services.
    video editors studio in hyderabad
    short film editors in hyderabad
    corporate video editing studio in hyderabad
    ad making company in hyderabad

    ReplyDelete
  11. Awesome. You have clearly explained …Its very useful for me to know about new things. Keep on blogging.

    Power Bi Training in GUrgaon
    SQL Training in Gurgaon
    Advanced Excel /VBA training in Gurgaon

    ReplyDelete
  12. That blog is such a best blog posting, if you are looking the job posting tips on google then this blog does 100% help you thanks for sharing your experience.
    USA Dedicated Server Hosting

    ReplyDelete
  13. Wonderful article! this is amazing fact about "Adventures in Web Development". If you want to take knowledge about server hosting or interested in best Netherlands VPS Hosting you can ask us for more details and services.

    ReplyDelete
  14. This blog is very attractive you are providing a good information from this article.
    This is excellent information. It is amazing and wonderful to visit your site. It really gives me an insight on this topic Finland VPS ………..It is very helpful and I am really thankful of you.

    ReplyDelete
  15. Very Nice Blog, and I am very happy after reading this blog. And yes web hosting plays very importent role in growing website. Get the best New Zealand VPS Hosting service at a very low cost.

    ReplyDelete
  16. You are creating a very useful information regarding a property.Thanks for sharing your blog. Thanks author for giving us your valuable time. Europe VPS Hosting this is very nice hosting in the marker that makes your business strong.

    ReplyDelete
  17. Yes, It is important for software to be developed and I was searching all over the internet about it, that's when I found your blog. This was really extremely good.
    Do you know Japan VPS Hosting is remarkable VPS Hosting which is also budget-friendly. If you want to know more, you can contact us for more details.

    ReplyDelete
  18. Thanks a lot for giving us amazing information, I appreciated this blog post. Blog about "Adventures in Web Development". If you have a little interest in doing online business then Onlive Server one of the best platforms where you could book,Israel VPS Hosting you can ask us for more details and services.

    ReplyDelete
  19. Have you a website that's good, but if you haven't chosen a dedicated server hosting services then we are sure you faced some problems in running your online business website. A dedicated server hosting makes an easy step to getting your target so choose a best-dedicated server and get full root access in this blog post.
    USA Dedicated Server Hosting

    ReplyDelete
  20. Great blog, we also share UK Dedicated Server Hosting info so are you looking one of the best UK Dedicated Server visit this link.

    ReplyDelete
  21. Wow-what information! There is numerous reseller web hosting provider, Which offers fully managed hosting services. So we have the best reseller hosting services plan for your online business growing.
    Reseller Web Hosting

    ReplyDelete
  22. Hi!! Very interesting information glad that I came across such an informative post. I really liked your Information. Keep up the good work friend.this time hard to find right information from internet.
    Dedicated Server

    ReplyDelete
  23. Wonderful article! this is amazing fact about this topic. I am really glad I found your blog. Thanks for sharing this informative post. Dubai Dedicated Server Hosting

    ReplyDelete
  24. Thanks for the high quality backlinks list that will surely boost my web design website. Great blog you have here.
    Canada Dedicated Server Hosting

    ReplyDelete
  25. I like this article.I was searching over search engines and found your blog and its really helps thank you so much

    Ethereum Smart Contract Development Company

    ReplyDelete
  26. Very Nice Blog…Thanks for sharing this information with us. Here am sharing some information about training institute.
    devops online training in hyderabad

    ReplyDelete
  27. “I don't remember the last time I read something as good as your blog like Adventures in Web Development. If you are looking for fastest and Best Cheap VPS you can ask us for more details and services.

    ReplyDelete
  28. Awesome. This blog is very impressive and very helpful. You make so many great points here that You can get more information by visiting Instant Domain Search. you can ask us for more details and services.

    ReplyDelete

  29. Yeah, this is a too awesome blog and which you have written in this blog, each and every word is also great. Nice dear!! Thanks to sharing this with us! Fastest WordPress Hosting Thanks a lot!!!! Fastest WordPress Hosting

    ReplyDelete
  30. I like your articles. your article must be good and easily understandable. I really impressed by your post. I am going to share your post on my Facebook page. Thanks for sharing this post. Also, I can help you about WordPress Web Hosting .

    ReplyDelete
  31. Thanks for your great and helpful presentation I like your good service. I always appreciate your post. Cheap VPS Hosting That is very interesting I love reading and I am always searching for informative information like this. The well-written article Thank You for Sharing with Us

    ReplyDelete
  32. Wow-what information! There is a great many Linux VPS Hosting provider, Which offers fully managed hosting services. So we have the best Cheap Linux VPSservices plan for your online business growing.

    ReplyDelete
  33. I love reading an article. your article must be good and easily understandable. I am going to share your post on my Linkedin page. Thanks for sharing this post. Also, I can help you with VPS Hosting For WordPress.

    ReplyDelete
  34. Yes, It is important for software to be developed and I was searching all over the internet about it, that's when I found your blog. This was really extremely good. the remarkable USA Dedicated that is also budget-friendly.USA Dedicated Server If you want to know more, you can contact us for more details.

    ReplyDelete
  35. Best and Important article. It is very important software. Thank You for sharing this. VPS Cloud Hosting

    ReplyDelete
  36. Thanks a lot for giving us remarkable information, I preferred this weblog post. Blog about "Adventures in Web Development". If you have a little pastime in doing on-line commercial enterprise then Onlive Server one of the nice systems the place you ought to book, Israel VPS Hosting you can ask us for extra important points and services. best cloud vps hosting
    through Onlive Server.

    ReplyDelete
  37. first thanking to you make a blog on Adventures in Web Development. If you are looking for the fastest and cheapest Linux Shared Hosting you can ask us for more details and services.

    ReplyDelete
  38. Very well-written article. Thanks for sharing Adventures in Web Development. If you are looking for the fastest and cheapest Linux Shared Hosting ​you can ask us for more details and services.

    ReplyDelete
  39. I want to Know that how to open website page in blogger hiding website address. Please must reply me. Linux Shared Hosting I m waiting.

    ReplyDelete
  40. Thank you for an additional excellent post. Exactly where else could anybody get that kind of facts in this kind of ideal way of writing? Linux Shared Hosting

    ReplyDelete
  41. OH, What a wonderful site for blog commenting. if you want to know about server hosting or are interested in the bestLinux Shared Hosting
    you can ask us for more details and services.

    ReplyDelete
  42. I am really impressed with your blog article, thanks for sharing. I always appreciate your post. Here I also want to share some information about Linux Shared Hosting services for your website.

    ReplyDelete
  43. Awesome explanation in this blog. thank you for sharing it. This is what I was wondering about! Nice information. Keep it up!! I have come with very important information about Web Hosting if you won't know about it then click on Linux Shared Hosting

    ReplyDelete
  44. Thank you a lot......for sharing info with us
    Wonderful Blogpost by you. It's very nice & Useful info. I want to share this info with my friend and good people. If you want more info on Linux Shared Hosting to increase your business growth. Then I will help you.

    ReplyDelete
  45. I find this article good and beneficial, so I am sharing it with my friends………………….!!!

    NFT MARKETPLACE DEVELOPMENT

    ReplyDelete
  46. In this post having more useful information and improve our knowledge. Can you share more valuable information present Technology. I am here to give you some information on Cloud VPS Hosting . It helps you to grow your business very easily.

    ReplyDelete
  47. Thanks for the nice blog. It was very useful for me. I'm happy I found this blog. Thank you for sharing with us,I too always learn something new from your post.

    Best NFT Marketplace For Artists

    ReplyDelete
  48. I find this information in this post very useful, thanks for sharing……!!
    Solana Based Development

    ReplyDelete
  49. Thank you for your post, I look for such an article for a long time, today I find it finally. this post gives me lots of advice it is very useful for me.

    NFT Marketplace Clone Script

    ReplyDelete

  50. Infycle Technologies offers the best Python training in Chennai for tech professionals and freshers with New year offers. In addition to the Python Training Course, Infycle also offers other technical courses such as Data Science, Oracle, Java, Power BI, Digital Marketing, Big Data, etc., which will be trained with complete practical classes. Dial 7504633633 to get more info and a free demo.

    ReplyDelete
  51. Thanks for the nice blog. It was very useful for me. I'm happy I found this blog. Thank you for sharing with us,I too always learn something new from your post.

    NFT Art Marketplace

    ReplyDelete
  52. Thanks for the nice blog. It was very useful for me. I'm happy I found this blog. Thank you for sharing with us,I too always learn something new from your post.

    Cross-Chain NFT Development

    ReplyDelete
  53. This article is very good and we got lot useful and informative, beneficial information from this article, so I share this article for are user
    Polygon token

    ReplyDelete