Configuring Eclipse to run Map/Reduce program on Your Hadoop Cluster

Wednesday, July 31, 201324comments

After setting up your hadoop cluster which we learnt in our earlier blogs( Pseudo Distributed Cluster, Fully Distributed Cluster), we now set up eclipse on ubuntu to develop Map Reduce programs for our Hadoop Cluster. Below are the steps to do so:

  • Install Eclipse on ubuntu, by using $ sudo apt-get eclipse.
  • Next step is to download the Hadoop Eclipse Plugin. Many tutorials suggest to build the plugin jar file Yourself using "ant". Trust me, this method is a quite messy and You may screwup Your hadoop install changing the various build.xml and build-properties.xml files. The best way is to directly download this jar file from here by clicking this line.
  • Next copy the jar file to eclipse/plugins directory. Its going to be /usr/lib/eclipse/plugins in my case.
  • Start eclipse, go to "Window >> Open Perspective >> Other". From perspectives window, you should see “Map/Reduce”, Select it and click "OK".
  • You will see “Map/Reduce” perspective icon at the top right hand corner of the main eclipse panel now, as highlighted below. 

  • Also You see the Map/Reduce Locations tab at the bottom. Go to that tab and add a new location as shown below.

  • In the details form, give any Location Name.Under the Map/Reduce Master section, fill in Host as your cluster's name node host name. In our case, its "master". The port is 9001. Under DFS Master, check the "Use M/R Master host" option and give port as 9000. Under User Name give Your hadoop install user name. Its "hduser" in our case. Now click finish.


  • Now you should see Your newly set-up DFS Locations in project explorer.

Now you are all set with environment for development.
Share this article :

+ comments + 24 comments

Anonymous
November 18, 2013 at 9:45 PM

I tried all steps.. copied jar file into plugins directory but there is no change in perspective menu.. help me how can i install it..??

Sunil
December 23, 2013 at 1:25 AM

Thank you so much for this post. Its extremely helpful for newbie like me.

February 23, 2014 at 6:54 AM

https://dl.dropboxusercontent.com/u/27032474/hadoop-eclipse-plugin-0.20.203.0.jar
can i use this plugin for hadoop-1.0.4

February 24, 2014 at 5:50 PM

Yes You should be able to

July 14, 2015 at 1:15 AM

There are lots of information about hadoop have spread around the web, but this is a unique one according to me. The strategy you have updated here will make me to get to the next level in big data. Thanks for sharing this.

Hadoop training chennai velachery
Hadoop training velachery

August 26, 2015 at 1:29 AM

Hi admin thanks for sharing informative article on hadoop technology. In coming years, hadoop and big data handling is going to be future of computing world. This field offer huge career prospects for talented professionals. Thus, taking Hadoop Training in Chennai will help you to enter big data technology.

November 5, 2015 at 4:28 AM

Excellent information with unique content and it is very useful to know about the information based on blogs.
Hadoop Training In Chennai | oracle apps financials Training In Chennai | advanced plsql Training In Chennai

November 5, 2015 at 4:35 AM

I am very impressed with the article I have just read,so nice.......
QTP Training In Chennai | Selenium Training in Chennai | Oracle Training in Chennai

Nilang
December 6, 2015 at 3:50 AM

Great post, accurate and to the point for newbies. Impressive!

December 13, 2015 at 1:22 AM

The content provided here is vital in increasing one's knowledge regarding hadoop, the way you have presented here is simply awesome. Thanks for sharing this. The uniqueness I see in your content made me to comment on this. Keep sharing article like this. Thanks :)

Hadoop Training in Chennai | Best hadoop training institute in chennai | Big data training in Chennai

February 9, 2016 at 10:33 PM

This post is very useful to one and informative article i really impressed keep it up for most post selenium training institute in chennai

February 9, 2016 at 10:48 PM

This post is very useful to one and informative article i really impressed keep it up for most post selenium course in chennai

June 27, 2016 at 5:11 AM

Good day. I was impressed with your article. Keep it up . You can also visit my site if you have time. Thank you and Bless you always.



Spark Training Academy Chennai

October 24, 2016 at 6:16 AM

Thanks for sharing this valuable information.
oracle finance training in chennai

October 24, 2016 at 6:17 AM

This post is very useful to one and informative article i really impressed keep it up for most post.
android training in chennai

June 4, 2017 at 11:00 PM


This is excellent information. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...
Android Training in Chennai
Ios Training in Chennai

June 26, 2017 at 11:35 PM


Nice it seems to be good post... It will get readers engagement on the article since readers engagement plays an vital role in every blog.i am expecting more updated posts from your hands.
Android App Development Company
iOS App Development Company

July 24, 2017 at 5:10 AM

Pretty article! I found some useful information in your blog, it was awesome to read, thanks for sharing this great content to my vision, keep sharing..
Fitness SMS
Fitness Text
Salon SMS
Salon Text
Investor Relation SMS
Investor Relation Text

September 25, 2017 at 11:45 PM

Candid institute Spring and Hibernate course provides a comprehensive introduction to Spring and Hibernate open source frameworks as well as Web Services and AJAX. Suitable for both Spring3/Hibernate3 and Spring4/Hibernate4, the course includes coverage of the core Spring and Hibernate capabilities, as well as the integration capabilities provided by Spring.
Spring boot training

September 25, 2017 at 11:48 PM

The Spring Framework is a lightweight framework for developing Java enterprise applications. It provides high performing, easily testable and reusable code. Spring handles the infrastructure as the underlying framework so that you can focus on your application.Spring is modular in design, thereby making creation, handling and linking of individual components so much easier. Spring implements Model View Container(MVC) design pattern.
spring mvc validation example

Post a Comment

 
Support : Creating Website | Johny Template | Mas Template
Copyright © 2011. Atom's Arena - All Rights Reserved
Template Created by Creating Website Published by Mas Template
Proudly powered by Blogger