Configuring Eclipse to run Map/Reduce program on Your Hadoop Cluster

Wednesday, July 31, 201331comments

After setting up your hadoop cluster which we learnt in our earlier blogs( Pseudo Distributed Cluster, Fully Distributed Cluster), we now set up eclipse on ubuntu to develop Map Reduce programs for our Hadoop Cluster. Below are the steps to do so:

  • Install Eclipse on ubuntu, by using $ sudo apt-get eclipse.
  • Next step is to download the Hadoop Eclipse Plugin. Many tutorials suggest to build the plugin jar file Yourself using "ant". Trust me, this method is a quite messy and You may screwup Your hadoop install changing the various build.xml and build-properties.xml files. The best way is to directly download this jar file from here by clicking this line.
  • Next copy the jar file to eclipse/plugins directory. Its going to be /usr/lib/eclipse/plugins in my case.
  • Start eclipse, go to "Window >> Open Perspective >> Other". From perspectives window, you should see “Map/Reduce”, Select it and click "OK".
  • You will see “Map/Reduce” perspective icon at the top right hand corner of the main eclipse panel now, as highlighted below. 

  • Also You see the Map/Reduce Locations tab at the bottom. Go to that tab and add a new location as shown below.

  • In the details form, give any Location Name.Under the Map/Reduce Master section, fill in Host as your cluster's name node host name. In our case, its "master". The port is 9001. Under DFS Master, check the "Use M/R Master host" option and give port as 9000. Under User Name give Your hadoop install user name. Its "hduser" in our case. Now click finish.

  • Now you should see Your newly set-up DFS Locations in project explorer.

Now you are all set with environment for development.
Share this article :

+ comments + 31 comments

November 18, 2013 at 9:45 PM

I tried all steps.. copied jar file into plugins directory but there is no change in perspective menu.. help me how can i install it..??

December 23, 2013 at 1:25 AM

Thank you so much for this post. Its extremely helpful for newbie like me.

February 23, 2014 at 6:54 AM
can i use this plugin for hadoop-1.0.4

February 24, 2014 at 5:50 PM

Yes You should be able to

July 14, 2015 at 1:15 AM

There are lots of information about hadoop have spread around the web, but this is a unique one according to me. The strategy you have updated here will make me to get to the next level in big data. Thanks for sharing this.

Hadoop training chennai velachery
Hadoop training velachery

August 26, 2015 at 1:29 AM

Hi admin thanks for sharing informative article on hadoop technology. In coming years, hadoop and big data handling is going to be future of computing world. This field offer huge career prospects for talented professionals. Thus, taking Hadoop Training in Chennai will help you to enter big data technology.

November 5, 2015 at 4:28 AM

Excellent information with unique content and it is very useful to know about the information based on blogs.
Hadoop Training In Chennai | oracle apps financials Training In Chennai | advanced plsql Training In Chennai

November 5, 2015 at 4:35 AM

I am very impressed with the article I have just read,so nice.......
QTP Training In Chennai | Selenium Training in Chennai | Oracle Training in Chennai

December 6, 2015 at 3:50 AM

Great post, accurate and to the point for newbies. Impressive!

December 13, 2015 at 1:22 AM

The content provided here is vital in increasing one's knowledge regarding hadoop, the way you have presented here is simply awesome. Thanks for sharing this. The uniqueness I see in your content made me to comment on this. Keep sharing article like this. Thanks :)

Hadoop Training in Chennai | Best hadoop training institute in chennai | Big data training in Chennai

February 9, 2016 at 10:33 PM

This post is very useful to one and informative article i really impressed keep it up for most post selenium training institute in chennai

February 9, 2016 at 10:48 PM

This post is very useful to one and informative article i really impressed keep it up for most post selenium course in chennai

June 27, 2016 at 5:11 AM

Good day. I was impressed with your article. Keep it up . You can also visit my site if you have time. Thank you and Bless you always.

Spark Training Academy Chennai

October 24, 2016 at 6:16 AM

Thanks for sharing this valuable information.
oracle finance training in chennai

October 24, 2016 at 6:17 AM

This post is very useful to one and informative article i really impressed keep it up for most post.
android training in chennai

June 4, 2017 at 11:00 PM

This is excellent information. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...
Android Training in Chennai
Ios Training in Chennai

June 26, 2017 at 11:35 PM

Nice it seems to be good post... It will get readers engagement on the article since readers engagement plays an vital role in every blog.i am expecting more updated posts from your hands.
Android App Development Company
iOS App Development Company

July 24, 2017 at 5:10 AM

Pretty article! I found some useful information in your blog, it was awesome to read, thanks for sharing this great content to my vision, keep sharing..
Fitness SMS
Fitness Text
Salon SMS
Salon Text
Investor Relation SMS
Investor Relation Text

September 25, 2017 at 11:45 PM

Candid institute Spring and Hibernate course provides a comprehensive introduction to Spring and Hibernate open source frameworks as well as Web Services and AJAX. Suitable for both Spring3/Hibernate3 and Spring4/Hibernate4, the course includes coverage of the core Spring and Hibernate capabilities, as well as the integration capabilities provided by Spring.
Spring boot training

September 25, 2017 at 11:48 PM

The Spring Framework is a lightweight framework for developing Java enterprise applications. It provides high performing, easily testable and reusable code. Spring handles the infrastructure as the underlying framework so that you can focus on your application.Spring is modular in design, thereby making creation, handling and linking of individual components so much easier. Spring implements Model View Container(MVC) design pattern.
spring mvc validation example

September 1, 2018 at 2:58 AM

Very nice post here and thanks for it .I always like and such a super contents of these post.Excellent and very cool idea and great content of different kinds of the valuable information's.
Hadoop Training in Chennai

Hadoop Training in Bangalore

Big data training in tambaram

Big data training in Sholinganallur

Big data training in annanagar

Big data training in Velachery

September 10, 2018 at 3:23 AM

Your good knowledge and kindness in playing with all the pieces were very useful. I don’t know what I would have done if I had not encountered such a step like this.
Devops Training in pune

Devops Training in Chennai

Devops Training in Bangalore

AWS Training in chennai

AWS Training in bangalore

September 21, 2018 at 2:24 AM

This is an awesome post.Really very informative and creative contents. These concept is a good way to enhance the knowledge.I like it and help me to development very well.Thank you for this brief explanation and very nice information.Well, got a good knowledge.
java online training | java training in pune

java training in chennai | java training in bangalore

October 4, 2018 at 11:16 PM

Inspiring writings and I greatly admired what you have to say , I hope you continue to provide new ideas for us all and greetings success always for you..Keep update more information..
Data Science training in Chennai
Data science training in bangalore
Data science training in pune
Data science online training

October 16, 2018 at 2:02 AM

Your very own commitment to getting the message throughout came to be rather powerful and have consistently enabled employees just like me to arrive at their desired goals.

angularjs Training in chennai
angularjs Training in chennai

angularjs-Training in tambaram

angularjs-Training in sholinganallur

angularjs-Training in velachery

October 31, 2018 at 10:52 PM

I’ve bookmarked your site, and I’m adding your RSS feeds to my Google account.
safety course in chennai

November 14, 2018 at 11:17 PM

Hello! This is my first visit to your blog! We are a team of volunteers and starting a new initiative in a community in the same niche. Your blog provided us useful information to work on. You have done an outstanding job.

AWS Training in Bangalore | Amazon Web Services Training in Bangalore

AWS Interview Questions And Answers

Learn Amazon Web Services Tutorial |AWS Tutorials For Beginners

Amazon Web Services Training in OMR , Chennai | Best AWS Training in OMR,Chennai

Post a Comment

Support : Creating Website | Johny Template | Mas Template
Copyright © 2011. Atom's Arena - All Rights Reserved
Template Created by Creating Website Published by Mas Template
Proudly powered by Blogger