Configuring Eclipse to run Map/Reduce program on Your Hadoop Cluster

Wednesday, July 31, 201353comments

After setting up your hadoop cluster which we learnt in our earlier blogs( Pseudo Distributed Cluster, Fully Distributed Cluster), we now set up eclipse on ubuntu to develop Map Reduce programs for our Hadoop Cluster. Below are the steps to do so:

  • Install Eclipse on ubuntu, by using $ sudo apt-get eclipse.
  • Next step is to download the Hadoop Eclipse Plugin. Many tutorials suggest to build the plugin jar file Yourself using "ant". Trust me, this method is a quite messy and You may screwup Your hadoop install changing the various build.xml and build-properties.xml files. The best way is to directly download this jar file from here by clicking this line.
  • Next copy the jar file to eclipse/plugins directory. Its going to be /usr/lib/eclipse/plugins in my case.
  • Start eclipse, go to "Window >> Open Perspective >> Other". From perspectives window, you should see “Map/Reduce”, Select it and click "OK".
  • You will see “Map/Reduce” perspective icon at the top right hand corner of the main eclipse panel now, as highlighted below. 

  • Also You see the Map/Reduce Locations tab at the bottom. Go to that tab and add a new location as shown below.

  • In the details form, give any Location Name.Under the Map/Reduce Master section, fill in Host as your cluster's name node host name. In our case, its "master". The port is 9001. Under DFS Master, check the "Use M/R Master host" option and give port as 9000. Under User Name give Your hadoop install user name. Its "hduser" in our case. Now click finish.


  • Now you should see Your newly set-up DFS Locations in project explorer.

Now you are all set with environment for development.
Share this article :

+ comments + 53 comments

Anonymous
November 18, 2013 at 9:45 PM

I tried all steps.. copied jar file into plugins directory but there is no change in perspective menu.. help me how can i install it..??

Sunil
December 23, 2013 at 1:25 AM

Thank you so much for this post. Its extremely helpful for newbie like me.

February 23, 2014 at 6:54 AM

https://dl.dropboxusercontent.com/u/27032474/hadoop-eclipse-plugin-0.20.203.0.jar
can i use this plugin for hadoop-1.0.4

February 24, 2014 at 5:50 PM

Yes You should be able to

July 14, 2015 at 1:15 AM

There are lots of information about hadoop have spread around the web, but this is a unique one according to me. The strategy you have updated here will make me to get to the next level in big data. Thanks for sharing this.

Hadoop training chennai velachery
Hadoop training velachery

August 26, 2015 at 1:29 AM

Hi admin thanks for sharing informative article on hadoop technology. In coming years, hadoop and big data handling is going to be future of computing world. This field offer huge career prospects for talented professionals. Thus, taking Hadoop Training in Chennai will help you to enter big data technology.

November 5, 2015 at 4:28 AM

Excellent information with unique content and it is very useful to know about the information based on blogs.
Hadoop Training In Chennai | oracle apps financials Training In Chennai | advanced plsql Training In Chennai

November 5, 2015 at 4:35 AM

I am very impressed with the article I have just read,so nice.......
QTP Training In Chennai | Selenium Training in Chennai | Oracle Training in Chennai

Nilang
December 6, 2015 at 3:50 AM

Great post, accurate and to the point for newbies. Impressive!

December 13, 2015 at 1:22 AM

The content provided here is vital in increasing one's knowledge regarding hadoop, the way you have presented here is simply awesome. Thanks for sharing this. The uniqueness I see in your content made me to comment on this. Keep sharing article like this. Thanks :)

Hadoop Training in Chennai | Best hadoop training institute in chennai | Big data training in Chennai

February 9, 2016 at 10:33 PM

This post is very useful to one and informative article i really impressed keep it up for most post selenium training institute in chennai

February 9, 2016 at 10:48 PM

This post is very useful to one and informative article i really impressed keep it up for most post selenium course in chennai

June 27, 2016 at 5:11 AM

Good day. I was impressed with your article. Keep it up . You can also visit my site if you have time. Thank you and Bless you always.



Spark Training Academy Chennai

October 24, 2016 at 6:16 AM

Thanks for sharing this valuable information.
oracle finance training in chennai

October 24, 2016 at 6:17 AM

This post is very useful to one and informative article i really impressed keep it up for most post.
android training in chennai

June 4, 2017 at 11:00 PM


This is excellent information. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...
Android Training in Chennai
Ios Training in Chennai

June 26, 2017 at 11:35 PM


Nice it seems to be good post... It will get readers engagement on the article since readers engagement plays an vital role in every blog.i am expecting more updated posts from your hands.
Android App Development Company
iOS App Development Company

July 24, 2017 at 5:10 AM

Pretty article! I found some useful information in your blog, it was awesome to read, thanks for sharing this great content to my vision, keep sharing..
Fitness SMS
Fitness Text
Salon SMS
Salon Text
Investor Relation SMS
Investor Relation Text

September 25, 2017 at 11:45 PM

Candid institute Spring and Hibernate course provides a comprehensive introduction to Spring and Hibernate open source frameworks as well as Web Services and AJAX. Suitable for both Spring3/Hibernate3 and Spring4/Hibernate4, the course includes coverage of the core Spring and Hibernate capabilities, as well as the integration capabilities provided by Spring.
Spring boot training

September 25, 2017 at 11:48 PM

The Spring Framework is a lightweight framework for developing Java enterprise applications. It provides high performing, easily testable and reusable code. Spring handles the infrastructure as the underlying framework so that you can focus on your application.Spring is modular in design, thereby making creation, handling and linking of individual components so much easier. Spring implements Model View Container(MVC) design pattern.
spring mvc validation example

September 1, 2018 at 2:58 AM

Very nice post here and thanks for it .I always like and such a super contents of these post.Excellent and very cool idea and great content of different kinds of the valuable information's.
Hadoop Training in Chennai

Hadoop Training in Bangalore

Big data training in tambaram

Big data training in Sholinganallur

Big data training in annanagar

Big data training in Velachery

September 10, 2018 at 3:23 AM

Your good knowledge and kindness in playing with all the pieces were very useful. I don’t know what I would have done if I had not encountered such a step like this.
Devops Training in pune

Devops Training in Chennai

Devops Training in Bangalore

AWS Training in chennai

AWS Training in bangalore





September 21, 2018 at 2:24 AM

This is an awesome post.Really very informative and creative contents. These concept is a good way to enhance the knowledge.I like it and help me to development very well.Thank you for this brief explanation and very nice information.Well, got a good knowledge.
java online training | java training in pune

java training in chennai | java training in bangalore

October 4, 2018 at 11:16 PM

Inspiring writings and I greatly admired what you have to say , I hope you continue to provide new ideas for us all and greetings success always for you..Keep update more information..
Data Science training in Chennai
Data science training in bangalore
Data science training in pune
Data science online training

October 16, 2018 at 2:02 AM

Your very own commitment to getting the message throughout came to be rather powerful and have consistently enabled employees just like me to arrive at their desired goals.

angularjs Training in chennai
angularjs Training in chennai

angularjs-Training in tambaram

angularjs-Training in sholinganallur

angularjs-Training in velachery

October 31, 2018 at 10:52 PM

I’ve bookmarked your site, and I’m adding your RSS feeds to my Google account.
safety course in chennai

November 14, 2018 at 11:17 PM

Hello! This is my first visit to your blog! We are a team of volunteers and starting a new initiative in a community in the same niche. Your blog provided us useful information to work on. You have done an outstanding job.



AWS Training in Bangalore | Amazon Web Services Training in Bangalore

AWS Interview Questions And Answers

Learn Amazon Web Services Tutorial |AWS Tutorials For Beginners

Amazon Web Services Training in OMR , Chennai | Best AWS Training in OMR,Chennai

December 5, 2018 at 9:11 PM

Have you been thinking about the power sources and the tiles whom use blocks I wanted to thank you for this great read!! I definitely enjoyed every little bit of it and I have you bookmarked to check out the new stuff you post
Java training in Bangalore | Java training in Kalyan nagar

Java training in Bangalore | Java training in Kalyan nagar

Java training in Bangalore | Java training in Jaya nagar

December 9, 2018 at 9:30 PM

Hi, Great.. Tutorial is just awesome..It is really helpful for a newbie like me.. I am a regular follower of your blog. Really very informative post you shared here. Kindly keep blogging.
Best Devops Training in pune

December 9, 2018 at 9:51 PM

I really like the dear information you offer in your articles. I’m able to bookmark your site and show the kids check out up here generally. Im fairly positive theyre likely to be informed a great deal of new stuff here than anyone
python course in pune
python course in chennai
python Training in Bangalore

December 18, 2018 at 11:21 PM

Really very nice blog information for this one and more technical skills are improve,i like that kind of post.

rpa training in chennai |best rpa training in chennai|
rpa training in bangalore | best rpa training in bangalore

December 21, 2018 at 1:27 AM

The admin of this blog has really shared a needed information in a simple way. Kindly continue sharing this king of useful information.

TOEFL Training Institute in Adyar
TOEFL Classes in ECR
TOEFL in Shasthri Nagar
TOEFL Training near me
TOEFL Coaching in T-Nagar
TOEFL Classes at Ashok Nagar
TOEFL Coaching near me

January 8, 2019 at 3:00 AM

Hmm, it seems like your site ate my first comment (it was extremely long) so I guess I’ll just sum it up what I had written and say, I’m thoroughly enjoying your blog. I as well as an aspiring blog writer, but I’m still new to the whole thing. Do you have any recommendations for newbie blog writers? I’d appreciate it.
Advanced AWS Training in Bangalore | Best Amazon Web Services Training Institute in Bangalore
Advanced AWS Training Institute in Pune | Best Amazon Web Services Training Institute in Pune
Advanced AWS Online Training Institute in india | Best Online AWS Certification Course in india

January 11, 2019 at 11:36 PM

You’ve written a really great article here. Your writing style makes this material easy to understand.. I agree with some of the many points you have made. Thank you for this is real thought-provoking content
Data science course in bangalore

January 17, 2019 at 11:23 PM

Hmm, it seems like your site ate my first comment (it was extremely long) so I guess I’ll just sum it up what I had written and say, I’m thoroughly enjoying your blog. I as well as an aspiring blog writer, but I’m still new to the whole thing. Do you have any recommendations for newbie blog writers? I’d appreciate it.
Advanced AWS Training in Bangalore | Best Amazon Web Services Training Institute in Bangalore
Advanced AWS Training Institute in Pune | Best Amazon Web Services Training Institute in Pune
Advanced AWS Online Training Institute in india | Best Online AWS Certification Course in india
AWS training in bangalore | Best aws training in bangalore

January 18, 2019 at 5:03 AM


Greetings. I know this is somewhat off-topic, but I was wondering if you knew where I could get a captcha plugin for my comment form? I’m using the same blog platform like yours, and I’m having difficulty finding one? Thanks a lot.
Best AWS Training in Chennai | Amazon Web Services Training Institute in Chennai Velachery, Tambaram, OMR
Advanced AWS Training in Bangalore |Best AWS Training Institute in Bangalore BTMLA ,Marathahalli

January 21, 2019 at 11:29 PM

I appreciate your efforts because it conveys the message of what you are trying to say. It's a great skill to make even the person who doesn't know about the subject could able to understand the subject . Your blogs are understandable and also elaborately described. I hope to read more and more interesting articles from your blog. All the best.
rpa training in bangalore
rpa training in chennai
rpa training in pune
best rpa training in bangalore

January 23, 2019 at 9:51 PM

Wow it is really wonderful and awesome thus it is very much useful for me to understand many concepts and helped me a lot. it is really explainable very well and i got more information from your blog.
microsoft azure training in bangalore
rpa interview questions and answers
automation anywhere interview questions and answers
blueprism interview questions and answers
uipath interview questions and answers
rpa training in bangalore

January 24, 2019 at 4:13 AM

Nice post. By reading your blog, i get inspired and this provides some useful information. Thank you for posting this exclusive post for our vision. 
Best Devops Training in pune
Devops Training in Bangalore
Power bi training in Chennai

January 25, 2019 at 10:01 PM

It has been simply incredibly generous with you to provide openly what exactly many individuals would’ve marketed for an eBook to end up making some cash for their end, primarily given that you could have tried it in the event you wanted.
fire and safety course in chennai

January 30, 2019 at 2:34 AM

Thank you a lot for providing individuals with a very spectacular possibility to read critical reviews from this site.
Python Online certification training
python Training institute in Chennai
Python training institute in Bangalore

January 30, 2019 at 9:30 PM

This is a terrific article, and that I would really like additional info if you have got any. I’m fascinated with this subject and your post has been one among the simplest I actually have read.
python Course in Pune
python Course institute in Chennai
python Training institute in Bangalore

February 5, 2019 at 11:07 PM

Informative Blog, Thank you to share this
Regards,
Best Devops Training in Chennai | Best Devops Training Institute in Chennai

Post a Comment

 
Support : Creating Website | Johny Template | Mas Template
Copyright © 2011. Atom's Arena - All Rights Reserved
Template Created by Creating Website Published by Mas Template
Proudly powered by Blogger