EFY Times  
Thursday, November 27, 2014

 
GO
 
 

12 Very Important Tools For Hadoop Users
 
Home >> Infotech >> Features
 
12 Very Important Tools For Hadoop Users  
 
When it comes to Big Data, its often all about the tools!   
Rate this news:  (1 Votes)
Wednesday, April 16, 2014 When it comes to Big Data analysis, Hadoop is at the forefront of things. Almost every company worth mentioning is looking for people specialised in Hadoop. These tools manage various aspects of big data analysis using Hadoop.

Apache, Hadoop, HDFS, Apache Lucene, Oozie, Avro, Big Data analysis




1. Ambari

The Apache Ambari project is aimed at making Hadoop management simpler by developing software for provisioning, managing, and monitoring Apache Hadoop clusters. Ambari provides an intuitive, easy-to-use Hadoop management web UI backed by its RESTful APIs. (Official Website)

2. HDFS (Hadoop Distributed File System)

The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware. It has many similarities with existing distributed file systems. However, the differences from other distributed file systems are significant. HDFS is highly fault-tolerant and is designed to be deployed on low-cost hardware. HDFS provides high throughput access to application data and is suitable for applications that have large data sets. HDFS relaxes a few POSIX requirements to enable streaming access to file system data. HDFS was originally built as infrastructure for the Apache Nutch web search engine project. HDFS is now an Apache Hadoop subproject. (Official Website)

3. HBase

Use Apache HBase when you need random, realtime read/write access to your Big Data. This project's goal is the hosting of very large tables -- billions of rows X millions of columns -- atop clusters of commodity hardware. Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable: A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, Apache HBase provides Bigtable-like capabilities on top of Hadoop and HDFS. (Official Website)

4. Hive

The Apache Hive ™ data warehouse software facilitates querying and managing large datasets residing in distributed storage. Hive provides a mechanism to project structure onto this data and query the data using a SQL-like language called HiveQL. At the same time this language also allows traditional map/reduce programmers to plug in their custom mappers and reducers when it is inconvenient or inefficient to express this logic in HiveQL. (Official Website)

5. Sqoop

Apache Sqoop(TM) is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases. (Official Website)

6. Pig

Apache Pig is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets. (Official Website)

7. ZooKeeper

Apache ZooKeeper is an effort to develop and maintain an open-source server which enables highly reliable distributed coordination. (Official Website)

8. NoSQL

This is the answer to MySQL and other established database management systems. It includes names like MongoDB etc.

9. Mahout

The Apache Mahout project's goal is to build a scalable machine learning library. (Official Website)

10. Lucene/Solr

This is an enterprise search platform that comes from the Apache Lucene project.

11. Avro

This is a data sterilisation system.

12. Oozie

This is a workflow scheduler that helps manage jobs on Apache Hadoop.




Print Email Post Comment  (1)
(Total Views: 6939)
 
Share

 
 

1 Comments

lmccay   213 days ago

I think #11 should be serialization.
Reply  
 
Infotech News
   
Axis Recognizes Outstanding Partners; Hosts Them At Partner Summit 2014 Held In Dubai
Quick Heal Technologies, The Leader In IT Security Solutions, Launches Its New And Improved 16.00 Series
Infineon Launches New TO-247PLUS Package Enabling Current Rates Of Up To 120A
Tintri Named A Visionary In The Gartner Magic Quadrant For General-Purpose Disk Arrays
TVS’ Partnership With ELECTRA IC Strengthens Turkish Presence
 
 
 
     
     
     
     
     
     
Most popular
 

Daily

SanDisk Co-Founder And Retired CEO Receives United States’Highest Honor For Scientific Achievement And Innovation At White House Ceremony
Schneider Electric India Highlights Importance Of ICT For Smart Cities, Citing An Independent Survey
Industry's First 10-W Wireless Power Solution Allows Consumers To Charge Faster And Cooler Without Plugging In
Team From National Institute Of Technology Agartala Wins Synopsys India’s Analog Design Contest 2014
Amazon Development Centre India Is The Highest New Jobs Creator In Karnataka
Altera CEO John Daane Receives 2014 Robert N. Noyce Award From Semiconductor Industry Association
New M-Series IGBTs From STMicroelectronics Raise Energy Efficiency And Ruggedness For Solar And Industrial Power
Microchip Introduces New 5V dsPIC33 "EV" Family For Enhanced Noise Immunity And Robustness In Harsh Environments
UV-Visible-NIR Polarization Spectroscopy Of Microscopic Samples
GlacialTech Launches Bay Light Heatsink Range For High Power LEDs From 100W To 250W – Igloo SR Series
 
   

Weekly

Teradata And MapR Partnership Expands Hadoop Choices Within Teradata’s Unified Data Architecture
Google's Material Design Ideas A Part Of Linux Distros Now!
Six Fastest Supercomputers In The World!
Nokia Z Launcher Released On Google Play For Android 4.1 and Higher Versions!
Oracle Advances Data Integration Portfolio With Major Enhancements To Oracle GoldenGate 12c
Top 7 Technologies To Watch Out For In 2015!
8 Killer Music Streaming Clients For Linux Users
8 Most Useful Ajax And PHP Based Webmail Clients
ZTE Releases Grand S II With Voice-Control Technology In India
8 Cyber-Crime Predictions For The Year To Come – 2015
Meet A Smartphone Look-Alike Handgun – Taurus Curve
Beware Android Users! A New Malware Is Here To Turn You Into Hackers' Slaves
Celkon Millennia Epic Q550 With Android 4.4 KitKat Launched
15 Unique And Must Have Android Apps To Make iPhone Users Feel Jealous
12 Major Applications To Be Shipped With Linux Mint 17.1 “Rebecca” Cinnamon
Microsoft Shows Further Commitment Towards Open Source, Releases Docker Client For Windows
 
   

Overall

Features
Learn How To Pentest WPA/WPA2 Networks With Kali Linux
Accessing anyone's Wi-Fi connection without due permission is illegal hacking but it can be used for penetration testing and secure hacking to know th...
Here Is All You Need To Know Before Choosing Between Debian And Ubuntu!
Here we will discuss the basic differences between Debian and Ubuntu, to help you understand which is best suited for your needs....
5 Tips For Developers To Protect Their Mobile Apps From Hacking
Here we have five tips for app developers to let them know how they can protect their apps....
8 Most Interesting PHP Projects For Developers
Experimentation with programming becomes fun if done with PHP. Here are eight most interesting projects which can be implemented with PHP....
10 Best Alternative Browsers For Ubuntu Linux
Here we have compiled a list of ten best alternative browsers for Ubuntu which might impress you....
10 Useful Security Firewall Software For Linux
Here we are giving you a list of ten most popular firewalls which might prove useful for your requirements....
10 Best Video Editing Software For Linux
Here we'll discuss ten most potential video editors available for Linux....
7 Best Graphical Web-Based Network Monitoring Tools For Linux
Graphical and web-based network monitoring tools are necessary for monitoring CPU load, network traffic stats, memory consumption etc....
10 Best Sites To Find Remote Jobs For Web Developers And Programmers
There are some great sites which help you find remote coding jobs. Check them out here....
7 Major Linux Security Distributions – Know Which One Suits You The Most!
Here we will discuss the strengths and weaknesses of all the seven major Linux security distributions....
10 Coolest Facts About Android 5.0 Lollipop!
To make out the most from the new Android, we're bringing you ten coolest tips and tricks for the Android Lollipop....
5 Best Online Backup Tools For Ubuntu Linux
Online cloud backups are always good for an overall backup plan, but it's equally important to keep data secure, encrypted and backed up automatically...
6 Best Development Methods To Create Scalable CSS
Here are the best six CSS development methodologies and style guides which can help you....
8 Most Useful Ajax And PHP Based Webmail Clients
These clients offer excellent user interface and sophisticated privacy protection and it allows users view HTML formatted email messages easily....
7 Best Free Archive Managers For Linux
Here we have compiled a list of seven best archive managers which can be used on daily basis....
 
  View All
Dialogue
 
10 Questions That Google Never Asks While Hiring!
Here is a list of 10 questions that Google just banned from their interviews....
For Enjay, Open Source Technology Is A Way Of Life
An entirely open source-based company, Enjay IT Solutions, has built itself a reputation in the OSS domain....
Switching To Tizen Doesn’t Mean We Are Abandoning Android: Samsung
The company has worked to build Tizen up from scratch and has now introduced it to developers and the general public with its latest range of wearable...
Venturing Into The Cloud? Develop A Customised Cloud Strategy First!
Diksha P Gupta speaks to Rushikesh Jadhav, cloud evangelist, ESDS Software Solution Pvt Ltd, on how the cloud has changed the way compan...
HTC Is Strong And There Are No Plans Of Sale Now Or In Future, Says HTC's Senior Director-Marketing
Atithya Amaresh from EFYTimes had an exclusive chat with Sirpa H. Ikola, senior director, Marketing, South Asia, HTC about its devices and its plans w...
   
  View All
Videos
 
First Look: LG Optimus G
The phone sports a high-end display and comes powered by a powerful processor. ...
Create QR-Codes For Free
TEC-IT releases the freeware QR-Code Studio to provide a quick and convenient way of QR code creation for every application scenario....
DoT Secretary Shares Plans For Growth Of Telecom Sector
M.F. Farooqui has recently taken charge as secretary, Department of Telecom....
Hands-On: Sony Xperia Z
Xperia Z is Sony's first entrant model in the big-screen smartphone category. ...
Hands On: Videocon A30 Smartphone
Videocon, the consumer electronics company which is known for its refrigerators, washing machine and air-conditioner has unveiled its Android-based sm...
   
View All
   
 
IFA 2014
 
IFA 2014: LG Launches 34-Inches Curved Monitor
The company is yet to confirm price and availability of the device....
IFA 2014: Intel Launches First Core M Range Of Processors
This range of processors is tailor-made for 2-in-1 devices which include a tablet and a laptop....
MWC 2014: Tablet Lets People Feel Textures On Its Screen
Now feel what you see on your tablet, by way of ultrasonic waves....
MWC 2014: 4K Android Tablet Games To Kill Consoles, iPad
Tablet makers like Samsung want to beat the iPad by making 4K tabs. ...
MWC 2014: This Vodafone Backpack Helps Get Network In Disaster Situations
Two engineers of Vodafone New Zealand displayed the "mini" mobile network by Vodafone substructure in a backpack. ...
MWC 2014: Wilocity Chipset To Bring 'Lightening' Speed To Mobile Phones
Wilocity has developed a WiGig chipset for mobile phones that will bring lightning-fast wireless capability ...
MWC 2014: Samsung Introduces Octacore, Hexacore Chipsets
The Korean giant, Samsung unveiled two new octacore and hexacore chipsets at MWC 2014, in Barcelona. The company previously used Exynos 5 Octa 5410 ch...
   
View All
   
 
Events
 
19th Consumer Electronic Imaging Fair To Be Held On ...

View All
   
   
 
 

home archives contact us advertise with us
           
Magazines Portals Directories Events News Verticals Educational Institute  
Electronics for You
Open Source for You
Electronics Bazaar
electronicsforu.com
efytimes.com
opensourceforu.com
electronicsb2b.com
Electronics Annual Guide
EFY EXPO INDIA
EFY EXPO WEST
ELECTRONICS ROCKS
EFY Awards
OSIDAYS Expo
Electronics
Infotech
Linux & Open Source
Consumer Electronics
Science & Technology
BPO
EFY Techcenter

Educational Kits
Kitsnspares.com  
 
 
© Copyright 2014 EFY Enterprises Pvt. Ltd.
All rights reserved. Reproduction in whole or in part in any form or medium without written permission is prohibited.
Usage of the content from the web site is subject to Terms and Conditions