EFY Times  
Tuesday, March 31, 2015

 
GO

12 Very Important Tools For Hadoop Users
 
Home >> Infotech >> Features
 
12 Very Important Tools For Hadoop Users  
 
When it comes to Big Data, its often all about the tools!   
Rate this news:  (1 Votes)
Wednesday, April 16, 2014 When it comes to Big Data analysis, Hadoop is at the forefront of things. Almost every company worth mentioning is looking for people specialised in Hadoop. These tools manage various aspects of big data analysis using Hadoop.

Apache, Hadoop, HDFS, Apache Lucene, Oozie, Avro, Big Data analysis




1. Ambari

The Apache Ambari project is aimed at making Hadoop management simpler by developing software for provisioning, managing, and monitoring Apache Hadoop clusters. Ambari provides an intuitive, easy-to-use Hadoop management web UI backed by its RESTful APIs. (Official Website)

2. HDFS (Hadoop Distributed File System)

The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware. It has many similarities with existing distributed file systems. However, the differences from other distributed file systems are significant. HDFS is highly fault-tolerant and is designed to be deployed on low-cost hardware. HDFS provides high throughput access to application data and is suitable for applications that have large data sets. HDFS relaxes a few POSIX requirements to enable streaming access to file system data. HDFS was originally built as infrastructure for the Apache Nutch web search engine project. HDFS is now an Apache Hadoop subproject. (Official Website)

3. HBase

Use Apache HBase when you need random, realtime read/write access to your Big Data. This project's goal is the hosting of very large tables -- billions of rows X millions of columns -- atop clusters of commodity hardware. Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable: A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, Apache HBase provides Bigtable-like capabilities on top of Hadoop and HDFS. (Official Website)

4. Hive

The Apache Hive ™ data warehouse software facilitates querying and managing large datasets residing in distributed storage. Hive provides a mechanism to project structure onto this data and query the data using a SQL-like language called HiveQL. At the same time this language also allows traditional map/reduce programmers to plug in their custom mappers and reducers when it is inconvenient or inefficient to express this logic in HiveQL. (Official Website)

5. Sqoop

Apache Sqoop(TM) is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases. (Official Website)

6. Pig

Apache Pig is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets. (Official Website)

7. ZooKeeper

Apache ZooKeeper is an effort to develop and maintain an open-source server which enables highly reliable distributed coordination. (Official Website)

8. NoSQL

This is the answer to MySQL and other established database management systems. It includes names like MongoDB etc.

9. Mahout

The Apache Mahout project's goal is to build a scalable machine learning library. (Official Website)

10. Lucene/Solr

This is an enterprise search platform that comes from the Apache Lucene project.

11. Avro

This is a data sterilisation system.

12. Oozie

This is a workflow scheduler that helps manage jobs on Apache Hadoop.




Print Email Post Comment  (1)
(Total Views: 7195)
 
Share

 
 

1 Comments

lmccay   337 days ago

I think #11 should be serialization.
Reply  
 
Infotech News
   
'Moto Care', The First Motorola Experience Centre In Bengaluru
LG G4 launch expected on 28 April?
IBM Investing $3 Billion In Building IoT Division
Microchip Launches 3Dtouchpad; Providing The First 2D/3D Input Sensing Development Platform
Google Launches Gmail App Update For Android App
 
 
 
     
     
     
Most popular
 

Daily

Adaptalux: Adaptive. Powerful. Portable. Adaptalux Brings Macro Photography Lighting To The Studio Level
Minneapolis-Based MOTI Sports, Inc. Announces The Launch Of Their Unique 3D Soccer Training Drill App Available In iTunes And Google Play Stores
Xperia Z2, Xperia Z2 Tablet To Get Android 5.0 Lollipop Update From Next Week
Optomec To Present At Signature Propulsion Industry Safety And Readiness Conference
Google Unveils The 2015 Chromebook Pixel
Hitachi Participates In Demonstration Project Realizing Hospital’s Energy Saving
Research And Markets: Cellular MEMS & Sensor Markets 2014-2018
Lenovo Announces ThinkVision T Series Monitors
Xiaomi Expected To Launch Entry Level Smartphone On April 8
Leading UK Charity Selects Storage Made Easy Enterprise File Sync And Share To Securely Work With File Content
 
   

Weekly

Microsoft Partners With Android Manufacturers
TDC Announces Partnership With NIDA - Australia’s National Institute Of Dramatic Art
Amazon Launches Unlimited Cloud Storage Service
Canonical Partners With Ericsson For NFV Telecoms
Samsung Health And Medical Equipment Sponsors Heart Across America Cycling Tour Kicking Off March 22
Cloud-Based 3D Printing OS Launched By 3DPrinterOS
New Live Or On-Demand Online Courses Develop Human Resources And Technology Skills For Leaders In Business Of Law
TRAI May Regulate Skype, Viber, WhatsApp And Other Apps
GreenPeak Launches Smart PIR Sensor For Smart Home Applications
7 Simple Solutions To Daily Tech Problems
Updated Versions Of Google Maps Now Available!
Mozilla Releases Updated Version Of Firefox
4 Websites To Get Free Stuff
Samsung To Launch Tablet With Iris Recognition
Asus Zenfone 2 To Arrive In India Soon!
Moto G (Second Gen) Available At Rs. 10,999 Exclusively On Flipkart
 
   

Overall

Features
10 Best Wire-Framing Tools For UX Designers
Here is the list of top 10 wireframing tools to help designers...
7 Simple Solutions To Daily Tech Problems
Here we round up some common tech hurdles and their simple solutions...
8 Must-Have Tools For IT Manager
As technology has changed, the job of an IT manager has grown even more complex. Here are 8 tools that can help IT managers in working more effectivel...
5 Biggest Information Security Threats
Cyber security has been top concern for tech companies and organisations. Here are 5 biggest security threats for next two years!...
7 Easy To Operate Code Checking Tools
These 7 online tools for code testing are helpful to developers looking to track unidentified and incomplete codes on the Internet...
9 Creative Perks Offered By tech Companies
Here are nine of the most enticing perks tech companies are offering their employees...
7 Rules All Programmers Should Live By
Here is a set of rules that we think all software developers should live by. These rules are more of a guidelines...
4 Websites To Get Free Stuff
Now you don't need to pay for furnishing your home or your kid's closet...
6 Must Have Tools For Java Professionals
Here is the list of tools for Java developers that are proven to get the job done efficiently....
8 Coolest Cloud Programming Langauges
If you are looking to master in programming languages, here are eight great options among cloud computing world....
7 Tips To Mitigate Data Breaches
Here are seven tips you can follow to avoid data breaches in your organisation!...
Top 8 Python Frameworks For Web Developers
Working with a web framework helps you jump-start your web application. Here are eight best Python Frameworks for web developers....
Best Alternatives To Google Code For Programmers
Google is shutting down Google Code, their hosting service for open source projects and coding initiatives. Here are a few alternatives that can get y...
Top 8 Best PHP Tools For Analysing And Parsing Code
Here are some of the best PHP Tools that will help programmers to analyse and parse their programming code....
8 Open Source Tools For Windows
Here are top eight free open source tools by Microsoft....
 
  View All
Dialogue
 
We Have Registered 50 Per Cent Growth In The Last Two Years: Arihant Lighting
Apart from LEDs, Arihant is associated with the promotion of renewable energy in India and therefore, manufactures various energy saving products....
“Elcom Plans To Build A New State Of The Art R&D And Manufacturing Unit In Maharashtra", Reveals MD Girish V Vaze
Starting out as a small business to cater to the industry’s need for import substitutes, Elcom International has grown to be a leader in the field of ...
Delta Magnets Ltd To Enter Into JV With Chinese Company!
The company had partnered with TDK Japan for technology transfer to manufacture magnets in India....
"Littelfuse Is Growing At Around 20-25 Per Cent In India And Expect That To Continue", Predicts VP Deepak Nayar
On the electronics side, Littelfuse has registered an 8-10 per cent growth, year on year....
10 Questions That Google Never Asks While Hiring!
Here is a list of 10 questions that Google just banned from their interviews....
   
  View All
Videos
 
First Look: LG Optimus G
The phone sports a high-end display and comes powered by a powerful processor. ...
Create QR-Codes For Free
TEC-IT releases the freeware QR-Code Studio to provide a quick and convenient way of QR code creation for every application scenario....
DoT Secretary Shares Plans For Growth Of Telecom Sector
M.F. Farooqui has recently taken charge as secretary, Department of Telecom....
Hands-On: Sony Xperia Z
Xperia Z is Sony's first entrant model in the big-screen smartphone category. ...
Hands On: Videocon A30 Smartphone
Videocon, the consumer electronics company which is known for its refrigerators, washing machine and air-conditioner has unveiled its Android-based sm...
   
View All
   
 
IFA 2014
 
IFA 2014: LG Launches 34-Inches Curved Monitor
The company is yet to confirm price and availability of the device....
IFA 2014: Intel Launches First Core M Range Of Processors
This range of processors is tailor-made for 2-in-1 devices which include a tablet and a laptop....
MWC 2014: Tablet Lets People Feel Textures On Its Screen
Now feel what you see on your tablet, by way of ultrasonic waves....
MWC 2014: 4K Android Tablet Games To Kill Consoles, iPad
Tablet makers like Samsung want to beat the iPad by making 4K tabs. ...
MWC 2014: This Vodafone Backpack Helps Get Network In Disaster Situations
Two engineers of Vodafone New Zealand displayed the "mini" mobile network by Vodafone substructure in a backpack. ...
MWC 2014: Wilocity Chipset To Bring 'Lightening' Speed To Mobile Phones
Wilocity has developed a WiGig chipset for mobile phones that will bring lightning-fast wireless capability ...
MWC 2014: Samsung Introduces Octacore, Hexacore Chipsets
The Korean giant, Samsung unveiled two new octacore and hexacore chipsets at MWC 2014, in Barcelona. The company previously used Exynos 5 Octa 5410 ch...
   
View All
   
 
Events
 
19th Consumer Electronic Imaging Fair To Be Held On ...

View All
   
   
 
 

home archives contact us advertise with us
           
Magazines Portals Directories Events News Verticals Educational Institute  
Electronics for You
Open Source for You
Electronics Bazaar
electronicsforu.com
efytimes.com
opensourceforu.com
electronicsb2b.com
Electronics Annual Guide
EFY EXPO INDIA
EFY EXPO WEST
ELECTRONICS ROCKS
EFY Awards
OSIDAYS Expo
Electronics
Infotech
Linux & Open Source
Consumer Electronics
Science & Technology
BPO
EFY Techcenter

Educational Kits
Kitsnspares.com  
 
 
© Copyright 2015 EFY Enterprises Pvt. Ltd.
All rights reserved. Reproduction in whole or in part in any form or medium without written permission is prohibited.
Usage of the content from the web site is subject to Terms and Conditions