EFY Times  
Tuesday, October 13, 2015

5 Open Source Big Data Technologies To Look Out For!
Home >> Infotech >> Features
5 Open Source Big Data Technologies To Look Out For!  
The open source technology is at the core of most Big Data initiatives. We bring to you the top 5!    
Rate this news:  (8 Votes)
Saturday, November 09, 2013 With all the big companies storing more and more data for various purposes, Big Data is already becoming the next big thing, and Gartner has already announced that data analysis is going to be the most prosperous IT job in the world. Here we bring top 5 open source big data technologies to look out for!

big data, open source, data analsys, big data technologies, storing big data, hadoop, ElasticSearch, Scribe,  Cascading,

1. Apache Hadoop

The open source software framework, Apache Hadoop is meant for data-intensive distributed applications, which was created by Doug Cutting to support his open source Web search engine, Nutch. Cutting introduced Hadoop as the MapReduce facility and a distributed file system to meet Nutch's multimachine processing requirements. The name Hadoop came after his son's toy elephant. With this MapReduce facility Hadoop distributes Big Data in pieces over a series of nodes running on commodity hardware. Hadoop is now already amongst one of the most popular technologies for gather and store structured, semi-structured and unstructured data which together makes Big Data. Hadoop is available under the Apache License 2.0.

2. R

The open source programming language and software environment, R, was designed for statistical computing and visualization. Ross Ihaka and Robert Gentleman designed R at the University of Auckland, New Zealand in the year 1993. R is has lately become the go-to tool for statistical analysis for the large data sets. Company called Revolution Analytics is now commercialising R in a similar model alike of Red Hat. R is available under the GNU General Public License.

3. Cascading

Cascading is an open source software abstraction layer for Hadoop which with the use of JVM-based language lets the users create and execute data processing workflows on Hadoop clusters. Cascading intends to cover the complexities beneath the MapReduce jobs. Designed by Chris Wensel, it was initially created as an alternative API to MapReduce. The software layer is usually used for ad targeting, log file analysis, bioinformatics, machine learning, predictive analytics, Web content mining and ETL applications. A company founded by Wensel called Concurrent is providing the commercial support for Cascading. Big shot enterprises like Twitter and Etsy are already using Cascading, it is available under the Apache License.

4. Scribe

A server developed by Facebook, Scribe was released in 2008. The server intends to aggregate log data streaming in real time from a large number of servers. As Facebook is required to meet its own scaling challenges, it now uses Scribe to tackle with the tens of billions of messages coming every day. It is available under the Apache License 2.0.

5. ElasticSearch

Inspired by and based upon Apache Lucene, this open source search server ElasticSearch was developed by Shay Banon. This scalable solution supports real-time search and multitenancy without any special configuration. The server has is currently being used by numerous companies like StumbleUpon and Mozilla. ElasticSearch is available under the Apache License 2.0.

Additionally Apache CouchDB, MongoDB, Apache Cassandra and Apache Hbase are worth a mention.

Print Email Post Comment 
(Total Views: 7816)

Infotech News
IBM Expands Cloud Footprint In India
Securifi To Make Middle East Debut At GITEX Technology Week 2015
Mumbai City FC To Partner With Fanmode In ISL-II
iGTB Announces Launch Of Release 16 At SIBOS 2015, Including Apple Watch Support And A.I. KYC
Fortinet Complements Cisco Application Centric Infrastructure With High-Performance SDN Security
Most popular



5 Reasons That Suggest Google Is Becoming New Microsoft
Arup Employs Highly Innovative Engineering Methodologies For Samsung's Device Solutions America Headquarters
Android 6.0 Marshmallow: 7 new features
Must know: Top 5 tech skills for you
5 Things You Probably Didn't Know About Nexus 5X & 6P
Gmail Vs Outlook.com, Which One Is Better?
Top 5 New Features In OS X El Capitan
9 Motorola Phones That Will Get Taste Of Android 6.0
Surface Book, Microsoft's first-ever laptop is launched
5 Hidden Features Of Instagram
Top 6 New Features Of iOS 9
Galaxy S7 may be launched in first quarter of 2016
Germany pledges to invest $2.3 billion in India's solar energy development
Aircel's IoT contract bagged by Tech Mahindra
Now get Apple iPhone 6S, iPhone 6S Plus on Flipkart
Windows 10 event: Devices launched by Microsoft


Top 5 WhatsApp Tricks That You Must Know!
Are you using WhatsApp to it's full potential? Here is how you can utilize all features of WhatsApp....
8 Laptops That Rival Microsoft Surface Book
It's not going to be easy competition for Surface Book....
Top 5 Worst Apps Of All Time
We all talk about interesting and useful mobile apps. Here is the list of worst ones!...
8 Best Android Marshmallow Tips & Tricks
Android v6.0 Marshmallow brings number of new features and shortcuts to mobile device....
Top 6 New Features Of iOS 9
iOS 9 brings new features and performance enhancements to iPhone....
5 Hidden Features Of Instagram
Here are 5 Instagram features that you may not have heard of!...
5 Things You Probably Didn't Know About Nexus 5X & 6P
Google's latest Nexus devices are manufactured by LG and Huawei....
Gmail Vs Outlook.com, Which One Is Better?
Gmail offers best features while, Outlook has most user-friendly and clean interface....
Top 5 New Features In OS X El Capitan
El Capitan is a upgrade worth having for Mac users....
9 Motorola Phones That Will Get Taste Of Android 6.0
Motorola is the first manufacturer to announce it’s plans for Marshmallow update....
5 Reasons That Suggest Google Is Becoming New Microsoft
In today's market, Google is under siege from all directions....
5 Ways Microsoft Office 2016 Can Make Your Life Easier
Microsoft Office 2016 is a comprehensive solution that is designed to make your work life easier....
5 Ways To Speed Up Your Mac
Sluggish computing experience is frustrating. Here are 5 ways to help you speed up your Macintosh computer....
5 Tips To Boost Your Home WiFi
You can get the most out of your home WiFi by using simple tricks....
5 Unique Features Of Microsoft Office 2016
Office 2016 brings tons of new features and apps to boost productivity of users....
  View All
Meet Pranjal Saxena, India's 21 Year Old Electronics Wizard
Milan Ondhia of EFYTimes was in a forthright conversation with the 21 year old Pranjal Saxena from New Delhi; an aspirant at the WorldSkills meet, in ...
“We Offer Managed Document Solutions To CIO And IT Decision Makers”: Canon
Manufacturing within the country will surely reduce the cost of our devices, but manufacturing can begin only if there is the desired eco-system and w...
“One Day The End User Can Open Up A Used Battery, And Use What’s Inside As Barbecue Sauce”
Of course that is not something currently possible, but what B&B Batteries does have are some secret recipes for their very specialised battery design...
We Wish To Procure All The LED Components Within India: Avni Energy
G. Gururaja, director, Avni Energy Solutions Pvt Ltd, shares his views about the expanding LED industry in the Indian market and the company's plans i...
We Have Registered 50 Per Cent Growth In The Last Two Years: Arihant Lighting
Apart from LEDs, Arihant is associated with the promotion of renewable energy in India and therefore, manufactures various energy saving products....
  View All
First Look: LG Optimus G
The phone sports a high-end display and comes powered by a powerful processor. ...
Create QR-Codes For Free
TEC-IT releases the freeware QR-Code Studio to provide a quick and convenient way of QR code creation for every application scenario....
DoT Secretary Shares Plans For Growth Of Telecom Sector
M.F. Farooqui has recently taken charge as secretary, Department of Telecom....
Hands-On: Sony Xperia Z
Xperia Z is Sony's first entrant model in the big-screen smartphone category. ...
Hands On: Videocon A30 Smartphone
Videocon, the consumer electronics company which is known for its refrigerators, washing machine and air-conditioner has unveiled its Android-based sm...
View All
IFA 2014
IFA 2014: LG Launches 34-Inches Curved Monitor
The company is yet to confirm price and availability of the device....
IFA 2014: Intel Launches First Core M Range Of Processors
This range of processors is tailor-made for 2-in-1 devices which include a tablet and a laptop....
MWC 2014: Tablet Lets People Feel Textures On Its Screen
Now feel what you see on your tablet, by way of ultrasonic waves....
MWC 2014: 4K Android Tablet Games To Kill Consoles, iPad
Tablet makers like Samsung want to beat the iPad by making 4K tabs. ...
MWC 2014: This Vodafone Backpack Helps Get Network In Disaster Situations
Two engineers of Vodafone New Zealand displayed the "mini" mobile network by Vodafone substructure in a backpack. ...
MWC 2014: Wilocity Chipset To Bring 'Lightening' Speed To Mobile Phones
Wilocity has developed a WiGig chipset for mobile phones that will bring lightning-fast wireless capability ...
MWC 2014: Samsung Introduces Octacore, Hexacore Chipsets
The Korean giant, Samsung unveiled two new octacore and hexacore chipsets at MWC 2014, in Barcelona. The company previously used Exynos 5 Octa 5410 ch...
View All
19th Consumer Electronic Imaging Fair To Be Held On ...

View All

home archives contact us advertise with us
Magazines Portals Directories Events News Verticals Educational Institute  
Electronics for You
Open Source for You
Electronics Bazaar
Electronics Annual Guide
EFY Awards
Linux & Open Source
Consumer Electronics
Science & Technology
EFY Techcenter

Educational Kits
© Copyright 2015 EFY Enterprises Pvt. Ltd.
All rights reserved. Reproduction in whole or in part in any form or medium without written permission is prohibited.
Usage of the content from the web site is subject to Terms and Conditions