Hadoop
Hadoop
is a platform where you can submit your Java applications to do computations
which involve processing of huge quantity of data.Hadoop is divided in 2 division :
First is the Map-Reduce (now Know a Yarn) which can be called as the processing engine and the later one is the storage called as HDFS.
The important thing to be taken into notice is that when the application is runned, the data is not loaded to the CPU, instead the computation happens where the data is residing. This application is referred as the Mapping Phase.
The other one is the Reducing phase, where processed data goes and produces output.
Nowadays Pig script is used in most of the application rather than writing your own M-R Java codes. Apache Tez is a new platform to be focused on.
Pros and Cons of Hadoop :
Benefits of Hadoop:
·
Better career oppurtunities
·
High pay scale
·
Improved job oppurtunities
·
Improvisation in placements
Hadoop
Market Forecast 2017-2022 :
The Hadoop market took a peak in 2012 – 2014, a period
marked by wave of mergers, acquisitions and financial rounds with high costing.
It would be feasible to conclude: today Hadoop is the only cost-sensible and
scalable open source substitute to fruitfully available Big Data management
packages.
By 2015 it was concluded that Hadoop has failed to deliver
in terms of revenues. In 2012 -2015 Hadoop development and growth has been capitalised
mostly by experprise capital, procurement money and R&D budgets. Hadoop
talent is scarce and does not come cheap Hadoop growth is stagnant. Yet, more
and more companies are gravitating toward Hadoop and functionality that it
offers. A few fascinating trends began in the Hadoop market in few couple of
years:
- Shift
from batch processing to online processing;
- Evolution
of MapReduce options, like Spark, Storm and DataTorrent;
- Dissatisfaction
due to the gap between increased demand for SQL-on-Hadoop and available resources is a growing factor.
- In-house
Hadoop development and deployment;
- Niche
companies focus on enhancing Hadoop features and functionality like
conceptualization, user-friendliness, administration, simplifying Hadoop’s
way to the market.
Limitations/ Cons in
Hadoop :
1. Not suitable for
Small Data/ Files:
There are some applications in market who doesnot support
small datas and Hadoop is one amongst those application. Small data files are
no processed in Hadoop and as a result of which it is not feasible and worth
for the small organization to work on Hadoop.
2. Security reasons :
Hadoop’s base is Java and Java is a software which can be
easily accessed and cracked by cyberfrauds/ cyber criminals. Hence if we have a
look from the security point of view then some corporates avoid using Hadoop.
Future Job market Trends in India for Hadoop Developer
Hadoop has proved to be a
grace for lots of developers to get jobs. By using their Hadoop skills for
these projects, developers can become more productive to their current
employers and marketable to other employers, as well. The job market for Hadoop
professionals is profit making and is speeding up at an increased rate. Hence,
it can always be said that Hadoop is on the rise.
The Current Trend:
Companies that are hiring Hadoop professionals now and in
the future are looking for various roles including:
- Product
managers,
- Hadoop
developers,
- Database
administrators,
- Team
leaders,
- Sr.
Hadoop developers,
- Engineers
and professionals with operating skills.
The latest version of Hadoop is available in market now i.e.
2.6.4 .
No comments:
Post a Comment