BIG DATA TECHNOLOGIES

Abstract

In the recent era Information technology has become an integral part of daily life as well as various other domains, like health, education, entertainment, science and technology, genetics or business operations. These industries generate large amount of data through various sources to run their businesses. This vast amount of data is big data. There is a need to analyze the data to understand and interpret market trends, study customer behavior, and to take financial decisions. Big data consist of large datasets range from terabytes to Exabyte that cannot be efficiently managed by traditional tools and techniques. Due to the rapid growth of such data, solutions need to be provided in order to handle and extract knowledge from these datasets. In order to process these large datasets in an efficient way a new architecture, techniques, algorithms, is required. Apache Hadoop, Apache Spark, Apache Storm, and Apache Flink etc is a frameworks for structuring Big Data, and making it useful for analytics purposes. In this paper, a survey on these new Big Data technologies is presented.