Business Intelligence by Log analysis in Hadoop using MapReduce

Information Technology

A log file is a file that records the events that occur generally in the operating system or either event generated when software runs. Log is the main source of system operation status user behavior system actions etc. Log analysis system not only work on the massive data but also the data processing ability, the adaptation to a variety of scenarios under the efficiency, scalability and performance of quality data, which never be achieved from available standalone analysis tools or single computing framework. Now a days data is increasing day by day and there are huge numbers of log files are generated at the data centers and recommended companies. As this log file increases a scalable and advance system is necessary to efficiently handling the logs. Log files analysis becomes an important aspect for analyzing customers behavior regards to improve the sales of particular products. Hence we propose a log analyzer with the combination of Hadoop and Map-Reduce paradigm. The joint of Hadoop and MapReduce programming tools makes it possible to provide batch analysis in minimum response time and in memory computing capacity in order to process log in a high available, efficient and stable way. Business intelligence is the variance in the software application use to analyze large scale raw data. It is nothing but the set of process architecture, different application strategies, and technological architectures. Business Intelligence is the way by which business trends can use this Log analysis structure and enhance their way to increase productivity and growth in revenue. Company can guess the user requirements by using their comments, reviews, opinions and many more by which its easy to identify and fulfill end users requirements. In our systems we are going to provide all these necessary things that can be identified using Log analysis which is used to improve productivity and these will totally turn into growth in revenue generation of any organization.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.