Data Analysis

Big Data Analytics

This section contains a number of articles and tutorials on Big Data Analytics.


Hadoop FileSystem Commands

In this article we will learn the basic and mostly used Hadoop File System Commands. The File System (FS) shell commands interact with the Hadoop Distributed File System (HDFS). Most of the commands in FS shell behave like corresponding Unix commands.

Updated on May 14, 2019

Log File Analysis Using Hadoop & Hive- PHP Error Log

In this article we will learn how to perform quick analysis on Unstructured data using Hadoop & Hive. In this case we have a huge PHP Error Log file. What we want here is to parse the log file and get meaningful analytics from the error log. For example we want to understand which webpages are encountering the frequent PHP Errors, types of PHP Issue encountered (Warning, Notice, Error etc.). So lets see how easy it is, to get the answers to our questions, when we have HADOOP & HIVE in our toolbox.

Updated on May 14, 2019