Design and Implementation of Global Frequent Pattern Mining Algorithm Using Map Reduce

Abstract

1.1 Data mining and knowledge discovery [1]: Data mining is the process of extracting interesting (implicit, nontrivial, earlier unknown and potentially useful) information or patterns from large data repositories such as: data warehouses, relational database, XML repository etc. Data mining is one of the core processes of Knowledge Discovery in Database (KDD) which is the extracted knowledge from the large datasets used for generating patterns and decision making. There three main tasks in data mining:  Pre-processing - This is the process which is executed before data mining techniques are applied to the right data. The pre-processing includes data cleaning, integration, selection and transformation.  Data mining process – In this process hidden knowledge is produced by applying different algorithm.  Post-processing – After having the mining results, the mining result is evaluated according to user’s requirements and domain knowledge.