Data Mining Techniques in Database Systems

Abstract

At the current stage the technologies for generating and collecting data have been advancing rapidly. The main problem is the extraction of valuable and accurate information from large data sets. One of the main techniques for solving this problem is Data Mining. Data mining (DM) is the process of identification and extraction of useful information in typically large databases. DM aims to automatically discover the knowledge that is not easily perceivable. It uses statistical analysis and  artificial intelligence (AI) techniques  together to address the issues. There are different types of tasks associated to data mining process. Each task can be thought of as a particular kind of problem to be solved by a data mining algorithm. The main types of tasks performed by DM algorithms are:

•   Classification:

•   Association:

•   Clustering:

•   Regression:

•   Anomaly Detection:

•   Feature Extraction

• Time Series Analyses

In this paper we will perform a survey of the techniques above. A secondary goal of our paper is to give an overview of how DM is integrated in Business Intelligence (BI) systems  .BI refers to a set of tools used for multidimensional data analysis, with the main purpose to facilitate decision making. One of the main components of BI systems is OLAP. The main OLAP component is the data cube which is a multidimensional database model that with various techniques has accomplished an incredible speed-up of analyzing and processing large data sets. We will discuss the advantages of integrating DM tools in BI systems.

Keywords

• Data Mining,BI,OLAP,AI

References

1. Frans Coenen ,Data Mining: Past, Present and Future, The Knowledge Engineering Review, 2004, Cambridge University Press
2. Pradnya P. Sondwale, Overview of Predictive and Descriptive Data Mining Techniques, International Journal of Advanced Research in Computer Science and Software Engineering,April 2015
3. Mihika Shah, Sindhu Nair , A Survey of Data Mining Clustering Algorithms, International Journal of Computer Applications (0975 – 8887) Volume 128 – No.1, October 2015
4. Irina Tudor, Association Rule Mining as a Data Mining Technique, Petroleum-Gas University of Ploieşti,Buletin Vol. LX No. 1/2008
5. Trupti A. Kumbhare et al An Overview of Association Rule Mining Algorithms, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 5 (1) , 2014, 927-930
6. N. Elavarasan, Dr. K.Mani,A Survey on Feature Extraction Techniques, International Journal of Innovative Research in Computer and Communication Engineering Vol. 3, Issue 1, January 2015
7. Fabricio Voznika Leonardo Viana“DATA MINING CLASSIFICATION” Springer, 2001
8. A.Shameem Fathima,D.Manimegalai,Nisar Hundewale ,A Review of Data Mining Classification Techniques Applied for Diagnosis and Prognosis of the Arbovirus-Dengue IJCSI International Journal of Computer Science Issues, Vol. 8, Issue 6, No 3, November 2011

9. Varun Chandola, Arindam Banerjee, and Vipin Kumar. Anomaly Detection: A Survey. Technical report, University of Minnesota, 2007.
10. Victoria Hodge and Jim Austin. A survey of outlier detection methodologies. Artificial Intelligence Review, 22:85126, 2004
11. Han - Data Mining Concepts and Techniques 3rd Edition - 2012
12. Shanta Rangaswamy, Time Series Data Mining Tool, International Journal of Research in Computer and Communication Technology, Vol 2, Issue 10, October- 2013
13. Zanaj,Lico A multidimensional analyses in Business Intelligence systems IJCSIS May 2012
14. [14]J. Han, “Towards online analytical mining in large databases,” ACM SIGMOD Record, vol. 27, no. 1, pp. 97-107, March 1998.
15. [15] J. Han, S. H. S. Chee and J. Y. Chiang, “Issues for online analytical mining of data warehouses,” in Proc. Of the SIGMOND Workshop on Research Issues on Data Mining and Knowledge Discovery (DMKD), Seattle, 1998, pp. 2:1-2:5.
16. [16] H. Zhu, “Online analytical mining of association rules,” Master Thesis, Simon Fraser University, 1998,
17. [17].S. Dzeroski, D. Hristovski and B. Peterlin, “Using data mining and OLAP to discover patterns in a database of patients with Y chromosome deletions,”in Proc. AMIA Symp., 2000, pp. 215–219.
18. [18] F. Dehne, T. Eavis and A. Rau-Chaplin, “Coarse grained parallel on-line analytical processing (OLAP) for data mining, in Proc. of the Int’l Conf. on Computational Science (ICCS), 2001, 589-598.
19. [19] Usman ,Asghar,An Architecture for Integrated Online Analytical Mining, JOURNAL OF EMERGING TECHNOLOGIES IN WEB INTELLIGENCE, VOL. 3, NO. 2, MAY 2011
20. [20] Han - Data Mining Concepts and Techniques 2rd Edition - 2006.pdf
21. [21] NGUYEN Feature Extraction for Outlier Detection in High-Dimensional Spaces, JMLR: Workshop and Conference Proceedings 10: 66-75 The Fourth Workshop on Feature Selection in Data Mining