STEMM Institute Press
Science, Technology, Engineering, Management and Medicine
A Survey on the Convergence of Big Data, Artificial Intelligence and Data Mining
DOI: https://doi.org/10.62517/jbdc.202501429
Author(s)
Enlai Wang1, Jingbo Liu1, Yufei Zhang1, Xue Liu2
Affiliation(s)
1Henan University of Technology, Zhengzhou, Henan, China 2iFLYTEK Co., Ltd., Hefei, Anhui, China
Abstract
This paper provides a comprehensive study of the convergence of big data, Artificial Intelligence (AI), and data mining, systematically analyzing their inherent logic and arguing that these technologies form a closed-loop, value-creating ecosystem. Big data serves as the foundation, data mining as the bridge, and AI as the ultimate goal. The study proposes a layered technological architecture to support this synergy and explores its transformative applications in various fields such as finance, healthcare, and intelligent recommender systems. The research highlights the enormous potential for improving efficiency and fostering innovation while also identifying key challenges hindering widespread adoption, including data privacy issues, the "black box" nature of complex AI models, algorithmic bias, and ever-increasing computational demands. Finally, the paper discusses future trends, including Automated Machine Learning (AutoML), privacy-preserving computation, and explainable artificial intelligence (XAI), emphasizing the need to balance development processes to reconcile technological progress with ethical governance.
Keywords
Big Data; Artificial Intelligence; Data Mining; Technological Convergence; Intelligent Applications
References
[1] S Sagiroglu, D Sinanc. Big data: A review//2013 international conference on collaboration technologies and systems (CTS). IEEE, 2013: 42-47. [2] Z Sun, Y Huo. The Spectrum of Big Data Analytics. Journal of Computer Information Systems, 2019, 61(2): 154-162. https://doi.org/10.1080/08874417.2019.1571456. [3] Mining W I D. Introduction to data mining. Mining Multimedia Databases, Mining Time Series and, 2006. [4] D Baylor, E Breck, H T Cheng, et al. Tfx: A tensorflow-based production-scale machine learning platform. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2017. [5] Y Jiang, X Li, H Luo, et al. Quo vadis artificial intelligence? Discover Artificial Intelligence, 2022, 2(1): 4. [6] S Arora, S R Thota, S Gupta. Data Mining and Processing in the Age of Big Data and Artificial Intelligence - Issues, Privacy, and Ethical Considerations//2024 4th Asian Conference on Innovation in Technology. 2024:1-6. [7] Y Zhang, G M Huang, Y X Zhao, et al. Revolutionizing Crop Breeding: Next-Generation Artificial Intelligence and Big Data-Driven Intelligent Design. Engineering (English), 2025, 44(1): 245-255. DOI: 10.1016/j.eng.2024.11.034. [8] S Y Li. Data Mining and Intelligent Analysis of Geotechnical Engineering Investigation Based on Artificial Intelligence and Big Data. Intelligent Building & Smart City, 2025(6): 47-49. DOI: 10.13655/j.cnki.ibci.2025.06.013. [9]Y Y Shi. Research on the Application of Artificial Intelligence-Driven Data Mining Algorithms in Intelligent Recommendation Systems. Software, 2025, 46(7): 70-72. DOI: 10.3969/j.issn.1003-6970.2025.07.021. [10]L L Zhao. Artificial intelligence empowers data governance in universities: logic, challenges and practice. Chongqing Higher Education Research, 2022, 10(1): 71-79. DOI: 10.15998/j.cnki.issn1673-8012.2022.01.008. [11]X D Meng. Application of artificial intelligence and data mining in the construction of online reading service platform for university libraries. Information Recording Materials, 2024, 25(9): 78-80. [12]B Pan. Reconstruction of the rational use system of generative artificial intelligence text and data mining. Communication and Copyright, 2025(10): 107-110.
Copyright @ 2020-2035 STEMM Institute Press All Rights Reserved