Performance Optimization of Big Data Center Processing System - Big Data Analysis Algorithm Based on Location Awareness
Performance Optimization of Big Data Center Processing System - Big Data Analysis Algorithm Based on Location Awareness
INTERNATIONAL JOURNAL OF CONTENTS / INTERNATIONAL JOURNAL OF CONTENTS, (P)1738-6764; (E)2093-7504
2021, v.17 no.3, pp.74-83
https://doi.org/10.5392/ijoc.2021.17.3.074
Zhao, Wen-Xuan
(Teaching affairs office of HeXi university, Division of Information and Communication Convergence Engineering, Mokwon University)
Min, Byung-Won
(Division of Information and Communication Convergence Engineering, Mokwon University)
Zhao, Wen-Xuan,
&
Min, Byung-Won.
(2021). Performance Optimization of Big Data Center Processing System - Big Data Analysis Algorithm Based on Location Awareness. , 17(3), 74-83, https://doi.org/10.5392/ijoc.2021.17.3.074
Abstract
A location-aware algorithm is proposed in this study to optimize the system performance of distributed systems for processing big data with low data reliability and application performance. Compared with previous algorithms, the location-aware data block placement algorithm uses data block placement and node data recovery strategies to improve data application performance and reliability. Simulation and actual cluster tests showed that the location-aware placement algorithm proposed in this study could greatly improve data reliability and shorten the application processing time of I/O interfaces in real-time.
- keywords
-
Bigdata Center Processing System,
Location-awareness,
HDFS distributed storage,
Data Mining Alogorithm,
Performance Optimization