Big Data Evaluation

This book is a volume in the "12th Five-Year Plan" national key book publishing project series Big Data Technology and Applications, written by Cai Lizhi, Wu Xing, and Liu Zhenyu, with Zhu Yangyong and Wu Junwei as series editors. Approaching the subject from software testing, the book first surveys the concept and characteristics of big data, national big data development strategies and trends, and standardization efforts, then analyzes the new challenges big data poses to traditional software testing. Technically, the authors use Hadoop as the main thread: the underlying support framework layer focuses on unit testing and framework benchmarking, discussing data quality evaluation and distributed data model testing; the basic algorithm layer covers evaluation methods for clustering, classification, and personalized recommendation systems; the application layer addresses performance factors in big data applications, supporting data design, performance evaluation models, and tools and cases. Finally, the book discusses security and privacy issues raised by big data, covering security evaluation of big data architectures, data security evaluation, and application security level protection evaluation, and uses cases such as the Weibo platform to illustrate performance testing workflows, offering readers a fairly complete knowledge framework for big data evaluation.