计算机科学与探索2013,Vol.7Issue(8):736-746,11.DOI:10.3778/j.issn.1673-9418.1212008
基于多核处理器的VTD-XML解析性能优化
VTD-XML Parsing Performance Optimization Based on Chip Multiprocessor
摘要
Abstract
Aiming to multi-core processor,this paper studies the performance optimization of XML (extensible markup language) parser in XML documents processing,from multithreading and improving memory access performance of threads to optimize XML parser.The main contributions are as follows:Firstly,the framework of multithread XML documents parsing is presented,the framework uses the multithread implementation for the XML document scanning,and then uses the preload-ahead thread to improve the memory access performance of the parsing thread; Secondly,the XML document data partitioning algorithm and data fusion algorithm are presented,these two algorithms can ensure the correctness of the results of an XML document scanning,and the algorithm itself has low cost; Thirdly,the cost analysis of the framework is also presented,based on the cost analysis to optimize the performance of the framework; Finally,in the experiment,the multithread execution framework is realized based on the open source XML processing engine VTD-XML (virtual token descriptor XML),and the performance of the XML document parsing is tested.The experimental results show that the proposed multithread XML document parsing framework can take advantage of multi-core processors computing resources,and effectively improve the memory access performance of threads and the parsing performance of XML documents.关键词
VTD-XML/多核处理器/解析性能优化/多线程Key words
virtual token descriptor XML(VTD-XML)/ chip multiprocessor/ parsing performance optimization/multithread分类
信息技术与安全科学引用本文复制引用
郭宪勇,陈性元,邓亚丹..基于多核处理器的VTD-XML解析性能优化[J].计算机科学与探索,2013,7(8):736-746,11.基金项目
The National Natural Science Foundation of China under Grant No.60903220(国家自然科学基金) (国家自然科学基金)
the National Basic Research Program of China under Grant No.2011CB311801(国家重点基础研究发展计划(973计划)). (国家重点基础研究发展计划(973计划)