计算机与现代化Issue(1)：15-19,5.DOI:10.3969/j.issn.1006-2475.2025.01.003
基于StarRocks的实时物联网数据处理系统
Real Time IoT Data Processing System Based on StarRocks
摘要
Abstract
With the popularization and application of IoT technology,a large amount of real-time data needs to be processed and analyzed.Due to the massive and real-time characteristics of IoT data,traditional databases cannot meet the requirements of data storage scale and data processing efficiency,this article proposes a distributed real-time IoT data processing system based on StarRocks.The system utilizes the distributed architecture of StarRocks to build underlying data storage.By introducing mes-sage queues and data merging batch submission technology,it ensures fast data writing.At the same time,through storage strate-gies optimization,index optimization,and materialized view technology,rapid processing and querying of large-scale real-time data have been achieved.The powerful data compression capability of the system also effectively saves data storage space.This framework supports horizontal scaling in data storage scale,improving availability and robustness.Through experimental analy-sis,the system has significant advantages over traditional distributed databases in terms of data writing,data querying,and data compression.关键词
StarRocks/实时数据处理/分布式系统/数据压缩/查询优化Key words
StarRocks/real time data processing/distributed system/data compression/query optimization分类
信息技术与安全科学引用本文复制引用
董一舟,潘伟华,张楠,孟壮..基于StarRocks的实时物联网数据处理系统[J].计算机与现代化,2025,(1):15-19,5.基金项目
国家重点研发计划(2020YFB2104200) （2020YFB2104200）
江西省03专项及5G项目(20212ABC03A11) （20212ABC03A11）
