现代情报2026，Vol.46Issue(6)：60-75,16.DOI:10.3969/j.issn.1008-0821.2026.06.006
基于大模型多智能体协作的高价值专利识别方法研究
The High-Value Patent Identification Method Based on Large Language Models and Multi-Agent Collaboration
摘要
Abstract
[Purpose/Significance]International research on patent value assessment has progressively developed quantitative indicators(e.g.,citation counts,family size,claim metrics)and machine-learning classifiers built on engi-neered features.However,three interrelated limitations remain.First,most methods rely on surface-level indicators or feature aggregation and therefore fail to capture deep semantic relations,causal signals,and argumentative structure embedded in patent texts.Second,prevalent end-to-end discriminative models operate as"black boxes",offering little human-readable justification and limiting trust for decision-makers and policymakers.Third,many approaches show weak transferability:they perform poorly in low-resource settings and across technological domains because they lack prin-cipled,multi-dimensional evaluation frameworks.To address this gap,the paper proposes an interpretable,generative framework for high-value patent identification that leverages multi-agent collaboration built on large language models(LLMs).[Method/Process]The study first defined a patent evaluation framework covering three complementary dimen-sions:technical,economic,and legal.Using an LLM's contextual and chain-of-thought capabilities,the study synthe-sized explicit evaluation criteria for each dimension and iteratively refined them into a structured guideline.Empirically,the study used IncoPat's global patent database.Based on the"Classification of Strategic Emerging Industries and Corre-spondence Table with International Patent Classification",the study constructed retrieval queries and obtained 375591 granted invention patents in the artificial intelligence field.The study adopted IncoPat's"He Xiang value score"as the value indicator,treating patents with a score of 10 as high-value(positive class)and the remainder as non-high-value(negative class).From this corpus,the study randomly sampled 1000 high-value patents and 1000 non-high-value pa-tents to ensure class balance,and partitioned them into training,validation,and test sets in a 6∶2∶2 ratio.The core analy-sis used the DeepSeek-R1 to implement three evaluative agents(technical,economic,legal)and a collaborative reasoning protocol that aggregates agent outputs and generates human-readable rationales.[Result/Conclusion]On the AI patent test set,the proposed multi-agent LLMs framework achieves an accuracy of 0.81 and an F1 score of 0.80.It consistently pro-duces structured,logic-grounded rationales,overcoming the interpretability gap that persists in most state-of-the-art international models.Moreover,in low-resource and cross-domain experiments,the method demonstrates stronger gene-ralization than mainstream indicator-driven or end-to-end discriminative approaches.By integrating multi-dimensional patent value criteria with generative reasoning mechanisms,this work provides a scalable and transparent alternative to black-box evaluation pipelines that currently dominate patent analytics.The proposed paradigm aligns with the global shift toward trustworthy AI and explainable intellectual property analytics,offering actionable insights for technology evaluation,strategic decision-making,and innovation governance in both industrial and policy contexts.关键词
高价值专利识别/大语言模型/多智能体协作/可解释性Key words
high-value patent identification/large language models/multi-agent collaboration/interpretability分类
社会科学引用本文复制引用
张志豪,杨子良,朱作箫,袁家旭,何喜军,乔晚馨..基于大模型多智能体协作的高价值专利识别方法研究[J].现代情报,2026,46(6):60-75,16.基金项目
国家自然科学基金青年项目"大模型赋能的高价值专利个性化交易推荐方法与应用研究"(项目编号:72404020) （项目编号:72404020）
中国博士后科学基金第76批面上项目"大模型赋能的专利技术供需匹配方法与应用研究"(项目编号:2024M760177) （项目编号:2024M760177）
北京市自然科学基金面上项目"大模型赋能的北京技术交易市场供需数据质量评估方法与应用研究"(项目编号:9252002) （项目编号:9252002）
北京自然科学基金青年项目"北京在线医疗服务质量智能评估、影响机制及干预策略研究"(项目编号:9264021). （项目编号:9264021）
