DiscoveryRSI: Recursively Learning to Discover Valuable Hypotheses
在研究中学会研究:假设树里留下的每一步,都成为下一轮改进的经验。
把光标移到图上
介绍
从研究经历中递归学习的假设发现
多智能体演化搜索发展研究假设树,选中的研究编译成可执行任务;保留下来的研究记录用于训练模型、改进工作流,并在新问题上重新发现。
DiscoveryRSI 是一项关于研究智能体如何从自己的研究经历中持续改进的方法研究。论文先给出“有价值、可检验的研究假设”的操作性定义:围绕重要的不确定性提出有证据支撑的主张,并配有可行的研究方案、明确的判定标准和备择解释。
难点有两处。把一个假设变成可以执行的研究,需要落实数据要求和验证标准,同时不改变原本的研究问题。从研究经历中学习,还要知道该强化哪些贡献:一个假设最后得到的评价,并不说明是哪一步起了作用。可能一个智能体提出了解释,另一个加了关键的对照,第三个根据新证据修改了研究方案;如果只保留最终的提案,这些贡献就看不见了。
DiscoveryRSI 用多智能体演化搜索发展研究假设树,保留每个提案和每次修订背后的证据与决策;选中的计算研究被编译成可执行的 Harbor 任务,带有具体的输入、运行环境、产出要求和校验。保留下来的研究记录支撑三种相互衔接的改进机制:假设贡献度优化(hypothesis credit optimization)把对研究质量的评估归到有记录的具体贡献上,为相应的模型动作提供监督,论文用它训练了 DiscoveryRSI-27B;harness 回放(harness replay)从这些记录中找出有效的策略和反复出现的失败,改进智能体之间的协作、证据获取和研究分配;重新发现(rediscovery)把通过检验的模型和工作流更新用到新的研究问题上,产生下一轮学习所需的新经验。论文同时提出 DFM-Bench,评估假设、修订、发展路径和整轮研究的质量,任务的可执行性单独记录。
评测方式
- 自动评分(DFM-Bench):假设质量随自我改进轮次的变化
- 研究行为:各类研究动作所占比例的变化
- 专家指导下的人工评审:27 名评审者盲评 292 份提案
- 启发率:与模型截止日期之后发表的研究对照
- 电池领域:检验方法能否用到生命科学之外
技术报告、GitHub 上的代码,以及 Hugging Face 上的模型和数据集均已公开;直播即将开始。
摘要
Scientific discovery requires developing worthwhile hypotheses into practical investigations, yet learning from this evolving research process remains challenging. We introduce an operational definition of valuable and testable research hypotheses: evidence-grounded claims about consequential uncertainties, coupled with feasible investigations, explicit decision criteria, and alternative explanations. Our DiscoveryRSI framework develops hypothesis trees through multi-agent evolutionary search, compiles selected investigations into executable Harbor tasks, and recursively learns through three mechanisms: hypothesis credit optimization attributes scientific assessments to documented research contributions; harness replay identifies productive strategies and recurring failures to refine research workflows; and rediscovery applies accepted improvements to new investigations, generating further experience for subsequent learning. We also introduce DFM-Bench, which provides comprehensive assessment of hypothesis quality and cumulative research progress at the levels of hypotheses, revisions, development paths and research runs. Across four life-science domains, automated evaluation shows that hypothesis quality rises from 4.86 for the base model to 5.39 after two rounds of self-improvement, with the large gains in falsifiability and data resolvability. We further validate hypothesis quality through expert review, comparing our DiscoveryRSI-27B with other research agents. Preliminary human assessments show that DiscoveryRSI-27B scores higher than GPT-6 Luna on hypothesis importance and whether claims are plausible and evidence-bounded. DiscoveryRSI-27B achieved a 6.3% rate of hypothesis correspondence with research published after the model cutoff, largely outperform GPT-6 with 2.5% and Claude Opus 5 with 2.3%, while delivering greater human-rated improvement along research paths.
作者
* 共同一作
期刊/会议
引用
BibTeX
@techreport{zhong2026discoveryrsi,
title = {{DiscoveryRSI}: Recursively Learning to Discover Valuable Hypotheses},
author = {Zhong, Jianyuan and Wu, Chenwei and Yu, Zhaochen and Jiang, Xixian and Fan, Jiajun and Li, Xuewei and Xiao, Hao and Dai, Xilin and Wang, Junyang and Zou, Jiaru and Cui, Zhiqing and Zheng, Boyuan and Xiong, Jing and Zhang, Zhen and Gao, Qiang and Morley, Michael and Nakayama, Luis and Xu, Qiang and Shen, Liyue and Gui, Tao and Celi, Leo Anthony and Zou, James and Yin, Zhenfei and Wu, Yingcheng and Yang, Ling},
institution = {PhAI Labs},
type = {Technical Report},
number = {PHAI-TR-2026-06},
month = {October},
year = {2026},
url = {https://phai-labs.com/papers/discoveryrsi/},
note = {Version v1. Equal contribution: Jianyuan Zhong, Chenwei Wu, Zhaochen Yu}
}