JEPA-Anything: Learning Predictive Models across Different Worlds
在动手之前先预测:如果这样做,世界会变成什么样,哪条路值得走。
把光标移到图上
介绍
跨领域统一科学世界模型
面向跨领域状态预测、干预模拟和科学诊断。
JEPA-Anything 是一项面向潜在世界模型和正交预测因子分解的独立模型方法研究。
它探索如何在视觉、生物、临床轨迹、控制、分子动力学、物理场和气象这七个领域中,学习能够预测世界状态变化的潜在表示,并为干预预测、状态合成和科学诊断提供统一接口。
在未来的研究愿景中,JEPA-Anything 可以被理解为面向多个科学环境的统一预测模型或科学世界模拟器:当研究者提出某种科学行为或干预时,模型预先预测可能的状态变化、结果和风险,帮助筛选无效或代价较高的方案。这是希望探索的能力方向:目前它并不能模拟所有科学环境,也尚未接入 ScienceBuddy 或 ScienceIDE。
研究问题
- 如何表示复杂系统中的多种可预测因素
- 如何预测不同干预带来的状态变化
- 如何为实验选择和科学诊断提供预测依据
- 如何在跨领域场景中复用潜在世界状态接口
技术报告和 Hugging Face 上的模型集合已公开。本次发布不包含公开演示,开放范围以仓库和集合的实际状态为准。
摘要
World modeling enables intelligence to anticipate consequences, guide interventions, and learn from interaction. Yet predictive models remain domain-specific: can a common learning principle support world modeling across radically different systems? We introduce JEPA-Anything, a domain-agnostic framework based on orthogonal predictive factorization (OPF). Extending joint-embedding predictive architectures, OPF decomposes latent targets into complementary factors, learns them through dedicated pathways, and recombines them within a shared predictive design. We evaluate JEPA-Anything across seven domains: vision, biology, clinical trajectories, control, molecular dynamics, physical fields, and weather. Experiments span representation learning, intervention prediction, out-of-distribution generalization, and long-horizon dynamics, including 10 matched dynamics tasks, forecasting of over 1,000 clinical events, and 100-step molecular rollouts across four systems. Against matched JEPA baselines, JEPA-Anything improves reported metrics on all 10 dynamics tasks and reduces single-intervention prediction error on Interventional Pong by 34.8%. It achieves the lowest one-step and 100-step molecular errors among compared methods in all four systems. Beyond prediction, a factor-nominated biological intervention receives experimental support in cell co-cultures, patient-derived organoids, tumor fragments, and mice; latent orbital modes recover the Keplerian scaling exponent with a fitted slope of −1.4991. These results support a common factorized predictive principle across heterogeneous worlds, connecting world modeling with intervention and experimentally grounded scientific discovery.
作者
期刊/会议
引用
BibTeX
@article{cui2026jepa,
title={JEPA-Anything: Learning Predictive Models across Different Worlds},
author={Cui, Taoyong and Wang, Zhongyao and Xu, Xinyue and Liu, Weiyang and Yu, Zhaochen and Zhang, Yuying and Gao, Qiang and Yang, Mengyue and Ouyang, Wanli and Heng, Pheng Ann and Wu, Yingcheng and Yin, Zhenfei and Yang, Ling},
journal={arXiv preprint arXiv:2609.20800},
year={2026}
}