Why MobileMem
MobileMem
MobileMem:面向持续演进智能体的端侧记忆
MobileMem: On-Device Memory for Continually Evolving Agents
MobileMem 作为用户的个人记忆智能体,能够自动理解用户意图,执行跨时间的人脸识别以关联多年间女儿的身份,从海量照片档案中定位 2016 年的生日场景,并返回一家三口围坐在生日蛋糕旁的照片。
MobileMem acts as the user's personal memory agent, automatically understanding user intent, performing cross-time facial recognition to associate the daughter's identity across years, locating the 2016 birthday scene from a vast photo archive, and returning the photo of the family of three gathered around the birthday cake.
Research Features
MobileMem 的特色 MobileMem Features
01 从推理到记忆 From Reasoning to Remembering 下一代个人助手的核心能力 A foundation for personal assistants
因此,AI 的未来不仅在于推理,也在于记忆。
Consequently, the future of AI lies not only in reasoning but also in remembering.
02 移动记忆的形态 Mobile Memory Streams 多模态、跨应用、时间连续 Multimodal, cross-application, temporal
这类数据天然具有多模态、跨应用和强时间连续性。重要用户记忆往往表现为分布在不同模态和应用中的事件。
Such data are inherently multimodal, cross-application, and strongly temporally continuous. Important user memories often manifest as events distributed across different modalities and applications.
03 复合记忆架构 Composite Memory Architecture 系统级记忆层与应用专属记忆 System-level and application-specific memory
相反,我们设想一种由两个互补组件构成的复合记忆架构。这两个组件可以通过标准化协议协作,形成统一的记忆生态,其能力超过各个模块的简单叠加。
Instead, we envision a composite memory architecture consisting of two complementary components. These two components can collaborate through standardized protocols, forming a unified memory ecosystem whose capability exceeds the simple aggregation of individual modules.
04 KEME 合成框架 KEME Synthesis Framework 知识锚点、用户画像与时间约束 Anchors, persona knowledge, temporal constraints
在用户画像知识和时间约束的引导下,KEME 将这些锚定会话分层组织成统一的交互流,同时随着用户经历随时间展开,逐步合成人机交互。
Guided by user persona knowledge and temporal constraints, KEME hierarchically organizes these anchored sessions into a unified interaction stream, while progressively synthesizing human-assistant interactions that naturally emerge as the user’s experiences unfold over time.
05 双场景基准 Two Benchmark Scenarios 文本 MobileMem 与多模态 MobileMem-Omni Textual MobileMem and multimodal MobileMem-Omni
这些基准共同提供了一个综合框架,用于评估记忆系统从原始移动经验中合成、组织和检索结构化知识的有效性。
Together, these benchmarks provide a comprehensive framework for assessing how effectively memory systems synthesize, organize, and retrieve structured knowledge from raw mobile experiences.
Dataset Construction
Dataset Construction Dataset Construction
如下所示,MobileMem 具有真实用户参与、多模态交互和多源内容,并通过多阶段管线构建。
As illustrated below, MobileMem, featuring real-user participation, multimodal interactions, and multi-source content, is established through a multi-stage pipeline.
Core Framework
KEME 将零散的用户-App 会话作为基础知识锚点,反映已经发生且必须保留的内容。在用户画像知识和时间约束的引导下,KEME 将这些锚定会话分层组织成统一的交互流。
KEME treats the fragmented user-app sessions as foundational knowledge anchors that reflect what has already occurred and must be preserved. Guided by user persona knowledge and temporal constraints, KEME hierarchically organizes these anchored sessions into a unified interaction stream.
A:plan - Knowledge-Guided Planner
从人物画像根节点构建时序事件图,并递归展开:粗粒度生活阶段 -> 更细的子事件图 -> 叶级会话,并按拓扑顺序展开。
Builds a temporal event graph from the persona root and recursively expands it: coarse life phases →finer sub-event graphs →leaf-level sessions, expanded in topological order.
A:ground - Knowledge Anchor Grounder
将每个锚定的 App 会话分配到时间兼容的事件节点;若没有节点适配,则修订事件图,使每个锚点都可落地,并向下传播非矛盾约束。
Assigns each anchored app session to a time-compatible event node; when none fits, it revises the graph so every anchor is groundable, propagating a non-contradiction constraint downward.
A:realize - Experience Realizer
在叶节点采纳或合并锚定内容,或合成上下文一致的人机对话,并通过版本跟踪属性和证据链接驱动人物画像演化。
At leaf nodes it adopts or merges anchored content, or synthesizes context-consistent human-assistant dialogue, and drives persona evolution with version-tracked attributes and evidence links.
A:revise - Experience-Driven Reviser
每次展开后,它会更新剩余图,增添、移除或调整未来事件与边,以解决不一致并丰富结构,形成自底向上的反馈循环。
After each expansion it updates the remaining graph —adding, removing or adjusting future events and edges to resolve inconsistencies and enrich structure, forming a bottom-up feedback loop.
Persona & Memory
为平衡真实性、多样性与可扩展性,MobileMem 采用混合方式构建人物画像:一半来自代表性受雇参与者并参考真实参与者数据,另一半由这些真实样例生成虚拟画像。统一 Schema 进一步组织基础属性、上一年状态和关键里程碑,形成核心记忆结构,共 8 个真实画像和 8 个虚拟画像。
To balance authenticity, diversity, and scalability, MobileMem builds personas through a hybrid approach: half are derived from representative hired participants that reference real participant data, and half are virtual personas generated from those real examples. A unified Schema then organizes basic attributes, previous-year status, and key milestones into the core memory structure —8 real and 8 virtual personas in total.
Knowledge Graph
每个人物画像由三部分表示:基础信息向量 B 捕捉核心身份与背景,初始状态向量 S 捕捉交互前的状态和日常模式,个人知识图谱 G 则由社会关系构建。G 以人物为中心,以频繁且重要的联系人作为周围节点;每个节点描述由 GPT-5.1 丰富,并通过 Seedream 文生图模型转化为参考照片。
Each persona is represented by three components: a basic information vector B capturing core identity and background, an initial state vector S capturing status and daily patterns before interaction, and a personal knowledge graph G built from social relationships. G centers on the persona, with frequent and significant contacts as surrounding nodes; every node description is enriched by GPT-5.1 and turned into reference photos via the Seedream text-to-image model.
Event Building
在人物知识图谱驱动下,MobileMem 分三阶段生成构成每条轨迹主干的事件:重要日期收集锚定个人和文化上重要的日期;事件构建将其扩展为个性化的一年事件序列;步骤拆解把每个事件分解为按时间排序的子事件步骤,并为每一步标注涉及的移动应用和图像类型。
Driven by the persona knowledge graph, MobileMem generates the events that form the backbone of each trajectory in three stages: Important Date Collection anchors personally and culturally significant dates; Event Building expands them into a personalized one-year event sequence; and Step Breakdown decomposes every event into temporally ordered sub-event steps, each annotated with the mobile apps and image types involved.
Dialogue Synthesis
事件步骤通过两个阶段变成具体的多模态对话。记忆点拆解将每个步骤分解为细粒度文本和视觉记忆点;随后会话生成让 GPT-5.1 作为 agent,将它们编织成自然对话轮次和匹配图像,这些图像通过 HTML 渲染、文生图和图像编辑工具生成,并用参考照片保持人物一致性。会话按时间顺序拼接成完整轨迹。
Event steps become concrete multimodal dialogues in two phases. Memory Point Decomposition breaks each step into fine-grained textual and visual memory points; Session Generation then lets GPT-5.1 act as an agent to weave them into natural dialogue turns and matching images —produced via HTML rendering, text-to-image, and image-editing tools, with reference photos keeping characters consistent. Sessions are concatenated in temporal order into the full trajectory.
Question Generation
为系统评估记忆能力,评测问题基于生成的记忆点和步骤信息构建,覆盖七类:单跳、多跳、知识更新、时间推理、隐式偏好、拒答和视觉推理。
To systematically assess memory systems, evaluation questions are built from the generated memory points and step information. They span seven categories: Single-Hop, Multi-Hop, Knowledge Update, Temporal Reasoning, Implicit Preference, Abstention, and Visual Reasoning.
Applications
MobileMem 的应用场景
Application Scenarios
01 生态系统 Ecosystem 移动 AI 助手长期记忆评测 Long-term memory evaluation for mobile AI assistants
MobileMem 被设计为一个统一基准,用于评估移动 AI 助手中的长期记忆,而不是一个独立的记忆系统。其模块化架构可无缝集成到现有移动智能体生态中,包括任务理解、记忆检索、问答、网页搜索、回复安全和执行模块。因此,MobileMem 支持不同记忆架构之间的可复现比较,并促进长期记忆评测接入真实开发管线。
MobileMem is designed as a unified benchmark for evaluating long-term memory in mobile AI assistants rather than a standalone memory system. Its modular architecture seamlessly integrates with the existing mobile agent ecosystem, including task understanding, memory retrieval, question answering, web search, response safety, and execution modules. Consequently, MobileMem supports reproducible comparison across different memory architectures and facilitates the integration of long-term memory evaluation into real-world development pipelines.
02 标准化 Standardization 真实手机记忆与统一评测框架 Authentic smartphone memory and unified protocols
MobileMem 的一个关键特征是,它由真实智能手机记忆构建,而不是合成交互日志或人工整理的用户画像。该基准在单一评测框架中统一了基础记忆、认知记忆、偏好记忆、时间推理和视觉推理,同时将评估建立在约一年真实用户活动之上。MobileMem 建立在原生移动应用生成的异构记忆源之上,包括日历、相册、笔记、文档、待办事项、账单、语音备忘录、屏幕记忆、视频记忆以及其他用户生成记录。
A key characteristic of MobileMem is that it is constructed from authentic smartphone memory rather than synthetic interaction logs or manually curated user profiles. The benchmark unifies foundational memory, cognitive memory, preference memory, temporal reasoning, and visual reasoning within a single evaluation framework, while grounding assessment in approximately one year of real user activities. MobileMem is built upon heterogeneous memory sources generated by native mobile applications, including calendars, albums, notes, documents, to-do lists, bills, voice memos, screen memories, video memories, and other user-generated records.
03 端侧智能 On-Device Intelligence 可度量、可比较、可持续改进 Measurable, comparable, continuously improvable
MobileMem 将长期记忆评测从定性能力展示转向可度量、可比较且可持续改进的评估。该基准为检索准确性、时间一致性、偏好理解、多模态推理和长程知识整合提供综合指标,从而能够客观比较不同记忆架构和检索策略。随着基础模型日益从云服务迁移到边缘设备,MobileMem 为评估可靠、高效、隐私感知且能通过长期用户交互持续演进的记忆系统提供了有效框架。
MobileMem shifts long-term memory evaluation from qualitative capability demonstrations to measurable, comparable, and continuously improvable assessment. The benchmark provides comprehensive metrics for retrieval accuracy, temporal consistency, preference understanding, multimodal reasoning, and long-horizon knowledge integration, enabling objective comparison among different memory architectures and retrieval strategies. As foundation models increasingly migrate from cloud services to edge devices, MobileMem offers an effective framework for evaluating reliable, efficient, and privacy-aware memory systems that continuously evolve through long-term user interactions.
04 用户记忆价值 User Memory Value 以长期多模态用户记忆作为个性化基本单元 Long-term multimodal user memory as personalization
从核心上看,MobileMem 将长期多模态用户记忆视为个性化的基本单元。不同于主要评估孤立事实回忆的传统问答基准,MobileMem 评估 AI 助手是否能够在扩展时间跨度内持续积累、检索、整合并推理不断演化的用户记忆。通过建模真实用户轨迹、多语言交互、动态偏好和真实世界事件,该基准鼓励开发能够提供上下文感知、主动且持续自适应辅助能力的 AI 助手。
At its core, MobileMem treats long-term multimodal user memory as the fundamental unit of personalization. Unlike conventional question answering benchmarks that primarily evaluate isolated factual recall, MobileMem evaluates whether AI assistants can continuously accumulate, retrieve, integrate, and reason over evolving user memories across extended temporal horizons. By modeling authentic user trajectories, multilingual interactions, dynamic preferences, and real-world events, the benchmark encourages the development of AI assistants capable of delivering context-aware, proactive, and continuously adaptive assistance.
05 OPPO 应用场景 OPPO Application Scenarios OPPO 原生记忆生态与生产级移动环境 OPPO native memory ecosystem and production mobile environments
MobileMem 已经接入 OPPO 的 AI 助手研发流程,用于系统性评估并提升生产级移动环境中的长期记忆能力。该基准建立在 OPPO 原生记忆生态之上,该生态提供了通过日常智能手机使用积累的多样长期记忆集合。这些记忆来源包括日历、相册、笔记、文档、待办事项、账单、语音备忘录、屏幕记忆、视频记忆以及其他用户生成记录,覆盖生产力、沟通、多媒体、金融和日常生活。
其中,屏幕记忆、视频记忆、语音记忆和账单记忆等代表性智能记忆服务,会自动将用户的浏览历史、多媒体收藏、语音提醒、支付记录和其他上下文信息组织成结构化长期记忆。除了记忆检索本身,MobileMem 还通过与任务理解模块、网页搜索系统、安全过滤器和执行引擎无缝集成,支持对记忆增强型 AI 助手进行端到端评测。
MobileMem has been integrated into OPPO's AI assistant development pipeline to systematically evaluate and improve long-term memory capabilities in production-grade mobile environments. The benchmark is built upon OPPO's native memory ecosystem, which provides a diverse collection of long-term memory accumulated through everyday smartphone usage. These memory sources include calendars, albums, notes, documents, to-do lists, bills, voice memos, screen memories, video memories, and other user-generated records, covering productivity, communication, multimedia, finance, and daily life.
Among them, representative intelligent memory services such as Screen Memory, Video Memory, Voice Memory, and Bill Memory automatically organize users' browsing histories, multimedia collections, spoken reminders, payment records, and other contextual information into structured long-term memories. Beyond memory retrieval itself, MobileMem also supports end-to-end evaluation of memory-augmented AI assistants by integrating seamlessly with task understanding modules, web search systems, safety filters, and execution engines.
快速开始 Quick Start
完整安装、数据构建和文本评测说明维护在项目仓库中。
Full setup, data construction, and text-only evaluation details are maintained in the project repository.
Institutions
本工作由以下机构联合完成。
This work is jointly conducted by the following institutions.
由 OPPO 和 OpenKG 开发。
Developed by OPPO and OpenKG.
User
Daughter
User
Daughter
