Skip to content

What is LightRSI

LightRSI is a modular runtime for recursive improvement in long-running LLM agents. It provides the shared lifecycle, state, safety, observability, and host integration needed to build an improvement capability once and run it across OpenClaw, Codex, Claude Code, and future hosts. The current implementation focuses on context and agentic memory.

LightRSI vs. TokenPilot

A common point of confusion: LightRSI and TokenPilot are not the same thing.

LightRSITokenPilot
What it isA recursive-improvement runtime and platformA preset that runs on LightRSI
RoleLoads, manages, and executes pluginsProvides cache-aware context management
ScopePlatform-wide: plugins, adapters, CLIOne specific capability: reducing token usage
StatusActive developmentStable — the first official plugin

LightRSI provides the reusable runtime boundary; TokenPilot supplies one concrete policy bundle for cache-efficient context management.

What Problems It Solves

  • Long sessions get expensive. As agent sessions grow, every turn carries more context, which means more tokens and higher costs.
  • Context is repetitive. Much of what gets sent to the model each turn is identical to the previous turn — wasteful if not cached.
  • Tool output is noisy. Large tool responses can pollute future turns with irrelevant data.
  • Sessions don't prune themselves. Without eviction, old context accumulates until sessions hit limits or become too slow.

LightRSI addresses these through its plugin model. TokenPilot, the first plugin, implements the runtime policies: stable-prefix rewriting, context reduction, and lifecycle-aware eviction.

What It Doesn't Solve

  • Short, single-turn interactions. If your sessions are always one-shot, there is nothing for caching or eviction to optimize.
  • Model quality or accuracy. LightRSI doesn't change model behavior — it changes what context gets sent to the model.
  • All memory problems. Long-term memory is an experimental feature area; TokenPilot focuses on the current session's context window.

Relationship to the Paper

The TokenPilot paper describes the cache-efficient context management technique. LightRSI is the platform that hosts TokenPilot as its first plugin, and will host additional plugins in the future.

Next Steps

Released under the MIT License.