sica ci

Rule

SICA’s base-selection port and its recorded incumbent.

The method returns one edited harness per round. It never sees a score for the harness it is producing — the platform measures every candidate on the same study set and records the result in curve.jsonl.

Measured results

Scores, rounds and per-split comparisons are on the ALFWorld benchmark page — one table for every method, so the same number cannot say two different things in two places.

Record

This method’s rounds on the Hub — each round’s harness, the edit that produced it, and its per-task trajectories: open the directory.

Deviations from the method it ports

4 deliberate difference(s), recorded in methods/sica_ci/method.json:

• The platform owns candidate measurement and the stopping budget; normal returns record the selected historical round as step.incumbent_round when its comparison bound has an available CI.
• An unavailable comparison CI leaves incumbent_round unspecified rather than asserting a fallback kept round.
• The selected historical round is recorded and named in the prompt, but its source snapshot is not restored for editing.
• When no iteration clears the bound, this port keeps the bound holder; upstream select_base_agent falls off the end of its loop and returns None.

Code

methods/sica_ci/run.py and its rule test in tests/quality/. python3 tools/method_lint.py prints one line per method.