[SLICE 13][CORE-D] Implement resumable corpus/backfill engine with stable work IDs, checkpoints, cancellation, and idempotent resume #18

New issue

Open

opened 2026-09-08 01:57:00 +00:00 by nsaspy · 0 comments

nsaspy commented

2026-09-08 01:57:00 +00:00

Owner

Parent epic: #15
Depends on: #22 #23
Refines: #8

Goal

Implement the generic corpus/job runner that discovers durable sources, schedules bounded semantic projection work, checkpoints progress, and resumes without duplication.

Implement:

stable source/segment/work IDs;
run/job status and progress counts;
bounded concurrency and cancellation;
per-unit compile/publish state;
checkpoint/restart;
idempotent unchanged-corpus rerun;
selective rework on source/compiler/schema/config fingerprint change;
backfill existing memories with absent/stale projection;
partial failure isolation and explicit publication completeness;
actual provider usage accounting only for compiler calls.

Acceptance

Kill/restart halfway through a multi-source fixture; completed units are not duplicated, pending units resume, failed units remain inspectable/retriable, unchanged rerun is mostly no-op, changed source produces new lineage, and namespace boundaries remain intact.

Parent epic: #15 Depends on: #22 #23 Refines: #8 ## Goal Implement the generic corpus/job runner that discovers durable sources, schedules bounded semantic projection work, checkpoints progress, and resumes without duplication. Implement: - stable source/segment/work IDs; - run/job status and progress counts; - bounded concurrency and cancellation; - per-unit compile/publish state; - checkpoint/restart; - idempotent unchanged-corpus rerun; - selective rework on source/compiler/schema/config fingerprint change; - backfill existing memories with absent/stale projection; - partial failure isolation and explicit publication completeness; - actual provider usage accounting only for compiler calls. ## Acceptance Kill/restart halfway through a multi-source fixture; completed units are not duplicated, pending units resume, failed units remain inspectable/retriable, unchanged rerun is mostly no-op, changed source produces new lineage, and namespace boundaries remain intact.

nsaspy referenced this issue

2026-09-08 01:57:32 +00:00

[semantic-memory] Expose general semantic ingestion, query, provenance, and bounded world-model projections through native/MCP tools #40

nsaspy referenced this issue

2026-09-08 01:57:39 +00:00

[EPIC][CORE] Library-first Symbolic Memory v1: durable semantic world model, learning history, federation, and zero-model recall #38