[SLICE 20][CORE-B] Implement projection DAG, dependency generations, delta feeds, selective invalidation, and bounded rebuild #11

Open
opened 2026-09-08 01:57:00 +00:00 by nsaspy · 0 comments
Owner

Parent epic: #13
Depends on: #37
Research: prolog-rlm#402D

Goal

Make current/epistemic/query/identity/retrieval projections incrementally maintainable without making derived state canonical.

Implement:

  • versioned projection registry/spec;
  • exact input dependencies and generations;
  • ledger delta feed from committed frontier advances;
  • dependency graph from semantic/source/lifecycle/schema/identity/admission/redaction/integrity changes to derived projections;
  • selective invalidation and stale-partition status;
  • propagation-stop when recomputed normalized interface digest is unchanged;
  • bounded demanded/background rebuild;
  • atomic checkpoint publication after successful recomputation;
  • explicit exact|lagging|stale_dependency|rebuilding|integrity_blocked|resource_limited freshness.

Optional DBSP/differential machinery may be added only if measured workloads justify it; direct delta/generation maintenance is the baseline.

Acceptance

Changing one identity mapping invalidates only dependent aliases/results; unrelated projections stay valid; crash mid-rebuild leaves old checkpoint or explicit stale state, never half-published current truth; full rebuild and incremental result normalize equal for deterministic fixtures.

Parent epic: #13 Depends on: #37 Research: prolog-rlm#402D ## Goal Make current/epistemic/query/identity/retrieval projections incrementally maintainable without making derived state canonical. Implement: - versioned projection registry/spec; - exact input dependencies and generations; - ledger delta feed from committed frontier advances; - dependency graph from semantic/source/lifecycle/schema/identity/admission/redaction/integrity changes to derived projections; - selective invalidation and stale-partition status; - propagation-stop when recomputed normalized interface digest is unchanged; - bounded demanded/background rebuild; - atomic checkpoint publication after successful recomputation; - explicit `exact|lagging|stale_dependency|rebuilding|integrity_blocked|resource_limited` freshness. Optional DBSP/differential machinery may be added only if measured workloads justify it; direct delta/generation maintenance is the baseline. ## Acceptance Changing one identity mapping invalidates only dependent aliases/results; unrelated projections stay valid; crash mid-rebuild leaves old checkpoint or explicit stale state, never half-published current truth; full rebuild and incremental result normalize equal for deterministic fixtures.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
nsaspy/symbolic-memory#11
No description provided.