nsaspy/symbolic-memory
1
0
Fork 0
Code Issues 42 Pull requests 2 Projects Releases Packages Wiki Activity Actions

[SLICE 25][CORE-H] Build deterministic cross-domain conformance + crash/failure-injection suite with cold/warm/rebuilt/incremental equivalence #6

New issue
Open
opened 2026-09-08 01:56:59 +00:00 by nsaspy · 1 comment
nsaspy commented 2026-09-08 01:56:59 +00:00
Owner
Copy link

Parent epic: #19
Depends on: #23-#42 as applicable
Upstream semantics: prolog-rlm#395

Goal

Create one deterministic provider-disabled correctness suite spanning the whole implemented library.

Cover:

  • exact source round trip and authority isolation;
  • full-IR persistence across heterogeneous semantic classes;
  • bitemporal current/history behavior;
  • support/counterevidence/withdrawal/conflict semantics;
  • identity reconciliation/retraction;
  • query + TAPS dependency closure;
  • corpus resume/idempotency;
  • experience/candidate/promotion/quarantine/drift history;
  • crash before/after canonical commit and projection checkpoint;
  • corrupted/stale cache/checkpoint handling;
  • redaction non-resurrection;
  • federation/replica/fork/remote-unavailable behavior;
  • transport/library equivalence;
  • exact historical replay where retained artifacts permit it.

Required differential oracle for same canonical frontier/generations:

cold rebuild == warm == cache-drop/rebuild == incremental

under normalized semantic comparison where the profile claims equivalence.

Acceptance

One headless test command runs with providers disabled and model_calls=0 for all known-symbolic paths; every injected failure returns structured non-success rather than weakening semantics or silently rebuilding canonical truth from derived state.

Parent epic: #19 Depends on: #23-#42 as applicable Upstream semantics: prolog-rlm#395 ## Goal Create one deterministic provider-disabled correctness suite spanning the whole implemented library. Cover: - exact source round trip and authority isolation; - full-IR persistence across heterogeneous semantic classes; - bitemporal current/history behavior; - support/counterevidence/withdrawal/conflict semantics; - identity reconciliation/retraction; - query + TAPS dependency closure; - corpus resume/idempotency; - experience/candidate/promotion/quarantine/drift history; - crash before/after canonical commit and projection checkpoint; - corrupted/stale cache/checkpoint handling; - redaction non-resurrection; - federation/replica/fork/remote-unavailable behavior; - transport/library equivalence; - exact historical replay where retained artifacts permit it. Required differential oracle for same canonical frontier/generations: ```text cold rebuild == warm == cache-drop/rebuild == incremental ``` under normalized semantic comparison where the profile claims equivalence. ## Acceptance One headless test command runs with providers disabled and `model_calls=0` for all known-symbolic paths; every injected failure returns structured non-success rather than weakening semantics or silently rebuilding canonical truth from derived state.
nsaspy commented 2026-09-08 01:59:47 +00:00
Author
Owner
Copy link

MACHINE-SPIRIT #404D conformance/failure-injection additions

Add the CLOCKWORK learned-state differential/race suite to CORE-H. At minimum cover:

  • deterministic LAC canonical bytes/fingerprint and typed signature/trust-root reclassification;
  • exact exposure closure vs cached closure; source-copy/ancestor dependence; retracted mistaken dependence; private-origin unknown;
  • candidate freeze and immutable EvaluationSnapshot; exposed holdout reclassification; stale baseline/verifier/metric generations; bounded candidate-family risk accounting;
  • exact finite symbolic validation vs bounded counterexample search; retained seed/search bounds/witness; bounded search never reports exhaustive;
  • drift/transfer invalidation and historical admission preservation;
  • crash before promotion append -> no admission;
  • crash after promotion append but before derived-view/cache update -> rebuild restores admission;
  • retraction-before-promotion -> stale/reject; promotion-before-retraction -> historical admission then current suspension;
  • duplicate same transition idempotency; same idempotency identity/different digest conflict;
  • async evaluator completion permutation cannot change normalized fixed-evidence decision;
  • cold rebuild == warm == cache-drop/rebuild == incremental for the same exact frontier/generations;
  • live remote/model reevaluation is new observation lineage;
  • admitted/imported learned objects cannot register handlers or widen authority;
  • provider-disabled known-symbolic experience→candidate→validation→promotion→selection path has model_calls=0.

Refs prolog-rlm#404D/#395 and #16/#33-#36.

## MACHINE-SPIRIT #404D conformance/failure-injection additions Add the CLOCKWORK learned-state differential/race suite to CORE-H. At minimum cover: - deterministic LAC canonical bytes/fingerprint and typed signature/trust-root reclassification; - exact exposure closure vs cached closure; source-copy/ancestor dependence; retracted mistaken dependence; private-origin `unknown`; - candidate freeze and immutable EvaluationSnapshot; exposed holdout reclassification; stale baseline/verifier/metric generations; bounded candidate-family risk accounting; - exact finite symbolic validation vs bounded counterexample search; retained seed/search bounds/witness; bounded search never reports exhaustive; - drift/transfer invalidation and historical admission preservation; - crash before promotion append -> no admission; - crash after promotion append but before derived-view/cache update -> rebuild restores admission; - retraction-before-promotion -> stale/reject; promotion-before-retraction -> historical admission then current suspension; - duplicate same transition idempotency; same idempotency identity/different digest conflict; - async evaluator completion permutation cannot change normalized fixed-evidence decision; - `cold rebuild == warm == cache-drop/rebuild == incremental` for the same exact frontier/generations; - live remote/model reevaluation is new observation lineage; - admitted/imported learned objects cannot register handlers or widen authority; - provider-disabled known-symbolic experience→candidate→validation→promotion→selection path has `model_calls=0`. Refs prolog-rlm#404D/#395 and #16/#33-#36.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
rage/002-symbolic-projection-recall
rage/001-remember-get
noop
No results found.
Labels
Clear labels   
accessibility
Barrier affecting people with disabilities

  
bug
Something isn't working

  
documentation
Improvements or additions to documentation

  
duplicate
This issue or pull request already exists

  
enhancement
New feature or request

  
good first issue
Good for newcomers

  
help wanted
Extra attention is needed

  
invalid
This doesn't seem right

  
question
Further information is requested

  
wontfix
This will not be worked on

No labels
accessibility
bug
documentation
duplicate
enhancement
good first issue
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
nsaspy/symbolic-memory#6
No description provided.