[P1] Cluster captures into activity sessions and generate summaries #25

New issue

Closed

opened 2026-07-18 00:01:54 +00:00 by lost-rob0t · 0 comments

lost-rob0t commented

2026-07-18 00:01:54 +00:00

(Migrated from github.com)

Goal

Turn individual captures into coherent activities instead of a noisy screenshot stream.

Requirements

Group records using time gaps, application/workspace changes, perceptual similarity, and semantic similarity.
Preserve exact source-record membership for every cluster.
Generate local summaries incrementally using the configured generation provider.
Recompute affected clusters when records are deleted or policies change.
Store summaries encrypted with model/version provenance.
Avoid inventing actions not supported by source records.

Acceptance criteria

Repetitive frames become one activity span with start/end times.
Summaries cite their source record IDs and can be regenerated.
Low-confidence clusters remain separate rather than being aggressively merged.
Tests cover rapid task switching, long idle gaps, and repeated use of the same application for different tasks.

Depends on

## Goal Turn individual captures into coherent activities instead of a noisy screenshot stream. ## Requirements - Group records using time gaps, application/workspace changes, perceptual similarity, and semantic similarity. - Preserve exact source-record membership for every cluster. - Generate local summaries incrementally using the configured generation provider. - Recompute affected clusters when records are deleted or policies change. - Store summaries encrypted with model/version provenance. - Avoid inventing actions not supported by source records. ## Acceptance criteria - Repetitive frames become one activity span with start/end times. - Summaries cite their source record IDs and can be regenerated. - Low-confidence clusters remain separate rather than being aggressively merged. - Tests cover rapid task switching, long idle gaps, and repeated use of the same application for different tasks. ## Depends on - #20 - #21 - #22 - #24