Skip to content

feat(cli): gd compare and AI variance diagnosis (2/3) - #1187

Open
psiarkiewicz wants to merge 5 commits into
feat/trajectory-normalizationfrom
feat/cli-eval-compare
Open

feat(cli): gd compare and AI variance diagnosis (2/3)#1187
psiarkiewicz wants to merge 5 commits into
feat/trajectory-normalizationfrom
feat/cli-eval-compare

Conversation

@psiarkiewicz

@psiarkiewicz psiarkiewicz commented Aug 4, 2026

Copy link
Copy Markdown
Collaborator

Summary

Part 2 of 3 (stacked on #1186 ).

Adds headless CLI run comparison and multi-stage LLM variance diagnosis.

  • CLI: gd compare <runDirA> <runDirB>.
  • GCS Downloader: Lazy downloading and caching of remote runs with streaming logs.
  • Comparison Engine: Diffs files against base apps, compares Playwright results, and aligns trajectory steps.
  • Diagnosis Subagents: Multi-stage LLM analysis (compliance auditor, code friction analyzer, synthesis engine) outputting variance_diagnosis.md.

@paulirish
paulirish force-pushed the feat/cli-eval-compare branch from 59e76b0 to 4f1edf8 Compare August 11, 2026 04:32
@paulirish paulirish changed the title feat(cli): add gd compare workflow and AI variance diagnosis engine feat(cli): gd compare and AI variance diagnosis (2/3) Aug 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants