01Challenge
End-to-end tests break with every UI change, and the team spends hours telling real defects from stale selectors. The client needed an agent that maintains the tests on its own but never weakens assertions or touches product code.
02Solution
- The core is CI-agnostic; an adapter handles only triggers, secrets and report publishing
- Two-level failure triage: heuristics and deterministic selector repair from a DOM snapshot; the model handles only ambiguous cases
- Guardrails are enforced in code: the diff is checked for weakened assertions, product changes and secrets
- A cumulative PR/MR, defect issues, Slack and Teams notifications, a test data registry
- A Rails dashboard: run history, metrics, per-project access and data retention
03Results
- A working implementation of every part of the specification
- A control set: 24 UI changes, defects and an infrastructure failure
- Documentation for onboarding a project in one working day