Changelog
What we've shipped so far.
May 2025
Jira enterprise hardening and reliability fixes
Fixed a class of Jira webhook registration failures that affected enterprise Jira configurations with custom base URLs. Webhook trigger names now match Jira's documented event schema. Also fixed: sync job reliability under concurrent load, improved error logging on failed LLM calls, and reduced false-positive "stale" flags on recently analyzed tickets.
- Correct trigger function name in Jira webhook registrations
- Sync job reliability improvements under concurrent worker load
- Improved error surfacing for failed LLM analysis calls
- Reduced stale-flag false positives on recently refreshed tickets
April 2025
Criterion feedback and prompt overhaul
Engineers and PMs can now mark individual criterion results as correct or incorrect. That feedback feeds directly into the analysis prompt — criteria that get marked wrong see improved accuracy on re-analysis. Separately, the core analysis prompt was rebuilt from scratch to reduce over-confident "satisfied" scores on vague criteria and improve partial-match detection.
- Per-criterion feedback: mark any result as correct or incorrect
- Feedback-aware re-analysis: marked criteria improve on next run
- Analysis prompt rebuilt for accuracy — less over-confident on ambiguous criteria
- Improved partial satisfaction detection (new PARTIAL threshold: 0.55)
- Criteria health panel: see which criteria are consistently hard to evaluate
- Criteria testability pre-classifier flags vague criteria before analysis runs
March 2025
GitHub PR comments and auto-analysis on merge
Waterline now posts its analysis as a comment on GitHub pull requests — automatically, when a PR merges. No manual trigger needed. Teams using GitHub Issues get ticket progress posted directly in their review workflow. Also added: ticket keys are now extracted from PR title, body, branch name, and commit messages — so Waterline finds the right tickets even when the team doesn't follow a strict linking convention.
- Auto-post Waterline analysis as GitHub PR comment on merge
- Update existing PR comment in-place when re-analyzed
- Auto-trigger ticket analysis in worker after PR sync completes
- Extract ticket keys from PR title, body, branch name, and commits
- Async ticket analysis endpoint — returns 202 immediately, poll for result
- On-demand code preview with syntax highlighting and parallel prefetch
Want to be first when new features ship?
Early access members get notified when major features land.
Request early access →