Release Readiness Checklist
A pre-release checklist for docs, skills, connectors, and safety controls.
Use this checklist before major changes to prompts, skills, or connector configurations.
Pre-Release Validation
Functional Quality
- Core query paths return structured, source-backed output.
- Role-based use cases still produce expected response format.
- Critical prompts pass regression checks on known scenarios.
Security and Access
- Connector credentials are scoped correctly.
- Host allowlists and outbound restrictions are validated.
- No new sensitive fields are exposed in logs or traces.
Operational Safety
- Rate-limit behavior is tested under burst load.
- Error and latency alerts are configured for release window.
- Rollback path is documented and tested.
Release Day Runbook
- Deploy to limited scope first.
- Monitor error rate, latency, and token spend for 30-60 minutes.
- Validate two real-world analyst workflows.
- Expand rollout only after stability threshold is met.
Post-Release Review
- Capture incidents, false positives, and unexpected failure modes.
- Update skills/docs with lessons from first-week usage.
- Archive release notes with observed impact metrics.