AGI Consultant / Engagement dossier
Northstar Support
Customer-facing copilots
DraftSC-020
Recommended engagement
Governance + Eval Buildout
Growth and enterprise teams building repeatable AI assurance operations.
- Term
- 4-6 weeks
- Commercial
- Scoped retainer
- Posture
- Critical
Executive position
Customer-facing copilots is not launch-ready. Treat this as a control-build engagement before any expansion, with executive sign-off and evidence review before release.
Decision rule: 3 stage + 4 use case + 2 timeline + 1 stack + 10 risk = 20 total.
Engagement outputs
- 01Intake summary with assumptions, constraints, and launch decision criteria.
- 02AI system inventory covering data sources, model vendors, human review, and owners.
- 03Prioritized risk register with severity, owner, mitigation, and proof needed.
- 04Customer journey risk map with launch approval gates.
- 05Golden-task evaluation pack with acceptance thresholds.
- 06Data handling review covering retention, redaction, and vendor boundaries.
- 07Measurement plan for offline evals, review sampling, and production monitors.
- 08Engagement roadmap with weekly milestones and decision checkpoints.
Control conditions
- Confirm named business, technical, security, and review owners before work starts.
- Define stop/go gates for pilot, launch, and rollback decisions.
- Require golden tasks, reviewer sampling, drift thresholds, and launch-blocking eval gates.
- Map prohibited data, retention limits, redaction ownership, and vendor logging boundaries.
- Define offline eval coverage, production monitors, sample rates, and failure triage SLAs.
Discovery questions
- Who owns executive sign-off for launch, remediation, or pilot expansion?
- Which production data can be sampled for evaluation without creating new risk?
- What customer, compliance, or security evidence must be produced before launch?
- What internal milestone should this engagement unblock?
- Which parts of the current stack are mandatory versus replaceable?
- Which examples define a correct, borderline, and failed response?
- Which data classes are prohibited from model prompts or logs?
- What signals will prove the system is safe enough to launch?