Context Switch
Supporting exercise · simulated support workflow

AI Support Workflow Exercise

I used a fictional company, Meridian, to work through a practical product question: if a support team wants AI help, where should AI actually participate, what should software enforce, and when should a person take over? The useful result was not the fictional pilot plan. It was seeing how quickly the workflow changed once discovery challenged the original assumptions.

In shortWorking through a fictional support team showed how quickly the AI boundaries, software rules and human handoffs changed once discovery challenged the first design.

How I worked with AI

I chose the scope, wrote the discovery questions, made the boundary and handoff decisions, and decided which simulated findings were strong enough to change the design. Claude helped generate early simulated stakeholder material and rendered the workflow from rules I specified. The company, interviews, and operating numbers are simulated; the product decisions and reasoning are mine.

What discovery changed

I started with a fairly generic idea: let AI draft support responses so reps can answer faster. The questions below changed the product more than prompt tuning would have.

Rep workflowHow do support reps actually handle first responses today?
What changed: the assumed “mixed workflow” was mostly wrong. Simulated rep discovery showed that a separate quick acknowledgment was uncommon, so I stopped designing around it and became more conservative about expected response-time gains.
Billing and account contextDoes the AI need a new integration to see the account information reps use?
What changed: the needed field already existed through an overnight sync but was hidden from the Tier 1 view. The better answer was a configuration change, not another AI integration.
High-risk categoriesShould AI still draft replies for money, account-access, and security issues if a person reviews them?
What changed: I decided those categories should bypass drafting entirely. Classification can route them, but the response itself starts with a person. The risk was not worth treating as a confidence-threshold problem.
Knowledge qualityWhat happens if the source material the AI retrieves is stale or contradictory?
What changed: I stopped treating every bad answer as “the model was wrong.” Knowledge-base failures became their own root-cause category so the team could distinguish model behavior from bad source material.

Support workflow and AI boundaries

The resulting design is deliberately bounded. AI helps with interpretation and drafting only where being probabilistic is useful. Software owns the hard stops. People remain responsible for anything consequential and for every message that reaches a customer.

AI

Classify standard tickets, retrieve relevant context, draft a response, and surface uncertainty.

Software

Block high-risk categories from drafting and enforce explicit escalation conditions.

Human

Approve or rewrite responses, handle high-risk work, and take over when a conversation escalates.

Ticket arrives → human handoff
AI / systemHumanCustomer
1
CustomerTicket arrives
2
AI / systemClassify the ticketcategory determines which path is allowed next
The classification step creates two different authority paths.
Standard category
Retrieve approved knowledge and account context
Draft a response
Surface uncertainty or missing context for review
Money / security / account access
Skip AI drafting. Route directly to a person.
↳ both paths continue with human responsibility
3
HumanReview or write the responseapprove, edit, or start over
4
HumanSend to the customernothing customer-facing is sent autonomously in this exercise
5
AI / systemCheck for escalation conditionscustomer asks for a person, risk changes mid-thread, or the conversation becomes repetitive or prolonged
6
HumanMove to human-only handling when neededcarry the conversation history forward instead of making the customer start over

How the design changed

Early assumptionAfter discovery
AI could draft nearly every support ticket for review.Money, security, and account-access categories bypass drafting entirely.
Faster first response depended on a common “quick acknowledgment” workflow.That workflow appeared uncommon, so expected gains became more modest and were not tied to it.
Billing context required a new AI-facing integration.The data already existed. A view/configuration change solved the need more directly.
Bad AI answers would mainly be model-quality failures.Stale or conflicting source material needed to be tracked as a separate failure class.
Success could be summarized with aggressive speed targets.Mandatory human review limits the plausible efficiency gain. Quality, boundary adherence, and root cause matter separately.

What I would measure in a real pilot

I would not carry the exercise's fictional target numbers forward. In a real team I would establish baselines first, then track response and handling time alongside draft acceptance/editing, escalation reasons, knowledge-source failures, boundary violations, and customer outcomes. A faster workflow would not count as a success if reps spend the saved time correcting bad drafts or if risky categories leak through the boundary.

What I took from the exercise: an AI workflow can change substantially before model selection or prompting becomes the important question. Several things that initially looked like AI problems turned out to be workflow, access, source-quality, or policy problems. Discovery is what exposed the difference. The limitation is equally important: simulated stakeholders can sharpen reasoning, but they cannot substitute for watching real people do the work.