Approvals
Why Panel
Understanding AI reasoning for transparency and trust
The Why Panel shows exactly how AI arrived at its decision. This transparency helps you trust (or correct) AI actions.
Accessing the Why Panel
From Approval Queue
- Open an approval item
- Click "Why?" or "See reasoning"
- Panel slides in from right
From Ticket Detail
- Open any ticket
- Find an AI action in the timeline
- Click "Why did AI do this?"
What the Why Panel Shows
Intent Recognition
How AI interpreted the customer's request:
Detected Intent: Refund Request
Customer is asking for a refund on order #12345.
They mentioned the product arrived damaged.
Confidence: 95%Information Sources
What data AI used:
| Source | Used |
|---|---|
| Customer message | ✓ |
| Knowledge base | ✓ (3 articles) |
| Customer history | ✓ (2 previous tickets) |
| Order data | ✓ (via Shopify connector) |
| Previous responses | ✓ (similar tickets) |
Reasoning Steps
The logic chain:
- Identified request as refund for damaged item
- Found refund policy in knowledge base
- Checked order status via Shopify
- Verified within 30-day return window
- Determined eligible for full refund
- Generated response with refund steps
Confidence Score
How certain AI is about this decision:
| Score | Meaning |
|---|---|
| 90-100% | Very confident |
| 70-89% | Confident |
| 50-69% | Uncertain |
| Below 50% | Low confidence (usually escalates) |
Alternatives Considered
Other approaches AI evaluated:
Alternatives:
1. Offer replacement instead of refund (rejected: customer specifically asked for refund)
2. Escalate to human (rejected: straightforward policy case)
3. Request photos first (rejected: policy allows refund without photos under $50)Using the Why Panel
To Build Trust
As you review Why Panels:
- See AI follows your policies
- Understand its decision process
- Build confidence in its capabilities
To Improve AI
When AI gets it wrong:
- Identify where reasoning failed
- Add missing knowledge base content
- Adjust training examples
To Learn Patterns
Notice patterns in AI decisions:
- Common question types
- Frequent policy applications
- Areas needing more KB content
Example Why Panels
Example 1: Simple Response
Intent: Business Hours Inquiry
Confidence: 99%
Sources Used:
- Knowledge Base: "Business Hours" article
Reasoning:
Customer asked about business hours.
Found exact answer in knowledge base.
Generated direct response with hours.
No alternatives considered - straightforward query.Example 2: Refund Decision
Intent: Refund Request (Damaged Item)
Confidence: 87%
Sources Used:
- Customer message: Mentioned damaged item
- Shopify: Order #12345 - $75.00
- Knowledge Base: "Return Policy" article
- Customer History: 2 previous orders, no returns
Reasoning:
1. Customer reports damaged item
2. Order found: $75.00, delivered 5 days ago
3. Within 30-day return window
4. Refund policy allows for damaged items
5. No previous abuse of return policy
6. Eligible for full refund
Alternative Considered:
- Request damage photos first
Rejected: Policy only requires photos for items over $100Example 3: Escalation
Intent: Account Closure + Legal Threat
Confidence: 72%
Sources Used:
- Customer message: Contains "lawyer" and "cancel my account"
- Customer History: VIP customer, 3 years
Reasoning:
1. Customer mentions potential legal action
2. Also requesting account closure
3. VIP customer with significant history
4. Combination warrants human attention
5. ESCALATING to human review
Alternatives Considered:
- Auto-respond with standard closure process
Rejected: Legal mention triggers escalation policyInterpreting Confidence Scores
High Confidence (90%+)
AI is very sure. Usually:
- Clear, simple request
- Exact match in knowledge base
- Standard scenario
Medium Confidence (70-89%)
AI is confident but used some inference:
- Multiple possible interpretations
- Partial knowledge base match
- Some ambiguity resolved
Lower Confidence (50-69%)
AI is uncertain:
- Ambiguous request
- Missing information
- No clear KB match
- May need human review
Very Low Confidence (<50%)
AI usually escalates these:
- Very complex issue
- Contradictory information
- Sensitive topics
- Outside training scope