credentialsintro
Expired API Key
CRM enrichment suddenly fails after a credential rotation window.
learn.soatmos.dev
Failure Lab
Diagnose broken automations, identify root causes, and store failure-diagnosis evidence.
30 scenarios · 8 agent scenarios · learner@local.soatmos.dev
Open Scenario
deploymentintro
Wrong Environment Variable
Production points at staging even though the deploy itself succeeded.
webhooksintro
Malformed JSON Webhook
The webhook endpoint rejects real client payloads before the workflow starts.
api-authintro
CRM 401 Bearer Prefix
A valid token is rejected because the Authorization header is shaped incorrectly.
api-authstandard
CRM 403 Missing Scope
Reads still work, but writes fail after a least-privilege credential change.
api-datastandard
Missing Record 404
The automation treats a normal not-found lookup as a fatal incident.
api-reliabilitystandard
Rate Limit 429 Retry
A batch job hammers the CRM and turns a recoverable limit into a failed sync.
reliabilitystandard
Upstream 500 Without Circuit Breaker
A vendor outage floods retries and delays every workflow in the queue.
webhooksstandard
Duplicate Webhook Replay
A provider retry creates duplicate tasks because delivery is at least once.
databasestandard
Database Unique Constraint
Parallel sync workers collide while creating the same company row.
ai-outputstandard
Hallucinated AI Output Schema
The model returns confident prose where the workflow expects strict JSON.
oauthadvanced
OAuth Refresh Expired
A calendar integration works for one user but fails after a long idle period.
agent-operationsadvanced
Agent Runaway Loop Cost Cap
A coding agent repeatedly rewrites tests until the token spend explodes.
agent-operationsadvanced
Agent Hallucinated Passing Test
The agent reports green tests, but no matching test command was actually run.
agent-operationsadvanced
Agent Unrelated File Edits
A small bug fix arrives with broad changes outside the requested module.
agent-operationsadvanced
Agent Context Truncation
Mid-task compaction drops a key acceptance criterion and the agent finishes the wrong work.
agent-operationsadvanced
Agent Deprecated API From Stale Training
The agent uses an obsolete SDK method that no longer exists in the installed version.
agent-operationsadvanced
Agent Committed Secret
A helper agent adds a real API key to a sample configuration file.
discoverystandard
Ambiguous Discovery Owner
A workflow map says someone follows up, but no role owns the step.
architecturestandard
Brittle Agent Decision Fit
An agent is proposed for a stable rules problem that should stay deterministic.
n8nstandard
n8n Credential Wrong Scope
A workflow authenticates but fails when it reaches a protected CRM action.
n8nintro
n8n Empty Items Expression
A Code node assumes the first item exists and crashes on an empty filtered result.
typescriptstandard
TypeScript Null Field
TypeScript compiles, but runtime data includes null where the code expects a string.
pythonstandard
Python Timezone Drift
A Python cleanup script moves jobs to the wrong service day.
roistandard
Optimistic ROI Volume
The ROI model looks attractive only because monthly volume is inflated.
client-communicationstandard
Scope Creep Not Logged
A client adds work verbally and the project loses its acceptance boundary.
client-communicationintro
Proposal Missing Exclusions
A proposal is clear about deliverables but silent on excluded work.
architectureadvanced
No Human Review Boundary
AI output is written directly to customer-facing messages without review or confidence checks.
pythonstandard
Python Parser Silent Drop
A parser catches every exception and silently skips failed documents.
roistandard
ROI Forgets Review Cost
Agent-assisted delivery looks profitable only because human review time was omitted.