ai-automation-consultant / Failure Lab

Rate Limit 429 Retry

A batch job hammers the CRM and turns a recoverable limit into a failed sync.

Failure LabDashboard

Category

api-reliability

Difficulty

standard

Last Run

none

Incident Brief

Diagnose why the batch keeps failing and what retry behavior is missing.

Broken State

The workflow ignores Retry-After and retries all records immediately.

Symptoms

  • Failures cluster near the top of each hour.
  • Later manual reruns usually succeed.

Trace

crm.response status=429 retry-after=60
retry.delay_ms=0 batch_size=500

Diagnosis