docs/hermes_infra-gateway-lag-recovery
This branch is 14 commits behind admin/ansible:master
On-call playbook for the symptom chain that produced the prod outage
on admin/ansible#26:
Persisted transcript lagged
-> cgroup memory pressure
-> s6 SIGTERM
-> drain timed out 0.0s
-> interrupting remaining work
-> Scheduled auto-resume
Includes live diagnostic commands (gateway log grep, cgroup RSS /
threads inside the container, WAL snapshot), a four-step mitigation
ladder (clear-session, USR2 checkpoint, rolling restart, escalate)
with PR #27 / PR #28 cross-refs, and an explicit 'what NOT to do'
list (docker kill without run id, log rotate mid-checkpoint, masked
timeouts).
Refs admin/ansible#26.
Description
No description provided
12 MiB
Languages
Jinja
43.6%
Python
43.3%
Shell
9.7%
Dockerfile
3.4%