ACME HQDemo work items and pages, made up for Emargen's demo. Not a real company.
Operations / OPS-43

Sign-in lockout and rate limits: release in every region, Thursday 07:00

Project
Operations
Type
Change
Status
Done Done
Priority
Medium
Reporter
Mira Holm <mira.holm@acme-hq.example>
Assignee
Oskar Lund <oskar.lund@acme-hq.example>
Labels
securitysign-in
Components
identity-serviceinfrastructure
Created
9 Sep 2026, 08:00 UTC
Updated
16 Sep 2026, 08:40 UTC
Resolved
10 Sep 2026, 10:15 UTC

Description

Release of ENG-1702 on Thursday 10 September.

  1. 07:00 US, 07:20 UK, 07:40 EU (smallest first).
  2. Watch failed sign-ins, locks and 429s for an hour per region.
  3. Retune the WAF rules from OPS-42 once the per-account lock holds.
  4. Support briefed on unlocking (Confluence ENG › Runbook: credential stuffing and lockouts).

Way back: a config switch turns the lock and the per-address limit off without a deploy.

Linked issues

Comments (2)

Oskar Lund · 10 Sep 2026, 10:15 UTC

All regions out by 07:45. First morning: 23 locks, all real people who forgot their password; 4 unlocked by their administrators. WAF rules retuned at 12:00.

Oskar Lund · 16 Sep 2026, 08:40 UTC

Follow-up: at this morning's 06:00 shift change whole Northgate sites hit the per-address limit (failed attempts only since ENG-1716, but a site's typos add up). Raised the limit for known depot networks and allow-listed Northgate's site addresses. Config change, no deploy.