ACME HQDemo work items and pages, made up for Emargen's demo. Not a real company.
Support / SUP-1139

Northgate: Warrington night shift couldn't sign in for 20 minutes

Project
Support
Type
Incident
Status
Done Done
Priority
High
Organization
Northgate
Reporter
Daniel Okafor <daniel.okafor@northgate.example>
Assignee
Ines Costa <ines.costa@acme-hq.example>
Labels
northgateincidentsecurity
Components
infrastructure
Created
3 Sep 2026, 05:50 UTC
Updated
3 Sep 2026, 07:00 UTC
Resolved
3 Sep 2026, 07:00 UTC

Description

Our Warrington night shift says 11 people couldn't sign in last night between about 23:20 and 23:40 UK time, an "Access denied" page. Fine since. Your status page said something about slow sign-in. What happened?

Daniel

Linked issues

Comments (4)

Ines Costa · 3 Sep 2026, 06:15 UTC

Hi Daniel, sorry about that. Overnight someone ran a large attack against password sign-in, trying email and password pairs stolen from other websites. One of the first blocks our engineer put in place was too wide and also refused your Warrington night shift for about 20 minutes, until it was narrowed. That one is on us. Our security lead is going through everything this morning, and we'll write to the customers affected today.

Oskar Lund · 3 Sep 2026, 06:30 UTCInternal note

OPS-41. The temporary block on whole networks caught Warrington's night-shift sign-ins until it was narrowed. Runbook to say: narrow a network block before using it.

Daniel Okafor · 3 Sep 2026, 06:50 UTC

OK, thanks for being straight about it.

Ines Costa · 3 Sep 2026, 07:00 UTC

Closing. We're changing our runbook so a block like that is narrowed before it's used.