Access report for Vossberg times out after 60 seconds

Summary

Vossberg's administrators couldn't load the Access report for the whole organisation: the API took about 190 s and the gateway gives up at 60 s. Reports filtered by depot worked.

Impact

Vossberg only (6,500 people, 60 depots, 140 bundles). Bettina Hahn needed the whole report for their quarterly review and waited most of a day for it (SUP-1195).

Timeline (Tuesday 29 September)

• 09.10 Ticket SUP-1195: the report never loads.
• 09.55 Opened here. Jonas and Oskar on it.
• 10.30 Jonas: 190 s in the API. Grants loaded one person at a time, bundle grants one item at a time.
• 10.45 Workaround to Vossberg through Yusuf: filter by depot, a few seconds each.
• 15.20 Gateway timeout for this endpoint raised to 240 s as a stopgap.
• 15.55 Bettina has the whole report (3 min 20 s).
• Tue 6 Oct 11.30 Fix deployed: API 11 s. Timeout back to 60 s.

Cause

The slowness noted in March (ENG-1361), made worse by bundles and by the 19 depots added on Friday.

Follow-ups

• The fix: ENG-1767