I've updated to PHP 8.1.12
And set my agent login to SSO only
And I've just noticed that my username is not my email address (which is what I'd be using for SSO). I'll create a new agent and set their username to their email address and try again.
I really hope it wasn't something that simple...
[Edit] It looks like I can't use the @ symbol in the username field.