osTicket does not have the concept of limiting how many tickets an Agent can have assigned to them.
I dont know how you would get SQL to impose a limit like this.
You can probably modify the core files to achieve this, but with all mods, you would be on your own to implement it.