I think I figured it out and I am very annoyed.
It looks like Outlook is suddenly not displaying the alias as the alias email when it is an internal email address that is being replied to. This wasn't the case a month ago, so something may have changed on the client side.
It appears, externally, clients display the email it actually came from.
Anyways, thanks for all your help as always!