In some configurations outlook will replace links with something like this (domain is incorrect, but here’s the gist) outlookvirusscanner.outlook.com?scanredirect=theoriginalink.com
So yes, that WILL slow you down, but there is a valid reason for it. If that’s the reason I have no idea why the others wouldn’t be slow. It might just be a I use x at home vs y at work type deal?