Fancy maybe wouldn’t be the best word, perhaps exotic, but I know there’s plenty of us who, depending on the Aussie, might not be able to tell the accent from a British one and just go “ooh, accent, fancy”.
As an American I feel like either US or UK could be considered the “normal” one, UK or AUS the “fancy” one, and US and AUS the “wildcard” (from the UK perspective).