It reduces suffering of potential unwanted offspring and the suffering of local bird populations so I would argue that it’s unethical to not spay or neuter your cat, even if the individual cat suffers a bit from it.
I think there is an interesting argument on whether it’s ethical to keep pets at all however