The thing is, downvotes mean whatever the person downvoting feels like they mean. Personally I don’t downvote anything, only upvote.
It would be interesting to have a bot that looks for bad actors—by that I mean users who abuse the downvote and do not use it the way the community agrees that it means. And have a mod review and take action if necessary.