I like the thought behind this idea but I don't think it's a good solution. It requires having a reputation score, which I think outweighs the positives here. I could also see people trying to play this system in a couple different ways, which is just plain bad for discussion culture: encourage others to downvote something without spending the reputation yourself, or collect downvotes with bait content in order to eat through other peoples reputation.