No they’d just be happy that there’s less people they have to convince to vote for them. Less people voting means it’s easier to pass policies that enrich them. You aren’t doing some meaningful protest, you’ve removed yourself from the conversation.
There’s tons of money in seeding voter apathy and people like you are why. They get you to remove your own voice and make you think you’re hurting them and not yourself.