It would. An anarchist system requires participation at all ends from just about everyone. If you forfeith your vote once, you’ll forfeight it again, not because of a conscious choice, but because you empowered others to make your choice for you in the first place.

Anarchy is not about comfort. Its about freedom, as nebulous as that term is, and freedom, as has been said many many times, is not free.