I mean yeah, but you could already do that now

Yes, but because the votes are not private, I can be found out by correlating votes. Like if I made another account and just used it to always upvote everything my first account posts, that would be pretty obvious. If votes are private, there is no way to find out such conduct.