Why YSK? Comments you reply positively to, should definitely get your upvote. Comments you disagree with should be at your discretion. Trolls deserve downvotes (seriously, they live for those). Disagreeing with someone in the midst of a good discussion doesn’t necessarily warrant one, and might deserve an upvote. Even if you don’t reply, but you agree with the comment, give it your vote.
Also, this has nothing to do with propping up folks’ egos. Comments with more upvotes will likely be seen first the longer the post is up. Alternatively, downvoted posts are less likely to be seen unless users are looking for them.
Of course, this can lead to folks accusing communities of having leftist/right-wing bias, but I think overall it improves the usage of the site. Personally, the thing I liked most about Reddit was the conversations in the comments. Usually the ones with the most upvotes were more worth the read & engagement.
If you want your community to stay healthy, then voting on posts simply means one thing: This post is a good fit for this community.
You don’t have to like it or agree with it, that’s not the point. This is to improve the service for your fellow community members, as they will then become more likely to see posts that fit, and less likely to see ones that do not. They can then decide for themselves if they like or do not like the actual contents.
Voting on comments is another story, and is much more up to user discretion and the community culture. Vote however you like on comments.
Also, be aware, downvoting a post into oblivion does not make less people see it, it makes more people see it. We all love checking the downvote bombed posts from time to time, sometimes they can get downright hilarious, in a sad sort of way.