For others, it's a top reason not to vote for him.