Limit the number of votes :)
The UserVoice seems to have unlimited votes per user (I'm not running out). Some other products gave a quota, which makes one think more and leads to more presentative vote counts.
(Also, no category for improments on UserVoice forum itself.)
Sean Ellis commented
Each user may vote on each idea once. This seems fair to me and avoids the ranked voting paradox.