Give users a few down votes they can use over a period of time.