I feel downvotes are fairly useless.
They're used as a disagree button. Ok but why do you disagree? Leave a reply and let's discuss. Gain saying has little value and that's all a downvote to disagree is.
They're used to report spam. Spam should be reported so I don't think that's a valid argument for them. Downvoting spam leaves it up, reporting spam gets it taken down. We have a better solution to spam than downvotes.
They are used by bad actors, with the removal of downvotes bad actors have to spend more effort in making a comment and it becomes far more obvious in who they are, report and block them.
Finally downvotes are a way to yuck someone's yum, I'm mindful of the instance we're on. I don't want our communities to become like Reddit where only one genital configuration and body type are allowed.