Assalamualaikum
Not just reputation, but sympathies from people will lead you to more depressing thoughts. You will get drained into it which will eventually affect your health, I believe.
Absolutely, don't let yourself be oppressed so much. It's not good. Know that there isn't any barrier between the invocation of oppressor and Allah SWT. Umm... Is there any way you can convey this bold written message to them? It can be indirectly. At least it will instill a fear in their hearts ,even if it's of atom's weight. Don't give up, try all the means,if they don't work wait for justice in akhirah. This life is gonna end soon and you will definitely get justice from the BEST JUDGE.
There's a hadith I got:
Narrated Abu Huraira: Allah's Apostle said, "Whoever has oppressed another person concerning his reputation or anything else, he should beg him to forgive him before the Day of Resurrection when there will be no money (to compensate for wrong deeds), but if he has good deeds, those good deeds will be taken from him according to his oppression which he has done, and if he has no good deeds, the sins of the oppressed person will be loaded on him."