Haters only give you free publicity as long as you're not retarded enough to let them affect you or your business in the first place, something not many creators in the vtuber space have nowadays (see, Nijisanji EN, lean/cuckposting era Mori, Mysta/Kuro, Froot). If you can conviniently label them as wrongthinkers it helps but the pendulum can always bouce back under the right circumstances (see, Uki's current controversy).
VSJ is riding the current high of saving Pikamee and being relatively controversy-free ever since they cut the 3 hoemigos out, but they are built on an interesting house of cards that can either collapse or have a million skeletons revealed, although considering Nux and Evanit0 are the only sources of those skeletons, maybe they dont have as much as we think