I think the Nightshade algorithm is less like a poison and more like antibiotics. It works because it’s rare.
If it stops being rare, it will stop working.
@vruba indeed. the metaproblem is that there’s no way to tell if it’s working, so people may be happy to adopt some completely ineffective system
@jes5199 (A rule of thumb is that if you can gradient-descend your way into something, you can gradient-ascend your way out of it, and while this is not always true in practice, I think it at least complicates a lot of claims made for unbeatable adversarial this-and-that.)