"Note that you cannot simply say that you will build A.I. that only offers pro-social solutions to the problems you ask it to solve. That’s the equivalent of saying that you can defuse the threat of McKinsey by starting a consulting firm that only offers such solutions." get their asses Ted https://www.newyorker.com/science/annals-of-artificial-intelligence/will-ai-become-the-new-mckinsey
I do not love that in 2023 a totally smart writer still has to include a disclaimer that "whenever I criticize capitalism, I’m not criticizing the idea of selling things" in the goddamn New Yorker
Honestly my only disagreement here is when Chiang writes that "it’s not the job of A.I. to strengthen capitalism...yet that is what it currently does." I think by the time of the Dartmouth conference John McCarthy had pretty explicitly renounced the Communist beliefs his organizer parents raised him on and IMO McCarthy's (and Minsky's, and the other guys)' political beliefs are part of the story of AI's intellectual history
I use "Finance capitalism" for the system that plays with us, versus "market capitalism", the formal system of exchange we play in.
@ingrid Yeah, I get that, too, but I think also if the goal is to fully vivisect the values that drive the current "A.I." spring, then that at least is worth a mention