I have a strong sense that one of the big things that's going wrong in conversations about alignment is the fact that "how long can agents work autonomously on a task" is The Metric for progress.
@JerusalemDemsas I think Trump's SI rebrand was a classic Trump move of trying to reclaim a word after Bernie tried to specifically ban "Super Intelligence".
He did the same with "fake news". It's a way to confuse the conversation when a problematic term for him pops up.
@ezraklein I'm not sure if you've ever seen this (it opens with you hilariously enough), but this is an example of Hasan Piker having a strong aesthetic POV:
youtu.be/pPAP2_TmZxU?is…
You don't have to like it but it's a real yearning in the way you were gesturing towards.