I just chatted with my brother Balazs about OpenAI's papers. He was super pumped about some of the results. One thing, of course, is the matrix multiplication paper. He used to work on this 20 years ago and said that he located an ingenious-looking computational trick in the new
Up until last year, all these results would be papers separated by years, waiting for peer review for months, communicated in arxiv papers first, published after a year in some journal.
Now, all that research using AI and formal tools can be compressed into hours.
I've just made a live tracker for the community effort for optimizing the "Integer multiplication below n log n" mathematical problem, so everybody can see the progress on it: beyond-n-log-n.netlify.app
That's why I believe strongly that formal verification will be a critical component of being able to use superhuman AI.
Formal verification is a cheat code by which a really dumb program can check an output produced by a superintelligent entity.
An expected outcome of increasingly intelligent entities is that people using them increasingly dont understand what they are saying. It already happens between humans. It will happen more and more with AI.