The article's perspective reminds me of math class when I was a kid. The teacher didn't want the right answer alone, she wanted to see how I got there. In an absolute sense, the right answer is the right answer with or without my understanding, but that's not how the class was graded. We're approaching a point where AI is to science as my old calculator is to elementary school math -- it's capable of leapfrogging to answers faster and more accurately than we can.
Thing is, though, verification is knowledge itself. And if we can get to a point where the important questions have answers, we can surely have the verifiers explain those to us in ways we can understand them.
This is not obvious to me at all. LLMs are capable of amazing feats of reverse engineering but are terrible at explaining and abstracting things well.
I think this is an artefact of how we train them, and they could be trained to be better at this if we focused on it, but at the same time, it shows its possible for these things to be able to do things they cant explain to us (granted, they can't explain them well - you can bash your way to understanding with them anyway but they aren't good at it)
I don't think we're there yet for science. Perhaps for math proofs, but that's a very different domain ultimately since we know the rules of the game in a way we don't with science.
Meaning requires integration. But I assume AI can make meaning of it, now or in the future. I assume the same with people. However I don’t see the point of knowledge without meaning.
I would prefer relation or context instead of integration. Meaning is contextual. Understanding is the process of attaing the meaning or a meaning. Knowledge in this perspective is the final outcome that can be verified in some way or you assume so.
"Is science about humans achieving insight, or the archiving of verifiable solutions?"
I wonder if this dichotomy fully captures the value of scientific discoveries. One could argue that their practical impact can be independent of whether humans fully understand how they were reached.
Practical impact has always been linked but ultimately independent of knowledge. You can have very sophisticated technology based on zero actual knowledge or understanding, like roman concrete or borosillicate glass. And you can have a very deep understanding without practical impact, like lasers for decades or galactic algorithms for multiplication.
The problem is distinguishing short term from long term progress. A solution alone can be useful in the short term, but if humans don't also build up understanding it will probably prevent long progress from happening. It's much more difficult to build on top of something you don't understand.
I would rephrase it as: "Verification is not human knowledge", but that doesn't really matter. We are going to be several steps behind AI as it reaches a level of intelligence far beyond human capabilities, and we are not going to be able to catch up with it. It's like trying to beat AI at chess: we are bound to be left behind as AI continues to expand its knowledge in mathematics, physics, computer science, and other fields. Eventually, no human being will be able to reach that level of knowledge within their lifetime.
I have doubts about that. You don't need AI (understood as the current LLMs) to make a powerful chess engine, or computer vision or anything that reacts faster and better than a human. We've had those forever.
A good word predictor happens to be good with closed systems with very defined rules for which a huge training corpus exists and we are suddendly freaking out about how it's gonna become so much better than us at everything that we are basically obsolete.
When in doubt about where AI stands, ask it to create a poem, a joke or a riddle. And see how little actual intelligence it has.
No need to start worrying about AI reaching a level of intelligence far beyond human capabilities until it actually reaches the level of humans and assuming that ever happens it could be a very very long way off. All of the intelligence "AI" has right now comes from the human data that it was trained on. It's been given enough power to crunch numbers better than we do, as any computer can, and more data to play with than any one human can retain, but none of that equals intelligence. Speculating on a sci-fi future however, if AI is ever able to create new and more advanced forms of AI, which can also create new and and more advanced forms of AI we'll be outpaced quickly.
As long as humans are in charge it's vital for us to understand what is going on - be it in science or coding, once you give up all knowledge (yes knowledge = power) not just work to AI, you can be manipulated/controlled/fooled with ease.
How do we know if/when that happens if it’s beyond us to comprehend. An open ended and broad claim like this can always become true one day, similar to flying cars.
Ive never heard such drivel in my life. Are you a shill? The current "AI" is not intelligent, it can beat humans in certain areas but weve always had that with things like Deep Blue. I dont believe llms will reach human intelligence and certainly not super intelligence.
Thing is, though, verification is knowledge itself. And if we can get to a point where the important questions have answers, we can surely have the verifiers explain those to us in ways we can understand them.
This is not obvious to me at all. LLMs are capable of amazing feats of reverse engineering but are terrible at explaining and abstracting things well.
I think this is an artefact of how we train them, and they could be trained to be better at this if we focused on it, but at the same time, it shows its possible for these things to be able to do things they cant explain to us (granted, they can't explain them well - you can bash your way to understanding with them anyway but they aren't good at it)
I wonder if this dichotomy fully captures the value of scientific discoveries. One could argue that their practical impact can be independent of whether humans fully understand how they were reached.
A good word predictor happens to be good with closed systems with very defined rules for which a huge training corpus exists and we are suddendly freaking out about how it's gonna become so much better than us at everything that we are basically obsolete.
When in doubt about where AI stands, ask it to create a poem, a joke or a riddle. And see how little actual intelligence it has.