I’m no expert, so take what I’m about to say with a grain of salt.
Fundamentally, a LLM is just a fancy autocomplete; there’s no source of knowledge it’s tapping into, it’s just guessing words (though it is quite good at it). Correspondingly, even if it did have a pool of knowledge, even that can’t be perfect, because the truth is never quite so black and white in many areas.
Very difficult, it’s one of those “it’s a feature not a bug” things.
By design, our current LLMs hallucinate everything. The secret sauce these big companies add is getting them to hallucinate correct information.
When the models get it right, it’s intelligence, when they get it wrong, it’s a hallucination.
In order to fix the problem, someone needs to discover an entirely new architecture, which is entirely conceivable, but the timing is unpredictable, as it requires a fundamentally different approach.
Genuine question: How hard is it to fix A.I. Hallucinations?
I’m no expert, so take what I’m about to say with a grain of salt.
Fundamentally, a LLM is just a fancy autocomplete; there’s no source of knowledge it’s tapping into, it’s just guessing words (though it is quite good at it). Correspondingly, even if it did have a pool of knowledge, even that can’t be perfect, because the truth is never quite so black and white in many areas.
In other words, hard.
Very difficult, it’s one of those “it’s a feature not a bug” things.
By design, our current LLMs hallucinate everything. The secret sauce these big companies add is getting them to hallucinate correct information.
When the models get it right, it’s intelligence, when they get it wrong, it’s a hallucination.
In order to fix the problem, someone needs to discover an entirely new architecture, which is entirely conceivable, but the timing is unpredictable, as it requires a fundamentally different approach.
[This comment has been deleted by an automated system]