Your comment is a perfect example of a human hallucinating something and not knowing they are wrong about it. People are confidently wrong about things _all the time_.
No no, you don't understand. People can misunderstand. But they will not, for example, proceed to drive a car as if they have attended driving lessons when they have not.
They might misremember, but they can know, for sure, if they have NOT come across some information. So if you ask someone if they know where `x` is, they might have came across that info, and still be wrong. But they will know if they have never come across it.
A neural network will happily produce an output when when the input is completely out of range of the training data.
> if you ask someone if they know where `x` is, they might have came across that info, and still be wrong. But they will know if they have never come across it.
False memories are super common. "I thought I had seen this thing there, but turns out it's not" is a perfectly normal, very frequent occurrence.
If someone ask "Hey how do I do this thing in python programming language" what are the chances that you will try to make up a solution, if you have never tried to learn Python?
Q: How do I reverse an array in the Navajo programming language?
A: I'm not familiar with a programming language called "Navajo." It's possible you might be thinking of a different language, or it could be something very niche that I don't have information about.
---
As for your question, the chances go from 0 to 100% depending on how many languages I already know and whether I have an idea (or I think I have an idea) of how python looks like. And LLMs have seen (and tried to "learn") pretty much everything.
