I think the problem is that humans are not random, they are very biased. When you try to capture this bias with an LLM you get a biased pseudo random model