15. Hallucinations, or AI don’t do facts

Language models are completely unsuitable for use as information systems because of their pervasive ‘hallucinations’.

Summary

Large Language Models have a tendency to hallucinate and fabricate nonsense in ways that are hard to detect. This makes fact-checking and correcting the output very expensive and labour-intensive. These hallucinations appear in AI-generated summaries as well, which makes these systems unsuitable for many knowledge- and information-management tasks.