Or: a gentle introduction into the architecture of GPT-style Large Language Models (LLM). What does GPT stand for? GPT stands for Generative Pre-trained Transformer. Let’s break that down: Generative: This means it can generate or create new text, like writing a story, answering questions, or even composing emails. Pre-trained: Before you use it, the model… Continue reading How does ChatGPT know where the ketchup is?
Tag: Hallucination
RAG beats GPT hallucinations: the story of Einstein and the light bulb
An often mentioned problem with GPT models such as ChatGPT is the “hallucination” issue. Luckily, there is also a solution for it: RAG, short for Retrieval-Augmented Generation. Let’s break down how RAG helps reduce “hallucination” in AI, using simple terms and relatable examples. What is Hallucination in AI? Hallucination in AI happens when a model… Continue reading RAG beats GPT hallucinations: the story of Einstein and the light bulb