Black Friday sale: an extra 40% off every course until Monday, November 30.New Year sale: an extra 30% off every course until Friday, January 1.Memorial Day sale: an extra 25% off every course until Monday, May 31.SysAdmin Day sale: an extra 25% off every course until Sunday, August 1.Back to School sale: an extra 25% off every course until Sunday, August 22.Labor Day sale: an extra 25% off every course until Monday, September 6.Black Friday sale: an extra 40% off every course until Monday, November 29.New Year sale: an extra 30% off every course until Saturday, January 1.Choose your certification →

Copyright (c) 2026 MindMesh Academy. All rights reserved. This content is proprietary and may not be reproduced or distributed without permission.

3.1.1. How Generative AI Models Work

💡 First Principle: Generative models work on tokens — small chunks of text (roughly word-pieces). You send a prompt (tokens in), the model predicts the most likely next token, adds it, and repeats until done, producing a completion (tokens out). It's prediction all the way down; there's no fact lookup happening.

Two terms you must know: the context window is the maximum number of tokens the model can consider at once (prompt plus completion) — exceed it and the model "forgets" the earliest content. A large language model (LLM) is a generative model trained on enormous text corpora to do this prediction well across many topics. Because the model predicts plausible continuations rather than retrieving verified facts, it can generate fluent text that's wrong — the hallucination problem from Phase 1, now with a mechanism attached.

⚠️ Exam Trap: Tokens are not the same as words. A long word may be several tokens; punctuation and spaces count too. Pricing and context-window limits are measured in tokens, not words — a distinction the exam likes to probe.

Reflection Question: If a model has a fixed context window and you keep adding to a long conversation, what eventually happens to the earliest messages, and why?

See how it connects
Alvin Varughese
Written byAlvin Varughese
Founder•26 professional certifications earned