Pandotic · Field Notes
Talk Nerdy
To Me
A map for navigating the AI ecosystem — what the words mean, what's hype, and how not to get lost or locked in.
12 min reador skip aroundyour call
You got on a call. Someone said "we'll wrap a RAG layer around your knowledgebase and expose it through an agent with tool use, then harden it for production." Everyone nodded. You nodded. Inside: I have no idea what just happened, and I'm not about to be the one who asks.
Here's the secret the room won't tell you: the words are mostly simple. The complexity is sold to you. This isn't really a glossary — it's a map. It tells you what each landmark is, which ones matter, which ones are scenery someone's charging you to look at, and how to move through this place without getting lost or trapped.
Every concept comes with three videos — a roughly one-minute hit, a five-ish-minute version, and a deep dive — so you can stay at map-level or go all the way down, your call. But before any of that, three rules that matter more than any definition here.
How to navigate any AI conversation
1
The words are simple; the build is hard. Anyone making the vocabulary sound complicated is selling difficulty. The real difficulty is never the concept — it's the gap between a thing that demos and a thing that runs.
2
The money and the risk live in that gap. "It works in the demo" and "it works as a business" look identical for about ten minutes. Almost everything that matters is invisible in a demo. Learn to ask about the invisible part.
3
The landscape moves monthly — don't get married to it. Whatever's "best" today won't be by the time you've built on it. The goal is never to pick the right model. It's to never be a hostage to the one you picked.
Hold those three. Everything below is just terrain.
The Big Divide · Read This One
The line between a weekend project and a company
Vibe coding is building software by describing what you want to an AI and accepting what it gives you — without reading the code. Coined by Andrej Karpathy in early 2025; Collins Dictionary named it the 2025 Word of the Year; Y Combinator reported a quarter of its Winter 2025 batch had codebases that were 95% AI-generated. It is, genuinely, the best prototyping medium ever invented. We use it. You should too.
But the engineer Simon Willison drew the line cleanly: if an AI wrote every line but you reviewed and understood it all, that's just a fast typist. Real vibe coding means nobody is minding the code. That's the difference between the thing you built during soccer practice and a company.
The soccer-practice version works — on your laptop, with one user (you), with happy-path data, on the afternoon you demoed it. A company is what happens when:
- A stranger uses it at 2am and does something you never imagined.
- Two people save the same record at the same time.
- The data is still there — and correct — in eighteen months.
- Someone tries to break in, because someone always does.
- It bills people, and the billing is right, because that's the law.
- It keeps working when the model underneath it changes (it will).
None of that is "vibes." That's the unglamorous 80% — auth, data integrity, security, scale — that doesn't demo well but is the entire reason businesses don't fall over. A December 2025 CodeRabbit study found AI-co-authored code carried roughly 1.7× more major issues than human-written code. One vibe-coding platform shipped apps that leaked personal data; another's agent deleted a production database despite being told not to. Not reasons to avoid the tools — reasons not to ship the tool's first draft.
This is the Pandotic part.
Our favorite project starts with "I vibe-coded this over a weekend and people actually want it — now what?" That's the ideal place to start. The hardest question in product — does anyone want this? — already has a yes. We take the working-but-fragile prototype and turn it into something a business can stand on, without throwing away the idea or the momentum that got it there.
You can vibe-code your way to "it works on my screen." You cannot vibe-code your way to "it's a company." That bridge is the work. That bridge is us.
Chapter 1
Speaking the language
The handful of words you need to stop being lost in the room. Not the engine schematics — just enough to follow the conversation and call the bluffs.
01 LLM (Large Language Model)
Why it's on the map: it's the engine everything else bolts onto. "The model" = this.
Trained on enormous amounts of text to predict what comes next — and doing that well looks a lot like reasoning and writing. ChatGPT, Claude, and Gemini are interfaces on top of LLMs. That's the whole concept. Everything else on this map exists because a raw LLM, by itself, doesn't know your business and will confidently make things up.
02 Tokens & the Context Window
Why it's on the map: it's why an AI "forgets" — and it's a hidden cost lever you should ask about.
A token is the chunk an AI reads text in (~¾ of a word). The context window is how much it can hold in working memory at once. When a model loses the thread of a long conversation or a big document, this is usually why. You don't need the math — you need to know it has a limit, and that limit costs money.
03 Hallucination
Why it's on the map: the single biggest reason "just put AI on it" is dangerous without a plan.
When an LLM states something false with total confidence. Not lying, not broken — predicting plausible words, and sometimes the plausible answer isn't true. It's structural; you don't patch it out, you design around it. (The design is mostly the next chapter.)
04 Prompt Engineering
Why it's on the map: the cheapest lever — often closes most of the gap before anyone spends a dollar building.
Writing instructions an LLM can actually follow — clear directions, examples, a role, an output format. Less "magic words," more "being an unusually precise manager." When someone proposes expensive infrastructure before they've tried a sharper prompt, that's a flag.
Chapter 2
Toy vs. tool
Everything here exists to answer one question: is this a clever demo, or something a business can actually run on?
05 RAG (Retrieval-Augmented Generation)
Why it's on the map: the answer to "can it use our knowledge without retraining anything?" Yes — this is how.
The most useful pattern on the map. Instead of hoping the model "knows" your business, you retrieve the relevant facts from your own documents first and make it answer from those — with sources. Open-book exam, not closed-book. The main practical defense against hallucination.
06 Embeddings & Vector Databases
Why it's on the map: "we'll embed your docs" = search that understands meaning, not just keywords.
The machinery under RAG. An embedding turns text into numbers that capture meaning ("cancel my plan" lands near "close my account"). A vector database stores millions and finds the closest matches fast. You don't operate it — you just need to know that's what's happening when someone says it.
07 Fine-Tuning
Why it's on the map: usually the thing to not start with. Prompt first, RAG second, fine-tune only if proven.
Actually training the model further on your own examples. Powerful, heavier, pricier — and rarely the right first move. When a pitch leads with "let's fine-tune a model," the useful question is "have we exhausted the cheap levers first?"
08 MCP (Model Context Protocol)
Why it's on the map: the reason connecting AI to your tools no longer means a tangle of one-off wiring that rots.
A 2024 open standard for plugging AI into tools and data through one consistent interface — the "USB-C port for AI." It quietly matters a lot, because portable connections are the difference between a system you can evolve and one you have to rebuild.
The Divide · Product vs. Prayer
Knowledgebase: a product, not a prayer
RAG is the technique. A knowledgebase is the thing it runs on: a curated, maintained body of your truth the AI is required to answer from. This is the single clearest line on the whole map between a toy and a tool.
An LLM with no knowledgebase, asked the same question twice, can give two different answers — both confident, neither sourced, both possibly wrong. That's not a product. That's a prayer. A knowledgebase turns "it usually gets it right" into "it gives the same correct, sourced answer every time — and when your policy changes, you change one place, not the model."
An LLM with no knowledgebase is a confident stranger. A knowledgebase turns it into your colleague.
It's the least flashy and most load-bearing thing in the stack — which tells you exactly which parts of this ecosystem actually matter, and which parts are scenery.
Read the deep dive: Controlling the Truth — why AI needs a knowledge engine →
Chapter 3
The agentic shift
The biggest, loudest, most over-sold movement in the ecosystem right now. Here's how to tell the shift from the sales pitch.
09 Chatbots vs. Agents
Why it's on the map: the question that cuts through the hype — what is it actually allowed to do?
A chatbot answers — you ask, it replies, the conversation is the product. An agent acts — it takes steps in the world (look something up, update a record, send the email) to get a task done. Most things called "an AI agent" in a deck are really a very good chatbot with a knowledgebase — and that's frequently exactly what you want. The word "agent" should trigger one question: what's it allowed to do, and what's the damage when it does the wrong thing?
10 AI Agents (& "Tool Use" / "Function Calling")
Why it's on the map: workflow-vs-agent is the line between a plan and an ambition.
An agent is an LLM that takes actions in a loop — decide, do, check, decide again. Tool use (a.k.a. function calling) is the mechanism that lets it actually do things. The line worth stealing: a workflow is steps you fixed in advance; an agent decides the steps itself. Agents are more powerful and less predictable. The grown-up move is the least autonomy that solves the problem.
11 Agentic AI (the umbrella everyone's selling)
Why it's on the map: the single most inflated phrase in the ecosystem this year. Translate it before you trust it.
If a chatbot answers and an agent does a task, "agentic AI" is the umbrella term for the whole paradigm — software that pursues goals over many steps with minimal hand-holding, chaining tools and decisions together. It's a real shift. It's also the phrase currently glued onto roughly everything to make it sound inevitable and expensive.
Here's the translation that protects you. When someone says "it's agentic," what you actually need to know is three things: how much autonomy does it really have, where exactly does a human stay in the loop, and what's the blast radius when it gets something wrong? A genuinely agentic system has crisp answers. A sales deck has the word in the title and a demo on the happy path. Most things pitched as "agentic" should, honestly, be scoped workflows with one or two agentic moments — and that's not a downgrade, it's the version that works in production.
"Agentic" is not a feature. It's a question about autonomy, control, and consequences — and most pitches don't survive being asked it.
Chapter 4
Don't get locked in
The last stretch of the map is about ownership — making sure the thing you build is yours, and survives a landscape that won't sit still.
12 No-Code / Low-Code
Why it's on the map: the real question is never "code or no-code" — it's "what's the migration story when this works?"
Build software with visual blocks instead of (much) handwritten code. Great for speed, validation, and "does this even work." The trade-off arrives later: ceilings on control, portability, and cost-at-scale. Not a dirty word — a stage. The skill is knowing when you've outgrown it before it traps you.
13 MVP / Prototype vs. Production
Why it's on the map: the entire plot of this guide. They look identical in a demo. They are not the same object.
Prototype proves the idea. Production survives real users, real data, real attackers, real money. The most expensive misunderstanding in software is treating the first as the second. Most of the value — and most of the work — lives in the gap between them.
14 Backend-as-a-Service (e.g., Supabase)
Why it's on the map: a lot of where "turn the prototype into a company" actually happens. Nobody screenshots it.
The unglamorous foundation: database, accounts, authentication, file storage, security rules. A backend-as-a-service gives you a real, production-grade version of all that without building it from scratch — fast, without being a house of cards. This is where ownership gets real.