39 of 81
ContentsPart III · Chapter 9

Chapter 9How it all fits together

Build your own

Because the four parts are separate, they can be swapped. The same model can sit in a chat app, a coding agent or an assistant inside your email. Some harnesses let you choose among models from several companies,12 and the same harness can be given different tools. So what you experience is the combination: how good the answers are, where your words go and who approves actions. It is not the model alone.3

Here are three combinations, described by their parts. The verdicts are general rules of thumb written for this book, not a review of any product, and every real product is set up in its own way.

  • A mid-size model in a chat app, with web search. Good for questions, drafts and explanations, including ones that need fresh information. Not good for acting on your files or other systems: it mostly writes text back to you. Your words go to the company that runs the app, under the terms of your account. There is little to approve, but every page it reads is text that could try to give it orders.
  • A top model in a coding agent, with your files and a terminal. Good for changing code, running tests and other long, many-step jobs on a project; coding agents of this kind edit files and run commands.45 Your files are read on your computer, and what the model needs to see is sent to the model’s provider. You approve actions, command by command or through settings you choose.
  • A small model on your own computer, with the text you give it. Good for narrow, private jobs, such as tagging or summarizing documents you supply; once downloaded, such models can run without an internet connection.67 Not good for broad factual questions without a source: one maker says its small model lacks the capacity to store much factual knowledge.8 Your words can stay on your machine. You approve whatever you set up.

Run the lawyer’s job through the same questions. He needed real decisions, so the combination that fit was a harness with a tool connected to a real legal database, plus the check his profession required. Any capable model in a setup like that reads real decisions. Even a brilliant one in a setup without it reads none.

ChatGPT launched in 2022 as a chat app.9 As of October 2026, the Claude app offered web search as one of its tools.10 Claude Code and OpenAI’s Codex were coding agents of the second kind.45 Hermes Agent, an open-source AI agent, could run on your own server with a model you choose.2 Spot it today: name the brain, the body and the hands of the AI tool you use most. The names change; the four parts don’t.

Try it: choose a brain, a body and hands, and see what the combination is good for.

Build your own AI system

Illustration

Interactive Pick a ready-made system, or choose a brain, a body and hands, and see what you get.Try it on the web: aifromthepartsup.com/how-it-all-fits-together/5/

Good for
Not good for
Where your words go
Who approves actions

Illustration. The presets are typical setups, with real products as examples; the results are general rules of thumb written for this page, not a product review, and each product lets you choose among models. Examples: the Claude app,11 Claude Code,4 ChatGPT,9 Codex,5 Hermes Agent.2 As of October 2026

Your turn

Try it. Pick a question from your own work that needs current information, such as a rule or schedule that changed recently in your field, and ask any AI tool you already use. Then look for the loop. Did the app show that it searched, or list its sources? Did it ask you before doing anything? If it showed no search, ask it to find sources and see whether the answer changes. Then test this chapter’s main claim by naming each of the four parts in what you just used. On paper instead: choose a task you would like help with, write out the six steps of Figure 9.1 for it, and mark the step where you would want to be asked first.

Think about it. Think of one AI tool you use at work, or might. If its answers kept going wrong, which of the four parts would you check first? And who in your organization controls that part?

So between your question and its answer, a loop runs. The harness briefs the model, the model predicts an answer or asks for a tool, the harness checks and acts, and the result goes back in until the answer comes out. Every turn of that loop carries your words somewhere: into a briefing, onto a company’s servers, into a tool. Where they go, and who may keep them, is the subject of the next chapter, which opens Part IV.

Check in

Try answering in your own words, then open each one to compare.read the answer to compare.

Name the six steps of the loop, and the part that does each.

You ask the harness. The harness builds the briefing. The model reads it and predicts an answer or a tool request. The harness checks the rules, asks you if needed and runs the tool. The result goes back into the briefing, and steps 3 to 5 repeat. The harness hands the answer back to you.

An AI assistant greets you by name and mentions a project you described last week. Has the model learned about you?

No. Using the model doesn’t retrain it. The harness saved a note and put it into this week’s briefing. As Chapter 2 put it, the model works only from what is on its desk right now.

A teacher asks an AI chat tool for three recent articles on a topic. It gives titles, authors and links, and one link leads nowhere. Using the loop, what might have happened, and what should she do?

If no search ran (no tool request, no result in the briefing), the model wrote plausible titles from patterns, just as it wrote the lawyer’s cases in Chapter 1. Even when a search runs, its result is only text. She should look up each article herself in a source she trusts before assigning it.

A colleague proposes paying for the biggest model available “so it stops making things up.” Is that the best fix?

Not by itself. Even state-of-the-art models still guess, and Chapter 5 showed that the biggest model is often more than a job needs. Putting a real source in front of the model, through a search or document tool, and keeping a person at the approval step changes more. Choose the model for the job, then look at the parts around it.

An HR manager wants a summary of 200 private comments from an employee survey. Of this chapter’s three combinations, which fits best, and why?

By the chapter’s rules of thumb, the small model on her own computer: summarizing text she supplies is a narrow, private job, and the words can stay on her machine. A chat app would send them to the company that runs it, which her organization may or may not allow (Chapter 10). Either way, she checks the summary against the comments.

End of Part III, The parts at work.Next: Chapter 10: Where your words go →

Notes (11)
  1. 1GitHub, “Supported AI models in GitHub Copilot,” GitHub Docs, https://docs.github.com/en/copilot/reference/ai-models/supported-models (accessed October 26, 2026).
  2. 2Nous Research, “hermes-agent,” Nous Research (GitHub), https://github.com/NousResearch/hermes-agent (accessed October 26, 2026).
  3. 3Yilun Yao, Xinyu Tan, Chao-Hsuan Liu, Yaoming Li, Zhengyang Wang, Zongwei Lv, Wenhan Yu, et al., “Harness-Bench: Evaluating Agent Harnesses across Models and Realistic Workflows” (preprint, arXiv, October 15, 2026), https://doi.org/10.48550/arXiv.2605.27922.
  4. 4Anthropic, “Claude Code overview,” Claude Code Docs, https://code.claude.com/docs/en/overview (accessed October 26, 2026).
  5. 5OpenAI, “openai/codex,” GitHub, https://github.com/openai/codex (accessed October 26, 2026).
  6. 6Microsoft, “Phi open models,” Microsoft Azure, https://azure.microsoft.com/products/phi (accessed October 26, 2026).
  7. 7LM Studio, “Welcome to LM Studio Docs!” https://lmstudio.ai/docs/app (accessed October 26, 2026).
  8. 8Marah Abdin, Jyoti Aneja, Hany Awadalla, Ahmed Awadallah, Ammar Ahmad Awan, Nguyen Bach, Amit Bahree, et al., “Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone” (preprint, arXiv, April 2024 (v4 2024-08-30)), https://doi.org/10.48550/arXiv.2404.14219.
  9. 9OpenAI, “ChatGPT: Optimizing language models for dialogue (now 'Introducing ChatGPT'),” November 30, 2022, https://openai.com/index/chatgpt/ (accessed October 27, 2026).
  10. 11Anthropic, “Claude Cowork and chat are now one Claude,” Claude blog, September 16, 2026, https://claude.com/blog/cowork-is-now-claude (accessed October 27, 2026).

Chapter 9 · page 5 of 5

Turn pages with the ← and → keys.

Cite this page

Using this book

© 2026 Steve Sparks. All rights reserved. Teachers and students may assign, read, quote and excerpt chapters of this book for classes and study, with credit to Steve Sparks and a link to aifromthepartsup.com. Anyone may quote short passages and cite any page, with a link back. To repost, reproduce or sell the book or larger parts of it, ask through GitHub.

Quoted material and figures from other sources remain their owners'.