25 of 81
ContentsPart III · Chapter 6

Chapter 6The prompt

One request, layer by layer

Figure 6.2 follows a single request through the stack. It is an example written for this page: the library, its rules, its hours and the conversation are all made up. A patron types six words into a library’s help-desk chat: “Is the library open on Sunday?”

System promptToday is Friday, May 22. Be helpful and honest.App instructionsYou are the Elm Street Library help desk. Answerquestions about hours, holds and library cards. Ifyou are unsure, give the front-desk phone number.Tool descriptioncheck_hours(date): the library’s hours on a date.Memory anddocumentsHoliday notice: the library is closed Sunday, May 24.Memory: this patron prefers short answers.Conversationso farPatron: Can I renew a book online?Assistant: Yes, under My Account.Tool results(none yet in this conversation)Your messageIs the library open on Sunday?
Figure 6.2. One request, as the model reads it. An example written for this page; the library and everything in it are made up. The six words at the bottom are all the patron typed. The two layers with a dark left edge hold what a good answer needs: the date and the holiday notice.

Read the stack the way the model does, top to bottom. The system prompt supplies the date, Friday, May 22, so “Sunday” means May 24. The app instructions say what this assistant is for and what to do when it is unsure: give the front-desk number. The tool description tells the model it may ask for the hours on any date. The memory and documents layer holds a holiday notice, closed Sunday, May 24, and a saved note that this patron likes short answers. The conversation so far shows an earlier question about renewing a book. There are no tool results yet.

Now look at what a good answer needs. It needs the date, which the patron never typed. It needs the holiday notice, which the patron may not know exists. And it should be short, because the saved note says so. Of the seven layers, the patron wrote one. If the model asks for the hours as well, the harness runs the tool and adds the result below the patron’s message, and the model reads the whole stack again.1 Change any layer above the message, say by dropping the holiday notice, and the same six words could get a different reply.

Who outranks whom

The layers don’t all carry the same weight. As of its October 2025 version, OpenAI’s Model Spec, the published rules its models are trained to follow, ranks them. When instructions conflict, OpenAI’s own rules come first, then the app builder’s, then yours.2 Text that comes back from tools, along with quoted text and attached files, has no authority by default: any instructions inside it are to be treated “as information rather than instructions to follow.”2 Anthropic publishes a document it calls a constitution, describing the values it intends Claude to have.3 Spot it today: look for a “model spec,” “constitution” or “system prompts” page from the company behind the model you use.

An illustration, not a real case. An accountant asks her firm’s AI assistant to help word a note to a client. The draft it writes ends with a line about the firm’s review policy, which she never mentioned. Nothing went wrong. The firm’s instructions, a layer above her message, asked for that line, and in the ranking above, the builder’s instructions come before hers. If she wants it gone, the person to ask is whoever set the tool up.

The ranking is a design, not a guarantee. A line of text inside a web page or a file can still be written to look like an order. Chapter 8 returns to what happens when a tool brings back text like that. And when people ask whether an AI tool is biased, the layers add a fair question to the list: what was it told before you arrived? Chapter 15 gathers the facts on bias.

Notes (3)
  1. 1Anthropic, “How tool use works,” Claude Platform Docs, https://platform.claude.com/docs/en/agents-and-tools/tool-use/how-tool-use-works (accessed October 26, 2026).
  2. 2OpenAI, “OpenAI Model Spec (2025-10-27 version),” October 27, 2025, https://model-spec.openai.com/2025-10-27 (accessed October 27, 2026).
  3. 3Anthropic, “Claude's Constitution,” n.d., https://www.anthropic.com/constitution (accessed October 27, 2026).

Chapter 6 · page 3 of 4

Turn pages with the ← and → keys.

Cite this page

Using this book

© 2026 Steve Sparks. All rights reserved. Teachers and students may assign, read, quote and excerpt chapters of this book for classes and study, with credit to Steve Sparks and a link to aifromthepartsup.com. Anyone may quote short passages and cite any page, with a link back. To repost, reproduce or sell the book or larger parts of it, ask through GitHub.

Quoted material and figures from other sources remain their owners'.