Who should decide? (Chapter 16, page 2 of 2) · AI, from the Parts Up

Before you hand a task to AI, ask who it affects, what a mistake would cost them, and whether you could explain the decision yourself.

Who is affected? You, a customer, a student, an employee?
What would a mistake cost them? An awkward email, or a job, a grade, a diagnosis?
Could you explain the decision without pointing at the tool?
Would you tell them AI was involved? If not, ask yourself why not.

Illustration

Interactive Pick a task, then pick how AI should be involved.Try it on the web: aifromthepartsup.com/knowing-when-not-to/2/

Some jobs are fine to hand to AI with a check, some need a person to decide, and some should stay out of AI tools.

1. Pick a task

2. How should AI be involved?

Now pick an answer.

Draft a practice schedule for a youth soccer team Let AI draft it; you review. Low stakes and easy to check: read it over and fix what doesn’t fit.
Summarize your notes from a budget meeting Let AI draft it; you review. A good use, in an account your organization approves (Chapter 12). Check the numbers before you send it.
Rank job applicants for an interview shortlist AI may help prepare; a person decides. A decision about people’s livelihoods. Laws such as the EU AI Act treat AI used in hiring as high-risk, and people can over-trust a machine’s ranking. A person decides and can explain why.¹²
Give a student’s essay its final grade AI may help prepare; a person decides. AI might help with comments, but the grade is a judgment about a person. The EU AI Act also lists AI that evaluates learning outcomes as high-risk.¹
Tell an employee their job is ending AI may help prepare; a person decides. A person decides, and a person says it. AI might help you plan the conversation; it shouldn’t have it for you.
Paste a patient’s chart into a personal chatbot account Keep it out of AI tools. Patient information needs a regulated workspace and a signed agreement (Chapter 12). A personal account isn’t one.

Examples and rules of thumb written for this page. Your organization’s policy decides.

Check in

Try answering in your own words, then open each one to compare.

Which decisions should stay with a person?

Decisions about people’s jobs, grades, health or rights, where someone has to answer for the outcome and explain it.

What is automation bias?

The habit of trusting an automated aid too much, and missing its mistakes.

One chapter left: short answers to the questions people ask most. On to Chapter 17: Questions people ask →