Chapter 15Questions people ask
Can a teacher tell if a student used it?
Not reliably, with a detector. A detector doesn’t find a hidden mark in the text. It makes a statistical guess. Most detectors, one research team notes, lean on how predictable the words are, a measure called perplexity: how surprised a model is by each next word.1 Chapter 3 showed Shannon measuring the predictability of English in 1951.2 Plain, predictable human writing can look machine-made by that measure.
OpenAI released its own detector in January 2023 and called it “not fully reliable.” On its test set it caught 26 percent of AI-written text and wrongly flagged human writing 9 percent of the time. In July 2023 OpenAI withdrew it “due to its low rate of accuracy.”3 A 2023 study tested seven detectors on 91 essays by non-native English speakers for the TOEFL exam. The detectors flagged more than half as AI-written, an average false-positive rate of 61.3 percent, while scoring U.S. eighth graders’ essays almost perfectly.1 An international team that tested fourteen tools found them “neither accurate nor reliable.”4
“A detector score proves cheating.” Even OpenAI said its tool “should not be used as a primary decision-making tool.”3 The researchers behind both studies advise against using detectors to judge students.14 Those studies tested 2023 tools; newer ones may do better or worse, so ask for independent test results, including on people writing in a second language.
Students do use these tools. In a Pew Research Center survey in fall 2025, 54 percent of U.S. teens said they had used chatbots to get help with schoolwork. One in ten said they did all or most of their schoolwork with a chatbot’s help.5 Chapter 12’s habit applies to teachers too: look for evidence you can check, such as drafts and a conversation with the student. Chapter 13 covers saying plainly how AI helped.
Could a voice on the phone be fake?
Yes. A familiar voice is no longer proof of who is calling. “A scammer could use AI to clone the voice of your loved one,” the Federal Trade Commission warned in March 2023. All it takes, the FTC said, is a short clip of the person’s voice, perhaps from something posted online, and a voice-cloning program.6 The FBI warned in December 2024 that criminals generate short audio clips in a loved one’s voice to pose as a relative in a crisis and ask for money right away.7
The defense is old-fashioned. “Don’t trust the voice,” the FTC says. Call the person back, using “a phone number you know is theirs.” A request to wire money, send cryptocurrency or buy gift cards could be a sign of a scam.6 The FBI suggests a secret word or phrase that your family agrees on ahead of time.7 At work, the same trick aims at money. The Treasury’s financial-crimes unit reported in November 2024 that financial institutions were filing more reports of suspected deepfakes in fraud, often fake identity documents.8 The rule is the same as at home: confirm through a channel you already trust, such as the number in the company directory.
The crimes aren’t new, and old laws are being applied to them. In February 2024 the Federal Communications Commission ruled that a 1991 law limiting robocalls with “artificial or prerecorded” voices covers AI-generated voices too.9 In September 2024 it imposed a $6 million penalty, under a law against faking caller ID, on Steve Kramer for robocalls before New Hampshire’s 2024 primary that carried a deepfake of President Biden’s voice. One commissioner dissented.10 Both are agency actions, not court rulings.
“You can always spot a fake by its glitches.” Don’t count on it. The Treasury alert, drawing on the Department of Homeland Security, notes that deepfakes “do not need to be particularly advanced or believable to be effective.”8 Chapter 12’s rule applies. Check the claim through a source you trust, not through the message itself.
Notes (10)
- 1Weixin Liang, Mert Yuksekgonul, Yining Mao, Eric Wu, and James Zou, “GPT Detectors Are Biased against Non-Native English Writers,” Patterns 4, no. 7 (July 14, 2023): 100779, https://doi.org/10.1016/j.patter.2023.100779.
- 2C. E. Shannon, “Prediction and Entropy of Printed English,” Bell System Technical Journal 30, no. 1 (January 1951): 50–64, https://doi.org/10.1002/j.1538-7305.1951.tb01366.x.
- 3Jan Hendrik Kirchner, Lama Ahmad, Scott Aaronson, and Jan Leike, “New AI classifier for indicating AI-written text,” OpenAI, January 31, 2023, https://openai.com/index/new-ai-classifier-for-indicating-ai-written-text/ (accessed October 27, 2026).
- 4Debora Weber-Wulff, Alla Anohina-Naumeca, Sonja Bjelobaba, Tomáš Foltýnek, Jean Guerrero-Dib, Olumide Popoola, Petr Šigut, and Lorna Waddington, “Testing of detection tools for AI-generated text,” International Journal for Educational Integrity 19 (December 25, 2023): article 26, https://doi.org/10.1007/s40979-023-00146-z.
- 5Colleen McClain, Monica Anderson, Olivia Sidoti, and William Bishop, “How Teens Use and View AI,” Pew Research Center, February 24, 2026, https://www.pewresearch.org/internet/2026/02/24/how-teens-use-and-view-ai/ (accessed October 27, 2026).
- 6Alvaro Puig, “Scammers use AI to enhance their family emergency schemes,” FTC Consumer Alerts, March 20, 2023, https://consumer.ftc.gov/consumer-alerts/2023/03/scammers-use-ai-enhance-their-family-emergency-schemes (accessed October 27, 2026).
- 7Federal Bureau of Investigation, “Criminals Use Generative Artificial Intelligence to Facilitate Financial Fraud,” Internet Crime Complaint Center, Public Service Announcement I-120324-PSA, December 3, 2024, https://www.ic3.gov/PSA/2024/PSA241203 (accessed October 27, 2026).
- 8Financial Crimes Enforcement Network, FinCEN Alert on Fraud Schemes Involving Deepfake Media Targeting Financial Institutions (FIN-2024-Alert004) (U.S. Department of the Treasury, November 13, 2024), https://www.fincen.gov/sites/default/files/shared/FinCEN-Alert-DeepFakes-Alert508FINAL.pdf (accessed October 27, 2026). Cited at page 1.
- 9Federal Communications Commission, Implications of Artificial Intelligence Technologies on Protecting Consumers from Unwanted Robocalls and Robotexts: Declaratory Ruling (FCC 24-17) (Federal Communications Commission, February 8, 2024), https://docs.fcc.gov/public/attachments/FCC-24-17A1.pdf (accessed October 27, 2026). Cited at ¶ 2.
- 10Federal Communications Commission, In the Matter of Steve Kramer: Forfeiture Order (FCC 24-104) (Federal Communications Commission, September 30, 2024), https://docs.fcc.gov/public/attachments/FCC-24-104A1_Rcd.pdf (accessed October 27, 2026). Cited at ¶ 1.
Chapter 15 · page 6 of 7
Turn pages with the ← and → keys.