Why AI Can Make Things Up

Generative AI can produce plausible but unsupported details because it predicts language rather than checking every statement against reality.

LESSON COMPASS

What will you use this page for?

Core idea

Generative AI can produce plausible but unsupported details because it predicts language rather than checking every statement against reality. The lesson connects four ideas—probabilistic generation, missing or weak grounding, fabricated citations, and verification and uncertainty—to one practical situation. Rather than treating these ideas as isolated…

Evidence to produce

Complete the page task with your own input, test conditions and reasoning.

Control trap

Using probabilistic generation as a label without showing how it changed the decision. Choosing one example for missing or weak grounding and treating it as a universal rule. Recording only the final answer and losing the evidence created through fabricated citations. Ignoring the limits or recovery steps connected…

Next connection

For “Why AI Can Make Things Up”, return to the module page, complete the evidence artefact for this lesson and continue to the next item in sequence. For “Why AI Can Make Things Up”, a project should be presented as completed personal work only after real testing evidence and…

Module sources: NIST AI Risk Management Framework · NIST AI RMF Playbook

LevelBeginner–Intermediate
Age10–15
Duration55–85 min
PrerequisitePrevious item in this module
ContentStandard lesson · 2476 words
Last updated

Short answer

Generative AI can produce plausible but unsupported details because it predicts language rather than checking every statement against reality. The lesson connects four ideas—probabilistic generation, missing or weak grounding, fabricated citations, and verification and uncertainty—to one practical situation. Rather than treating these ideas as isolated definitions, the page shows how they work together. The learner first states the problem, then chooses evidence, performs a safe action and records what changed. For “Why AI Can Make Things Up”, this structure is useful beyond this topic because it makes reasoning transferable: the next unfamiliar tool or claim can be approached with the same disciplined sequence.

Why this matters

Generative AI can produce plausible but unsupported details because it predicts language rather than checking every statement against reality. For “Why AI Can Make Things Up”, this matters because a learner can follow a rule once without understanding when it applies, when it fails or how to recover from a mistake. Begin with the observable situation rather than a slogan. In the responsible ai context, the goal is not merely to remember vocabulary. The goal is to make a decision that another person can inspect, question and improve. For “Why AI Can Make Things Up”, an ai output is a proposal to inspect, not evidence by itself; responsibility remains with the people who define the task, supply data, test the result and decide how it is used. A clear record of assumptions makes later correction easier. For “Why AI Can Make Things Up”, therefore every activity on this page asks for an artefact: a table, diagram, test record, checklist, explanation or short reflection.

Learning objectives

  • Explain probabilistic generation and connect it to the main decision in the lesson.
  • Use missing or weak grounding to compare at least two possible actions.
  • Create visible evidence by applying fabricated citations.
  • Recognise the limits, risks or assumptions connected with verification and uncertainty.

Four working principles

probabilistic generation is one of the central decision points in Why AI Can Make Things Up. For “Why AI Can Make Things Up”, responsible AI work makes the purpose, evidence, uncertainty, affected people and human decision point visible before an output is trusted or published. For “Why AI Can Make Things Up”, applied to the worked situation, this principle helps the learner decide what to inspect, which evidence to record and where a boundary should be placed. It also prevents the topic from becoming a list of rules with no reason behind them. For “Why AI Can Make Things Up”, the learner should be able to explain the principle in their own words, identify it in a new example and show one piece of evidence that the principle was actually used. In the case used on this page—an AI response gives a convincing library name and documentation link that do not exist.—the principle changes the next action: instead of reacting immediately, the learner pauses, defines the relevant information and chooses a step that can be checked. A useful record includes the starting condition, the decision, the result and one limitation. That record becomes a learning artefact rather than a private impression.

The first useful lens is missing or weak grounding . For “Why AI Can Make Things Up”, responsible AI work makes the purpose, evidence, uncertainty, affected people and human decision point visible before an output is trusted or published. For “Why AI Can Make Things Up”, applied to the worked situation, this principle helps the learner decide what to inspect, which evidence to record and where a boundary should be placed. It also prevents the topic from becoming a list of rules with no reason behind them. For “Why AI Can Make Things Up”, the learner should be able to explain the principle in their own words, identify it in a new example and show one piece of evidence that the principle was actually used. In the case used on this page—an AI response gives a convincing library name and documentation link that do not exist.—the principle changes the next action: instead of reacting immediately, the learner pauses, defines the relevant information and chooses a step that can be checked. A useful record includes the starting condition, the decision, the result and one limitation. That record becomes a learning artefact rather than a private impression.

In this lesson, fabricated citations turns a broad idea into something observable. For “Why AI Can Make Things Up”, responsible AI work makes the purpose, evidence, uncertainty, affected people and human decision point visible before an output is trusted or published. For “Why AI Can Make Things Up”, applied to the worked situation, this principle helps the learner decide what to inspect, which evidence to record and where a boundary should be placed. It also prevents the topic from becoming a list of rules with no reason behind them. For “Why AI Can Make Things Up”, the learner should be able to explain the principle in their own words, identify it in a new example and show one piece of evidence that the principle was actually used. In the case used on this page—an AI response gives a convincing library name and documentation link that do not exist.—the principle changes the next action: instead of reacting immediately, the learner pauses, defines the relevant information and chooses a step that can be checked. A useful record includes the starting condition, the decision, the result and one limitation. That record becomes a learning artefact rather than a private impression.

A reliable approach begins by making verification and uncertainty explicit. For “Why AI Can Make Things Up”, responsible AI work makes the purpose, evidence, uncertainty, affected people and human decision point visible before an output is trusted or published. For “Why AI Can Make Things Up”, applied to the worked situation, this principle helps the learner decide what to inspect, which evidence to record and where a boundary should be placed. It also prevents the topic from becoming a list of rules with no reason behind them. For “Why AI Can Make Things Up”, the learner should be able to explain the principle in their own words, identify it in a new example and show one piece of evidence that the principle was actually used. In the case used on this page—an AI response gives a convincing library name and documentation link that do not exist.—the principle changes the next action: instead of reacting immediately, the learner pauses, defines the relevant information and chooses a step that can be checked. A useful record includes the starting condition, the decision, the result and one limitation. That record becomes a learning artefact rather than a private impression.

Worked case

Situation: An AI response gives a convincing library name and documentation link that do not exist.

The weak response would be to choose the fastest or most familiar action without checking assumptions. For “Why AI Can Make Things Up”, the stronger response begins by writing one sentence that defines the problem, one sentence that states what evidence would change the decision and one sentence that names a safety or privacy boundary. The learner then applies probabilistic generation before using missing or weak grounding. After the action, fabricated citations is used to create a record, while verification and uncertainty is used to review limitations.

A good case analysis does not pretend that every uncertainty disappears. It distinguishes a confirmed observation from an interpretation and a future question. For “Why AI Can Make Things Up”, that distinction is especially important for learners aged 10–15, because many digital, research and robotics situations look more certain on a screen than they really are.

A practical workflow

  1. Write the exact goal in one sentence and remove words such as “best” or “safe” unless they are defined.
  2. List what can be observed about probabilistic generation and what is still an assumption.
  3. Choose one comparison or check based on missing or weak grounding.
  4. Perform the smallest safe action that produces evidence for fabricated citations.
  5. Review the result through verification and uncertainty and record at least one limitation.
  6. Explain the final decision to another learner without hiding the evidence trail.

Practice lab

Practical task: audit a synthetic answer claim by claim, classify support levels and rewrite it with verified evidence and uncertainty labels.

For Why AI Can Make Things Up, use a four-column page labelled starting condition, decision, evidence and next revision. The first column captures the situation before any change. The second states what you chose and why. The third contains an observable artefact rather than a claim such as “it worked”. The final column records what you would change if the same task were repeated.

Complete the activity once, then exchange the record with a classmate or trusted adult. For “Why AI Can Make Things Up”, ask them to identify which conclusion is strongly supported, which conclusion is only plausible and which detail is missing. Revise the record without adding private information or pretending that an untested step was completed.

Evidence and evaluation

Evidence and evaluation table
Evidence itemWhat it should showQuality question
DefinitionThe goal and the meaning of probabilistic generationCould another learner identify the same boundary?
ComparisonAt least two options considered through missing or weak groundingWere the options compared under fair conditions?
Test recordAn observable result connected with fabricated citationsAre units, dates or conditions visible where relevant?
ReflectionA limitation or next step identified through verification and uncertaintyDoes the reflection change a future action?

For “Why AI Can Make Things Up”, evidence should be sufficient for the learning purpose but should not expose passwords, personal messages, precise locations, private photographs or information about another person. When the topic involves measurements, keep raw values as well as the final chart or average. When it involves research, keep the source path as well as the conclusion.

Common mistakes

  • Using probabilistic generation as a label without showing how it changed the decision.
  • Choosing one example for missing or weak grounding and treating it as a universal rule.
  • Recording only the final answer and losing the evidence created through fabricated citations.
  • Ignoring the limits or recovery steps connected with verification and uncertainty.

For “Why AI Can Make Things Up”, a useful correction is to return to the original goal, reduce the task and run one check that can disprove the current assumption.

Safety, privacy and limits

For “Why AI Can Make Things Up”, responsible AI work makes the purpose, evidence, uncertainty, affected people and human decision point visible before an output is trusted or published. For “Why AI Can Make Things Up”, use fictional or privacy-safe examples whenever real accounts, messages, images, locations or personal learning records could identify someone. Do not test security ideas on systems you do not own or have explicit permission to use. For “Why AI Can Make Things Up”, do not present a proposed project as Doruk’s completed personal work until real evidence and publication approval exist.

For mathematics and measurement tasks, use low-risk educational equipment and state units clearly. For research tasks, respect copyright and attribution. For “Why AI Can Make Things Up”, for study-system tasks, avoid turning a dashboard into surveillance: the purpose is reflection, not pressure or comparison with other children.

Lesson summary

Why AI Can Make Things Up can be summarised as a sequence: define the situation, apply probabilistic generation, compare through missing or weak grounding, create evidence with fabricated citations, and review the result using verification and uncertainty. For “Why AI Can Make Things Up”, the sequence is more important than a memorised slogan because it can be used again in an unfamiliar case.

The final learning goal is independence with boundaries. For “Why AI Can Make Things Up”, a learner should know what can be checked alone, what requires permission or adult support, and what must remain private. The work is complete only when the reasoning and evidence are clear enough to revisit later.

Review questions

  1. What role does “probabilistic generation” play in Why AI Can Make Things Up?
  2. What role does “missing or weak grounding” play in Why AI Can Make Things Up?
  3. What role does “fabricated citations” play in Why AI Can Make Things Up?
  4. What role does “verification and uncertainty” play in Why AI Can Make Things Up?
  5. In Why AI Can Make Things Up, why is an evidence trail stronger than a confident conclusion?
  6. In Why AI Can Make Things Up, what should happen when a result is uncertain?

Answers with explanations

  1. What role does “probabilistic generation” play in Why AI Can Make Things Up?

    In Why AI Can Make Things Up, “probabilistic generation” gives the learner a specific lens for deciding what to inspect, compare or record. In the worked case it should change an observable action, not remain a vocabulary label.

  2. What role does “missing or weak grounding” play in Why AI Can Make Things Up?

    In Why AI Can Make Things Up, “missing or weak grounding” gives the learner a specific lens for deciding what to inspect, compare or record. In the worked case it should change an observable action, not remain a vocabulary label.

  3. What role does “fabricated citations” play in Why AI Can Make Things Up?

    In Why AI Can Make Things Up, “fabricated citations” gives the learner a specific lens for deciding what to inspect, compare or record. In the worked case it should change an observable action, not remain a vocabulary label.

  4. What role does “verification and uncertainty” play in Why AI Can Make Things Up?

    In Why AI Can Make Things Up, “verification and uncertainty” gives the learner a specific lens for deciding what to inspect, compare or record. In the worked case it should change an observable action, not remain a vocabulary label.

  5. In Why AI Can Make Things Up, why is an evidence trail stronger than a confident conclusion?

    For “Why AI Can Make Things Up”, because another person can inspect the observations, conditions and reasoning, identify a limitation and repeat or improve the work.

  6. In Why AI Can Make Things Up, what should happen when a result is uncertain?

    For “Why AI Can Make Things Up”, the uncertainty should be labelled, the missing evidence should be named and the next safe check should be planned instead of presenting the result as proven.

Sources and verification note

The official or primary references listed below provide the technical and educational foundation for “Why AI Can Make Things Up”. These links support the concepts; they do not prove that a proposed project has been physically completed. Dates, software behaviour and policy details should be rechecked before future publication updates.

  • NIST — Generative AI Profile for the AI Risk Management Framework
  • NIST — Artificial Intelligence Risk Management Framework 1.0
  • UNESCO — AI Competency Framework for Students

Next step

For “Why AI Can Make Things Up”, return to the module page, complete the evidence artefact for this lesson and continue to the next item in sequence. For “Why AI Can Make Things Up”, a project should be presented as completed personal work only after real testing evidence and publication approval exist.

QUESTION POOL

Reinforce this lesson with 10 questions

This lesson has a pool of 24 questions. Each attempt selects 10 questions and reshuffles the choices; results remain only in this browser.