A school uses an AI system to prioritise admission applications. If it is trained only on biased selection data from previous years, which statement is correct?
Answer and explanation
Correct answer: The AI system may reproduce past bias in its decisions.
Historical selection data may reflect unequal opportunities or earlier unfair decisions. If the AI learns only from those patterns, it may reproduce or even strengthen the same bias when ranking new applicants. Training data alone does not guarantee fairness, so data review, fairness checks, and human oversight remain necessary.
Frequently asked questions
What is the correct answer to this question?
The AI system may reproduce past bias in its decisions.
Why is this the correct answer?
Historical selection data may reflect unequal opportunities or earlier unfair decisions. If the AI learns only from those patterns, it may reproduce or even strengthen the same bias when ranking new applicants. Training data alone does not guarantee fairness, so data review, fairness checks, and human oversight remain necessary.
Which subject and chapter does this question cover?
This is a Class 9 Artificial Intelligence question. Chapter: Reflection, Project Cycle, and Ethics. Topic: AI Ethics.