The ROBOT Test is another strategy for evaluating AI-generated content, generative AI tools, and other sources and texts about AI.
Investigate these questions when assessing content generated by an AI model:
Reliability
- How reliable is the information available about the AI technology?
- If it's not produced by the party responsible for the AI, what are the author's credentials?
- If it is produced by the party responsible for the AI, how much information are they making available?
- Is information only partially available due to trade secrets?
Objective
- What is the goal or objective of the use of the AI technology?
- What is the goal of sharing information about it?
- To inform?
- To convince?
- To find financial support?
Bias
- What could create bias in the AI technology?
- Are bias or other ethical issues acknowledged?
- By the source of information?
- By the party responsible for the AI?
- By its users
Owner
- Who is the owner or developer of the AI technology?
- Who is responsible for it?
- Is it a private company?
- The government?
- A think tank or research group?
- Who has access to it?
- Who can use it?
Type
- Which subtype of AI is it?
- Is the technology theoretical or applied?
- What kind of information system does it rely on?
- Does it rely on human intervention?
The ROBOT Test evalution tool by S. Hervieux and A. Wheatley (for The LibAIry) is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0).
