Appraising AI tools
Look for information provided by the developers about the tool you want to use.
- What do they say about why the tool was developed?
- How do they envisage it will be used, or how it will help people?
- Does this match what you want to do?
Look for information about how others have used the tool.
- What comments do they have about what it is good for?
- What are its strengths and weaknesses?
- Explore the tool yourself. Enter different prompts and see what happens. Test it against something you know really well or are starting to learn.
A useful expression in computer science is “garbage in, garbage out”.
Tools are only as good as the data used. If programs are trained on incomplete, inaccurate, or biased data, then the output will also be incomplete, inaccurate, or biased. The output is also influenced by the quality, accuracy, and thoroughness of the training that the program receives.
Look for information provided by the developers about the tool you want to use.
- Does it include a description of the data set and the training methods used?
- Are there any obvious gaps or biases?
- What do other tech or subject experts say about the tool and its outputs?
- Would this impact the reliability?
It can take a long time to train AI programs and a long time for new datasets to be incorporated into its training.
- Does the program indicate when it was last updated and how current its dataset is?
- Does this impact the relevance of the tool for your requirements?
As with any digital tool, it is good practice to check any terms of use.
Look for the following:
Restrictions on use
- Are there limitations on who can use the tool? E.g. persons under 18 years of age.
- Are there limitations on how the outputs can be used? E.g. can it be used for educational purposes, but not commercial?
Intellectual property
- Who owns the outputs produced?
- What can you do with the outputs? Can you share it, re-use it, edit it?
- Is there a requirement to provide an acknowledgement when using the output?
Privacy and security
- Do you need to provide any personal information to use the tool?
- Where is this information stored? Who has access to it? What can they do with it?
As well as the relevance, trustworthiness and use-limits of AI tools, you may be interested to think about some of the social and ethical aspects of AI tools.
For example:
- Use of copyrighted material when training AI programs.
- Equity of access (e.g. where users need to pay to use the tool, or where a minimum level of internet access or computing power is needed to use the tool).
- Environmental impact of developing and running large AI programs.
Additional links
- FUTUREPEDIA - AI tools directoryFuturepedia is a website that acts as a directory for various artificial intelligence tools available on the internet. It provides detailed profiles of each tool, highlighting their features, benefits, and applications. Updated frequently
- Deakin University: Exploring Generative AI toolsThis page provides a great overview of some of the most popular AI tools and what they can be used for.